CN116361403A

CN116361403A - Data link processing method, device, computer equipment and storage medium

Info

Publication number: CN116361403A
Application number: CN202310362322.XA
Authority: CN
Inventors: 刘亚
Original assignee: Ping An Technology Shenzhen Co Ltd
Current assignee: Ping An Technology Shenzhen Co Ltd
Priority date: 2023-03-29
Filing date: 2023-03-29
Publication date: 2023-06-30

Abstract

The embodiment of the application discloses a data link processing method, a data link processing device, computer equipment and a storage medium; the embodiment of the application comprises the following steps: acquiring a data processing table, and analyzing the data processing table to obtain a data processing link corresponding to the data processing table; carrying out level discrimination processing on the data processing links corresponding to the data processing table to obtain a level discrimination result; based on the hierarchy discrimination result, carrying out identification processing on the data processing link to obtain link distribution information and link node specific gravity information of the data processing link; carrying out link analysis processing on the data processing link according to the link distribution information and the link node specific gravity information of the data processing link to obtain an analysis result; and adjusting the data processing table based on the analysis result to obtain an adjusted data processing table so as to optimize the data processing link, and the data processing link can be identified to be optimized, so that the data quality is improved and the data processing time efficiency is reduced.

Description

Data link processing method, device, computer equipment and storage medium

Technical Field

The present invention relates to the field of communications technologies, and in particular, to a data link processing method, a data link processing device, a computer device, and a storage medium.

Background

The data processing link exists in a data processing system of the data warehouse, and the data is subjected to data collection, standardization, model construction and application data construction to be finally provided for users, so that a bottom-up data processing link is naturally formed between the data. This data processing link records the entire life cycle of the data from collection to generation of value, and is an essential information in data management. The perfect data processing link can clearly record the source and destination of data and the processing logic and change in the data transmission process. The inventors of the present application have found through practice of the prior art that complex, lengthy, cumbersome data processing links are often developed in the prior art. And complex, lengthy, cumbersome data processing links can lead to reduced data quality and increased data processing time.

Disclosure of Invention

The embodiment of the application provides a data link processing method, a device, computer equipment and a storage medium, which can identify complex, lengthy and complicated data processing links, optimize the complex, lengthy and complicated data processing links, improve the data quality and reduce the data processing time.

The embodiment of the application provides a data link processing method, which comprises the following steps:

acquiring a data processing table, and analyzing the data processing table to obtain a data processing link corresponding to the data processing table;

performing level discrimination processing on the data processing links corresponding to the data processing table to obtain a level discrimination result corresponding to the data processing links;

based on the hierarchy discrimination result, carrying out identification processing on the data processing link to obtain link distribution information and link node specific gravity information of the data processing link;

according to the link distribution information and the link node specific gravity information of the data processing link, carrying out link analysis processing on the data processing link to obtain an analysis result of the data processing link;

and carrying out adjustment processing on the data processing table based on the analysis result to obtain an adjusted data processing table so as to realize the optimization of the data processing link.

Correspondingly, the embodiment of the application also provides a data link processing device, which comprises:

the analysis unit is used for acquiring a data processing table, analyzing the data processing table and obtaining a data processing link corresponding to the data processing table;

The hierarchy discrimination unit is used for carrying out hierarchy discrimination processing on the data processing links corresponding to the data processing table to obtain hierarchy discrimination results corresponding to the data processing links;

the identification unit is used for carrying out identification processing on the data processing link based on the hierarchy discrimination result to obtain link distribution information and link node specific gravity information of the data processing link;

the link analysis unit is used for carrying out link analysis processing on the data processing link according to the link distribution information and the link node specific gravity information of the data processing link to obtain an analysis result of the data processing link;

and the adjusting unit is used for adjusting the data processing table based on the analysis result to obtain an adjusted data processing table so as to optimize the data processing link.

Correspondingly, the embodiment of the application also provides computer equipment, which comprises a memory and a processor; the memory stores a computer program, and the processor is configured to run the computer program in the memory to execute any one of the data link processing methods provided in the embodiments of the present application.

Accordingly, the embodiments of the present application further provide a storage medium storing a computer program, where the computer program when executed by a processor implements the data link processing method provided in any one of the embodiments of the present application.

The embodiment of the application comprises the following steps: acquiring a data processing table, and analyzing the data processing table to obtain a data processing link corresponding to the data processing table; performing hierarchical discrimination processing on the data processing links corresponding to the data processing table to obtain a hierarchical discrimination result corresponding to the data processing links; based on the hierarchy discrimination result, carrying out identification processing on the data processing link to obtain link distribution information and link node specific gravity information of the data processing link; according to the link distribution information and the link node specific gravity information of the data processing link, carrying out link analysis processing on the data processing link to obtain an analysis result of the data processing link; and (3) adjusting the data processing table based on the analysis result to obtain an adjusted data processing table so as to optimize the data processing link, identify the complex, lengthy and complicated data processing link, optimize the complex, lengthy and complicated data processing link, improve the data quality and reduce the data processing time.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly introduced below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a flow chart of a data link processing method provided in an embodiment of the present application;

fig. 2 is a schematic structural diagram of a data link processing apparatus according to an embodiment of the present application;

fig. 3 is a schematic structural diagram of a computer device according to an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which embodiments of the present application are shown, however, in which embodiments are shown, by way of illustration, only, and not in any way all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.

The embodiments of the present application propose a data link processing method which may be performed by a data link processing apparatus which may be integrated in a computer device having at least one data link processing hardware. Wherein the computer device may comprise at least one of a computer device, a server, etc. That is, the data link processing method provided in the embodiment of the present application may be executed by a computer device, or may be executed by a server, or may be executed by a terminal and a server that are capable of communicating with each other together.

The terminal may be a smart phone, a tablet computer, a notebook computer, a personal computer (Personal Computer, PC), a smart home, a wearable electronic device, a VR/AR device, a vehicle-mounted computer, or the like. The server may be an interworking server or a background server among a plurality of heterogeneous systems, may be an independent physical server, may be a server cluster or a distributed system formed by a plurality of physical servers, and may be a cloud server for providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, basic cloud computing services such as big data and an artificial intelligence platform, and the like.

In an embodiment, the data link processing apparatus may be integrated on a server to implement the data link processing method provided in the embodiments of the present application. Specifically, the server may acquire a data processing table, and perform analysis processing on the data processing table to obtain a data processing link corresponding to the data processing table; performing hierarchical discrimination processing on the data processing links corresponding to the data processing table to obtain a hierarchical discrimination result corresponding to the data processing links; based on the hierarchy discrimination result, carrying out identification processing on the data processing link to obtain link distribution information and link node specific gravity information of the data processing link; according to the link distribution information and the link node specific gravity information of the data processing link, carrying out link analysis processing on the data processing link to obtain an analysis result of the data processing link; and carrying out adjustment processing on the data processing table based on the analysis result to obtain an adjusted data processing table so as to realize the optimization of the data processing link.

The following detailed description is given, respectively, of the embodiments, and the description sequence of the following embodiments is not to be taken as a limitation of the preferred sequence of the embodiments.

Embodiments of the present application will be described in terms of a data link processing apparatus that may be integrated into a computer device.

As shown in fig. 1, a data link processing method is provided, and a specific flow includes:

101. and acquiring the data processing table, and analyzing the data processing table to obtain a data processing link corresponding to the data processing table.

Wherein the data processing table may include a structure table stored in a preset storage database. For example, the data processing table may be a structural table generated based on an Oracle database. As another example, the data processing table may be a structural table generated based on a mySQL database, or the like.

In one embodiment, there may be several data processing tables stored in the preset storage database. For example, hundreds of data processing tables may exist in a preset storage database, and so on. Thus, the data processing table can be acquired by presetting the storage database. For example, when a certain data processing table is required to be processed currently, the data processing table to be processed can be obtained from a preset storage database.

Wherein the data processing links may be used to characterize data processing field processing paths in the data processing table. For example, when the field "data" in the data processing table a is processed by the data processing table B, the data processing table C, and the data processing table D, the data processing link corresponding to the field "data" in the data processing table a is the data processing table a, the data processing table B, the data processing table C, and the data processing table D.

In an embodiment, the data processing table may be parsed to obtain the data processing links corresponding to the data processing table. Specifically, the step of "analyzing the data processing table to obtain a data processing link corresponding to the data processing table" may include:

traversing the data processing table to obtain a data processing field corresponding to the data processing table;

searching a preset storage database for an associated data processing table associated with the data processing field;

and carrying out serial processing on the data processing table and the associated data processing table to obtain a data processing link.

In an embodiment, the data processing table may be traversed to obtain the data processing field corresponding to the data processing table. For example, by performing a traversal process on the data table, at least one data processing field of the data processing table may be obtained. For example, the data processing fields of the data processing table including "data", "date" and "name" and the like can be obtained by traversing.

In one embodiment, the preset stored database may be searched for an associated data handling table associated with the data handling field. For example, the associated data processing table associated with the data processing field may be searched out by a related search algorithm. For example, the association data processing table associated with the data processing field may be searched in a preset storage database by breadth-first search method, depth-first search method, hill-climbing method, best-first algorithm, or backtracking method.

In an embodiment, after searching the associated data processing table associated with the data processing field in the preset database, the data processing table and the associated data processing table may be processed in series to obtain the data processing link. For example, the data processing field corresponding to the data processing table is "data" by performing traversal processing on the data processing table. Then, the association data processing table associated with the data processing field is searched in the preset storage database. For example, "data" obtained by searching is processed in the data processing table B. Then, the data are processed in the data processing table C. Then, the data processing table B and the data processing table C are both associated data processing tables. The data processing table and the associated data processing table may then be concatenated based on the time the field "data" was processed. For example, when the field "data" is first processed by the data processing table a and then processed by the data processing table B and the data processing table C, the data processing link corresponding to the field "data" is the data processing table a, the data processing table B and the data processing table C.

For example, by analyzing mySQL of data processing, key fields in the mySQL are identified, a processing table corresponding to the key fields is obtained, and the processing table is marked as an upstream table of a data processing table currently processed. The data processing table may then be concatenated with its upstream table, and the upstream table corresponding to its upstream table, and so on, to form a complete data processing link (this data processing link also corresponds to a data processing link, which may be used to describe the processing trace of the field).

In an embodiment, the fields of each data processing table may be parsed based on a preset link parsing tool to obtain a complete data processing link for each data processing table. The data processing links can then be presented clearly through the directed acyclic graph, revealing as complete data processing links.

102. And carrying out hierarchical discrimination processing on the data processing links corresponding to the data processing table to obtain a hierarchical discrimination result corresponding to the data processing links.

In an embodiment, the technical problem to be solved by the embodiments of the present application is that complex, lengthy and tedious data processing links are often developed in the prior art, and the complex, lengthy and cumbersome data processing links may cause degradation of data quality and increase of data processing time. If the data processing links of the data processing table are unreasonable, the data processing links are complicated and tedious. Therefore, the hierarchy discrimination processing can be performed on the data processing links corresponding to the data processing table, and the hierarchy discrimination result corresponding to the data processing links is obtained. The level discrimination processing is performed on the data processing link, which may refer to determining whether the data processing link is reasonable.

In one embodiment, the physical hierarchy information and the logical hierarchy information of the data processing links may be used to determine whether the hierarchy of the data processing links is reasonable. Specifically, the step of performing the hierarchical discrimination processing on the data processing link corresponding to the data processing table to obtain the hierarchical discrimination result corresponding to the data processing link may include:

performing level identification processing on the data processing link to obtain physical level information and logic level information corresponding to the data processing link;

matching the logic level information of the data processing link with preset logic level discrimination conditions;

and when the logic level information accords with the preset logic level discrimination conditions, discriminating the physical level information of the data processing link to obtain a level discrimination result corresponding to the data processing link.

In an embodiment, the level identification process may be performed on the data processing link of the data processing table, so as to obtain physical level information and logical level information corresponding to the data processing link.

Wherein the physical layer information may be used to describe how many data processing tables the data processing link is made up of, i.e. the physical layer information may be used to describe the number of data processing tables in the data processing link. For example, if the data processing link includes data processing table a, data processing table B, data processing table C, and data processing table D, the physical layer level information of the data processing link is 4. For another example, if the data processing link includes data processing table a, data processing table B, and data processing table C, the physical layer level information of the data processing link is 3.

The logic level information may be used to describe how many levels the data processing table in the data processing link may be divided into based on a preset logic level. The preset logic level may be a logic level preset for the data processing link manually.

For example, the data processing link includes a data processing table a, a data processing table B, a data processing table C, and a data processing table D. The preset logic level specifies that the data processing packet a and the data processing table B belong to the same logic level, and the data processing table B and the data processing table D belong to the same logic level, so that the logic level information of the data processing link is 2.

In one embodiment, the physical layer information may be obtained for calculating the number of data processing tables included in the data processing link. In addition, the data processing link can be identified according to a preset logic level, so that logic level information of the data processing link can be obtained.

In one embodiment, in determining whether the level of the data processing link is reasonable, it may be first determined whether the logic level information of the data processing link is reasonable. For example, for a data processing link, its physical level information should not exceed two levels, otherwise it is prone to link redundancy.

Therefore, the physical level information of the data processing link and the preset logic level discrimination conditions can be matched. And when the logic level information accords with the preset logic level discrimination conditions, discriminating the physical level information of the data processing link to obtain a level discrimination result corresponding to the data processing link.

For example, the predetermined level discrimination condition may be that for a data processing link, its physical level information should not exceed two levels. The physical level information of the data processing link may then be matched to a preset logical level discrimination criteria. When the physical level information of the data processing link is less than or equal to two levels, the logic level information accords with the preset logic level judgment condition. And when the physical level information of the data processing link is greater than two levels, the logic level information is not in accordance with the preset logic level judgment condition.

In an embodiment, when the logic level information meets a preset logic level discrimination condition, the discrimination processing may be performed on the physical level information of the data processing link, so as to obtain a level discrimination result corresponding to the data processing link. Specifically, the step of "when the logic level information meets the preset logic level discrimination condition, performing discrimination processing on the physical level information of the data processing link to obtain a level discrimination result corresponding to the data processing link" may include:

When the logic level information accords with the preset logic level judgment conditions, generating physical level judgment conditions according to the logic level information;

matching the physical level information of the data processing link with the physical level discrimination conditions;

and when the physical level information accords with the physical level discrimination conditions, generating a level discrimination result of the data processing link passing the level discrimination.

In one embodiment, when the logic level information meets a predetermined logic level criterion, a physical level criterion may be generated according to the logic level information. For example, in general, each data processing link has logic level information that does not exceed two levels in principle. Whereas for a data processing link across multiple logical levels, its physical level is in principle no more than twice that of the logical level. Therefore, the physical-level discrimination conditions can be generated from the logical-level information. For example, when the logical level information of the data processing link is 2, the physical level discrimination condition thereof is that the physical level of the data processing link does not exceed 4. Then, the physical level information of the data processing link and the physical level discrimination conditions can be matched; and when the physical level information accords with the physical level discrimination conditions, generating a level discrimination result of the data processing link passing the level discrimination. For example, when the physical level information of the data processing link is less than or equal to 4, then the physical level discrimination condition is met. If the physical layer information is greater than 4, the physical layer judgment condition is not met.

In an embodiment, the method provided in the embodiment of the present application may further include:

when the data processing link does not pass the hierarchy discrimination, the data processing table can be adjusted based on the hierarchy discrimination result to obtain an adjusted data processing table so as to realize the optimization of the data processing link.

For example, when the logic level information of the data processing link does not meet the preset logic level discrimination condition, the data processing table may be adjusted based on the level discrimination result, so as to obtain an adjusted data processing table, so as to optimize the data processing link.

For another example, when the physical hierarchy information of the data processing link does not meet the physical hierarchy discrimination condition, the data processing table may be adjusted based on the hierarchy discrimination result, so as to obtain an adjusted data processing table, so as to implement optimization of the data processing link.

103. And carrying out identification processing on the data processing link based on the hierarchical discrimination result to obtain link distribution information and link node specific gravity information of the data processing link.

In an embodiment, when the logic level information of the data processing link meets the preset logic level discrimination condition and the physical level information meets the physical level discrimination condition, the data processing link may be identified to obtain link distribution information and link node specific gravity information of the data processing link.

The link distribution information may be used to describe the distribution of the primary link and the bypass link in the data processing link. Wherein the primary link may refer to the primary processing of the data processing field in the data processing table. For example, the field "data" is first processed by the data processing table a, and then processed by the data processing table B, the data processing table C, and the data processing table D, and the main link corresponding to the field "data" is the data processing table a, the data processing table B, the data processing table C, and the data processing table D. In addition, the field "data" is processed by the data processing table E after being processed by the data processing table B. Then, the bypass path corresponding to the field "data" is the data processing table B and the data processing table E.

Where a link node may refer to a process of processing a data handling field.

In an embodiment, based on the hierarchical discrimination result, the data processing link may be identified by using an artificial intelligence algorithm to obtain link distribution information and link node specific gravity information of the data processing link.

Specifically, the step of "performing identification processing on the data processing link based on the level discrimination result to obtain link distribution information and link node specific gravity information of the data processing link" may include:

Based on the level discrimination result, extracting the characteristics of the data processing link to obtain the characteristic information of the data processing link;

feature mining is carried out on the feature information of the data processing link to obtain depth feature information of the data processing link;

and carrying out prediction processing on the depth characteristic information of the data processing link to obtain link distribution information and link node specific gravity information of the data processing link.

For example, training may be performed in advance, so that the identification process of the data processing link may be performed, and the link distribution information and the link node weight information of the data processing link may be obtained. Wherein the information recognition model is an artificial intelligence model. For example, the information identification model may be a convolutional neural network (Convolutional Neural Networks, CNN), a deconvolution neural network (De-Convolutional Networks, DN), or a deep neural network (Deep Neural Networks, DNN), among others.

Then, the information recognition model can be utilized to conduct feature extraction on the data processing link, so that feature information of the data processing link is obtained; feature mining is carried out on the feature information of the data processing link to obtain depth feature information of the data processing link; and carrying out prediction processing on the depth characteristic information of the data processing link to obtain link distribution information and link node specific gravity information of the data processing link.

For example, the information recognition model may be used to recognize the coverage of the data processing fields in the data processing table, the influence of the key indicators, etc., and then determine the primary link and the secondary link in the data processing link, and the influence specific gravity of each link node in the primary link.

104. And carrying out link analysis processing on the data processing link according to the link distribution information and the link node specific gravity information of the data processing link to obtain an analysis result of the data processing link.

Where link analysis of a data processing link may refer to identifying where redundancy or complications exist in the data processing link. For example, by analyzing key nodes of the main link, the data processing time consumption ratio, historical time consumption fluctuation, and the like of each node can be analyzed. In addition, key indexes such as the influence degree of key nodes on data aging, historical fluctuation rate and the like can be analyzed.

In one embodiment, the link influence coefficients and the node influence coefficients of the data processing link may be calculated, and then the analysis result of the data processing link may be obtained. Specifically, the step of performing link analysis processing on the data processing link according to the link distribution information and the link node specific gravity information of the data processing link to obtain an analysis result of the data processing link may include:

Calculating a link influence coefficient corresponding to the data processing link based on the link distribution information;

calculating a node gravity coefficient corresponding to the data processing link according to the link node gravity information;

and integrating the link influence coefficient and the node gravity coefficient to obtain an analysis result of the data processing link.

Wherein the link influencing coefficients can be used to describe the extent of influence of individual ones of the data processing links. For example, the link influencing coefficients may include a primary link node influencing coefficient and a collateral link node influencing coefficient. The influence coefficient of the main link node can be used for describing the influence degree of the main link in the data processing link. The collateral link node influence coefficient may be used to account for the degree of influence of the collateral link in the data processing link.

Wherein the node specific gravity coefficient may be used to account for the impact specific gravity of a link node in a data processing link.

In one embodiment, the step of calculating the link influence coefficient corresponding to the data processing link based on the link distribution information may include:

analyzing the link distribution information to obtain main link node number information, main link weight coefficient, side link node number information and side link weight coefficient;

Carrying out arithmetic operation on the main link node quantity information and the main link weight coefficient to obtain a main link influence coefficient;

carrying out arithmetic operation processing on the side link node quantity information and the side link weight coefficient to obtain a side link influence coefficient;

and integrating the link influence coefficient and the side link influence coefficient to obtain the link influence coefficient corresponding to the data processing link.

The number of main link nodes information may be used to describe how many nodes there are in the main link. The sidelink node information may be used to account for the number of nodes on the sidelink.

The arithmetic operations may include operations such as addition, subtraction, multiplication, division, and the like. For example, main link influence coefficient= (1/main link node number information) ×main link weight coefficient. As another example, side link influence coefficient= (1/side link node number information) ×side link weight coefficient.

In one embodiment, the step of calculating the node specific gravity coefficient corresponding to the data processing link according to the link node specific gravity information may include:

analyzing the link node specific gravity information to obtain link node quantity information, node influence coefficients, node time consumption information and link time consumption information;

Carrying out arithmetic operation on the link node quantity information and the node influence coefficient to obtain a node influence mean value;

performing arithmetic operation on the node influence coefficient, the node time consumption information and the link time consumption information to obtain a node time consumption influence rate;

and integrating the node influence mean value and the node time consumption influence rate to obtain a node gravity coefficient corresponding to the data processing link.

The link node number information may be a total point number of the data processing link. The link time consumption information may refer to the total time consumption of the data processing link. The node time-consuming information may refer to the time required by the node to perform the process.

For example, node influence mean= (1/link node number information) ×node influence coefficient, where the node needs to be identified as a main node and a side link node, so as to determine the corresponding node influence coefficient. As another example, node time consumption influence rate= (node time consumption information/link time consumption information) ×node influence coefficient.

105. And adjusting the data processing table based on the analysis result to obtain an adjusted data processing table so as to realize the optimization of the data processing link.

In an embodiment, the data processing table may be adjusted based on the analysis result of the data processing link, so as to obtain an adjusted data processing table, so as to optimize the data processing link.

For example, according to the analysis result, the problems of unreasonable link structure, abnormal aging fluctuation of the link nodes, unclear main link nodes, large occupation ratio of the collateral link nodes, aging influence and the like can be obtained. Then, the related data responsible person can optimize the data processing table according to the analysis result, so as to optimize the data processing link. After optimization, the complex 101-104 may be repeated, with round robin verification to ensure that the data processing link is continuously optimized.

The embodiment of the application provides a data link processing method, which comprises the following steps: acquiring a data processing table, and analyzing the data processing table to obtain a data processing link corresponding to the data processing table; performing hierarchical discrimination processing on the data processing links corresponding to the data processing table to obtain a hierarchical discrimination result corresponding to the data processing links; based on the hierarchy discrimination result, carrying out identification processing on the data processing link to obtain link distribution information and link node specific gravity information of the data processing link; according to the link distribution information and the link node specific gravity information of the data processing link, carrying out link analysis processing on the data processing link to obtain an analysis result of the data processing link; and adjusting the data processing table based on the analysis result to obtain an adjusted data processing table so as to realize the optimization of the data processing link. First, through the embodiments of the present application, optimization of a data processing link may be achieved. The optimization of the data processing link means the simplification of the intermediate process, and accordingly, the reduction of storage resources and the saving of calculation resources can be brought, so that the overall utilization rate of the data resources is improved. And secondly, the data processing link is better, the possibility of data errors is low, the difficulty of link modification is low, and the operation labor cost brought to the data nodes in the link in the later period is also greatly reduced. In addition, the data quality is also reduced by the reduction of links, and the possibility of errors is reduced. Meanwhile, the problems of data aging, data quality, data completeness and the like caused by abnormal data processing links can be solved more quickly, so that the user experience is improved, and the data response aging of the terminal data user can be ensured.

In order to better implement the data link processing method provided in the embodiments of the present application, in an embodiment, a data link processing apparatus is also provided, where the data link processing apparatus may be integrated into a computer device. Where the meaning of the terms is the same as in the data link processing method of the above-mentioned product, specific implementation details may be referred to in the description of the method embodiment.

In an embodiment, a data link processing apparatus is provided, which may be integrated in a computer device, such as a television, as shown in fig. 2, and includes: the parsing unit 301, the hierarchy level discrimination unit 302, the identification unit 303, the link analysis unit 304, and the adjustment unit 305 are specifically as follows:

the parsing unit 301 is configured to obtain a data processing table, perform parsing processing on the data processing table, and obtain a data processing link corresponding to the data processing table;

the hierarchy determining unit 302 is configured to perform hierarchy determining processing on a data processing link corresponding to the data processing table, so as to obtain a hierarchy determining result corresponding to the data processing link;

an identifying unit 303, configured to identify the data processing link based on the level discrimination result, to obtain link distribution information and link node specific gravity information of the data processing link;

A link analysis unit 304, configured to perform link analysis processing on the data processing link according to the link distribution information and the link node specific gravity information of the data processing link, so as to obtain an analysis result of the data processing link;

and the adjusting unit 305 is configured to perform adjustment processing on the data processing table based on the analysis result, so as to obtain an adjusted data processing table, so as to optimize the data processing link.

In an embodiment, the parsing unit 301 may include:

the traversal subunit is used for performing traversal processing on the data processing table to obtain a data processing field corresponding to the data processing table;

a searching subunit, configured to search a preset storage database for an associated data processing table associated with the data processing field;

and the serial subunit is used for carrying out serial processing on the data processing table and the associated data processing table to obtain the data processing link.

In an embodiment, the level discrimination unit 302 may include:

the hierarchy identification subunit is used for performing hierarchy identification processing on the data processing link to obtain physical hierarchy information and logic hierarchy information corresponding to the data processing link;

The matching subunit is used for carrying out matching processing on the logic level information of the data processing link and preset logic level discrimination conditions;

and the judging subunit is used for judging the physical level information of the data processing link when the logic level information accords with the preset logic level judging condition, so as to obtain a level judging result corresponding to the data processing link.

In an embodiment, the determining subunit may include:

the condition generation module is used for generating physical level discrimination conditions according to the logic level information when the logic level information accords with the preset logic level discrimination conditions;

the matching module is used for matching the physical level information of the data processing link with the physical level discrimination conditions;

and the result generation module is used for generating a hierarchy discrimination result of the data processing link passing hierarchy discrimination when the physical hierarchy information accords with the physical hierarchy discrimination condition.

In an embodiment, the identifying unit 303 may include:

the characteristic extraction subunit is used for extracting the characteristics of the data processing link to obtain the characteristic information of the data link;

The feature mining subunit is used for feature mining the feature information of the data link to obtain depth feature information of the data link;

and the prediction subunit is used for performing prediction processing on the depth characteristic information of the data link to obtain link distribution information and link node specific gravity information of the data processing link.

In an embodiment, the link analysis unit 304 may include:

the first calculating subunit is used for calculating a link influence coefficient corresponding to the data processing link based on the link distribution information;

the second calculating subunit is used for calculating the node influence coefficient corresponding to the data processing link according to the link node specific gravity information;

and the integration subunit is used for integrating the link influence coefficient and the node influence coefficient to obtain an analysis result of the data processing link.

In an embodiment, the first computing subunit may include:

the first analysis module is used for analyzing the link distribution information to obtain main link node number information, main link weight coefficients, side link node number information and side link weight coefficients;

The first arithmetic operation module is used for carrying out arithmetic operation on the main chain node quantity information and the main chain weight coefficient to obtain a main chain influence coefficient;

the second arithmetic operation module is used for carrying out arithmetic operation processing on the side link node quantity information and the side link weight coefficient to obtain a side link influence coefficient;

and the first integration module is used for integrating the link influence coefficient and the side link influence coefficient to obtain the link influence coefficient corresponding to the data processing link.

In an embodiment, the second computing subunit may include:

the second analysis module is used for analyzing the link node specific gravity information to obtain link node quantity information, node influence coefficients, node time consumption information and link time consumption information;

the third arithmetic operation module is used for carrying out arithmetic operation on the link node quantity information and the node influence coefficient to obtain the node influence coefficient;

the fourth arithmetic operation module is used for carrying out arithmetic operation on the node influence coefficient, the node time consumption information and the link time consumption information to obtain a node time consumption influence rate;

And the second integration module is used for integrating the node influence coefficient and the node time-consuming influence rate to obtain the node influence coefficient corresponding to the data processing link.

In the implementation, each unit may be implemented as an independent entity, or may be implemented as the same entity or several entities in any combination, and the implementation of each unit may be referred to the foregoing method embodiment, which is not described herein again.

The data link processing device can identify complex, lengthy and tedious data processing links, optimize the complex, lengthy and tedious data processing links, improve data quality and reduce data processing timeliness.

The embodiment of the application also provides a computer device, which may include a computer device or a server, for example, the computer device may be used as a data link processing computer device, and the data link processing computer device may be a smart television or the like; for another example, the computer device may be a server, such as a data link processing server, or the like. As shown in fig. 3, a schematic structural diagram of a computer device according to an embodiment of the present application is shown, specifically:

The computer device may include one or more processors 401 of a processing core, memory 402 of one or more computer readable storage media, a power supply 403, and an input unit 404, among other components. Those skilled in the art will appreciate that the computer device structure shown in FIG. 3 is not limiting of the computer device and may include more or fewer components than shown, or may be combined with certain components, or a different arrangement of components. Wherein:

the processor 401 is a control center of the computer device, connects various parts of the entire computer device using various interfaces and lines, and performs various functions of the computer device and processes data by running or executing software programs and/or modules stored in the memory 402, and calling data stored in the memory 402, thereby performing overall monitoring of the computer device. Optionally, processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user page, an application program, etc., and the modem processor mainly processes wireless communication. It will be appreciated that the modem processor described above may not be integrated into the processor 401.

The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data link processing by executing the software programs and modules stored in the memory 402. The memory 402 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like; the storage data area may store data created according to the use of the computer device, etc. In addition, memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.

The computer device further comprises a power supply 403 for supplying power to the various components, preferably the power supply 403 may be logically connected to the processor 401 by a power management system, so that functions of charge, discharge, and power consumption management may be performed by the power management system. The power supply 403 may also include one or more of any of a direct current or alternating current power supply, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.

The computer device may also include an input unit 404, which input unit 404 may be used to receive input numeric or character information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

Although not shown, the computer device may further include a display unit or the like, which is not described herein. In particular, in this embodiment, the processor 401 in the computer device loads executable files corresponding to the processes of one or more application programs into the memory 402 according to the following instructions, and the processor 401 executes the application programs stored in the memory 402, so as to implement various functions as follows:

The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.

According to one aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the methods provided in the various alternative implementations of the above embodiments.

It will be appreciated by those of ordinary skill in the art that all or part of the steps of the various methods of the above embodiments may be performed by a computer program, or by computer program control related hardware, which may be stored in a computer readable storage medium and loaded and executed by a processor.

To this end, the embodiments of the present application also provide a storage medium in which a computer program is stored, the computer program being capable of being loaded by a processor to perform the steps of any of the data link processing methods provided by the embodiments of the present application. For example, the computer program may perform the steps of:

The steps in any data link processing method provided in the embodiments of the present application may be executed by the computer program stored in the storage medium, so that the beneficial effects that any data link processing method provided in the embodiments of the present application may be achieved, which are described in detail in the previous embodiments and are not repeated herein.

The foregoing has described in detail the methods, apparatuses, computer devices and storage medium for processing data links provided in the embodiments of the present application, and specific examples have been applied to illustrate the principles and embodiments of the present application, where the foregoing examples are provided to assist in understanding the methods and core ideas of the present application; meanwhile, those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present application, and the present description should not be construed as limiting the present application in view of the above.

Claims

1. A method of data link processing, comprising:

2. The method of claim 1, wherein the parsing the data processing table to obtain a data processing link corresponding to the data processing table comprises:

and carrying out serial connection processing on the data processing table and the associated data processing table to obtain the data processing link.

3. The method according to claim 1, wherein performing hierarchical discrimination processing on the data processing link corresponding to the data processing table to obtain a hierarchical discrimination result corresponding to the data processing link comprises:

4. The method according to claim 3, wherein when the logic level information meets the preset logic level discrimination condition, discriminating the physical level information of the data processing link to obtain a level discrimination result corresponding to the data processing link, including:

when the logic level information accords with the preset logic level discrimination conditions, generating physical level discrimination conditions according to the logic level information;

and when the physical level information accords with the physical level discrimination conditions, generating a level discrimination result of the data processing link passing level discrimination.

5. The method according to claim 3 or 4, characterized in that the method further comprises:

and when the data processing link does not pass the hierarchy discrimination, adjusting the data processing table based on the hierarchy discrimination result to obtain an adjusted data processing table so as to realize the optimization of the data processing link.

6. The method according to claim 1, wherein the identifying the data processing link based on the hierarchical discrimination result to obtain link distribution information and link node specific gravity information of the data processing link includes:

based on the hierarchy discrimination result, extracting the characteristics of the data processing link to obtain the characteristic information of the data processing link;

And predicting the depth characteristic information of the data processing link to obtain link distribution information and link node specific gravity information of the data processing link.

7. The method according to claim 1, wherein the performing the link analysis processing on the data processing link according to the link distribution information and the link node specific gravity information of the data processing link to obtain the analysis result of the data processing link includes:

calculating a node proportion coefficient corresponding to the data processing link according to the link node proportion information;

8. The method of claim 7, wherein calculating the link impact coefficients corresponding to the data processing links based on the link distribution information comprises:

Performing arithmetic operation on the main chain node quantity information and the main chain weight coefficient to obtain a main chain influence coefficient;

performing arithmetic operation on the side link node quantity information and the side link weight coefficient to obtain a side link influence coefficient;

and integrating the main link influence coefficient and the side link influence coefficient to obtain the link influence coefficient corresponding to the data processing link.

9. The method of claim 7, wherein calculating the node gravity coefficient corresponding to the data processing link according to the link node gravity information comprises:

10. A data processing link processing apparatus, comprising:

11. A computer device comprising a memory and a processor; the memory stores a computer program, and the processor is configured to execute the computer program in the memory to perform the data link processing method according to any one of claims 1 to 9.

12. A storage medium storing a plurality of computer programs adapted to be loaded by a processor to perform the data link processing method of any one of claims 1 to 9.