CN115391373A

CN115391373A - Data construction method, device, computer program product and storage medium

Info

Publication number: CN115391373A
Application number: CN202210924038.2A
Authority: CN
Inventors: 孙艳萍
Original assignee: Seashell Housing Beijing Technology Co Ltd
Current assignee: Seashell Housing Beijing Technology Co Ltd
Priority date: 2022-08-02
Filing date: 2022-08-02
Publication date: 2022-11-25

Abstract

The invention provides a data construction method, a device, a computer program product and a storage medium, wherein the method comprises the following steps: determining a network topological graph corresponding to the data construction request according to the received data construction request; the network topological graph is a directed graph; the network topology graph comprises at least two nodes; receiving a target parameter associated with the data construction request; the target parameters comprise a starting node and a target node; and generating target data according to the network topological graph, the starting node and the target node. According to the data construction method provided by the invention, the construction of target data is realized through the network topological graph and the target parameters, the requirements of long-chain path and multi-combination complex business processes are supported, and the efficiency of data construction is improved.

Description

Data construction method, device, computer program product and storage medium

Technical Field

The present invention relates to the field of computer technologies, and in particular, to a data structuring method, an apparatus, a computer program product, and a storage medium.

Background

Because the system has a large number of services and a complex and long service flow, the cost for constructing service order data is extremely high, and the lack of data becomes a pain point problem for related personnel for system development; for example, joint tone pain spots: developers cannot make singles, and joint debugging cannot be realized due to the fact that no data exists; and (3) testing pain points: the test required time was 6 days, while the manufacturing data required 2 days, which took up 30% of the time; project show (showcase) pain point: the showcase time is too long, wherein half of the showcase time is in the process of manufacturing the sheets, even one piece of data is repeatedly modified and utilized, and the reliability of the data is reduced; and (4) checking and accepting pain points: the person who checks and accepts can not make the sheet, and no data can check and accept. Therefore, the order data becomes the main reason for blocking joint debugging, showcase and testing, and the problem of manufacturing data is solved, which is not easy.

In the related art, data construction generally supports services such as Structured Query Language (SQL), open source distributed service framework (dubbo), hypertext Transfer Protocol (HTTP) and distributed publish-subscribe message system (Kafka) through configuration, and can support simple short flows and single flows, that is, only can support small branch flows such as creating a customer source and the like; however, for an extremely complex long-link flow scenario, the configuration according to the branch condition and the multi-path cannot be performed, and the maintenance cost is high, and the requirement of the personalized function scenario is not met.

Disclosure of Invention

The invention provides a data construction method, a data construction device, a computer program product and a storage medium, which are used for overcoming the defect that the scene requirement of a complex long-chain path flow cannot be met in the related technology, realizing the data construction requirement of a multi-branch long-chain path flow and improving the data construction efficiency.

The invention provides a data construction method, which comprises the following steps:

determining a network topological graph corresponding to the data construction request according to the received data construction request; the network topological graph is a directed graph; the network topology graph comprises at least two nodes;

receiving a target parameter associated with the data construction request; the target parameters comprise a starting node and a target node;

and generating target data according to the network topological graph, the starting node and the target node.

According to a data constructing method provided by the present invention, the generating target data according to the network topology, the starting node and the target node comprises:

determining a target network flow chart according to the network topological graph, the starting node and the target node;

and generating target data according to the target network flow chart.

According to a data constructing method provided by the invention, the network topology map further comprises at least one of the following items: at least one event line and branch; wherein each of the event lines represents an event between two nodes or between one node and a branch; each event line corresponds to at least one configuration interface.

According to a data construction method provided by the present invention, generating target data according to the target network flowchart includes:

acquiring interface information of the configuration interface included in the target network flow chart according to the target network flow chart;

and sequentially calling configuration interfaces corresponding to the interface information according to the priority in the interface information to generate target data.

According to a data structuring method provided by the present invention, the method further comprises:

and responding to the calling failure of the configuration interface, and recording and storing the interface data of the configuration interface with the calling failure.

According to a data constructing method provided by the present invention, after the recording and storing the interface data of the configuration interface, the method further comprises:

searching a node corresponding to the interface data with the call failure as a failure node according to the interface data;

and taking the failed node as an updated initial node, and generating target data according to the target network flow chart, the updated initial node and the target node.

According to a data constructing method provided by the present invention, the interface information includes at least one of: events, request paths, request services, entries, returns, request patterns, and priorities.

The present invention also provides a data construction apparatus, the apparatus comprising:

the determining module is used for determining a network topological graph corresponding to the data construction request according to the received data construction request; the network topological graph is a directed graph; the network topology graph comprises at least two nodes;

a receiving module for receiving a target parameter related to the data construction request; the target parameters comprise a starting node and a target node;

and the generation module is used for generating target data according to the network topological graph, the starting node and the target node.

The present invention also provides a computer program product comprising computer programs/instructions which, when executed by a processor, carry out the steps of the data construction method as described in any one of the above.

The invention also provides a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, carries out the steps of the data construction method as described in any one of the above.

The data construction method provided by the invention determines a network topological graph corresponding to the data construction request according to the received data construction request; receiving target parameters related to the data construction request; and generating target data according to the network topological graph and the target parameters. According to the data construction method provided by the invention, the construction of target data is realized through the network topological graph and the target parameters, the requirements of long-chain path and multi-combination complex business processes are supported, and the efficiency of data construction is improved.

Drawings

In order to more clearly illustrate the technical solutions of the present invention or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.

FIG. 1 is a schematic flow chart of a data construction method provided by the present invention;

FIG. 2 is a schematic diagram of a network topology provided by the present invention;

FIG. 3 is a second schematic flowchart of a data structuring method provided by the present invention;

FIG. 4 is a new schematic diagram of the data structuring method provided by the present invention;

FIG. 5 is an edit schematic of the data construction method provided by the present invention;

FIG. 6 is a schematic diagram of a data structuring apparatus according to the present invention;

fig. 7 is a schematic structural diagram of an electronic device provided by the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The data construction method provided by the invention is explained in detail by some embodiments and application scenarios thereof in the following with reference to the accompanying drawings.

The invention provides a data construction method, which can be applied to a data construction scene of a complex service system, and determines a network topological graph corresponding to a data construction request according to the received data construction request; the network topological graph is a directed graph; the network topology graph comprises at least two nodes; receiving a target parameter associated with the data construction request; the target parameters comprise a starting node and a target node; and generating target data according to the network topological graph, the starting node and the target node. According to the data construction method provided by the invention, the construction of target data is realized through the network topological graph and the target parameters, the requirements of long-chain path and multi-combination complex business processes are supported, and the efficiency of data construction is improved.

Fig. 1 is a schematic flow chart of a data construction method provided by the present invention, and as shown in fig. 1, the method includes steps 110 to 130, where:

step 110, according to the received data construction request, determining a network topology map corresponding to the data construction request; the network topological graph is a directed graph; the network topology includes at least two nodes.

It should be noted that the data construction method provided by the present invention can be applied to a data construction scene of a complex service system. The execution subject of the data construction method provided by the invention can be a data construction device, such as an electronic device, or a control module in the data construction device for executing the data construction method.

Optionally, the network topology further comprises at least one of: at least one event line and branch; wherein each event line represents an event between two nodes or between one node and a branch; each event line corresponds to at least one configuration interface.

Specifically, the network topology is designed according to an actual complex service system, and then configured according to a preset rule; the rule comprises configuration interface information corresponding to the sequence, branches, advance lines and event lines between nodes or between nodes and branches of at least two adjacent nodes; the branch represents a branch flow in the network topology, for example, the branch is a pre-surveyor service, which corresponds to a branch condition for determining a relationship between nodes; the nodes represent links related to the network topology, for example, the nodes are to-be-allocated, to-be-measured rooms and the like; the event line represents an event between a node and a node or between a node and a branch, for example, using E1000.

For example, the network topology includes the following fields: state machine code (state _ machine _ code), source _ val, target _ val, event _ type, branch conditional expression (rule _ exp), and execute action (common _ action); wherein the state machine code is used to identify different network topology diagrams.

Optionally, the configuration interface information includes at least one of: events, request paths, request services, participation, return, request mode, and priority.

For example, the configuration interface information configured according to the event line includes the following fields: event _ type, request path (url), service _ name, params, return, request mode (http _ method), and priority (level).

Specifically, according to the received data construction request, a state machine code matched with the data construction request is selected, and therefore a network topological graph corresponding to the data construction request is determined.

It should be noted that the network topology graph is a directed graph, and nodes, event lines and branches included in the network topology graph, and configuration interface information configured by the event lines are all stored in the database.

Step 120, receiving target parameters related to the data construction request; the target parameters include an originating node and a target node.

Optionally, the target parameters include a start node and a target node, and further include other parameters, for example, parameters such as a mobile phone number, a business name, a branch condition, and a brand, which are specifically set according to actual requirements.

It should be noted that, according to the actual data construction request, the target parameters are input, and the service scenario for constructing data can be determined.

And 130, generating target data according to the network topological graph, the starting node and the target node.

Specifically, a scene is constructed according to data determined by an initial node and a target node, and then according to a pre-configured network topological graph, event lines, branches, configuration interfaces and configuration interface information between the initial node and the target node in the scene of data construction are determined, and target data are generated.

It should be noted that, according to the network topology, data construction can be completed only by selecting any starting node and any target node according to the actual data construction request, and the requirement of the data construction request with complex service can be met.

The data construction method provided by the invention determines a network topological graph corresponding to a data construction request according to the received data construction request; receiving target parameters related to the data construction request; and generating target data according to the network topological graph and the target parameters. According to the data construction method provided by the invention, the construction of the target data under the complex service scene is realized through the network topological graph and the target parameters, the long-chain and multi-combination complex service flow requirements are supported, and the data construction efficiency is improved.

Fig. 2 is a schematic structural diagram of a network topology provided by the present invention, and as shown in fig. 2, the network topology includes 5 nodes, 4 event lines, and a branch, where the event lines are configured between the nodes, and the interfaces are configured below the event lines. For example, an event line E1000 is configured between the node 1 and the node 2, and interfaces url1, url2 and url3 are configured under the event line E1000; an event line E1002 and branches exist between the node 2 and the node 3, return values of url1, url2, url3, url4, url5, and url6 under the event line E1000 and the event line E1002 are judged by using a branch condition expression, and the node 2 is circulated to the node 3 when a branch condition (a = = 1) is satisfied; when the branching condition (a = = 2) is satisfied, the node 2 flows to the node 4.

Fig. 3 is a second schematic flowchart of the data structuring method provided by the present invention, as shown in fig. 3, the method includes steps 310-340, wherein:

step 310, according to the received data construction request, determining a network topology map corresponding to the data construction request; the network topological graph is a directed graph; the network topology includes at least two nodes.

Step 320, receiving target parameters related to the data construction request; the target parameters include an originating node and a target node.

Optionally, for the descriptions and explanations of steps 310 to 320, reference may be made to the descriptions and explanations of steps 110 to 120, and the same technical effects can be achieved, and further description is omitted here to avoid repetition.

Step 330, determining a target network flow chart according to the network topology chart, the starting node and the target node.

Specifically, according to the network topology map, the starting node and the target node which are input by the user are received, and the target network flow chart from the starting node to the target node is determined.

It should be noted that, according to the target network flowchart determined by the start node and the target node, it may be determined whether the target network flowchart includes a branch, and when the target network flowchart does not include a branch, the target network flowchart is a single link; when the target network flow chart contains branches, the target network flow chart is a complex multi-branch network flow chart, and the requirement of a user on complex multi-branch structure data can be met.

And 340, generating target data according to the target network flow chart.

According to the data construction method provided by the invention, the target network flow chart is determined according to the network topological graph, the starting node and the target node, and the target data is generated according to the target network flow chart, so that the target data is generated through the target network flow chart, the requirement of a user on the construction of complex multi-branch data is met, and the efficiency of data construction is improved.

Optionally, a specific implementation manner of the step 340 includes the following steps:

step 1, according to the target network flow chart, obtaining interface information of a configuration interface included in the target network flow chart.

And 2, sequentially calling configuration interfaces corresponding to the interface information according to the interface information and the priority in the interface information to generate target data.

Specifically, when the service is started, the target network flow chart and interface information of a configuration interface included in the target network flow chart are acquired from a database and stored in a memory; when constructing data, according to the interface information, directly calling the configuration interfaces corresponding to the interface information from the memory in sequence according to the priority in the interface information, and generating target data.

The method comprises the steps of providing a common action method, analyzing interface information of different corresponding configuration interfaces under different events in a target network flow chart, calling the configuration interfaces corresponding to the interface information, and calling the configuration interfaces according to the priority of the configuration interfaces; if the priorities of the plurality of configuration interfaces are the same, calling the plurality of configuration interfaces in parallel; and if the priorities of the plurality of configuration interfaces are not the same, serially calling the plurality of configuration interfaces.

In practice, personalized customization of special scenes is also provided, for example, the same configuration interface circularly calls forAction, or different configuration interfaces circularly call, and the calling condition of the configuration interfaces is set according to actual requirements.

Fig. 4 is a newly-created schematic diagram of the data construction method provided by the present invention, and as shown in fig. 4, a network topology diagram of a long link flow is displayed according to a received data construction request, where the network topology diagram includes nodes such as un-started, frozen initialization, to-be-distributed, waiting room, to-be-contracted pre-delivery end, to-be-delivered manager, to-be-delivered order neutralization and to-be-pre-delivered end, and a pre-surveyor service branch; wherein each node includes a number, e.g., the number of the "freeze initialization" node is 200, the number of the "to-be-allocated" node is 201, and the branch includes a branch condition; for example, the node number of "freeze initialization" is 200; the branch condition corresponding to the precautionary is a = =1, that is, when the configuration interface return value between the node before the precautionary and the node meets the branch condition, the "to-be-dispatched manager" node is moved to the "to-be-presidented" node, otherwise, the "to-be-dispatched manager" node is moved to the "in-dispatch" node.

Specifically, clicking "new creation" to generate a target network flow chart from the "un-started" node, inputting target parameters such as a mobile phone number, a name, a target node, a branch condition and a brand by a right key, and clicking "creation data" to obtain interface information of a configuration interface included in the target network flow chart, namely analyzing interface information of different configuration interfaces corresponding to different events in the target network flow chart, and calling the configuration interfaces in series or in parallel according to information such as a request path, a request service, a return, an entry parameter, a priority and a request mode of the configuration interface to generate the target data, so as to achieve the effect of constructing data by one key.

Optionally, in response to the configuration interface failing to be called, recording and storing interface data of the configuration interface failing to be called.

Specifically, when the configuration interface corresponding to the interface information is called, the configuration interface is failed to be called due to system settings, a network and the like, and interface data of the configuration interface is recorded and stored. The interface data includes the following fields: id (businessId) for identifying service data, id (url _ cfg _ id) for corresponding request configuration, the number of times of failed request rerun (run _ num), whether failed request data is valid (state), and failed node (node _ val); wherein, businessId represents data generated from the starting node to the target node to construct order information; url _ cfg _ id represents a number corresponding to the configuration interface; run _ num represents the failure times of constructing data by a data construction order generated from the starting node to the target node, and the failure times are added once again; the state indicates that the failed interface data is requested again, and if the request is successful, the failed interface data is valid data; node _ val indicates a failure node corresponding to a configuration interface that failed in calling when the configuration interface is called.

Optionally, after the interface data of the configuration interface is recorded and stored, the method further includes:

searching a node corresponding to the interface data with the call failure as a failure node according to the interface data; and taking the failed node as an updated initial node, and generating target data according to the target network flow chart, the updated initial node and the target node.

Specifically, according to the stored interface data, searching for a node corresponding to the interface data with failed call as a failed node; the node corresponding to the interface data which is failed to be called can be an initial node or a target node; and then, the failed node is used as an updated initial node, and target data are generated again according to the updated initial node, the target network flow chart and the target node.

Fig. 5 is an editing schematic diagram of the data construction method provided by the present invention, as shown in fig. 5, based on the description of fig. 4, the target node is a waited-for-appointment pre-transaction end, and if the call fails when a configuration interface under an event line between the "waited-for-appointment house" node and the "waited-for-appointment pre-transaction end" node is called, the order id from "freeze initialization" to "waited-for-appointment pre-transaction end", the id of the failed configuration interface, the number of times of the failed request rerun, whether the failed request data is valid, and the failed node (waited-for-appointment pre-transaction end) are recorded and stored.

Specifically, when a data construction request is received next time, clicking 'edit', selecting a 'to-be-contracted pre-cross-bottom' node, and right-clicking to enter target parameters, such as a target node (in a dispatch), a pre-surveyor (a = = 1); searching a failure node (to-be-contracted pre-transaction bottom) corresponding to interface data according to an order id, taking the 'to-be-contracted pre-transaction bottom' as an updated initial node, taking a request corresponding to a failed configuration interface as an initial calling request, starting to flow a target network flow chart corresponding to the order id from the node (to-be-contracted pre-transaction bottom) to a target node (in a dispatching list), acquiring other configuration interfaces except the failed configuration interface under an event line corresponding to the failed configuration interface and interface information of different interfaces under all event lines between the updated initial node and the target node in the target network flow chart, and calling different interfaces in series or in parallel according to information such as request paths, request services, returns, entries, priorities, request modes and the like of all the interfaces to generate target data so as to achieve the effect of constructing the data by one key.

The data structuring device provided by the present invention is described below, and the data structuring device described below and the data structuring method described above may be referred to in correspondence with each other.

The present invention provides a data structuring device, fig. 6 is a schematic structural diagram of the data structuring device provided by the present invention, and as shown in fig. 6, a data structuring device 600 includes: a determination module 601, a receiving module 602 and a first generation module 603; wherein, the first and the second end of the pipe are connected with each other,

a determining module 601, configured to determine, according to a received data construction request, a network topology map corresponding to the data construction request; the network topological graph is a directed graph; the network topology graph comprises at least two nodes;

a receiving module 602, configured to receive a target parameter related to the data construction request; the target parameters comprise a starting node and a target node;

a first generating module 603, configured to generate target data according to the network topology, the starting node, and the target node.

The data construction device provided by the invention determines a network topological graph corresponding to a data construction request according to the received data construction request; receiving target parameters related to the data construction request; and generating target data according to the network topological graph and the target parameters. The data construction method provided by the invention realizes construction of target data, supports the requirements of long-chain and multi-combination complex business process and improves the efficiency of data construction through the network topological graph and the target parameters.

Optionally, the first generating module 603 is specifically configured to:

and generating target data according to the target network flow chart.

Optionally, the network topology further comprises at least one of: at least one event line and branch; wherein each of the event lines represents an event between two nodes or between one node and a branch; each event line corresponds to at least one configuration interface.

Optionally, the first generating module 603 is specifically configured to:

and sequentially calling the configuration interfaces corresponding to the interface information according to the priority in the interface information to generate target data.

Optionally, the apparatus 600 further comprises:

and the recording module is used for responding to the calling failure of the configuration interface, and recording and storing the interface data of the configuration interface with the calling failure.

Optionally, after the recording and storing the interface data of the configuration interface, the method further includes:

the searching module is used for searching a node corresponding to the interface data with the call failure as a failure node according to the interface data;

and the second generation module is used for generating target data according to the target network flow chart, the updated initial node and the target node by taking the failed node as an updated initial node.

Optionally, the interface information includes at least one of: events, request paths, request services, entries, returns, request patterns, and priorities.

Fig. 7 is a schematic physical structure diagram of an electronic device provided in the present invention, and as shown in fig. 7, the electronic device 700 may include: a processor (processor) 710, a communication Interface (Communications Interface) 720, a memory (memory) 730, and a communication bus 740, wherein the processor 710, the communication Interface 720, and the memory 730 communicate with each other via the communication bus 740. Processor 710 may call logical instructions in memory 730 to perform a data construction method comprising: determining a network topological graph corresponding to the data construction request according to the received data construction request; the network topological graph is a directed graph; the network topology graph comprises at least two nodes; receiving a target parameter associated with the data construction request; the target parameters comprise a starting node and a target node; and generating target data according to the network topological graph, the starting node and the target node.

In addition, the logic instructions in the memory 730 can be implemented in the form of software functional units and stored in a computer readable storage medium when the logic instructions are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk, and various media capable of storing program codes.

In another aspect, the present invention also provides a computer program product, the computer program product comprising a computer program/instructions, the computer program being storable on a non-transitory computer readable storage medium, the computer program being capable of executing a data structuring method provided by the above methods when executed by a processor, the method comprising: determining a network topological graph corresponding to the data construction request according to the received data construction request; the network topological graph is a directed graph; the network topology graph comprises at least two nodes; receiving a target parameter associated with the data construction request; the target parameters comprise a starting node and a target node; and generating target data according to the network topological graph, the starting node and the target node.

In yet another aspect, the present invention also provides a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a data construction method provided by the above methods, the method comprising: determining a network topological graph corresponding to the data construction request according to the received data construction request; the network topological graph is a directed graph; the network topology graph comprises at least two nodes; receiving a target parameter associated with the data construction request; the target parameters comprise a starting node and a target node; and generating target data according to the network topological graph, the starting node and the target node.

The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. Based on the understanding, the above technical solutions substantially or otherwise contributing to the prior art may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the various embodiments or some parts of the embodiments.

Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, and not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims

1. A method of data construction, the method comprising:

2. The data construction method of claim 1, wherein generating target data from the network topology, the originating node, and the target node comprises:

and generating target data according to the target network flow chart.

3. The data construction method of claim 2, wherein the network topology map further comprises at least one of: at least one event line and branch; wherein each of the event lines represents an event between two nodes or between one node and a branch; each event line corresponds to at least one configuration interface.

4. The data construction method of claim 3, wherein generating target data according to the target network flow graph comprises:

acquiring interface information of a configuration interface included in the target network flow chart according to the target network flow chart;

and according to the interface information, sequentially calling configuration interfaces corresponding to the interface information according to the priority in the interface information to generate target data.

5. The data construction method of claim 4, further comprising:

6. The data construction method of claim 5, wherein after the recording and storing the interface data of the configuration interface, further comprising:

7. The data construction method of claim 4, wherein the interface information comprises at least one of: events, request paths, request services, participation, return, request mode, and priority.

8. A data structuring apparatus, characterized in that the apparatus comprises:

9. A computer program product comprising computer programs/instructions, characterized in that the computer programs, when executed by a processor, implement the steps of the data structuring method according to any one of claims 1 to 7.

10. A non-transitory computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the data construction method according to any one of claims 1 to 7.