CN114840265A - Data processing method based on executable graph - Google Patents
Data processing method based on executable graph Download PDFInfo
- Publication number
- CN114840265A CN114840265A CN202210288937.8A CN202210288937A CN114840265A CN 114840265 A CN114840265 A CN 114840265A CN 202210288937 A CN202210288937 A CN 202210288937A CN 114840265 A CN114840265 A CN 114840265A
- Authority
- CN
- China
- Prior art keywords
- data
- output
- field
- target
- target component
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44521—Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
- G06F9/44526—Plug-ins; Add-ons
Abstract
The application discloses a data processing method based on executable graphs, which comprises the following steps: reading an executable graph constructed aiming at a target business system, and determining a second target component in the executable graph in a ready state; acquiring second input data from a first output field of a first target component in the executable diagram based on data source identification information of a second input field of a second target component, and executing the second target component based on the second input data, wherein the data source identification information of the second input field represents that the second input data of the second input field of the second target component is sourced from the first output field of the first target component; and determining a second output field of the second target assembly based on the preset data output identification information, and assigning the execution result data of the second target assembly to the second output field of the second target assembly. The method can simplify the composition process and reduce the use threshold of the graph execution process.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to an executable graph-based data processing method, a server for implementing an executable graph-based data processing process, and a computer-readable storage medium.
Background
Online service systems have strong demands for low latency, high throughput, and high service iteration efficiency. Service systems developed in a traditional manner are often executed according to a service logic sequence, and low delay benefits brought by a fully asynchronous concurrent execution part are lost; whether the components in the business system are reasonably split currently depends on personal skills of developers, and the components and input and output definitions of the components are easy to be unclear, so that the components are difficult to share and multiplex. Therefore, how to implement clear and accurate definition of input and output of components and further implement sharing and multiplexing of the components on the basis of meeting the requirements of an online business system on fast change of a business level, high business iteration efficiency and high requirements on simplicity and usability of an operation level is a problem to be solved.
Disclosure of Invention
The application provides a data processing method based on an executable graph, a server for realizing data processing based on the executable graph and a storage medium, so as to solve the problems that an online business system in the prior art cannot meet the requirements of fast change in a business level, high business iteration efficiency, high requirement on simplicity and usability of the operation level, and incapability of realizing sharing and multiplexing of components.
The embodiment of the application provides a data processing method based on an executable graph, which comprises the following steps:
reading an executable graph constructed for a target business system, and determining a second target component in the executable graph in a ready state;
acquiring second input data from a first output field of a first target component in the executable diagram based on data source identification information of a second input field of the second target component, and executing the second target component based on the second input data, wherein the data source identification information of the second input field characterizes that the second input data of the second input field of the second target component is derived from the first output field of the first target component;
and in response to the second target assembly being executed, determining a second output field of the second target assembly based on preset data output identification information, and assigning the execution result data of the second target assembly to the second output field of the second target assembly.
Optionally, the method further includes:
determining that third input data is derived from a second output field of a second target component based on data source identification information of a third input field of a third target component in the executable graph;
determining that the third target component is in a ready state in response to the assigning of the execution result data of the second target component to the second output field of the second target component;
obtaining the third input data from a second output field of the second target component;
executing the third target component based on the third input data.
Optionally, the method further includes:
determining that the third input data is derived from a second output field of the second target component and a fourth output field of a fourth target component based on data source identification information of a third input field of a third target component in the executable graph;
determining that the third target component is in a ready state in response to the assigning of the execution result data of the second target component to the second output field of the second target component and the fourth output field being assigned;
obtaining the third input data from a second output field of the second target component and a fourth output field of the fourth target component;
executing the third target component based on the third input data.
Optionally, the method further includes: the executable graph is constructed by:
acquiring data dependency relationship information among fields of all components contained in a target service system;
constructing an executable graph corresponding to the target business system based on the data dependency relationship information;
wherein the data dependency comprises: the data source identification information represents that the input data of the input field of each component is derived from the output fields of other components, and the data output identification information is used for identifying the output fields corresponding to the output data of each component.
Optionally, the data source identification information and/or the data output identification information includes:
annotating information in a pre-labeled field in a service development stage of the target service system; alternatively, the first and second electrodes may be,
and configuring file information preset in the service development stage of the target service system.
Optionally, the target service system is an online service system.
The embodiment of the present application further provides a method for constructing an executable graph, including:
acquiring data dependency relationship information among fields of all components contained in a target service system;
constructing an executable graph corresponding to the target business system based on the data dependency relationship information;
wherein the data dependency comprises: the data source identification information represents that the input data of the input field of each component is derived from the output fields of other components, and the data output identification information is used for identifying the output fields corresponding to the output data of each component.
Optionally, the data source identification information and/or the data output identification information includes:
the method comprises the steps of pre-marking field annotation information in a service development stage; alternatively, the first and second electrodes may be,
and configuration file information preset in a service development stage.
An embodiment of the present application further provides a server for implementing model-code synchronization, including:
a processor; and a memory for storing a program, the server executing the method as described above after being powered on and running the program through the processor.
Embodiments of the present application also provide a computer-readable storage medium, which stores a program, and the program is executed by a processor to perform the method described above.
Compared with the prior art, the method has the following advantages:
the data processing method based on the executable graph comprises the following steps: reading an executable graph constructed aiming at a target business system, and determining a second target component in the executable graph in a ready state; acquiring second input data from a first output field of a first target component in the executable diagram based on data source identification information of a second input field of a second target component, and executing the second target component based on the second input data, wherein the data source identification information of the second input field represents that the second input data of the second input field of the second target component is sourced from the first output field of the first target component; and in response to the second target assembly being executed, determining a second output field of the second target assembly based on the preset data output identification information, and assigning the execution result data of the second target assembly to the second output field of the second target assembly. In the graph execution process of the executable graph, full asynchronous concurrent execution of the execution process of the service system can be realized based on the data dependency relationship of the field granularity of each component (the full asynchronous concurrent execution means that when a plurality of tasks are executed simultaneously, the execution completion of any task triggers the downstream task to start execution, thereby reducing the task scheduling gap, improving the utilization rate of system resources and further reducing the service delay). And data transmission at field level based on data dependency relationship is realized through preset identification information aiming at fields, such as data source identification information, data output identification information and the like, so that accurate and clear automatic access logic in the graph execution process is realized. Meanwhile, the method clearly defines that the input data and the output data of the components are divided by the fields through the input fields and the output fields, namely, the data dependency relationship among the components is represented through the field granularity, the data dependency relationship among the components is determined by the production consumption relationship among the input fields and the output fields of the components, and the use threshold of the graph execution process can be reduced while the composition process is simplified; and because the data dependency of the field granularity is clearer and clearer, each component can realize multiplexing, replacement and sharing, and the same component can be configured in a plurality of executable graphs, thereby improving the service iteration efficiency of the online service system.
Drawings
FIG. 1 is a flow chart of a data processing method based on executable graphs provided by a first embodiment of the present application;
FIG. 1-A is a schematic diagram of an executable graph constructed based on pre-labeled field annotation information according to an embodiment of the present application;
FIG. 1-B is a block diagram of building and executing an executable graph according to an embodiment of the present application;
FIG. 2 is a flow chart of a method of building an executable graph provided in a second embodiment of the present application;
fig. 3 is a schematic logical structure diagram of a server for implementing the data processing method based on the executable graph according to the embodiment of the present application.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is capable of implementation in many different ways than those herein set forth and of similar import by those skilled in the art without departing from the spirit of this application and is therefore not limited to the specific implementations disclosed below.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to the explicitly listed steps, elements, or modules, but may include other steps, elements, or modules not expressly listed or inherent to such process, method, article, or apparatus.
The present application provides an executable graph-based data processing method, a server, a computer-readable storage medium and a system for executing the executable graph-based data processing method for an executable graph-based service processing scenario in an online service system, and the following embodiments provide detailed descriptions of the method, the server, the computer-readable storage medium and the system.
A first embodiment of the present application provides a data processing method based on executable graphs, which can be applied to graph execution links of an online service system, and is described below with reference to fig. 1.
As shown in fig. 1, the data processing method based on executable graph provided by this embodiment includes the following steps:
s101, reading the executable diagram constructed aiming at the target business system, and determining a second target component in the executable diagram in a ready state.
In this embodiment, a component refers to a part of independent function modules in a business system, which have explicit input/output definitions, and serve as high-cohesion function modules, data items required by the component are input to the component, and output data items are output from the component. The components of the business system have business dependency relationships, in the embodiment, the dependency relationship can be expressed by the dependency relationship between the input field and the output field of the component, the component is a class of object-oriented wind in code implementation, part of the fields can be designated as input fields, and part of the fields can be designated as output fields, for example, the field data of the output field of the component a is o1 and o2, which indicates that the output data of the component a is o1 and o 2; the field data of the input field of the component B are i1 and i2, the field data of the output field of the component B are o3 and o4, and the source of the field data i1 of the input field of the component B is the field data o2 of the output field of the component A, so that the process represents the data dependency relationship among the components based on the field granularity. The business system can contain a plurality of components, business dependency relationships exist among the components, a dependency relationship graph among the components can be used for scheduling execution, and the dependency relationship graph of the components is an executable graph.
In this embodiment, the target service system is an online service system, that is, the data processing method based on the executable diagram provided in this embodiment mainly provides technical support for a service processing link of the online service system. When the target business system schedules the executable graph to be executed (when the target business system starts providing service), the executable graph needs to be read, all components which are ready to be executed (in a ready state) are selected, and concurrent scheduling execution is started. This step is to select a ready executable (in ready state) second target component as a scheduled component after reading the executable graph constructed for the target business system.
In this embodiment, as shown in the system loading stage in fig. 1-B, the executable graph building process mainly includes "reading component and dependency relationship information, and composing a graph according to a dependency relationship", and this process can be specifically implemented as follows:
firstly, obtaining data dependency relationship information among fields of each component contained in a target business system, wherein the data dependency relationship comprises: the data source identification information is used for identifying the source of input data of the input field, and specifically, the data source identification information represents that the input data of the input field of each component is derived from the output fields of other components; the data output identification information is used for identifying an output field corresponding to the output data of each component, and is used for identifying whether a certain field of each component is an output field;
and secondly, constructing an executable graph corresponding to the target business system based on the data dependency relationship information.
S102, based on the data source identification information of the second input field of the second target assembly, second input data is obtained from the first output field of the first target assembly in the executable diagram, and the second target assembly is executed based on the second input data.
After the above steps are completed by reading the executable diagram constructed for the target business system and determining the second target component in the executable diagram in the ready state (e.g., "read executable diagram, select ready component" of the system execution diagram stage of fig. 1-B), this step is used to obtain second input data from the first output field of the first target component in the executable graph, inject data for the entry of the component, based on the data source identification information of the second input field of the second target component, and executing a second target component based on second input data, such as the "data from declared fields, select and inject data, execute component" of the system execution graph stage of fig. 1-B, wherein, the data source identification information of the second input field characterizes that the second input data of the second input field of the second target component is derived from the first output field of the first target component. That is, as described above, the data source identification information is used to identify the source of the input data of the input field, and may be field annotation information that is pre-labeled by a developer in the service development phase of the target service system, that is, the executable graph is constructed based on the field annotation information, or the data source identification information may be configuration file information that is pre-set in the service development phase of the target service system, that is, the executable graph is constructed based on the configuration file information.
For example, the pre-labeled field annotation information may be: in a node NodeA (component) states: the field data of the field outputA1 is an output data which can be referred to by other components, the field data of the declaration field outputA2 is an output data which can be referred to by other components, and outputA1 and outputA2 are assigned values during the business process; in a node NodeB (component) states: the data source of the field inputB1 is field data of a field outputA1 of a node NodeA, the field data of the field outputB1 is declared to be output data, and can be referred by other components, and in the service processing process, the value of the inputB1 is processed and assigned to the output putB 1; in a node NodeC (component) states: the data source of the field inputC1 is outputB1 of NodeB, the data source of the field inputC2 is outputA2 of NodeA, and during the service processing, the data processing is carried out on the inputC1 and the inputC2, and the values are assigned to the outputC 1. An executable graph constructed based on the noted field annotation information is shown in fig. 1-a.
S103, in response to the second target assembly being executed, determining a second output field of the second target assembly based on the preset data output identification information, and assigning the execution result data of the second target assembly to the second output field of the second target assembly.
After the above steps of obtaining the second input data from the first output field of the first target component in the executable graph, and executing the second target component based on the second input data, this step is configured to determine the second output field of the second target component based on the preset data output identification information, and assign the execution result data of the second target component to the second output field of the second target component, which may refer to "during the business process, the value of inputB1 is processed and assigned to output b 1" and "during the business process, the value of inputC1 and inputC2 is processed and assigned to output c 1" in the pre-labeled field annotation information. As shown in the user development phase of fig. 1-B, the user development phase includes the following: the user divides the business logic into components, develops the business logic of each component in an object-oriented mode, and declares the data source (data input identification information) of the field and declares the field as output data (identification information is output through the data). The expression that the data output identification information represents the data output identification information may be field annotation information pre-labeled by a user at a service development stage of the target service system, or configuration file information pre-set at the service development stage of the target service system.
As shown in "collect output data according to whether the field outputs data, and mark the component with complete dependency item as ready state" in the system execution diagram stage of fig. 1-B, after the component is executed, the system collects output data produced by the component for use by other components, and then the system starts to mark the state of other components dependent on the component, and if the dependency items of all the downstream components are completed, the component is determined to be ready state, and can be added into the prepared component list for execution. In this embodiment, after assigning the execution result data of the second target component to the second output field of the second target component in the above steps, the following process may be implemented in one of the following two ways:
in the first mode, the third input field of the third target component only includes the second output field of the second target component as a data source, specifically: determining that the third input data is from the second output field of the second target component based on the data source identification information of the third input field of the third target component in the executable graph; determining that a third target component is in a ready state in response to assigning the execution result data of the second target component to a second output field of the second target component; obtaining third input data from a second output field of a second target component; executing the third target component based on the third input data.
In a second manner, the third input field of the third target component may include a plurality of data sources, for example, two data sources, namely the second output field of the second target component and the fourth output field of the fourth target component, specifically: determining that the third input data is derived from the second output field of the second target component and the fourth output field of the fourth target component based on third data source identification information of a third input field of a third target component in the executable graph; determining that the third target component is in a ready state in response to the assigning of the execution result data of the second target component to the second output field of the second target component and the fourth output field being assigned; obtaining the third input data from a second output field of the second target component and a fourth output field of the fourth target component; executing the third target component based on the third input data.
For an online business system, the change of the business level is fast, the iteration efficiency required in the business operation process is high, and the requirement on the simplicity and the usability of the operation level is high, by implementing the data processing method based on the executable graph provided by the embodiment, the executable graph is constructed in a manner that a developer can understand and operate conveniently, for example, the developer marks the data dependency relationship (field annotation information) between the fields of each component when writing codes, or configures the data dependency relationship between the fields of each component through a configuration file, in the business execution stage, data transmission is performed through the data source identification information of the input field and the data output identification information of the output field of the component, and the input and output logic is clearer.
In the graph execution process of the executable graph, full asynchronous concurrent execution of the execution process of the service system can be realized based on the data dependency relationship of the field granularity of each component (the full asynchronous concurrent execution means that when a plurality of tasks are executed simultaneously, the execution completion of any task triggers the downstream task to start execution, thereby reducing the task scheduling gap, improving the utilization rate of system resources and further reducing the service delay). And data transmission at field level based on data dependency relationship is realized through preset identification information aiming at fields, such as data source identification information, data output identification information and the like, so that accurate and clear automatic access logic in the graph execution process is realized. Meanwhile, the method clearly defines that the input data and the output data of the components are divided by the fields through the input fields and the output fields, namely, the data dependency relationship among the components is represented through the field granularity, the data dependency relationship among the components is determined by the production consumption relationship among the input fields and the output fields of the components, and the use threshold of the graph execution process can be reduced while the composition process is simplified; and because the data dependency of the field granularity is clearer and clearer, each component can realize multiplexing, replacement and sharing, and the same component can be configured in a plurality of executable graphs, thereby improving the service iteration efficiency of the online service system.
A second embodiment of the present application provides a method for constructing an executable graph, as shown in a "system loading phase" in fig. 1-B, the method is applied to a business system loading phase (after a user development phase of a business system and before a business system execution phase), and the method corresponds to the executable graph-based data processing method provided in the first embodiment, and please refer to the first embodiment for details of implementation of the method. As shown in fig. 2, the method for constructing an executable graph provided in this embodiment includes the following steps:
s201, obtaining data dependency relationship information among fields of each component contained in the target business system.
Wherein the data dependency comprises: the data source identification information represents that the input data of the input field of each component is derived from the output fields of other components, and the data output identification information is used for identifying the output fields corresponding to the output data of each component. The data source identification information may be field annotation information pre-labeled by a user at a service development stage of the target service system, or may be configuration file information pre-set at the service development stage of the target service system. The data output identification information may also be field annotation information that is pre-labeled by a user at a service development stage of the target service system, or configuration file information that is pre-set at the service development stage of the target service system. The pre-annotated field annotation information is shown in fig. 1-a, the pre-set profile information is shown in fig. 1-B,
s202, constructing an executable graph corresponding to the target business system based on the data dependency relationship information.
According to the method for constructing the executable graph, the executable graph is constructed based on the data dependency relationship of each component in the field granularity, so that the full asynchronous concurrent execution of the execution process of the service system can be realized based on the data dependency relationship of the field granularity of each component in the graph execution process of the executable graph. And data transmission at field level based on data dependency relationship is realized through preset identification information aiming at fields, such as data source identification information, data output identification information and the like, so that accurate and clear automatic access logic in the graph execution process is realized. By implementing the method, the execution process of the business system is changed from most serial to full asynchronous concurrent execution (full asynchronous concurrent execution means that when a plurality of tasks are executed simultaneously, the execution completion of any task triggers the downstream task to start execution, thereby reducing the task scheduling gap, improving the utilization rate of system resources and further reducing the service delay). Meanwhile, the method clearly defines the input data and the output data of the components to be divided by the fields through the input fields and the output fields, namely, the data dependency among the components is represented through the field granularity, the data dependency among the components is determined by the production consumption relation among the input fields and the output fields of the components, and the use threshold of the graph execution process can be reduced while the composition process is simplified; and because the data dependency of the field granularity is clearer and clearer, each component can realize multiplexing, replacement and sharing, and the same component can be configured in a plurality of executable graphs, thereby improving the service iteration efficiency of the online service system.
In correspondence with the method provided in the first embodiment of the present application, a third embodiment of the present application provides a server for implementing the executable graph-based data processing method. As shown in fig. 3, the server includes: a processor 301; and a memory 302 for storing a program of the method, the apparatus performing the following steps after being powered on and running the program of the method by the processor:
reading an executable graph constructed for a target business system, and determining a second target component in the executable graph in a ready state;
acquiring second input data from a first output field of a first target component in the executable diagram based on data source identification information of a second input field of the second target component, and executing the second target component based on the second input data, wherein the data source identification information of the second input field characterizes that the second input data of the second input field of the second target component is derived from the first output field of the first target component;
and in response to the second target assembly being executed, determining a second output field of the second target assembly based on preset data output identification information, and assigning the execution result data of the second target assembly to the second output field of the second target assembly.
Optionally, the method further includes:
determining that third input data is derived from a second output field of a second target component based on data source identification information of a third input field of a third target component in the executable graph;
determining that the third target component is in a ready state in response to the assigning of the execution result data of the second target component to the second output field of the second target component;
obtaining the third input data from a second output field of the second target component;
executing the third target component based on the third input data.
Optionally, the method further includes:
determining that the third input data is derived from a second output field of the second target component and a fourth output field of a fourth target component based on data source identification information of a third input field of a third target component in the executable graph;
determining that the third target component is in a ready state in response to the assigning of the execution result data of the second target component to the second output field of the second target component and the fourth output field being assigned;
obtaining the third input data from a second output field of the second target component and a fourth output field of the fourth target component;
executing the third target component based on the third input data.
Optionally, the method further includes: the executable graph is constructed by:
acquiring data dependency relationship information among fields of all components contained in a target service system;
constructing an executable graph corresponding to the target business system based on the data dependency relationship information;
wherein the data dependency comprises: the data source identification information indicates that the input data of the input field of each component comes from the output fields of other components, and the data output identification information is used for identifying the output fields corresponding to the output data of each component.
Optionally, the data source identification information and/or the data output identification information includes:
annotating information in a pre-labeled field in a service development stage of the target service system; alternatively, the first and second electrodes may be,
and configuring file information preset in the service development stage of the target service system.
Optionally, the target service system is an online service system.
It should be noted that, for the detailed description of the server for implementing the data processing method based on the executable diagram provided in the third embodiment of the present application, reference may be made to the related description of the first embodiment of the present application, and details are not repeated here.
In accordance with a data processing method based on an executable graph provided in the first embodiment of the present application, a fourth embodiment of the present application provides a computer-readable storage medium storing a program of a data change response method, the program being executed by a processor to perform the steps of:
reading an executable graph constructed for a target business system, and determining a second target component in the executable graph in a ready state;
acquiring second input data from a first output field of a first target component in the executable diagram based on data source identification information of a second input field of the second target component, and executing the second target component based on the second input data, wherein the data source identification information of the second input field characterizes that the second input data of the second input field of the second target component is derived from the first output field of the first target component;
and in response to the second target assembly being executed, determining a second output field of the second target assembly based on preset data output identification information, and assigning the execution result data of the second target assembly to the second output field of the second target assembly.
Optionally, the method further includes:
determining that third input data is derived from a second output field of a second target component based on data source identification information of a third input field of a third target component in the executable graph;
determining that the third target component is in a ready state in response to the assigning of the execution result data of the second target component to the second output field of the second target component;
obtaining the third input data from a second output field of the second target component;
executing the third target component based on the third input data.
Optionally, the method further includes:
determining that the third input data is derived from a second output field of the second target component and a fourth output field of a fourth target component based on data source identification information of a third input field of a third target component in the executable graph;
determining that the third target component is in a ready state in response to the assigning of the execution result data of the second target component to the second output field of the second target component and the fourth output field being assigned;
obtaining the third input data from a second output field of the second target component and a fourth output field of the fourth target component;
executing the third target component based on the third input data.
Optionally, the method further includes: the executable graph is constructed by:
acquiring data dependency relationship information among fields of all components contained in a target service system;
constructing an executable graph corresponding to the target business system based on the data dependency relationship information;
wherein the data dependency comprises: the data source identification information represents that the input data of the input field of each component is derived from the output fields of other components, and the data output identification information is used for identifying the output fields corresponding to the output data of each component.
Optionally, the data source identification information and/or the data output identification information includes:
annotating information in a pre-labeled field in a service development stage of the target service system; alternatively, the first and second electrodes may be,
and configuring file information preset in the service development stage of the target service system.
Optionally, the target service system is an online service system.
It should be noted that, for the detailed description of the computer-readable storage medium provided in the fourth embodiment of the present application, reference may be made to the related description of the first embodiment of the present application, and details are not described here again.
Although the present application has been described with reference to the preferred embodiments, it is not intended to limit the present application, and those skilled in the art can make variations and modifications without departing from the spirit and scope of the present application, therefore, the scope of the present application should be determined by the claims that follow.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
1. Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage media, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include non-transitory computer readable media (transient media), such as modulated data signals and carrier waves.
2. As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Although the present application has been described with reference to the preferred embodiments, it is not intended to limit the present application, and those skilled in the art can make variations and modifications without departing from the spirit and scope of the present application, therefore, the scope of the present application should be determined by the claims that follow.
Claims (10)
1. An executable graph-based data processing method, comprising:
reading an executable graph constructed for a target business system, and determining a second target component in a ready state in the executable graph;
acquiring second input data from a first output field of a first target component in the executable diagram based on data source identification information of a second input field of the second target component, and executing the second target component based on the second input data, wherein the data source identification information of the second input field represents that the second input data of the second input field is derived from the first output field of the first target component;
and in response to the second target assembly being executed, determining a second output field of the second target assembly based on preset data output identification information, and assigning the execution result data of the second target assembly to the second output field of the second target assembly.
2. The method of claim 1, further comprising:
determining that third input data is derived from a second output field of a second target component based on data source identification information of a third input field of a third target component in the executable graph;
determining that the third target component is in a ready state in response to the assigning of the execution result data of the second target component to the second output field of the second target component;
obtaining the third input data from a second output field of the second target component;
executing the third target component based on the third input data.
3. The method of claim 1, further comprising:
determining that the third input data is derived from a second output field of the second target component and a fourth output field of a fourth target component based on data source identification information of a third input field of a third target component in the executable graph;
determining that the third target component is in a ready state in response to the assigning of the execution result data of the second target component to the second output field of the second target component and the fourth output field being assigned;
obtaining the third input data from a second output field of the second target component and a fourth output field of the fourth target component;
executing the third target component based on the third input data.
4. The method of claim 1, further comprising: the executable graph is constructed by:
acquiring data dependency relationship information among fields of all components contained in a target service system;
constructing an executable graph corresponding to the target business system based on the data dependency relationship information;
wherein the data dependency comprises: the data source identification information indicates that the input data of the input field of each component comes from the output fields of other components, and the data output identification information is used for identifying the output fields corresponding to the output data of each component.
5. The method according to any one of claims 1-4, wherein the data source identification information and/or the data output identification information comprises:
annotating information in a pre-labeled field in a service development stage of the target service system; alternatively, the first and second liquid crystal display panels may be,
and configuring file information preset in the service development stage of the target service system.
6. The method of claim 1, wherein the target business system is an online business system.
7. A method for building an executable graph, comprising:
acquiring data dependency relationship information among fields of all components contained in a target service system;
constructing an executable graph corresponding to the target business system based on the data dependency relationship information;
wherein the data dependency comprises: the data source identification information represents that the input data of the input field of each component is derived from the output fields of other components, and the data output identification information is used for identifying the output fields corresponding to the output data of each component.
8. The method of claim 7, wherein the data source identification information and/or the data output identification information comprises:
the method comprises the steps of pre-marking field annotation information in a service development stage; alternatively, the first and second electrodes may be,
and configuration file information preset in a service development stage.
9. A server for implementing model-code synchronization, comprising:
a processor; and
a memory for storing a model-code synchronization program, the server performing the method of any one of claims 1-8 upon powering on and running the program by the processor.
10. A computer-readable storage medium, in which a model-code synchronization program is stored, which is executed by a processor to perform the method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210288937.8A CN114840265A (en) | 2022-03-23 | 2022-03-23 | Data processing method based on executable graph |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210288937.8A CN114840265A (en) | 2022-03-23 | 2022-03-23 | Data processing method based on executable graph |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114840265A true CN114840265A (en) | 2022-08-02 |
Family
ID=82561543
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210288937.8A Pending CN114840265A (en) | 2022-03-23 | 2022-03-23 | Data processing method based on executable graph |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114840265A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101617292A (en) * | 2006-12-01 | 2009-12-30 | 莫雷克斯公司 | Programming and execution towards producer graph |
| CN105573836A (en) * | 2016-02-23 | 2016-05-11 | 中国农业银行股份有限公司 | Data processing method and device |
| CN113434527A (en) * | 2021-07-07 | 2021-09-24 | 北京京东振世信息技术有限公司 | Data processing method and device, electronic equipment and storage medium |
-
2022
- 2022-03-23 CN CN202210288937.8A patent/CN114840265A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101617292A (en) * | 2006-12-01 | 2009-12-30 | 莫雷克斯公司 | Programming and execution towards producer graph |
| CN105573836A (en) * | 2016-02-23 | 2016-05-11 | 中国农业银行股份有限公司 | Data processing method and device |
| CN113434527A (en) * | 2021-07-07 | 2021-09-24 | 北京京东振世信息技术有限公司 | Data processing method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107391527B (en) | Data processing method and device based on block chain | |
| CN106970921B (en) | Data migration method and device | |
| CN109670951B (en) | Block chain intelligent contract debugging and publishing method and system | |
| CN107341054B (en) | Task execution method and device and computer readable storage medium | |
| CN110262847B (en) | Application program starting acceleration method and device and machine-readable storage medium | |
| CN109947643B (en) | A/B test-based experimental scheme configuration method, device and equipment | |
| CN111736913B (en) | Class loading method and device | |
| CN110162573B (en) | Distributed sequence generation method, device and system | |
| CN109102200B (en) | Timed task processing method and device | |
| CN109829678B (en) | Rollback processing method and device and electronic equipment | |
| CN110019260B (en) | User data updating method and related equipment | |
| CN111651950B (en) | Generation method, equipment and medium of clock domain crossing time sequence constraint file | |
| CN104700255B (en) | Multi-process processing method, device and system | |
| CN108614697B (en) | Background Dex compiling control method and device | |
| CN113064676A (en) | Method for remote component sharing mechanism during front-end operation based on JS entrance | |
| CN109446271B (en) | Data synchronization method, device, equipment and medium | |
| US10901972B2 (en) | Table partition configuration method, apparatus and system for database system | |
| CN108536759B (en) | Sample playback data access method and device | |
| CN114840265A (en) | Data processing method based on executable graph | |
| CN110958138A (en) | Container expansion method and device | |
| CN110968406B (en) | Method, device, storage medium and processor for processing task | |
| CN107402749B (en) | Method and device for realizing picture loading library | |
| CN114416311A (en) | Method and device for managing message queue based on Go language | |
| CN115827028A (en) | System upgrading method and device, storage medium and electronic equipment | |
| CN114791884A (en) | Test environment construction method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |