CN115098093B - Data flow expression processing method and system - Google Patents
Data flow expression processing method and system Download PDFInfo
- Publication number
- CN115098093B CN115098093B CN202211017516.8A CN202211017516A CN115098093B CN 115098093 B CN115098093 B CN 115098093B CN 202211017516 A CN202211017516 A CN 202211017516A CN 115098093 B CN115098093 B CN 115098093B
- Authority
- CN
- China
- Prior art keywords
- flow
- node
- data
- query
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/34—Graphical or visual programming
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/35—Creation or generation of source code model driven
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Mathematical Physics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention relates to the technical field of data flow processing, and particularly discloses a data flow expression processing method and system. The embodiment of the invention constructs a business data processing flow consisting of a plurality of functional blocks by receiving the selection, arrangement and connection operation of a user; receiving a data stream request initiated by a user, identifying and verifying a service data processing flow, and generating a data stream processing instruction after the identification and verification are successful; performing node operation on the service data processing flow according to the data stream processing instruction to obtain a node operation result; and executing node query according to the node operation result, and finishing one-time dynamic data query in the operation database. A set of simple, easily-expandable, low-coupling and high-cohesion software functions can be designed through the programming thinking of abstract decoupling, codes in the traditional programming category are abstracted into various nodes and functional blocks, and an operator can finish a complex business data processing flow in a dragging mode.
Description
Technical Field
The invention belongs to the technical field of data flow processing, and particularly relates to a data flow expression processing method and system.
Background
The data flow is the whole process of data acquisition, input, processing and output. After the information original data is collected, it is inputted into computer system to make mode or statistical operation, or according to the special requirements of user a certain special program is programmed to process the data, then the result data is outputted. In the data flow processing process of an enterprise project, a series of logic information is usually included, the logic information has a mutually connected logic sequence or causal relationship, and in the construction and processing process, a non-technician is difficult to construct a complex self-defined business processing logic, so that the processing of corresponding business cannot be completed, and the working efficiency of the non-technician is influenced.
Disclosure of Invention
The embodiment of the invention aims to provide a data flow expression processing method and a data flow expression processing system, and aims to solve the problems in the background technology.
In order to achieve the above purpose, the embodiments of the present invention provide the following technical solutions:
a data flow expression processing method specifically comprises the following steps:
receiving selection, arrangement and connection operation of a user, and constructing a service data processing flow consisting of a plurality of functional blocks;
receiving a data stream request initiated by a user, identifying and verifying the service data processing flow, and generating a data stream processing instruction after the identification and verification are successful;
performing node operation on the service data processing flow according to the data stream processing instruction to obtain a node operation result;
and executing node query according to the node operation result, and finishing one-time dynamic data query in the operation database.
As a further limitation of the technical solution of the embodiment of the present invention, the receiving of the selection, arrangement, and connection operations of the user and the construction of the service data processing flow composed of a plurality of function blocks specifically includes the following steps:
receiving selection operation of a user and determining a plurality of function blocks;
receiving an arrangement operation of a user, and arranging a plurality of function blocks;
receiving a connection operation of a user, and connecting the function blocks;
and constructing a business data processing flow consisting of a plurality of functional blocks.
As a further limitation of the technical solution of the embodiment of the present invention, the receiving a data stream request initiated by a user, performing identification verification on the service data processing flow, and generating a data stream processing instruction after the identification verification is successful specifically includes the following steps:
receiving a data stream request initiated by a user;
performing expression base class identification on the service data processing flow according to the data flow request to generate identification information;
performing rationality verification on the service data processing flow according to the identification information to generate a verification result;
and according to the verification result, generating a data stream processing instruction after the verification is successful.
As a further limitation of the technical solution of the embodiment of the present invention, the performing node operation on the service data processing flow according to the data stream processing instruction to obtain a node operation result specifically includes the following steps:
entering a judgment node according to the data stream processing instruction, and determining the flow direction;
according to the flow trend, dynamically assigning values to corresponding variables at variable assignment nodes of the two branch flows;
and configuring query condition nodes, and forming the corresponding variables into an sql statement to obtain a node operation result.
As a further limitation of the technical solution of the embodiment of the present invention, the executing of the node query according to the node operation result and the completing of one dynamic data query in the operation database specifically include the following steps:
inquiring at an execution node, and generating an inquiry instruction according to the node operation result;
according to the query instruction, completing one-time dynamic data query in an operation database to obtain a data query result;
and generating and outputting result data according to the data query result.
A data flow expression processing system comprises a business flow construction unit, a flow identification verification unit, a flow node operation unit and a node query processing unit, wherein:
the business process construction unit is used for receiving selection, arrangement and connection operation of a user and constructing a business data processing process consisting of a plurality of functional blocks;
the flow identification and verification unit is used for receiving a data flow request initiated by a user, identifying and verifying the service data processing flow, and generating a data flow processing instruction after the identification and verification are successful;
the flow node operation unit is used for performing node operation on the service data processing flow according to the data stream processing instruction to obtain a node operation result;
and the node query processing unit is used for executing node query according to the node operation result and finishing one-time dynamic data query in the operation database.
As a further limitation of the technical solution of the embodiment of the present invention, the service flow construction unit specifically includes:
the selection processing module is used for receiving selection operation of a user and determining a plurality of functional blocks;
the arrangement processing module is used for receiving the arrangement operation of a user and arranging the functional blocks;
the connection processing module is used for receiving the connection operation of a user and connecting the functional blocks;
and the flow construction module is used for constructing a business data processing flow consisting of a plurality of functional blocks.
As a further limitation of the technical solution of the embodiment of the present invention, the flow identification and verification unit specifically includes:
a request receiving module, configured to receive a data stream request initiated by a user;
the base class identification module is used for carrying out expression base class identification on the service data processing flow according to the data flow request to generate identification information;
the reasonable verification module is used for performing reasonable verification on the business data processing flow according to the identification information to generate a verification result;
and the processing instruction generating module is used for generating a data stream processing instruction after the verification is successful according to the verification result.
As a further limitation of the technical solution of the embodiment of the present invention, the flow node operation unit specifically includes:
the node judgment module is used for entering a judgment node according to the data stream processing instruction and determining the flow direction;
the node assignment module is used for assigning nodes to the variables of the two branch flows according to the flow trend and dynamically assigning the nodes to the corresponding variables;
and the node configuration module is used for forming the corresponding variables into an sql statement to obtain a node operation result when the query condition nodes are configured.
As a further limitation of the technical solution of the embodiment of the present invention, the node query processing unit specifically includes:
the query instruction generating module is used for performing node query and generating a query instruction according to the node operation result;
the data query module is used for finishing one-time dynamic data query in the operation database according to the query instruction to obtain a data query result;
and the data output module is used for generating and outputting result data according to the data query result.
Compared with the prior art, the invention has the beneficial effects that:
the embodiment of the invention constructs a business data processing flow consisting of a plurality of functional blocks by receiving the selection, arrangement and connection operation of a user; receiving a data stream request initiated by a user, identifying and verifying a service data processing flow, and generating a data stream processing instruction after the identification and verification are successful; performing node operation on the service data processing flow according to the data stream processing instruction to obtain a node operation result; and executing node query according to the node operation result, and finishing one-time dynamic data query in the operation database. A set of simple, easily-expandable, low-coupling and high-cohesion software functions can be designed through the programming thinking of abstract decoupling, codes in the traditional programming category are abstracted into various nodes and functional blocks, an operator can finish a complex business data processing flow in a dragging mode, and a user can write rules according to a provided expression table and write expressions at will.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention.
Fig. 1 shows a flow chart of a method provided by an embodiment of the invention.
Fig. 2 shows a flowchart of a process flow for constructing data in the method provided by the embodiment of the present invention.
Fig. 3 shows a flowchart of processing flow identification verification in the method provided by the embodiment of the present invention.
Fig. 4 is a flowchart illustrating processing of flow node operations in the method according to the embodiment of the present invention.
Fig. 5 shows a flowchart of executing node query processing in the method provided by the embodiment of the present invention.
Fig. 6 shows an application architecture diagram of a system provided by an embodiment of the invention.
Fig. 7 shows a block diagram of a service flow building unit in the system according to the embodiment of the present invention.
Fig. 8 shows a block diagram of a flow identification verification unit in the system according to the embodiment of the present invention.
Fig. 9 is a block diagram illustrating a configuration of a flow node operation unit in the system according to the embodiment of the present invention.
Fig. 10 is a block diagram illustrating a structure of a node query processing unit in the system according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It can be understood that, in the prior art, a data flow processing process for an enterprise project generally includes a series of logic information, and the logic information has a linked logic sequence or a causal relationship, and in a building and processing process, it is difficult for a non-technical person to build a complex customized service processing logic, so that the non-technical person cannot complete processing of a corresponding service, and the work efficiency of the non-technical person is affected.
To solve the above problem, the embodiment of the present invention proposes the idea of "expression", which encapsulates the traditional code into one expression, and different expression types have focus points of respective functions, such as: variable expressions, constant expressions, and functional expressions, an expression being the smallest unit of operation of the entire data stream, just like a part of a machine. Various nodes which can be used in the data stream design process are composed of a plurality of expressions, and different functions can be completed. By abstracting codes in the traditional programming scope into various nodes and functional blocks, an operator can finish a complex business data processing flow in a dragging mode, and a core module of a flow processing program is an expression. Various algorithms and functions in the software industry can be built in as expressions, the api of a third party can be easily accessed by the driving of the nodes and the function blocks, and the self capacity is expanded. Through the programming thinking of abstract decoupling, a set of simple and easily-expandable software functional blocks with low coupling and high cohesion is designed, and theoretical no upper limit enhancement can be provided for the capacity of data streams.
Fig. 1 shows a flow chart of a method provided by an embodiment of the invention.
Specifically, a data flow expression processing method specifically includes the following steps:
and step S101, receiving selection, arrangement and connection operation of a user, and constructing a service data processing flow consisting of a plurality of function blocks.
In the embodiment of the present invention, during the actual use process, a user may discuss a process of analyzing a certain project service, the process of the project service may include a series of logic units (which may be subdivided into tasks), and the logic units have a logical order and a causal relationship that are connected to each other, the user may perform a selection operation in a dragging manner according to the corresponding logic units, determine a plurality of function blocks, perform an arrangement operation in the dragging manner, arrange the plurality of function blocks according to the logical order, perform a connection operation, connect the plurality of function blocks that have been arranged according to the causal relationship, and after completing the series of operations of selection, arrangement, and connection, construct a service data processing flow composed of the plurality of function blocks.
Specifically, fig. 2 shows a flowchart for constructing a data processing flow in the method provided by the embodiment of the present invention.
In an embodiment of the present invention, the receiving of the selection, arrangement, and connection operations of the user and the construction of the service data processing flow composed of a plurality of function blocks specifically includes the following steps:
in step S1011, a selection operation by the user is received, and a plurality of function blocks are determined.
Step S1012 is performed to receive a user' S operation for arranging the plurality of function blocks.
Step S1013, receiving a connection operation by a user, and connecting the plurality of function blocks.
Further, the data flow expression processing method further includes the following steps:
step S102, receiving a data flow request initiated by a user, identifying and verifying the service data processing flow, and generating a data flow processing instruction after the identification and verification are successful.
In the embodiment of the invention, a data stream request initiated by a user is received, expression base class identification is carried out on the service data processing flow according to the data stream request, identification information can be obtained, rationality verification is carried out on the service data processing flow according to the identification information, a verification result is generated, verification judgment is carried out according to the verification result, and if the verification judgment is successful, a data stream processing instruction is generated.
Specifically, the algorithm corresponding to the expression base class is as follows:
public abstract class ComputeUnitBase{
public string Id { get; set; } = string.Empty;
public virtual List<ComputeUnitBase> Children { get; set; } = new List<ComputeUnitBase> ();
public abstract Task
ComputeValue(DataFlowContext context)。
specifically, fig. 3 shows a flowchart of processing flow identification verification in the method provided in the embodiment of the present invention.
In a preferred embodiment provided by the present invention, the receiving a data stream request initiated by a user, performing identification verification on the service data processing flow, and after the identification verification is successful, generating a data stream processing instruction specifically includes the following steps:
step S1021, receiving a data stream request initiated by a user.
Step S1022, according to the data flow request, performing expression base class identification on the service data processing flow, and generating identification information.
And S1023, performing rationality verification on the service data processing flow according to the identification information to generate a verification result.
And step S1024, generating a data stream processing instruction after the verification is successful according to the verification result.
Further, the data flow expression processing method further includes the following steps:
step S103, according to the data flow processing instruction, performing node operation on the service data processing flow to obtain a node operation result.
In the embodiment of the invention, according to a data stream processing instruction, the data stream processing instruction enters a judgment node, the judgment node needs an expression of 'returning a Boolean value', so that the flow direction is determined, the flow enters two branches at the downstream, a dynamic value is assigned to a corresponding variable according to the 'assignment expression' in a variable assignment node, and then the 'assignment expression' is used again to form the corresponding variable into an sql statement in the downstream configured query condition node, so that the node operation result is obtained.
Specifically, the algorithm corresponding to the operator expression-return boolean is:
public class OperatorComputeUnit : ComputeUnitBase
public override Task 
ComputeValue (execution context)
return OperatorType switch
expressonoperatorrType. PLUS = > addition CompetilusValue (),
expressonoperatertype. Equal = > computeqvalue (),
..
Invoking
Return (new operator computeunit ()) ComputeValue (equal), return boolean type.
Constant expressions-algorithms for assignment correspondence are:
public class ConstantComputeUnit : ComputeUnitBase
public 
Value { get; set; }
public override Task 
ComputeValue (execution context)
if (Value == null) throw new ArgumentNullException(nameof(Value));
return Task.FromResult
(Value);
Assigned to variable
Set @parm = (new ConstantComputeUnit ).ComputeValue()。
Specifically, fig. 4 shows a flowchart for processing flow node operations in the method provided by the embodiment of the present invention.
In an embodiment of the present invention, the performing a node operation on the service data processing flow according to the data stream processing instruction to obtain a node operation result specifically includes:
and step S1031, entering a judgment node according to the data stream processing instruction, and determining the flow trend.
And step S1032, according to the flow trend, dynamically assigning values to corresponding variables at variable assignment nodes of the two branch flows.
Step S1033, when the query condition nodes are configured, the corresponding variables are composed into an sql statement to obtain the node operation result.
Further, the data flow expression processing method further includes the following steps:
and step S104, executing node query according to the node operation result, and finishing one-time dynamic data query in the operation database.
In the embodiment of the invention, node query is executed, a query instruction is generated according to a node operation result, data query is carried out on an operation database according to the query instruction, a data query result is generated, and then result data is generated according to the data query result and is output.
Specifically, fig. 5 shows a flowchart of executing node query processing in the method provided in the embodiment of the present invention.
In an embodiment of the present invention, the executing a node query according to the node operation result, and completing a dynamic data query in an operation database specifically includes the following steps:
and step S1041, inquiring the execution node, and generating an inquiry instruction according to the node operation result.
Step S1042, according to the query instruction, completing a dynamic data query in the operation database to obtain a data query result.
And S1043, generating and outputting result data according to the data query result.
Further, fig. 6 shows an application architecture diagram of the system provided by the embodiment of the present invention.
In another preferred embodiment, the present invention provides a data flow expression processing system, which includes:
the service flow construction unit 101 is configured to receive selection, arrangement, and connection operations of a user, and construct a service data processing flow composed of a plurality of function blocks.
In the embodiment of the present invention, a user may first discuss a process of analyzing a certain project service in an actual use process, the process of the project service may include a series of logic units (which may be subdivided into tasks), and the logic units have a logical order and a causal relationship that are connected to each other, the user may perform a selection operation in a dragging manner according to the corresponding logic units, determine a plurality of function blocks, perform an arrangement operation in the dragging manner, arrange the plurality of function blocks according to the logical order, perform a connection operation, connect the plurality of arranged function blocks according to the causal relationship, and after completing the series of operations of selection, arrangement, and connection, the service flow construction unit 101 constructs a service data processing flow composed of the plurality of function blocks.
Specifically, fig. 7 shows a block diagram of a structure of a business process constructing unit 101 in the system according to the embodiment of the present invention.
In an embodiment of the present invention, the business process constructing unit 101 specifically includes:
and a selection processing module 1011, configured to receive a selection operation of a user, and determine a plurality of function blocks.
An arrangement processing module 1012, configured to receive an arrangement operation of a user, and arrange a plurality of the function blocks.
And a connection processing module 1013 configured to receive a connection operation of a user and connect the plurality of function blocks.
A flow construction module 1014, configured to construct a business data processing flow composed of a plurality of the function blocks.
Further, the data flow expression processing system further includes:
the flow identification and verification unit 102 is configured to receive a data flow request initiated by a user, perform identification and verification on the service data processing flow, and generate a data flow processing instruction after the identification and verification are successful.
In the embodiment of the present invention, the flow identification verification unit 102 receives a data flow request initiated by a user, performs expression base class identification on a service data processing flow according to the data flow request, can obtain identification information, performs rationality verification on the service data processing flow according to the identification information, generates a verification result, performs verification judgment according to the verification result, and generates a data flow processing instruction if the verification is successful.
Specifically, fig. 8 shows a block diagram of the structure of the flow identification verification unit 102 in the system provided by the embodiment of the present invention.
In an embodiment of the present invention, the process identification and verification unit 102 specifically includes:
a request receiving module 1021, configured to receive a data stream request initiated by a user.
The base class identification module 1022 is configured to perform expression base class identification on the service data processing flow according to the data stream request, and generate identification information.
And the reasonable verification module 1023 is used for performing rationality verification on the service data processing flow according to the identification information to generate a verification result.
And a processing instruction generating module 1024, configured to generate a data stream processing instruction according to the verification result after the verification is successful.
Further, the data flow expression processing system further includes:
and the flow node operation unit 103 is configured to perform node operation on the service data processing flow according to the data stream processing instruction to obtain a node operation result.
In the embodiment of the present invention, the process node operation unit 103 enters a judgment node according to a data stream processing instruction, the judgment node needs an expression of "returning boolean value" to determine the flow direction, the flow enters two branches at the downstream, in a variable assignment node, a dynamic value is assigned to a corresponding variable according to the "assignment expression", and then in a downstream configured query condition node, the "assignment expression" is used again to form the corresponding variable into an sql statement, so as to obtain a node operation result.
Specifically, fig. 9 shows a block diagram of a flow node operation unit 103 in the system according to the embodiment of the present invention.
In a preferred embodiment provided by the present invention, the flow node operation unit 103 specifically includes:
and a node judgment module 1031, configured to enter a judgment node according to the data stream processing instruction, and determine a flow direction.
And the node assignment module 1032 is used for assigning the nodes to the variables of the two branch flows dynamically according to the flow trend.
A node configuration module 1033, configured to configure the query condition node, and form the corresponding variable into an sql statement to obtain a node operation result.
Further, the data flow expression processing system further includes:
and the node query processing unit 104 is configured to execute node query according to the node operation result, and complete a dynamic data query in the operation database.
In the embodiment of the present invention, the node query processing unit 104 performs node query, generates a query instruction according to the node operation result, performs data query on the operation database according to the query instruction, and generates a data query result, and the node query processing unit 104 generates result data according to the data query result, and outputs the result data.
Specifically, fig. 10 shows a block diagram of a structure of the node query processing unit 104 in the system according to the embodiment of the present invention.
In an embodiment of the present invention, the node query processing unit 104 specifically includes:
and a query instruction generating module 1041, configured to perform a node query, and generate a query instruction according to the node operation result.
The data query module 1042 is configured to complete a dynamic data query on the operation database according to the query instruction, so as to obtain a data query result.
And a data output module 1043, configured to generate and output result data according to the data query result.
In summary, the embodiment of the present invention can design a set of simple, easily expandable, low-coupling and high-cohesion software functions through the abstract decoupled programming thinking, and abstract the codes in the traditional programming category into various nodes and functional blocks, so that an operator can complete a complex business data processing flow in a dragging manner, and a user can write a rule according to a provided expression table and self-define and write an expression.
It should be understood that, although the steps in the flowcharts of the embodiments of the present invention are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of steps in various embodiments may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed alternately or alternatingly with other steps or at least a portion of sub-steps or stages of other steps.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the program is executed. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), rambus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is specific and detailed, but not to be understood as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (7)
1. A data flow expression processing method is characterized by specifically comprising the following steps:
receiving selection, arrangement and connection operation of a user, and constructing a service data processing flow consisting of a plurality of functional blocks;
receiving a data stream request initiated by a user, identifying and verifying the service data processing flow, and generating a data stream processing instruction after the identification and verification are successful;
performing node operation on the service data processing flow according to the data stream processing instruction to obtain a node operation result;
specifically, according to a data stream processing instruction, entering a judgment node, determining the flow direction by the judgment node needing an expression for returning a Boolean value, entering the flow into two branches at the downstream, assigning a dynamic value to a corresponding variable according to an assignment expression in a variable assignment node, and further forming the corresponding variable into an sql statement by using the assignment expression again in a downstream configuration query condition node to obtain a node operation result;
according to the node operation result, node query is executed, and one-time dynamic data query is completed in an operation database; the receiving a data stream request initiated by a user, performing identification verification on the service data processing flow, and after the identification verification is successful, generating a data stream processing instruction specifically includes the following steps:
receiving a data flow request initiated by a user;
performing expression base class identification on the service data processing flow according to the data flow request to generate identification information;
performing rationality verification on the service data processing flow according to the identification information to generate a verification result;
and according to the verification result, generating a data stream processing instruction after the verification is successful.
2. The data flow expression processing method according to claim 1, wherein the receiving of the selection, arrangement, and connection operations of the user to construct a service data processing flow composed of a plurality of function blocks specifically includes the steps of:
receiving selection operation of a user and determining a plurality of function blocks;
receiving an arrangement operation of a user, and arranging a plurality of function blocks;
receiving a connection operation of a user, and connecting the function blocks;
and constructing a business data processing flow consisting of a plurality of functional blocks.
3. The data flow expression processing method of claim 1, wherein the executing of the node query according to the node operation result and the completing of a dynamic data query in the operation database specifically include the following steps:
inquiring at an execution node, and generating an inquiry instruction according to the node operation result;
according to the query instruction, completing one-time dynamic data query in an operation database to obtain a data query result;
and generating and outputting result data according to the data query result.
4. A data flow expression processing system is characterized in that the system comprises a business flow construction unit, a flow identification verification unit, a flow node operation unit and a node query processing unit, wherein:
the business process construction unit is used for receiving selection, arrangement and connection operation of a user and constructing a business data processing process consisting of a plurality of functional blocks;
the flow identification and verification unit is used for receiving a data flow request initiated by a user, identifying and verifying the service data processing flow, and generating a data flow processing instruction after the identification and verification are successful;
the flow node operation unit is used for performing node operation on the service data processing flow according to the data stream processing instruction to obtain a node operation result;
specifically, the flow node operation unit enters a judgment node according to a data stream processing instruction, the judgment node needs an expression for returning a Boolean value so as to determine the flow direction, the flow enters two branches at the downstream, a dynamic value is assigned to a corresponding variable according to the assignment expression in the variable assignment node, and then the assignment expression is used again to form the corresponding variable into an sql statement in the downstream configured query condition node to obtain a node operation result;
the node query processing unit is used for executing node query according to the node operation result and finishing one-time dynamic data query in the operation database;
the flow identification verification unit specifically includes:
a request receiving module, configured to receive a data stream request initiated by a user;
the base class identification module is used for carrying out expression base class identification on the service data processing flow according to the data flow request to generate identification information;
the reasonable verification module is used for performing reasonable verification on the business data processing flow according to the identification information to generate a verification result;
and the processing instruction generating module is used for generating a data stream processing instruction after the verification is successful according to the verification result.
5. The data flow expression processing system of claim 4, wherein the business flow construction unit specifically includes:
the selection processing module is used for receiving selection operation of a user and determining a plurality of functional blocks;
the arrangement processing module is used for receiving the arrangement operation of a user and arranging the functional blocks;
the connection processing module is used for receiving the connection operation of a user and connecting the functional blocks;
and the flow construction module is used for constructing a business data processing flow consisting of a plurality of functional blocks.
6. The data flow expression processing system of claim 5, wherein the flow node operation unit specifically includes:
the node judgment module is used for entering a judgment node according to the data stream processing instruction and determining the flow direction;
the node assignment module is used for assigning nodes to the variables of the two branch flows according to the flow trend and dynamically assigning the nodes to the corresponding variables;
and the node configuration module is used for forming the corresponding variables into an sql statement to obtain a node operation result when the query condition nodes are configured.
7. The data flow expression processing system of claim 6, wherein the node query processing unit specifically includes:
the query instruction generating module is used for querying the execution node and generating a query instruction according to the node operation result;
the data query module is used for finishing one-time dynamic data query in the operation database according to the query instruction to obtain a data query result;
and the data output module is used for generating and outputting result data according to the data query result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211017516.8A CN115098093B (en) | 2022-08-24 | 2022-08-24 | Data flow expression processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211017516.8A CN115098093B (en) | 2022-08-24 | 2022-08-24 | Data flow expression processing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115098093A CN115098093A (en) | 2022-09-23 |
| CN115098093B true CN115098093B (en) | 2022-12-02 |
Family
ID=83301206
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211017516.8A Active CN115098093B (en) | 2022-08-24 | 2022-08-24 | Data flow expression processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115098093B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101821710A (en) * | 2007-09-11 | 2010-09-01 | 西安姆贝拉有限公司 | System, method and graphical user interface for workflow generation, deployment and/or execution |
| CN109447406A (en) * | 2018-09-20 | 2019-03-08 | 武汉达梦数据库有限公司 | A kind of method of visioning procedure and the device of visioning procedure |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106022568A (en) * | 2016-05-09 | 2016-10-12 | 福建南威软件有限公司 | Workflow processing method and apparatus |
| JP2019148859A (en) * | 2018-02-26 | 2019-09-05 | 株式会社日立製作所 | Device and method supporting discovery of design pattern in model development environment using flow diagram |
| US20190370407A1 (en) * | 2018-05-30 | 2019-12-05 | Ab Initio Technology Llc | Systems and methods for dataflow graph optimization |
| CN113360365B (en) * | 2020-03-03 | 2024-04-05 | 北京同邦卓益科技有限公司 | Flow test method and flow test system |
| WO2022056735A1 (en) * | 2020-09-16 | 2022-03-24 | 深圳晶泰科技有限公司 | Cloud high-performance scientific calculation workflow design control system and graphical user interface |
| CN113094776B (en) * | 2021-04-19 | 2022-05-03 | 城云科技（中国）有限公司 | Method and system for constructing visual component model data and electronic equipment |
| CN113535129A (en) * | 2021-07-02 | 2021-10-22 | 张洋 | Method and system for programming over-program nodes |
| CN114048720A (en) * | 2021-11-10 | 2022-02-15 | 伙伴智慧(北京)信息技术有限公司 | Workflow engine depending on form |
| CN114089986A (en) * | 2021-11-23 | 2022-02-25 | 浩云科技股份有限公司 | Method, system, device and medium for configuring low code development platform function expression |
| CN114860221A (en) * | 2022-04-24 | 2022-08-05 | 福建财通信息科技有限公司 | Workflow engine and implementation method thereof |
-
2022
- 2022-08-24 CN CN202211017516.8A patent/CN115098093B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101821710A (en) * | 2007-09-11 | 2010-09-01 | 西安姆贝拉有限公司 | System, method and graphical user interface for workflow generation, deployment and/or execution |
| CN109447406A (en) * | 2018-09-20 | 2019-03-08 | 武汉达梦数据库有限公司 | A kind of method of visioning procedure and the device of visioning procedure |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115098093A (en) | 2022-09-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7487115B2 (en) | System and method for data flow graph optimization - Patents.com | |
| US9569189B2 (en) | Computer-aided parallelizing of computation graphs | |
| JP2011150503A (en) | Parallel distributed processing method and computer system | |
| US10262077B2 (en) | Systems and methods for pattern matching and relationship discovery | |
| CN103078941A (en) | Task scheduling method and system for distributed computing system | |
| CN106991100B (en) | Data import method and device | |
| CN110058853B (en) | API (application program interface) flow method based on workflow and authority control | |
| Van Hee et al. | Soundness of resource-constrained workflow nets | |
| CN104423968A (en) | Method of designing business logic, server performing the same and storage medium storing the same | |
| CN104615703A (en) | RDF data distributed parallel inference method combined with Rete algorithm | |
| CN109189393A (en) | Method for processing business and device | |
| CN114035978A (en) | Service arrangement processing method and device based on micro-service architecture | |
| CN110275703B (en) | Method and device for assigning key value to data, computer equipment and storage medium | |
| CN115098093B (en) | Data flow expression processing method and system | |
| CN113052696B (en) | Financial business task processing method, device, computer equipment and storage medium | |
| CN113986206A (en) | Plug-in loading system construction method, plug-in loading system and computing equipment | |
| Lorenz et al. | Synthesis of petri nets from finite partial languages | |
| CN115965065A (en) | Model calculation method, device and equipment | |
| CN113703739B (en) | Cross-language fusion calculation method, system and terminal based on omiga engine | |
| Bouchekir et al. | Learning-based symbolic assume-guarantee reasoning for Markov decision process by using interval Markov process | |
| CN110851178B (en) | Inter-process program static analysis method based on distributed graph reachable computation | |
| CN114118811A (en) | Service code generation method, service code execution method, service code generation device, service code execution equipment and storage medium | |
| Martin et al. | Definition of the DISPEL Language | |
| Alfieri et al. | Minimum cost multi-product flow lines | |
| Zečević et al. | A Parallelizable Algorithm for Stabilizing Large Sparse Linear Systems With Uncertain Interconnections |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |