CN118260075A - Data processing method, apparatus, computer device, readable storage medium, and product - Google Patents

Data processing method, apparatus, computer device, readable storage medium, and product Download PDF

Info

Publication number
CN118260075A
CN118260075A CN202410342726.7A CN202410342726A CN118260075A CN 118260075 A CN118260075 A CN 118260075A CN 202410342726 A CN202410342726 A CN 202410342726A CN 118260075 A CN118260075 A CN 118260075A
Authority
CN
China
Prior art keywords
service
execution
node
result
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202410342726.7A
Other languages
Chinese (zh)
Inventor
李佳翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Construction Bank Corp
CCB Finetech Co Ltd
Original Assignee
China Construction Bank Corp
CCB Finetech Co Ltd
Filing date
Publication date
Application filed by China Construction Bank Corp, CCB Finetech Co Ltd filed Critical China Construction Bank Corp
Publication of CN118260075A publication Critical patent/CN118260075A/en
Pending legal-status Critical Current

Links

Abstract

The application relates to a data processing method, a data processing device, computer equipment, a readable storage medium and a product, and relates to the technical field of big data processing. The method comprises the following steps: responding to a data processing instruction aiming at a target service, and constructing a service frame corresponding to the target service; based on the service requirement corresponding to the target service, splitting out a service node corresponding to the service requirement in a service framework; carrying out service parameter configuration on the service node to obtain a parameter configuration result; based on the parameter configuration result, executing the node task corresponding to the service node to obtain an execution result; and the execution result is used for displaying the target service. By adopting the method, the efficiency of data display can be improved.

Description

Data processing method, apparatus, computer device, readable storage medium, and product
Technical Field
The present application relates to the field of big data technology, and in particular, to a data processing method, apparatus, computer device, readable storage medium, and product.
Background
At present, with the continuous development and popularization of the internet, the service data of the internet are increasingly in geometric scale, so as to meet the requirements of enterprise management and decision making, the data processing of a large amount of service data is increasingly important, and especially for the display of data, the efficient data display can provide view assistance for the future development and management decision making of enterprises.
At present, a developer writes codes to realize data presentation, however, the traditional development mode needs a series of steps from no to some for the developer, and has large writing workload and high writing difficulty, so that the efficiency of data presentation is low.
Disclosure of Invention
In view of the foregoing, it is desirable to provide a data processing method, apparatus, computer device, computer-readable storage medium, and computer program product that can improve data presentation efficiency.
In a first aspect, the present application provides a data processing method. The method comprises the following steps: responding to a data processing instruction aiming at a target service, and constructing a service frame corresponding to the target service; based on the service requirement corresponding to the target service, splitting out a service node corresponding to the service requirement in a service framework; carrying out service parameter configuration on the service node to obtain a parameter configuration result; based on the parameter configuration result, executing the node task corresponding to the service node to obtain an execution result; and the execution result is used for displaying the target service.
In one embodiment, based on the parameter configuration result, executing the node task corresponding to the service node to obtain an execution result, including: the parameter configuration result is sent to a preset controller, and the parameter configuration result is aggregated through the preset controller to generate an execution list; acquiring list information corresponding to the execution list through the target executor, and executing node tasks corresponding to the service nodes on the premise that the list information meets the execution conditions to obtain an execution result.
In one embodiment, the number of service nodes is multiple, and the parameter configuration result includes an execution rule and an execution mode; executing the node task corresponding to the service node to obtain an execution result, including: based on the execution rule, sequencing each service node through a target executor to obtain an execution sequence corresponding to each service node; and executing the node tasks corresponding to each service node according to the execution sequence and the execution mode to obtain an execution result.
In one embodiment, the execution mode comprises covering and adding; according to the execution sequence and the execution mode, executing the node task corresponding to each service node to obtain an execution result, including: repeatedly executing node tasks corresponding to the service nodes according to the execution sequence under the condition that the execution mode of the service nodes is coverage; acquiring a history execution task corresponding to the service node under the condition that the execution mode of the service node is additional; and stopping historical execution tasks, and re-executing node tasks corresponding to the service nodes according to the execution sequence.
In one embodiment, before the step of acquiring the list information corresponding to the execution list by the target executor, the method further includes: acquiring a list identifier corresponding to an execution list and an actuator identifier corresponding to a candidate actuator; comparing the list identifier with the actuator identifier to obtain an identifier comparison result; and screening target actuators from the candidate actuators based on the identification comparison result.
In one embodiment, after the step of obtaining the execution result, the method further includes: storing the execution result into a specified database; under the condition that a display instruction aiming at a target service is received, selecting a target result corresponding to the display instruction from execution results stored in a designated database; displaying a target result based on a preset display form; the preset display form comprises a report.
In a second aspect, the application further provides a data processing device. The device comprises: the frame construction module is used for responding to the data processing instruction aiming at the target service and constructing a service frame corresponding to the target service; the node splitting module is used for splitting service nodes corresponding to the service demands in the service framework based on the service demands corresponding to the target service; the parameter configuration module is used for carrying out service parameter configuration on the service node to obtain a parameter configuration result; the execution module is used for executing the node task corresponding to the service node based on the parameter configuration result to obtain an execution result; and the execution result is used for displaying the target service.
In one embodiment, the parameter configuration module further comprises: the list generation module is used for sending the parameter configuration result to a preset controller, and aggregating the parameter configuration result through the preset controller to generate an execution list; and the execution sub-module is used for acquiring list information corresponding to the execution list through the target executor, and executing node tasks corresponding to the service nodes on the premise that the list information meets the execution conditions to obtain an execution result.
In one embodiment, the number of service nodes is a plurality; the parameter configuration result comprises an execution rule and an execution mode; the execution sub-module further includes: the sequencing module is used for sequencing each service node through the target executor based on the execution rule to obtain the execution sequence corresponding to each service node; and the execution subunit is used for executing the node tasks corresponding to the service nodes according to the execution sequence and the execution mode to obtain an execution result.
In one embodiment, the execution mode comprises covering and adding; the execution subunit is further configured to: repeatedly executing node tasks corresponding to the service nodes according to the execution sequence under the condition that the execution mode of the service nodes is coverage; acquiring a history execution task corresponding to the service node under the condition that the execution mode of the service node is additional; and stopping historical execution tasks, and re-executing node tasks corresponding to the service nodes according to the execution sequence.
In one embodiment, the apparatus is further configured to: acquiring a list identifier corresponding to an execution list and an actuator identifier corresponding to a candidate actuator; comparing the list identifier with the actuator identifier to obtain an identifier comparison result; and screening target actuators from the candidate actuators based on the identification comparison result.
In one embodiment, the apparatus is further configured to: storing the execution result into a specified database; under the condition that a display instruction aiming at a target service is received, selecting a target result corresponding to the display instruction from execution results stored in a designated database; displaying a target result based on a preset display form; the preset display form comprises a report.
In a third aspect, the present application also provides a computer device. The computer device comprises a memory storing a computer program and a processor which when executing the computer program performs the steps of: responding to a data processing instruction aiming at a target service, and constructing a service frame corresponding to the target service; based on the service requirement corresponding to the target service, splitting out a service node corresponding to the service requirement in a service framework; carrying out service parameter configuration on the service node to obtain a parameter configuration result; based on the parameter configuration result, executing the node task corresponding to the service node to obtain an execution result; and the execution result is used for displaying the target service.
In a fourth aspect, the present application also provides a computer-readable storage medium. A computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of: responding to a data processing instruction aiming at a target service, and constructing a service frame corresponding to the target service; based on the service requirement corresponding to the target service, splitting out a service node corresponding to the service requirement in a service framework; carrying out service parameter configuration on the service node to obtain a parameter configuration result; based on the parameter configuration result, executing the node task corresponding to the service node to obtain an execution result; and the execution result is used for displaying the target service.
In a fifth aspect, the present application also provides a computer program product. Computer program product comprising a computer program which, when executed by a processor, realizes the steps of: responding to a data processing instruction aiming at a target service, and constructing a service frame corresponding to the target service; based on the service requirement corresponding to the target service, splitting out a service node corresponding to the service requirement in a service framework; carrying out service parameter configuration on the service node to obtain a parameter configuration result; based on the parameter configuration result, executing the node task corresponding to the service node to obtain an execution result; and the execution result is used for displaying the target service.
According to the data processing method, the device, the computer equipment, the computer readable storage medium and the computer program product, firstly, when a data processing instruction for a target service is received, a service frame corresponding to the target service is constructed, service nodes corresponding to the service requirements are split in the service frame based on the service requirements corresponding to the target service, and subsequent targeted parameter configuration is facilitated by splitting the service nodes, so that the efficiency of parameter configuration is improved. And performing service parameter configuration on the service node obtained by splitting to obtain a parameter configuration result, and executing a node task corresponding to the service node based on the parameter configuration result to obtain an execution result corresponding to the service node, wherein the execution result is used for displaying the target service. Therefore, compared with the prior art that the service data is displayed in a traditional development mode, the method and the device for displaying the service data in the network node split mode, so that the service nodes meeting the service requirements are subjected to parameter configuration and executed, the display of the target service is completed, the data processing is not required to be carried out on the service data of the whole target service, the data processing efficiency is effectively improved, and the service data displaying efficiency is further improved. For subsequent data maintenance, only relevant data corresponding to the service node is required to be maintained, so that the maintenance workload is greatly reduced, and the maintenance efficiency is improved.
Drawings
FIG. 1 is a schematic diagram of an application scenario of a data processing method in one embodiment;
FIG. 2 is a flow diagram of a data processing method in one embodiment;
FIG. 3 is a flow diagram of an executing service node in one embodiment;
FIG. 4 is a flow diagram of a service node according to an execution sequence and an execution manner in one embodiment;
FIG. 5 is a schematic flow diagram of an embodiment in which the execution mode is an overlay and an add-down execution service node, respectively;
FIG. 6 is a flow diagram of a screening target actuator in one embodiment;
FIG. 7 is a flow chart illustrating storing and displaying execution results in one embodiment;
FIG. 8 is a flow chart illustrating a data processing method in one embodiment;
FIG. 9 is another diagram of a data processing method in one embodiment;
FIG. 10 is a block diagram of a data processing apparatus in one embodiment;
FIG. 11 is an internal block diagram of a computer device in one embodiment.
Detailed Description
The user information (including but not limited to user equipment information, user personal information, etc.) and the data (including but not limited to data for analysis, stored data, presented data, etc.) related to the present application are information and data authorized by the user or sufficiently authorized by each party.
The present application will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present application more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.
At present, with the continuous development and popularization of the internet, the service data of the internet are increasingly in geometric scale, so as to meet the requirements of enterprise management and decision making, the data processing of a large amount of service data is increasingly important, and especially for the display of data, the efficient data display can provide view assistance for the future development and management decision making of enterprises. Currently, it is common for developers to write code such as ETL (Extract-Transform-Load), develop it,To extracting data from different data sources (such as database systems or file systems), cleaning, converting and processing, and finally loading into a target data warehouse to realize the presentation of the data. However, this conventional development mode is relatively open and irregular, and requires a series of steps from scratch for a developer to be implemented, i.e., first creating an ETL script program according to the service requirements, then implementing the non-service requirements of the script program, such as logging, listening, scheduling, etc., and implementing the development of the service requirements of the script program, finally configuring the scheduling and rendering the final result to be presented to the front end. The process is large in writing workload and high in writing difficulty, so that the efficiency of data display is low, and the maintenance difficulty of subsequent data is further increased.
The data processing method provided by the embodiment of the disclosure can be applied to an application environment as shown in fig. 1. Including a server 102, a controller 104, an actuator 106, and a terminal 108, the server 102 being in communication with the controller 104 and the terminal 104, respectively. Specifically, the server 102 responds to a data processing instruction sent by the terminal 108 and aiming at a target service, constructs a service frame corresponding to the target service, splits a service node corresponding to the service requirement in the service frame based on the service requirement corresponding to the target service, configures service parameters of the service node to obtain a parameter configuration result, and finally executes a node task corresponding to the service node based on the parameter configuration result to obtain an execution result corresponding to the service node, wherein the execution result is used for displaying the target service.
In an embodiment, the server 102 sends the parameter configuration result to the controller 104, and the controller 104 aggregates the parameter configuration result to generate the execution list.
In an embodiment, the executor 106 monitors the execution list generated on the controller 104 in real time, and executes the node task corresponding to each service node in the execution list on the premise that the list information meets the execution condition, so as to obtain an execution result.
The server 102 may be implemented by a stand-alone server or a server cluster formed by a plurality of servers, and the terminal 104 may be, but is not limited to, various desktop computers, notebook computers, smart phones, tablet computers, and internet of things devices.
In one embodiment, as shown in fig. 2, a data processing method is provided, and the method is applied to the server 102 in fig. 1 for illustration, and includes the following steps:
Step S202, responding to the data processing instruction aiming at the target service, and constructing a service frame corresponding to the target service.
The target service may refer to a service that needs to perform data processing and data display, such as a deposit service, a expenditure service, a profit statistics service, an employee assessment service, and the like. The data processing instructions may refer to instructions for performing data processing on the target service to perform service presentation. The service framework may be called a service unit, where the service framework defines a service composition structure of the target service, and the service unit may include at least one service node.
Specifically, when receiving a data processing instruction for a target service to be displayed, the server may first obtain a service composition structure of the target service, and construct a service framework of the target service according to the service composition structure.
In one embodiment, the business frame may be named, and the naming may be set based on a preset presentation, for example, the preset presentation is a report, and then the business frame of the target business may be named as report a.
In an embodiment, after the server creates the service frame of the target service, the server may further perform parameter configuration on the service frame, where the parameter configuration may be that a frame parameter corresponding to the service frame may be referred to as a unit parameter, and the configured frame parameter may include, but is not limited to, an execution frequency corresponding to the service frame, the number of service nodes executable in the service frame, and an execution dependency corresponding to the service frame, where the execution dependency corresponding to the service frame refers to an association relationship between the service frame and other service frames when the service frame is executed. The parameters specifically configured for the service framework may be set according to practical situations, and are not limited herein.
Step S204, based on the service requirement corresponding to the target service, the service node corresponding to the service requirement is split in the service framework.
The service requirement may refer to a condition that the target service needs to meet when displaying, such as an index, display content, and display layout that need to be displayed in a subsequent display process. A service node may refer to each node in a service framework that meets service requirements.
Specifically, after the service frame of the target service is created, the server can further obtain the condition that the target service needs to meet when displaying, namely, the service requirement, so that the service node corresponding to the service requirement is split in the service frame according to the service requirement.
In an embodiment, the service requirement of the target service may be carried by a data processing instruction, that is, when the server receives the data processing instruction of the target service, the server may parse the data processing instruction to obtain the service requirement carried by the data processing instruction.
In one embodiment, each service node may be named and naming rules may be combined with the naming of the service framework, such as node A-1, node A-2.
Step S206, carrying out service parameter configuration on the service node to obtain a parameter configuration result.
The parameter configuration result may refer to a result obtained after the node parameter of the service node is configured, including, but not limited to, an execution rule and an execution manner.
Specifically, after the server splits the service node corresponding to the service requirement, it detects whether the service node needs to perform parameter configuration, if so, the server configures the execution rule parameter and the execution mode parameter of the service node to obtain the execution rule and the execution mode corresponding to the service node.
In an embodiment, if the service node does not need to perform parameter configuration, a subsequent execution step may be directly performed, that is, a node task corresponding to the service node is executed.
In an embodiment, whether the service node needs to perform parameter configuration can be determined through a parameter configuration field, for example, in the parameter configuration field, if the field content is yes, it is indicated that the service node does not need to perform parameter configuration, and if the field content is yes, it is indicated that the service node needs to perform parameter configuration.
Step S208, based on the parameter configuration result, executing the node task corresponding to the service node to obtain the execution result corresponding to the service node.
The execution result is used for displaying the target service, and it can be understood that the execution result can exist in a specific data form or in other forms, and after the target executor obtains the execution result, the execution result can be stored in a specified database so as to be convenient for later calling the execution result from the database to realize the display of the target service. Node tasks may refer to tasks corresponding to service nodes. For example, the node task of the node a-1 may be to count a certain index, and the specific node task may be set according to the actual situation, which is not limited herein.
Specifically, after completing parameter configuration of the service node and obtaining a corresponding parameter configuration result, the server executes a node task corresponding to the service node based on the parameter configuration results, thereby obtaining an execution result corresponding to the service node.
In an embodiment, the server may send the parameter configuration results to a preset controller, the preset controller generates an execution list corresponding to the parameter configuration results, and under the condition that the target executor monitors the execution list generated by the preset controller, based on the parameter configuration results, the node tasks corresponding to the service nodes in the execution list are executed, so as to obtain the execution result.
In an embodiment, there may be a correspondence between the target executor and the execution list.
In this embodiment, first, when a server receives a data processing instruction for a target service, a service frame corresponding to the target service is constructed, and service nodes corresponding to the service requirements are split in the service frame based on service requirements corresponding to the target service, and by splitting the service nodes, subsequent targeted parameter configuration is facilitated, so that efficiency of parameter configuration is improved, and the nodes can be flexibly increased and reduced and have strong expandability. The method comprises the steps of carrying out service parameter configuration on service nodes obtained through splitting to obtain a parameter configuration result, executing node tasks corresponding to the service nodes by a target executor based on the parameter configuration result to obtain an execution result corresponding to the service nodes, wherein the execution result is used for displaying target services. Therefore, compared with the prior art that the service data is displayed in a traditional development mode, the method and the device for displaying the service data in the network node split mode, the service nodes are split to perform parameter configuration and execution on the nodes meeting service requirements, so that the display of the target service is completed, the data processing of the service data of the whole target service is not needed, the data processing steps are simplified, the data processing efficiency is effectively improved, and the service data displaying efficiency is further improved. For subsequent data maintenance, only relevant data corresponding to the service node is required to be maintained, so that the maintenance workload is greatly reduced, and the maintenance efficiency is improved.
In an embodiment, as shown in fig. 3, based on a parameter configuration result, executing a node task corresponding to a service node to obtain an execution result corresponding to the service node, including:
Step S302, the parameter configuration result is sent to a preset controller, and the parameter configuration result is aggregated through the preset controller to generate an execution list.
The preset controller is equivalent to an intermediate device, can be used for data transfer between the server and the target executor, and is mainly used for integrating parameter configuration results obtained by the server into an execution list, and the target executor monitors the execution list in real time. Compared with direct point-to-point transmission, the method has the advantages that the phenomenon of transmission delay and the like caused by network congestion, bandwidth limitation and the like can be avoided by adding one intermediate device, so that the stability and the reliability of parameter configuration result transmission are ensured, and the stability and the reliability of subsequent target service display are further ensured. The execution list may refer to a list in which service nodes and parameter configuration results corresponding to the service nodes are recorded.
Specifically, the server sends the obtained parameter configuration result to a pre-established controller, the sending can be completed through a preset registration control or registration instruction, and after the preset controller receives the parameter configuration result, the parameter configuration result and the corresponding service node are aggregated to obtain an execution list containing the service node and the parameter configuration result corresponding to the service node. The execution list may be used for subsequent node task execution.
Step S304, acquiring list information corresponding to the execution list through the target executor, and executing node tasks corresponding to the service nodes on the premise that the list information meets the execution conditions to obtain an execution result.
The list information may refer to parameter information corresponding to the execution list, and in an example, parameter information corresponding to the service framework, that is, the service unit, may be used as the list information. The execution condition may be a preset precondition that the execution name list can be executed, including but not limited to an execution date condition, for example, if a date parameter corresponding to the execution list satisfies a preset date condition, the execution list is executed, and specific execution conditions may be set according to actual situations, which is not limited herein.
Specifically, the target executor monitors the generation condition of an execution list of the preset controller in real time, that is, when the preset controller generates the execution list, the target executor can immediately acquire list information corresponding to the execution list, that is, parameter information of a service framework, and detect whether the parameter information meets preset execution conditions, and under the condition that the preset execution conditions are met, the target executor executes the execution list, that is, the target executor executes each service node in the execution list, so as to obtain a corresponding execution result.
In an embodiment, the target executor may monitor the processing duration of the preset controller for each service node, and perform early warning analysis under the condition that the processing duration is too long, so as to determine whether the service node is normal, thereby avoiding production accidents.
In this embodiment, an intermediate device, that is, a preset controller is set, and the server sends a parameter configuration result to the preset controller, so that the preset controller aggregates service nodes and parameter configuration results corresponding to the service nodes to generate an execution list, when the target executor monitors that the preset controller generates the execution list, the target executor obtains list information corresponding to the execution list, and executes node tasks corresponding to each service node in the execution list on the premise that the list information meets execution conditions, so as to obtain a corresponding execution result. The method effectively avoids the phenomena of transmission delay and the like caused by network congestion, bandwidth limitation and the like, thereby ensuring the stability and reliability of parameter configuration result transmission and further ensuring the stability and reliability of the subsequent target service display.
In an embodiment, as shown in fig. 4, executing a node task corresponding to a service node to obtain an execution result includes:
Step S402, based on the execution rule, ordering each service node through the target executor to obtain the execution sequence corresponding to each service node.
Wherein the number of service nodes is a plurality. The parameter configuration result comprises an execution rule and an execution mode. The execution rule may refer to rule information of the service node in the execution process, including, but not limited to, execution time and execution dependency of the service node, the execution dependency of the service node refers to an association relationship between each service node, and the execution time of the service node may refer to a time point when the service node is executed. The execution order may refer to an order in which the service nodes are executed by the target executor.
Specifically, the target executor may extract execution rules, that is, execution time and execution dependence, and an execution mode of each service node from parameter configuration results corresponding to each service node, and sort each service node according to the execution time and the execution dependence, so as to obtain an execution sequence corresponding to each service node.
And step S404, executing the node tasks corresponding to the service nodes according to the execution sequence and the execution mode to obtain an execution result.
The execution mode may refer to a mode when the target executor executes the service node, including coverage and addition.
Specifically, the target executor determines whether to cover or add the service node according to the execution mode corresponding to the service node, and executes the node task corresponding to each service node according to the corresponding execution mode, namely the coverage or addition, according to the execution sequence corresponding to the service node, thereby obtaining an execution result.
In this embodiment, by executing the node tasks corresponding to each service node one by one according to the execution rule and the execution mode of the service node, the execution efficiency of the service node can be effectively improved, so that the generation efficiency of the execution result is improved, and the efficiency of displaying the target service subsequently is improved.
In an embodiment, as shown in fig. 5, according to an execution sequence and an execution mode, executing node tasks corresponding to each service node to obtain an execution result, including:
Step S502, when the execution mode of the service node is coverage, repeating the node task corresponding to the service node according to the execution sequence.
Specifically, under the condition that the execution mode of the current service node is coverage, the node task corresponding to the current service node is repeatedly executed according to the execution sequence no matter whether the current service node is executing or not.
In one embodiment, the execution results generated after the repeated execution may be overridden by the execution results generated before the current service node.
Step S504, when the execution mode of the service node is additional, the history execution task corresponding to the service node is obtained.
Step S506, stopping the history execution task, and re-executing the node task corresponding to the service node according to the execution sequence.
The historical execution task may refer to a last execution task of the service node.
Specifically, when the execution mode of the service node is additional, the target executor may acquire the last execution task corresponding to the service node and stop the last execution task, which may be understood that whether the last execution task is completed or not is stopped, and the node task corresponding to the service node is re-executed according to the execution sequence.
In this embodiment, two cases of coverage and addition are fully considered in the execution mode, and in the case of coverage, the current service node is repeatedly executed, and in the case of addition, the task execution is stopped last time, and the current service node is re-executed. The accuracy of the execution of the service node is improved, so that the accuracy of the execution result is improved, and the accuracy of the subsequent display of the target service is further improved.
In an embodiment, as shown in fig. 6, before the step of acquiring, by the target executor, the list information corresponding to the execution list, the method further includes:
step S602, a list identifier corresponding to the execution list and an actuator identifier corresponding to the candidate actuator are obtained.
The list identifier may refer to a unique identifier corresponding to the execution list, and in an example, the identifier may be a unique identifier of a service frame corresponding to the execution list, such as a frame number, that is, a unit number. In this embodiment, there may be a plurality of actuators, that is, there may be a plurality of candidate actuators, and a target actuator matching with the execution list may be selected from the plurality of candidate actuators. The actuator identification may refer to a unique identification corresponding to the candidate actuator, such as an actuator number, etc.
Specifically, after the server monitors that the preset controller generates the execution list, the server acquires a list identifier of the execution list and acquires the corresponding executor identifiers of the pre-stored candidate executors, so that subsequent matching is facilitated.
Step S604, comparing the list identification with the executor identification to obtain an identification comparison result.
The identification comparison result can be used for representing the matching degree between the list identification and the actuator identification.
Specifically, the server compares the list identifier with the actuator identifier to detect the matching degree between the list identifier and the actuator identifier.
In an embodiment, the server may further store a mapping table between the list identifier and the actuator identifier in advance, so that the server may directly query the mapping table to query a correspondence between the list identifier and the actuator identifier, thereby determining whether the list identifier and the actuator identifier are matched.
Step S606, screening out target executors from the candidate executors based on the identification comparison result.
Specifically, if the identifier comparison result indicates that the list identifier is matched with the actuator identifier, a target actuator corresponding to the execution identifier is screened out from the candidate actuators, and a monitoring instruction is issued to the target actuator so as to instruct the target actuator to monitor an execution list corresponding to the list identifier. And if the identification comparison result shows that the list identification is not matched with the actuator identification, comparing the list identification with other actuator identifications except the actuator identification again until a matched target actuator is screened.
In this embodiment, considering that the serial execution of the executors has a problem of low execution efficiency, in this embodiment, the list identifier of the execution list is compared with the executor identifier to screen out a target executor matched with the execution list, and each service node in the execution list is executed by the target executor, so that parallel execution of the executors is realized, and thus, the execution efficiency is effectively improved.
In one embodiment, as shown in fig. 7, after the step of obtaining the execution result, the method further includes:
Step S702, storing the execution result in the specified database.
In step S704, when a presentation instruction for the target service is received, a target result corresponding to the presentation instruction is selected from the execution results stored in the designation database.
Step S706, based on the preset display form, displaying the target result.
The specified database may refer to a database that is specified in advance for storing execution results. The presentation instruction may refer to an instruction to present the target service. The target result may refer to an execution result stored in the execution database and a result of the instruction with respect to the presentation instruction, that is, the final presentation is the target result. The preset display form comprises a report, namely the target result can be displayed in the form of the report.
Specifically, after the target executor obtains the execution results corresponding to each service node, the execution results are stored in the specified database. When receiving the display instruction aiming at the target service, the server can screen out the target result corresponding to the display instruction from the execution result stored in the appointed database and display the target result in the form of a report.
In the embodiment, the target result is displayed in a report form, so that the target result is more visual and clear, and effective data support can be provided for subsequent management and decision of the target service.
In one embodiment, as shown in fig. 8, a specific implementation flow of a data processing method further includes:
S1: the server responds to a data processing instruction aiming at a target service, constructs a service unit corresponding to the target service, acquires a service requirement corresponding to the target service, splits a corresponding service node in the service unit according to the service requirement, and the target service and the service unit are in one-to-one correspondence.
S2: and carrying out service parameter configuration on each service node, including configuration of execution rule parameters and execution mode parameters, to obtain parameter configuration results corresponding to each service node, including execution rules and execution modes.
S3: the server registers the parameter configuration results to a preset controller so that the preset controller can generate a corresponding execution list.
S4: the server obtains the unit identifier corresponding to the execution list, compares the unit identifier with the actuator identifiers corresponding to the candidate actuators to obtain an identifier comparison result, and screens out the target actuator from the candidate actuators according to the identifier comparison result.
S5: the target executor monitors an execution list generated by the preset controller, acquires list information corresponding to the execution list, and orders each service node according to the execution rule corresponding to each service node in the execution list when the list information meets the execution condition, so as to obtain the execution sequence corresponding to each service node. And executing each service node one by one according to the execution sequence and the execution mode to obtain an execution result.
And S6, the target executor stores the execution result into a specified database, and when receiving the display instruction for the target service, the server extracts a target result corresponding to the display instruction from the execution result stored in the specified database and displays the target result in a report form.
In this embodiment, first, when a data processing instruction for a target service is received, a service unit corresponding to the target service is constructed, and service nodes corresponding to the service requirements are split in the service unit based on service requirements corresponding to the target service, so that subsequent targeted parameter configuration is facilitated by splitting the service nodes, and efficiency of parameter configuration is improved. And performing service parameter configuration on the service node obtained by splitting to obtain a parameter configuration result, and executing a node task corresponding to the service node based on the parameter configuration result to obtain an execution result corresponding to the service node, wherein the execution result is used for displaying the target service. Therefore, compared with the prior art that the service data is displayed in a traditional development mode, the method and the device for displaying the service data in the network node split mode, so that the service nodes meeting the service requirements are subjected to parameter configuration and executed, the display of the target service is completed, the data processing is not required to be carried out on the service data of the whole target service, the data processing efficiency is effectively improved, and the service data displaying efficiency is further improved. For subsequent data maintenance, only relevant data corresponding to the service node is required to be maintained, so that the maintenance workload is greatly reduced, and the maintenance efficiency is improved.
It should be understood that, although the steps in the flowcharts related to the above embodiments are sequentially shown as indicated by arrows, these steps are not necessarily sequentially performed in the order indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in the flowcharts described in the above embodiments may include a plurality of steps or a plurality of stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of the steps or stages is not necessarily performed sequentially, but may be performed alternately or alternately with at least some of the other steps or stages.
Based on the same inventive concept, the embodiment of the application also provides a data processing device for realizing the above related data processing method. The implementation of the solution provided by the device is similar to the implementation described in the above method, so the specific limitation of one or more embodiments of the data processing device provided below may refer to the limitation of the data processing method hereinabove, and will not be repeated herein.
In one embodiment, as shown in FIG. 10, there is provided a data processing apparatus comprising: a frame construction module 1002, configured to construct a service frame corresponding to a target service in response to a data processing instruction for the target service; the node splitting module 1004 is configured to split a service node corresponding to a service requirement in the service frame based on the service requirement corresponding to the target service; a parameter configuration module 1006, configured to perform service parameter configuration on the service node, to obtain a parameter configuration result; an execution module 1008, configured to execute a node task corresponding to the service node based on the parameter configuration result, to obtain an execution result; and the execution result is used for displaying the target service.
In one embodiment, the parameter configuration module further comprises: the list generation module is used for sending the parameter configuration result to a preset controller, and aggregating the parameter configuration result through the preset controller to generate an execution list; and the execution sub-module is used for acquiring list information corresponding to the execution list through the target executor, and executing node tasks corresponding to the service nodes on the premise that the list information meets the execution conditions to obtain an execution result.
In one embodiment, the number of service nodes is a plurality; the parameter configuration result comprises an execution rule and an execution mode; the execution sub-module further includes: the sequencing module is used for sequencing each service node through the target executor based on the execution rule to obtain the execution sequence corresponding to each service node; and the execution subunit is used for executing the node tasks corresponding to the service nodes according to the execution sequence and the execution mode to obtain an execution result.
In one embodiment, the execution mode comprises covering and adding; the execution subunit is further configured to: repeatedly executing node tasks corresponding to the service nodes according to the execution sequence under the condition that the execution mode of the service nodes is coverage; acquiring a history execution task corresponding to the service node under the condition that the execution mode of the service node is additional; and stopping historical execution tasks, and re-executing node tasks corresponding to the service nodes according to the execution sequence.
In one embodiment, the apparatus is further configured to: acquiring a list identifier corresponding to an execution list and an actuator identifier corresponding to a candidate actuator; comparing the list identifier with the actuator identifier to obtain an identifier comparison result; and screening target actuators from the candidate actuators based on the identification comparison result.
In one embodiment, the apparatus is further configured to: storing the execution result into a specified database; under the condition that a display instruction aiming at a target service is received, selecting a target result corresponding to the display instruction from execution results stored in a designated database; displaying a target result based on a preset display form; the preset display form comprises a report.
Each of the modules in the above-described data processing apparatus may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.
In one embodiment, a computer device is provided, which may be a server, and the internal structure of which may be as shown in fig. 11. The computer device includes a processor, a memory, and a network interface connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The database of the computer device is for storing item recommendation data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a data processing method.
It will be appreciated by those skilled in the art that the structure shown in FIG. 11 is merely a block diagram of some of the structures associated with the present inventive arrangements and is not limiting of the computer device to which the present inventive arrangements may be applied, and that a particular computer device may include more or fewer components than shown, or may combine some of the components, or have a different arrangement of components.
In one embodiment, a computer device is provided comprising a memory and a processor, the memory having stored therein a computer program, the processor when executing the computer program performing the steps of: responding to a data processing instruction aiming at a target service, and constructing a service frame corresponding to the target service; based on the service requirement corresponding to the target service, splitting out a service node corresponding to the service requirement in a service framework; carrying out service parameter configuration on the service node to obtain a parameter configuration result; based on the parameter configuration result, executing the node task corresponding to the service node to obtain an execution result; and the execution result is used for displaying the target service.
In one embodiment, the processor when executing the computer program further performs the steps of: the parameter configuration result is sent to a preset controller, and the parameter configuration result is aggregated through the preset controller to generate an execution list; acquiring list information corresponding to the execution list through the target executor, and executing node tasks corresponding to the service nodes on the premise that the list information meets the execution conditions to obtain an execution result.
In one embodiment, the number of service nodes is a plurality, the parameter configuration result includes an execution rule and an execution mode, and the processor when executing the computer program further implements the following steps: based on the execution rule, sequencing each service node through a target executor to obtain an execution sequence corresponding to each service node; and executing the node tasks corresponding to each service node according to the execution sequence and the execution mode to obtain an execution result.
In one embodiment, the implementation manner includes coverage and addition, and the processor executes the computer program to further realize the following steps: repeatedly executing node tasks corresponding to the service nodes according to the execution sequence under the condition that the execution mode of the service nodes is coverage; acquiring a history execution task corresponding to the service node under the condition that the execution mode of the service node is additional; and stopping historical execution tasks, and re-executing node tasks corresponding to the service nodes according to the execution sequence.
In one embodiment, the processor when executing the computer program further performs the steps of: acquiring a list identifier corresponding to an execution list and an actuator identifier corresponding to a candidate actuator; comparing the list identifier with the actuator identifier to obtain an identifier comparison result; and screening target actuators from the candidate actuators based on the identification comparison result.
In one embodiment, the processor when executing the computer program further performs the steps of: storing the execution result into a specified database; under the condition that a display instruction aiming at a target service is received, selecting a target result corresponding to the display instruction from execution results stored in a designated database; displaying a target result based on a preset display form; the preset display form comprises a report.
In one embodiment, a computer readable storage medium is provided having a computer program stored thereon, which when executed by a processor, performs the steps of: responding to a data processing instruction aiming at a target service, and constructing a service frame corresponding to the target service; based on the service requirement corresponding to the target service, splitting out a service node corresponding to the service requirement in a service framework; carrying out service parameter configuration on the service node to obtain a parameter configuration result; based on the parameter configuration result, executing the node task corresponding to the service node to obtain an execution result; and the execution result is used for displaying the target service.
In one embodiment, the computer program when executed by the processor further performs the steps of: the parameter configuration result is sent to a preset controller, and the parameter configuration result is aggregated through the preset controller to generate an execution list; acquiring list information corresponding to the execution list through the target executor, and executing node tasks corresponding to the service nodes on the premise that the list information meets the execution conditions to obtain an execution result.
In one embodiment, the number of service nodes is a plurality, the parameter configuration result includes an execution rule and an execution mode, and the computer program when executed by the processor further realizes the following steps: based on the execution rule, sequencing each service node through a target executor to obtain an execution sequence corresponding to each service node; and executing the node tasks corresponding to each service node according to the execution sequence and the execution mode to obtain an execution result.
In one embodiment, the execution mode includes overlay and append, and the computer program when executed by the processor further implements the steps of: repeatedly executing node tasks corresponding to the service nodes according to the execution sequence under the condition that the execution mode of the service nodes is coverage; acquiring a history execution task corresponding to the service node under the condition that the execution mode of the service node is additional; and stopping historical execution tasks, and re-executing node tasks corresponding to the service nodes according to the execution sequence.
In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring a list identifier corresponding to an execution list and an actuator identifier corresponding to a candidate actuator; comparing the list identifier with the actuator identifier to obtain an identifier comparison result; and screening target actuators from the candidate actuators based on the identification comparison result.
In one embodiment, the computer program when executed by the processor further performs the steps of: storing the execution result into a specified database; under the condition that a display instruction aiming at a target service is received, selecting a target result corresponding to the display instruction from execution results stored in a designated database; displaying a target result based on a preset display form; the preset display form comprises a report.
In one embodiment, a computer program product is provided comprising a computer program which, when executed by a processor, performs the steps of: responding to a data processing instruction aiming at a target service, and constructing a service frame corresponding to the target service; based on the service requirement corresponding to the target service, splitting out a service node corresponding to the service requirement in a service framework; carrying out service parameter configuration on the service node to obtain a parameter configuration result; based on the parameter configuration result, executing the node task corresponding to the service node to obtain an execution result; and the execution result is used for displaying the target service.
In one embodiment, the computer program when executed by the processor further performs the steps of: the parameter configuration result is sent to a preset controller, and the parameter configuration result is aggregated through the preset controller to generate an execution list; acquiring list information corresponding to the execution list through the target executor, and executing node tasks corresponding to the service nodes on the premise that the list information meets the execution conditions to obtain an execution result.
In one embodiment, the number of service nodes is a plurality, the parameter configuration result includes an execution rule and an execution mode, and the computer program when executed by the processor further realizes the following steps: based on the execution rule, sequencing each service node through a target executor to obtain an execution sequence corresponding to each service node; and executing the node tasks corresponding to each service node according to the execution sequence and the execution mode to obtain an execution result.
In one embodiment, the execution mode includes overlay and append, and the computer program when executed by the processor further implements the steps of: repeatedly executing node tasks corresponding to the service nodes according to the execution sequence under the condition that the execution mode of the service nodes is coverage; acquiring a history execution task corresponding to the service node under the condition that the execution mode of the service node is additional; and stopping historical execution tasks, and re-executing node tasks corresponding to the service nodes according to the execution sequence.
In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring a list identifier corresponding to an execution list and an actuator identifier corresponding to a candidate actuator; comparing the list identifier with the actuator identifier to obtain an identifier comparison result; and screening target actuators from the candidate actuators based on the identification comparison result.
In one embodiment, the computer program when executed by the processor further performs the steps of: storing the execution result into a specified database; under the condition that a display instruction aiming at a target service is received, selecting a target result corresponding to the display instruction from execution results stored in a designated database; displaying a target result based on a preset display form; the preset display form comprises a report.
Those skilled in the art will appreciate that implementing all or part of the above-described methods may be accomplished by way of a computer program, which may be stored on a non-transitory computer readable storage medium and which, when executed, may comprise the steps of the above-described embodiments of the methods. Any reference to memory, database, or other medium used in embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high density embedded nonvolatile Memory, resistive random access Memory (ReRAM), magneto-resistive random access Memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric Memory (Ferroelectric Random Access Memory, FRAM), phase change Memory (PHASE CHANGE Memory, PCM), graphene Memory, and the like. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, and the like. By way of illustration, and not limitation, RAM can be in various forms such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), etc. The databases referred to in the embodiments provided herein may include at least one of a relational database and a non-relational database. The non-relational database may include, but is not limited to, a blockchain-based distributed database, and the like. The processor referred to in the embodiments provided in the present application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic unit, a data processing logic unit based on quantum computing, or the like, but is not limited thereto.
The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The foregoing examples illustrate only a few embodiments of the application, which are described in detail and are not to be construed as limiting the scope of the application. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the application, which are all within the scope of the application. Accordingly, the scope of the application should be assessed as that of the appended claims.

Claims (15)

1. A method of data processing, the method comprising:
responding to a data processing instruction aiming at a target service, and constructing a service frame corresponding to the target service;
Splitting a service node corresponding to the service requirement in the service framework based on the service requirement corresponding to the target service;
Carrying out service parameter configuration on the service node to obtain a parameter configuration result;
Based on the parameter configuration result, executing the node task corresponding to the service node to obtain an execution result; and the execution result is used for displaying the target service.
2. The method according to claim 1, wherein the executing the node task corresponding to the service node based on the parameter configuration result to obtain an execution result includes:
The parameter configuration result is sent to a preset controller, and the parameter configuration result is aggregated through the preset controller to generate an execution list;
Acquiring list information corresponding to the execution list through the target executor, and executing node tasks corresponding to the service nodes on the premise that the list information meets the execution conditions to obtain the execution result.
3. The method according to claim 2, wherein the number of service nodes is plural, and the parameter configuration result includes an execution rule and an execution mode; the step of executing the node task corresponding to the service node to obtain the execution result comprises the following steps:
based on the execution rule, sequencing the service nodes through the target executor to obtain an execution sequence corresponding to the service nodes;
And executing the node tasks corresponding to the service nodes according to the execution sequence and the execution mode to obtain the execution result.
4. A method according to claim 3, wherein the execution means comprises an overlay and an append; and executing the node task corresponding to each service node according to the execution sequence and the execution mode to obtain the execution result, wherein the method comprises the following steps:
Repeatedly executing node tasks corresponding to the service nodes according to the execution sequence under the condition that the execution mode of the service nodes is coverage;
Acquiring a history execution task corresponding to the service node under the condition that the execution mode of the service node is additional;
stopping the history execution task, and re-executing the node task corresponding to the service node according to the execution sequence.
5. The method according to claim 2, further comprising, prior to the step of obtaining, by the target executor, list information corresponding to the execution list:
acquiring a list identifier corresponding to the execution list and an actuator identifier corresponding to the candidate actuator;
Comparing the list identifier with the actuator identifier to obtain an identifier comparison result;
and screening the target executors from the candidate executors based on the identification comparison result.
6. The method of claim 1, further comprising, after the step of obtaining the execution result:
Storing the execution result into a specified database;
Under the condition that a display instruction aiming at the target service is received, selecting a target result corresponding to the display instruction from execution results stored in the appointed database;
displaying the target result based on a preset display form; the preset display form comprises a report.
7. A data processing apparatus, the apparatus comprising:
the frame construction module is used for responding to a data processing instruction aiming at a target service and constructing a service frame corresponding to the target service;
The node splitting module is used for splitting service nodes corresponding to the service demands in the service framework based on the service demands corresponding to the target service;
the parameter configuration module is used for carrying out service parameter configuration on the service node to obtain a parameter configuration result;
The execution module is used for executing the node task corresponding to the service node based on the parameter configuration result to obtain an execution result; and the execution result is used for displaying the target service.
8. The apparatus of claim 7, wherein the parameter configuration module further comprises:
the list generation module is used for sending the parameter configuration result to a preset controller, and aggregating the parameter configuration result through the preset controller to generate an execution list;
and the execution sub-module is used for acquiring list information corresponding to the execution list through the target executor, and executing the node task corresponding to the service node on the premise that the list information meets the execution condition to obtain the execution result.
9. The apparatus of claim 8, wherein the number of service nodes is a plurality; the parameter configuration result comprises an execution rule and an execution mode; the execution sub-module further includes:
The sequencing module is used for sequencing the service nodes through the target executor based on the execution rule to obtain the execution sequence corresponding to the service nodes;
And the execution subunit is used for executing the node tasks corresponding to the service nodes according to the execution sequence and the execution mode to obtain the execution result.
10. The apparatus of claim 9, wherein the execution means comprises an overlay and an append; the execution subunit is further configured to: repeatedly executing node tasks corresponding to the service nodes according to the execution sequence under the condition that the execution mode of the service nodes is coverage; acquiring a history execution task corresponding to the service node under the condition that the execution mode of the service node is additional; stopping the history execution task, and re-executing the node task corresponding to the service node according to the execution sequence.
11. The apparatus of claim 8, wherein the apparatus is further configured to: acquiring a list identifier corresponding to the execution list and an actuator identifier corresponding to the candidate actuator; comparing the list identifier with the actuator identifier to obtain an identifier comparison result; and screening the target executors from the candidate executors based on the identification comparison result.
12. The apparatus of claim 7, wherein the apparatus is further configured to: storing the execution result into a specified database; under the condition that a display instruction aiming at the target service is received, selecting a target result corresponding to the display instruction from execution results stored in the appointed database; displaying the target result based on a preset display form; the preset display form comprises a report.
13. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of any of claims 1 to 6 when the computer program is executed.
14. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 6.
15. A computer program product comprising a computer program, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 6.
CN202410342726.7A 2024-03-25 Data processing method, apparatus, computer device, readable storage medium, and product Pending CN118260075A (en)

Publications (1)

Publication Number Publication Date
CN118260075A true CN118260075A (en) 2024-06-28

Family

ID=

Similar Documents

Publication Publication Date Title
US11979433B2 (en) Highly scalable four-dimensional web-rendering geospatial data system for simulated worlds
CN108153670B (en) Interface testing method and device and electronic equipment
US10212057B2 (en) Disparate monitoring for IoT
CN116644250B (en) Page detection method, page detection device, computer equipment and storage medium
CN117151045A (en) Report processing method and device based on block chain and computer equipment
CN118260075A (en) Data processing method, apparatus, computer device, readable storage medium, and product
CN117931789B (en) Ordered processing method, system and computer equipment for data recovery task
CN117130606A (en) Front-end page configuration method, front-end page configuration device, computer equipment and storage medium
CN116880927A (en) Rule management method, device, computer equipment and storage medium
CN117389605A (en) Service interface configuration method, device, equipment, storage medium and program product
CN116302830A (en) Micro-service inspection method and device for application program and computer equipment
CN116828505A (en) Fault processing method, device, computer equipment and storage medium
CN117313666A (en) Information acquisition method, apparatus, device, storage medium, and program product
CN117216164A (en) Financial data synchronous processing method, apparatus, device, medium and program product
CN118133793A (en) Form generation method, form generation device, computer equipment and storage medium
CN118227557A (en) Service information importing method, device, computer equipment and storage medium
CN116546103A (en) Processing method, device, equipment, storage medium and product of distributed service
CN117389601A (en) Financial software influence traceability analysis method, device, equipment and storage medium
CN117076527A (en) Data transmission method, apparatus, computer device, storage medium, and program product
CN116980430A (en) Resource allocation processing method, device, computer equipment and storage medium
CN116566720A (en) Firewall policy translation method, device, computer equipment and storage medium
CN118260328A (en) Data query method, device, computer equipment, readable storage medium and product
CN117202113A (en) Message material auditing method, device, equipment, storage medium and program product
CN118094024A (en) Virtual resource pushing method, device, computer equipment and storage medium
CN116700566A (en) Interaction method, device, computer apparatus, storage medium and program product

Legal Events

Date Code Title Description
PB01 Publication