CN108509330B - Data processing method and system - Google Patents

Data processing method and system Download PDF

Info

Publication number
CN108509330B
CN108509330B CN201710109234.3A CN201710109234A CN108509330B CN 108509330 B CN108509330 B CN 108509330B CN 201710109234 A CN201710109234 A CN 201710109234A CN 108509330 B CN108509330 B CN 108509330B
Authority
CN
China
Prior art keywords
target
configuration
task
instruction
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710109234.3A
Other languages
Chinese (zh)
Other versions
CN108509330A (en
Inventor
罗莎
黄鹤
杨璧嘉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201710109234.3A priority Critical patent/CN108509330B/en
Publication of CN108509330A publication Critical patent/CN108509330A/en
Application granted granted Critical
Publication of CN108509330B publication Critical patent/CN108509330B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention discloses a data processing method, which comprises the following steps: encapsulating the target function related to the service to generate a public node resource; creating a target configuration according to the public configuration in the public node resource; establishing a target task for testing the target configuration; the target task comprises a target node generated based on the target configuration; and under the condition of receiving a task operation instruction, sequentially operating each node in the target task and outputting an operation result. The invention also discloses a data processing system, which solves the technical problems that in the prior art, the configuration is tested in a manual mode, a large amount of manpower is often consumed, the offline communication time is often consumed, the efficiency is low, and the online speed is low.

Description

Data processing method and system
Technical Field
The present invention relates to the field of computers, and in particular, to a data processing method and a data processing system.
Background
With the development of electronic technology and internet technology, electronic devices (especially smart mobile devices) have increasingly powerful functions, and as long as users install various application programs on the electronic devices according to their own needs, various transactions can be completed through the mobile internet.
At present, the market and user requirements are varied, and how to ensure that products are quickly on-line and the subsequent update iteration is a key problem which people pay attention to all the time.
During the development and maintenance of the product, product personnel can often make modifications or updates to the product according to requirements. In the prior art, product personnel send all configurations modified by the product personnel to research and development personnel in an off-line mode such as mails or an instant messaging interactive platform in an enterprise, then the research and development personnel perform corresponding tests, and finally after the product personnel and the research and development personnel verify test results together, the product personnel and the research and development personnel can confirm that no problem exists and can be on-line. The manual configuration testing method usually consumes a large amount of manpower and offline communication time, and has low efficiency and low online speed.
Disclosure of Invention
The technical problem to be solved by the embodiments of the present invention is to provide a data processing method and a data processing system, so as to solve the technical problems in the prior art that a large amount of manpower and offline communication time are often consumed to test configuration in a manual manner, the efficiency is low, and the online speed is slow.
In order to solve the above technical problem, a first aspect of an embodiment of the present invention discloses a data processing method, including:
encapsulating target functions related to the service to generate public node resources;
creating a target configuration according to the public configuration in the public node resource;
establishing a target task for testing the target configuration; the target task comprises a target node generated based on the target configuration;
and under the condition of receiving a task operation instruction, sequentially operating each node in the target task and outputting an operation result.
A second aspect of the embodiments of the present invention discloses a data processing system, including:
the generating module is used for packaging the target function related to the service and generating a public node resource;
the configuration creating module is used for creating target configuration according to the public configuration in the public node resources;
the task establishing module is used for establishing a target task for testing the target configuration; the target task comprises a target node generated based on the target configuration;
the running module is used for sequentially running all nodes in the target task under the condition of receiving a task running instruction;
and the result output module is used for outputting the operation result.
By implementing the embodiment of the invention, the target function related to the service is packaged to generate the public node resource, the target configuration can be quickly created according to the public configuration in the public node resource, then the target task for testing the target configuration is established, each node in the target task can be automatically and sequentially operated, and the operation result is output, so that the automatic and quick test is realized, the technical problems that in the prior art, the configuration is tested in a manual mode, a large amount of manpower and offline communication time are often consumed, the efficiency is low, and the online speed is low are solved, the configuration error rate of a product can be greatly reduced, and the working cost of research personnel and product personnel is greatly reduced. In addition, when the node of the target task fails to operate, the operation of the whole task is interrupted, the operation result of the node which fails to operate is output, a downloading function can be provided for each node in the target task, and the processes of configuration testing, regression testing and online testing are further accelerated. In addition, when the management operation of public configuration in the public node resource is provided, the corresponding relation between the execution of the corresponding management operation and the user identification is established, the information of the operator who is modified or on-line every time can be recorded, the searching of the responsible person is facilitated, and the management monitoring efficiency of a product development team in the product development process is further improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a system architecture diagram of a data processing system according to an embodiment of the present invention;
FIG. 2 is a flow chart of a data processing method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of an interface of a data processing system provided by an embodiment of the present invention;
FIG. 4 is a schematic diagram of an interface for configuration auditing provided by an embodiment of the present invention;
FIG. 5 is a diagram of the operational state of a task or node provided by an embodiment of the present invention;
FIG. 6 is a schematic diagram of an interface for configuration management provided by an embodiment of the present invention;
FIG. 7 is a schematic diagram of an interface for configuration editing provided by an embodiment of the present invention;
FIG. 8 is a process diagram of configuration testing provided by an embodiment of the present invention;
FIG. 9 is a block diagram of a data processing system according to an embodiment of the present invention;
FIG. 10 is a block diagram illustrating an alternative embodiment of a data processing system;
FIG. 11 is a block diagram illustrating an alternative embodiment of a data processing system in accordance with the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention.
In order to better understand a data processing method and system disclosed in the embodiments of the present invention, a system architecture of the embodiments of the present invention is described below. Referring to fig. 1, fig. 1 is a schematic diagram of a system architecture for data processing according to an embodiment of the present invention. The data processing method or the data processing system of the embodiment of the invention is equivalent to providing a platform, such as a website platform, as shown in fig. 1, the overall system architecture of the platform can be divided into a front end and a back end, for example, the front end can be realized by adopting the nodejs technical scheme and is deployed on a docker. The back end can adopt a mode of a central control-execution machine, and the execution machine can automatically expand capacity as required. The front-end and back-end interactions are all via a database (e.g., mysql). It is understood that other technical solutions may also be adopted by the front end, such as PHP (Hypertext Preprocessor), and the embodiment of the present invention is not limited.
By the data processing method or the data processing system, automatic and rapid testing can be realized in the process of testing the configuration file, and the technical problems that in the prior art, a large amount of manpower is consumed and offline communication time is often consumed to test the configuration in a manual mode, the efficiency is low, and the online speed is low are solved.
It should be noted that the embodiments of the present invention relate to several concepts or elements: tasks, nodes, and configurations. The task, the node and the configuration are core elements of the data processing system or the platform of the embodiment of the invention, and the data processing system completes service requirements through the three. Specifically, the method comprises the following steps:
and (3) node: the method realizes certain functions (equivalent to program realization of one section of functions and reusability), and is divided into public and private attributes, and nodes of the public attributes cannot be modified and are provided for all persons; the node of private attributes is a customized function, which can only be used by itself, but can be modified to be public and thus provided to others.
Task (2): a stream realizing a series of functions is composed of 1 or more nodes, and different orders and dependency relationships can be customized among the nodes. Tasks are composed of node + relationships. One node can only belong to one task, and one task can comprise a plurality of nodes.
Configuration: the modified text file may be edited. A node may have 1 or more configurations configured to customize different input parameters to the node. Configuration is an optional attribute of a node, and for a certain node, it may depend on 1 or more configurations, or may not need a configuration, which is completely determined by the functional attributes of the node.
The data processing method provided by the embodiment of the invention is described in detail below with reference to fig. 2 to 8:
fig. 2 shows a flow chart of a data processing method according to an embodiment of the present invention, which may include the following steps:
step S200: encapsulating target functions related to the service to generate public node resources;
specifically, a technician may analyze the target function related to the service as needed or as statistics, then encapsulate the target function related to the service through the data processing system (or the data processing platform) according to the embodiment of the present invention, and finally generate the common node resource in the data processing system, for example, as shown in fig. 3, an interface schematic diagram of the data processing system provided in the embodiment of the present invention displays the generated common node resource. The common node resource in the embodiment of the present invention may include a common node and a common configuration.
It should be noted that the service association in the embodiment of the present invention may be specifically a service module associated with a data processing system. It will be appreciated that a data processing system has one or more different business modules, which differ between different data processing systems. For example, an e-commerce system may include business modules such as a supplier module, a procurement module, a sales module, a logistics module, a finance module, etc.; also, the service modules such as a search module, a navigation module, a collection module and the like; each service module has some common functions, such as an information access function, an information editing function, an information modification function, an information update function, and the like. The target function in the embodiment of the present invention may be a part or all of general functions related to the service, and the present invention is not limited, and may be set according to the requirements of the technical staff; in addition, the embodiments of the present invention are not limited to a certain data processing system.
It should be further noted that the generated common node resource may be provided for product personnel to use, including operations of copying, editing, modifying, updating, deleting, and the like.
Step S202: creating a target configuration according to the public configuration in the public node resource;
specifically, with the data processing system according to the embodiment of the present invention, a product person may create one or more target configurations based on the common configuration in the common node material according to a requirement for a configuration test of the product person, for example, copy a certain common configuration, and then modify the target configuration based on the copied common configuration to create a target configuration; as well as directly updating some common configuration to create a target configuration, etc.
Step S204: establishing a target task for testing the target configuration; the target task comprises a target node generated based on the target configuration;
specifically, with the data processing system according to the embodiment of the present invention, a product person may newly create a target task according to requirements of a target configuration to be tested, where the target task may include 1 or more nodes, for example, a node that includes exported test data, a node that includes run result data based on the target configuration, and so on. That is, the target task includes 1 or more nodes, and includes 1 or more target configurations, and the relationships of the respective nodes are set.
Step S206: and under the condition of receiving a task operation instruction, sequentially operating each node in the target task and outputting an operation result.
Specifically, the production personnel can input task running instructions at any time to instruct the data processing system to automatically run the target task. That is to say, the data processing system establishes a target task according to the requirements of product personnel, and after receiving a task operation instruction input by the product personnel, sequentially operates each node in the target task, and finally outputs an operation result.
According to the embodiment of the invention, automatic and rapid testing is realized, the technical problems that in the prior art, the configuration is tested in a manual mode, a large amount of manpower is consumed, the offline communication time is consumed, the efficiency is low, and the online speed is low are solved, and through statistics of actual operation, compared with the prior art, the configuration error rate of a product can be reduced by more than 70%, the online speed of the product is increased by 5 times, and the working cost of research personnel and product personnel is reduced by 80%.
Further, steps S208, 210, and 212 may also be included:
step S208: receiving an audit submission instruction for the target configuration;
specifically, when the operation result output in step 206 is that the operation is successful and the production staff confirms that the target configuration is feasible, the audit submitting instruction may be input, and then the data processing system receives the audit submitting instruction for the target configuration.
Step S210: submitting the target configuration to audit according to the audit submitting instruction;
specifically, the data processing system of the embodiment of the present invention sets an audit flow of a technician, that is, after a product worker confirms that the target configuration is feasible, the technician is required to perform audit confirmation. Accordingly, the data processing system submits the target configuration for review based on the review submission instructions to instruct a technician to perform a review validation.
Step S212: and after receiving the auditing passing information aiming at the target configuration, carrying out online processing on the target configuration.
Specifically, as shown in fig. 4, an interface schematic diagram for configuration auditing provided by the embodiment of the present invention is shown. After the technician checks and confirms that there is no problem, the data processing system can input the check passing information, and then after receiving the check passing information for the target configuration, the data processing system indicates that there is no problem in the target configuration, and can perform online processing, that is, perform online processing on the target configuration.
Still further, the data processing method according to the embodiment of the present invention is described with reference to the running state diagram of the task or node provided by the embodiment of the present invention shown in fig. 5:
after a target task is created according to the requirements of product personnel, the data processing system can sequentially run each node in the target task under the condition of receiving a task running instruction;
after the data processing system creates a target task according to the requirements of product personnel, the target task can be deleted under the condition of receiving a deletion instruction of the task or the node;
after outputting an operation result, for example, an operation result of successful operation or operation failure, the data processing system receives a modification instruction for the target task, and modifies the target task according to the modification instruction; after the target task is modified, the step S206 of sequentially operating each node in the target task when the task operation instruction is received is executed again;
in the process that the data processing system sequentially runs each node in the target task, after receiving the operation stopping instruction, stopping running the target task, outputting a running stopping result (including success stopping or failure stopping), and then receiving a modification instruction aiming at the target task and modifying the target task according to the modification instruction; and after the target task is modified, re-executing the step S206 of sequentially operating each node in the target task when the task operation instruction is received.
In the process that the data processing system sequentially runs each node in the target task, if the node of the target task fails to run, the running of the whole task can be interrupted, and the running result of the node which fails to run is output.
Still further, the data processing system according to the embodiment of the present invention may provide a configuration management function for a product person, for example, as shown in the schematic interface diagram of configuration management provided in the embodiment of the present invention in fig. 6, after the data processing system generates a common node resource, the product person may enter the management configuration page in fig. 6, and then input a management operation instruction for all configurations on the data processing system, which may include a version management instruction, a view instruction, an edit instruction, a copy instruction, an update instruction, an add instruction, a delete instruction, and the like. That is to say, the data processing system may execute corresponding operations according to the management operation instruction input by the product staff, for example, checking the configuration of each history version, copying a certain configuration, and the like, and for example, entering the schematic interface diagram for configuration editing provided in the embodiment of the present invention shown in fig. 7, after receiving the editing instruction for a certain configuration, the data processing system may display the interface shown in fig. 7, so that the product staff may perform configuration editing. The technician (i.e., developer) need not participate in the control maintenance of the configuration.
In conjunction with the processing schematic diagram of the configuration test provided in the embodiment of the present invention illustrated in fig. 8, how to perform the configuration test by the data processing method in the embodiment of the present invention is illustrated from the perspective of a product staff:
for example, if a product person wants to modify the access template configuration of a certain product, the following steps may be performed:
1. the product personnel can copy an on-line standard access template configuration for the product on the configuration management interface diagram of fig. 6;
2. product personnel can enter the interface schematic diagram of configuration editing in fig. 7, and modify the copied configuration according to the testing requirements of the product personnel to form target configuration;
3. a new target task is set up in the main page of fig. 7 to test the target configuration. Specifically, to test a configuration, test data is first available, so the first node of the target task can be the export test data; the second node may be based on the new configuration run result data. Respectively adding the nodes and the new configuration into the tasks, and establishing the target task;
4. the production personnel enter after clicking on the run task. At the moment, the product can do other things, the tasks can automatically run the nodes in sequence, and after the running is finished, the execution result can be prompted through the mail or the instant messaging interaction platform in the enterprise. The operation result provides a download function.
5. Analyzing the operation result by a product worker, and confirming whether the target configuration is correctly modified;
6. after confirming that no problem exists, the product personnel submit the target configuration to audit, namely input an audit submitting instruction;
7. and the technical personnel can check the target configuration, and if no problem exists, the target configuration can be subjected to online processing.
It should be noted that, as shown in fig. 8, after establishing a target task for testing the target configuration, the embodiment of the present invention may further include: receiving a downloading instruction aiming at the node in the target task; and issuing the nodes in the target task according to the downloading instruction. That is to say, the data processing system according to the embodiment of the present invention provides a downloading function for the operation result of each node, thereby facilitating the targeted data analysis for the user.
It should be further noted that, after receiving the management operation instruction for the common configuration in the common node resource, the embodiment of the present invention may further include: and acquiring a user identifier for inputting the management operation instruction, and establishing a corresponding relation between the corresponding operation to be executed and the user identifier. That is to say, the data processing system of the embodiment of the invention can record the operator information of each modification or each online, is convenient for tracing the responsible person, and further improves the management and monitoring efficiency of the product development team in the product development process.
By implementing the embodiment of the invention, the target function related to the service is encapsulated to generate the public node resource, the target configuration can be quickly created according to the public configuration in the public node resource, then the target task for testing the target configuration is established, each node in the target task can be automatically and sequentially operated, and the operation result is output, so that the automatic quick test is realized, namely, a product worker can establish own text configuration according to different requirements, divide the requirements into a streaming process, establish the task by using the nodes, and automatically finish the task by using a data processing system or a platform. The technical problems that in the prior art, configuration is tested in a manual mode, a large amount of manpower and offline communication time are often consumed, efficiency is low, and the online speed is low are solved, the configuration error rate of products can be greatly reduced, and the working cost of research personnel and product personnel is greatly reduced. In addition, when the node of the target task fails to operate, the operation of the whole task is interrupted, the operation result of the node which fails to operate is output, a downloading function can be provided for each node in the target task, and the processes of configuration testing, regression testing and online testing are further accelerated. In addition, when the management operation of public configuration in the public node resource is provided, the corresponding relation between the execution of the corresponding management operation and the user identification is established, the information of the operator who is modified or on-line every time can be recorded, the searching of the responsible person is facilitated, and the management monitoring efficiency of a product development team in the product development process is further improved.
In order to better implement the above-mentioned solution of the embodiments of the present invention, the present invention further provides a data processing system, which is described in detail below with reference to the accompanying drawings:
as shown in fig. 9, which is a schematic structural diagram of a data processing system according to an embodiment of the present invention, the data processing system 90 may include: a generation module 900, a configuration creation module 902, a task creation module 904, an execution module 906, and a result output module 908, wherein,
the generating module 900 is configured to encapsulate a target function related to a service, and generate a common node resource;
the configuration creating module 902 is configured to create a target configuration according to a public configuration in the public node resource;
the task establishing module 904 is configured to establish a target task for testing the target configuration; the target task comprises a target node generated based on the target configuration;
the running module 906 is configured to run each node in the target task in sequence when receiving a task running instruction;
the result output module 908 is used for outputting the operation result.
Specifically, as shown in the structural diagram of another embodiment of the data processing system provided in the present invention shown in fig. 10, the data processing system 90 may include, in addition to the generating module 900, the configuration creating module 902, the task establishing module 904, the running module 906, and the result outputting module 908, further include: a modification instruction receiving module 9010, a submission instruction receiving module 9012, a submission auditing module 9014, an online processing module 9016, a download instruction receiving module 9018, a delivery module 9020, an operation instruction receiving module 9022, an execution operation module 9024 and an acquisition establishing module 9026, wherein,
the modification instruction receiving module 9010 is configured to receive a modification instruction for the target task after the result output module 908 outputs the operation result, and modify the target task according to the modification instruction;
after the modification instruction receiving module 9010 completes modification of the target task, the operation triggering module 906 re-executes the step of sequentially operating each node in the target task under the condition that the task operation instruction is received.
The submission instruction receiving module 9012 is configured to receive an audit submission instruction for the target configuration after the result output module 908 outputs the operation result;
a submission auditing module 9014 is configured to submit the target configuration for auditing according to the audit submission instruction;
the online processing module 9016 is configured to perform online processing on the target configuration after receiving the audit pass information for the target configuration.
The download instruction receiving module 9018 is configured to receive a download instruction for a node in the target task after the task establishing module 904 establishes the target task for testing the target configuration;
the issuing module 9020 is configured to issue the node in the target task according to the download instruction.
The operation instruction receiving module 9022 is configured to receive a management operation instruction for a common configuration in the common node resource after the generating module 900 generates the common node resource;
the execution operation module 9024 is configured to execute a corresponding operation according to the management operation instruction; wherein the management operation instructions include at least one of:
version management instructions, viewing instructions, editing instructions, copying instructions, updating instructions, adding instructions and deleting instructions.
The obtaining and establishing module 9026 is configured to, after the operation instruction receiving module 9022 receives a management operation instruction for a common configuration in the common node resource, obtain a user identifier of the input management operation instruction, and establish a corresponding relationship between the execution corresponding operation and the user identifier.
Specifically, the result output module 908 may be further configured to, when the node of the target task fails to operate, interrupt operation of the entire task, and output an operation result for the node that fails to operate.
Referring to fig. 11, fig. 11 is a schematic structural diagram of a data processing system according to another embodiment of the present invention. As shown in fig. 11, the data processing system 110 may include: at least one processor 1101, e.g., a CPU, at least one network interface 1104, a user interface 1103, a memory 1105, at least one communication bus 1102, and a display screen 1106. Wherein a communication bus 1102 is used to enable the connection communication between these components. The user interface 1103 may include, among other things, a mouse, a keyboard, and the like. The network interface 1104 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1105 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one disk memory, and the memory 1105 includes a flash memory according to an embodiment of the present invention. The memory 1105 may alternatively be at least one memory system located remotely from the processor 1101 as previously described. As shown in fig. 11, the memory 1105, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a data processing program. The data processing system 110 may be a server.
In the data processing system 110 shown in FIG. 11, the processor 1101 may be configured to invoke a data processing program stored in the memory 1105 and perform the following operations:
encapsulating target functions related to the service to generate public node resources;
creating a target configuration according to the public configuration in the public node resource;
establishing a target task for testing the target configuration; the target task comprises a target node generated based on the target configuration;
and under the condition of receiving a task operation instruction, sequentially operating each node in the target task and outputting an operation result.
Specifically, after outputting the operation result, the processor 1101 may further perform:
receiving a modification instruction aiming at the target task, and modifying the target task according to the modification instruction;
and after the target task is modified, re-executing the step of sequentially operating each node in the target task under the condition of receiving the task operation instruction.
Specifically, after the processor 1101 outputs the operation result, it may further perform:
receiving an audit submission instruction for the target configuration;
submitting the target configuration to audit according to the audit submitting instruction;
and after receiving the auditing passing information aiming at the target configuration, carrying out online processing on the target configuration.
Specifically, after the processor 1101 establishes a target task for testing the target configuration, the following steps may be further performed:
receiving a downloading instruction aiming at the nodes in the target task;
and issuing the nodes in the target task according to the downloading instruction.
Specifically, processor 1101 outputs the results of the operations, including:
and under the condition that the node of the target task fails to operate, interrupting the operation of the whole task and outputting an operation result aiming at the node which fails to operate.
Specifically, after the processor 1101 generates the common node resource, it may further perform:
receiving a management operation instruction aiming at public configuration in the public node resource, and executing corresponding operation according to the management operation instruction; wherein the management operation instructions include at least one of:
version management instructions, viewing instructions, editing instructions, copying instructions, updating instructions, adding instructions and deleting instructions.
Specifically, after the processor 1101 receives a management operation instruction for a common configuration in the common node resource, it may further perform:
and acquiring a user identifier for inputting the management operation instruction, and establishing a corresponding relation between the executed corresponding operation and the user identifier.
It should be noted that, for the functions of each module in the data processing system 90 or the data processing system 110 in the embodiments of the present invention, reference may be made to the specific implementation manner of any embodiment in fig. 1 to fig. 8 in each method embodiment described above, and details are not repeated here.
By implementing the embodiment of the invention, the target configuration can be quickly created according to the public configuration in the public node resource, then the target task for testing the target configuration is established, each node in the target task can be automatically and sequentially operated, and the operation result is output, so that the automatic quick test is realized, namely, a product worker can establish the text configuration according to different requirements, divide the requirements into a streaming process, establish the task by using the nodes, and the task is automatically completed by a data processing system or a platform. The problem of among the prior art test the configuration with artifical mode, often need consume a large amount of manpowers and off-line communication time, inefficiency, the slow technique of on-line speed is solved, the configuration error rate of product that can significantly reduce moreover, the research and development personnel that significantly reduce and product personnel's working cost. In addition, under the condition that the operation of the node of the target task fails, the operation of the whole task is interrupted, the operation result aiming at the node with the operation failure is output, a downloading function can be provided for each node in the target task, and the processes of testing configuration, regression testing and online are further accelerated. In addition, when the management operation of public configuration in the public node resource is provided, the corresponding relation between the execution of the corresponding management operation and the user identification is established, the information of the operator who is modified or on-line every time can be recorded, the searching of the responsible person is facilitated, and the management monitoring efficiency of a product development team in the product development process is further improved.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
While the invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not to be limited to the disclosed embodiment, but on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims (15)

1. A data processing method, comprising:
encapsulating the first user according to the requirement or according to the target function related to the service analyzed by statistics to generate a public node resource;
according to the configuration test requirement of a second user, establishing target configuration based on the public configuration in the public node resource;
establishing a target task for testing the target configuration according to the requirement of the target configuration to be tested of the second user; the target task comprises target nodes generated based on the target configuration and relations among the target nodes;
and under the condition of receiving a task running instruction input by the second user, sequentially running all target nodes in the target task, and outputting a running result.
2. The method of claim 1, wherein after outputting the operation result, further comprising:
receiving a modification instruction aiming at the target task, and modifying the target task according to the modification instruction;
and after the target task is modified, re-executing the step of sequentially operating each node in the target task under the condition of receiving the task operation instruction.
3. The method of claim 1, wherein after outputting the operation result, further comprising:
receiving an audit submission instruction for the target configuration;
submitting the target configuration to audit according to the audit submitting instruction;
and after receiving the auditing passing information aiming at the target configuration, carrying out online processing on the target configuration.
4. The method of claim 1, wherein the establishing a target task for testing the target configuration further comprises:
receiving a downloading instruction aiming at the nodes in the target task;
and issuing the nodes in the target task according to the downloading instruction.
5. The method of claim 1, wherein outputting the operation result comprises:
and under the condition that the node of the target task fails to operate, interrupting the operation of the whole task and outputting an operation result aiming at the node which fails to operate.
6. The method of claim 1, wherein after generating the common node resource, further comprising:
receiving a management operation instruction aiming at the public configuration in the public node resource, and executing corresponding operation according to the management operation instruction; wherein the management operation instructions include at least one of:
version management instructions, viewing instructions, editing instructions, copying instructions, updating instructions, adding instructions and deleting instructions.
7. The method of claim 6, wherein after receiving the management operation instruction for the common configuration in the common node resource, further comprising:
and acquiring a user identifier for inputting the management operation instruction, and establishing a corresponding relation between the corresponding operation to be executed and the user identifier.
8. A data processing system, comprising:
the generating module is used for packaging the target functions related to the business analyzed by the first user according to the requirements or statistics to generate the public node resources;
the configuration creating module is used for creating target configuration based on the public configuration in the public node resources according to the configuration test requirement of a second user;
the task establishing module is used for establishing a target task for testing the target configuration according to the requirement of the target configuration to be tested of the second user; the target task comprises target nodes generated based on the target configuration and relations among the target nodes;
the running module is used for running each target node in the target task in sequence under the condition of receiving a task running instruction input by the second user;
and the result output module is used for outputting the operation result.
9. The system of claim 8, further comprising:
the modification instruction receiving module is used for receiving a modification instruction aiming at the target task after the result output module outputs the operation result and modifying the target task according to the modification instruction;
and after the modification instruction receiving module completes modification on the target task, triggering the running module to execute the step of running each node in the target task in sequence under the condition of receiving the task running instruction again.
10. The system of claim 8, further comprising:
a submission instruction receiving module, configured to receive an audit submission instruction for the target configuration after the result output module outputs the operation result;
the submission auditing module is used for submitting the target configuration to audit according to the audit submission instruction;
and the online processing module is used for performing online processing on the target configuration after receiving the auditing passing information aiming at the target configuration.
11. The system of claim 8, further comprising:
a download instruction receiving module, configured to receive a download instruction for a node in a target task after the task establishing module establishes the target task for testing the target configuration;
and the issuing module is used for issuing the nodes in the target task according to the downloading instruction.
12. The system of claim 8, wherein the result output module is further configured to interrupt the running of the entire task and output the running result for the node with failed running if the node of the target task has failed running.
13. The system of claim 8, further comprising:
an operation instruction receiving module, configured to receive a management operation instruction for a common configuration in a common node resource after the common node resource is generated by the generating module;
the execution operation module is used for executing corresponding operation according to the management operation instruction; wherein the management operation instructions include at least one of:
version management instructions, viewing instructions, editing instructions, copying instructions, updating instructions, adding instructions and deleting instructions.
14. The system of claim 13, further comprising:
and the acquisition establishing module is used for acquiring the user identifier of the management operation instruction input after the operation instruction receiving module receives the management operation instruction aiming at the public configuration in the public node resource, and establishing the corresponding relation between the corresponding operation to be executed and the user identifier.
15. A computer storage medium, characterized in that it stores a plurality of instructions adapted to be loaded by a processor and to perform the method according to any one of claims 1 to 7.
CN201710109234.3A 2017-02-27 2017-02-27 Data processing method and system Active CN108509330B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710109234.3A CN108509330B (en) 2017-02-27 2017-02-27 Data processing method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710109234.3A CN108509330B (en) 2017-02-27 2017-02-27 Data processing method and system

Publications (2)

Publication Number Publication Date
CN108509330A CN108509330A (en) 2018-09-07
CN108509330B true CN108509330B (en) 2022-08-19

Family

ID=63372802

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710109234.3A Active CN108509330B (en) 2017-02-27 2017-02-27 Data processing method and system

Country Status (1)

Country Link
CN (1) CN108509330B (en)

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103220163B (en) * 2012-01-19 2017-03-01 阿里巴巴集团控股有限公司 The update method of configuration information and system
CN104461651B (en) * 2014-12-22 2017-11-10 东信和平科技股份有限公司 A kind of framework flow control method, apparatus and system
CN106201472A (en) * 2016-06-24 2016-12-07 网易(杭州)网络有限公司 The method for scheduling task of software development and device

Also Published As

Publication number Publication date
CN108509330A (en) 2018-09-07

Similar Documents

Publication Publication Date Title
US10162612B2 (en) Method and apparatus for inventory analysis
US10572249B2 (en) Software kit release management
US9477581B2 (en) Integrated system and method for validating the functionality and performance of software applications
CN106156186B (en) Data model management device, server and data processing method
EP2228726B1 (en) A method and system for task modeling of mobile phone applications
US9037549B2 (en) System and method for testing data at a data warehouse
US8527452B2 (en) Construction of rules for use in a complex event processing system
CN114625353A (en) Model framework code generation system and method
KR102237877B1 (en) Intelligent software auto development system with real-time collaboration support and method thereof
CN111427561A (en) Service code generation method and device, computer equipment and storage medium
CN115170048B (en) Workflow realization method, system and medium based on model and rule
CN112380255A (en) Service processing method, device, equipment and storage medium
CN110727575B (en) Information processing method, system, device and storage medium
CN115993966B (en) Application development system and method
CN115576539A (en) Continuous integration method, device, equipment and medium of software data
US11899570B2 (en) System and method for optimizing assessment and implementation of microservices code for cloud platforms
CN110837356A (en) Data processing method and device
Jena et al. Test case creation from UML sequence diagram: a soft computing approach
CN108509330B (en) Data processing method and system
CN115827051A (en) Software integration management system, method and server
CN110633077B (en) Quick development system and method based on modularization
CN114911773A (en) Universal meta-model design method
CN114331110A (en) Project management method, device, equipment and storage medium
US10453019B1 (en) Business activity resource modeling system and method
CN116301804A (en) Front-end-based data modeling method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant