CN116755719A

CN116755719A - Data processing method, device and data processing system of application component

Info

Publication number: CN116755719A
Application number: CN202310805015.4A
Authority: CN
Inventors: 类铭辰
Original assignee: Industrial and Commercial Bank of China Ltd ICBC
Current assignee: Industrial and Commercial Bank of China Ltd ICBC
Priority date: 2023-06-30
Filing date: 2023-06-30
Publication date: 2023-09-15

Abstract

The specification provides a data processing method, a data processing device and a data processing system for application components, and the data processing method, the device and the data processing system can be used in the financial field. Based on the method, a data processing system at least comprising a system platform, a configuration management database, a function platform, a script deployment platform, a script library, a user terminal and a server can be built in advance before the implementation. In specific implementation, the deployment of the target script related to the target application component can be automatically completed based on the data processing system. After receiving a target pipeline processing request about a target application component generated by a user terminal, the system platform analyzes the target pipeline processing request through a first pipeline program to obtain target configuration parameters; meanwhile, acquiring the associated information of the target server by inquiring a configuration management database; and calling a command execution tool of the target server to execute the target script under the appointed directory by the function platform based on the target configuration parameters and the associated information of the target server, and efficiently and conveniently obtaining a target processing result.

Description

Data processing method, device and data processing system of application component

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a data processing method, apparatus, and data processing system for an application component.

Background

In a financial business scenario, especially for large financial transaction service institutions (e.g., banks, paymate, etc.), it may be necessary to deploy and run new application components in the system that are involved in financial transaction services.

However, based on the existing data processing method of the application component, when the application component is deployed, related setting and deployment are mostly needed to be manually completed by a user, and the processing time is long; when the specific operation is deployed, the user is required to write the related codes to smoothly call the related servers in the system to operate the application component, the user operation is complicated and complex, and the technical requirement on the operation threshold of the user is relatively high.

In view of the above problems, no effective solution has been proposed at present.

Disclosure of Invention

The specification provides a data processing method, a data processing device and a data processing system for an application component, which can effectively simplify user operation, reduce operation thresholds of users, automatically and accurately complete deployment of the target application component, and efficiently and conveniently operate the target application component to obtain a required target processing result.

The present specification provides a data processing method of an application component, applied to a data processing system, where the data processing system at least includes: the method comprises the steps of a system platform, a configuration management database, a function platform, a script deployment platform, a script library, a user terminal and a server, wherein the data processing system is deployed with at least a first pipeline program, and the server is deployed with at least a command execution tool, and the method comprises the following steps:

the user terminal receives and responds to the first type of operation of the user and generates a target script related to the target application component; the target script is sent to a system platform;

the system platform forwards the target script to a script deployment platform;

the script deployment platform deploys the target script to a designated directory of a target server corresponding to the target application component through a script library;

the user terminal receives and responds to a second type of operation of the user, and a target pipeline processing request about a target application component is acquired based on a first pipeline program; the target pipeline processing request is sent to a system platform;

the system platform analyzes the target pipeline processing request through the first pipeline program to acquire corresponding target configuration parameters; inquiring a configuration management database through a preset interface to acquire the associated information of a target server corresponding to the target application component;

And the system platform calls a command execution tool of the target server to execute the target script under the appointed directory through the function platform based on the target configuration parameters and the associated information of the target server so as to feed back a corresponding target processing result to the user terminal.

In one embodiment, the script deployment platform deploys a target script to a specified directory of a target server corresponding to a target application component through a script library, including:

the script deployment platform audits the target script according to a preset audit rule;

the script deployment platform sends the target script to a script library under the condition that the target script audit is confirmed to pass;

storing a target script and associated information of the target script by the script library; and sending the target script to a corresponding target server according to the association information of the target script so as to deploy the target script under the appointed directory of the target server.

In one embodiment, the script deployment platform audits the target script according to preset audit rules, including:

the script deployment platform detects whether a risk instruction statement exists in the target script according to a preset auditing rule;

under the condition that the script deployment platform determines that no risk instruction statement exists in the target script, detecting whether the target script accords with a preset script writing specification according to a preset auditing rule;

And under the condition that the target script accords with the preset script writing specification, determining that the target script passes the auditing.

In one embodiment, after the script deployment platform detects whether there is a risk instruction statement in the target script according to a preset auditing rule, the method further includes:

the script deployment platform generates a target instruction statement list containing risk instruction statements under the condition that the risk instruction statements exist in the target script; the target instruction statement list is sent to a system platform;

the system platform receives a target instruction statement list;

inquiring and determining whether the risk instruction statement in the target instruction statement list is matched with the user authority according to the user identification of the user by the system platform;

under the condition that the risk instruction statement in the target instruction statement list is determined to be matched with the user permission, the system platform generates first type prompt information for representing the user permission matching; and sending the first type prompt information to the script deployment platform.

In one embodiment, after the system platform queries and determines whether the risk instruction statement in the target instruction statement list matches the user authority according to the user identification of the user, the method further comprises:

The system platform generates second-type prompt information for representing the unmatched user permission under the condition that the risk instruction statement in the target instruction statement list is unmatched with the user permission;

the system platform sends the second type prompt information to a script deployment platform;

stopping continuously auditing the target script by the script deployment platform under the condition that the second type of prompt information is received; and determining that the target script audit is not passed.

In one embodiment, the association information of the target script includes at least one of: script name of the target script, execution rule of the target script, address data of the target script.

In one embodiment, the data processing system is further deployed with a second pipeline program; wherein the first pipeline program is an upgraded version of the second pipeline program.

In one embodiment, a user terminal receives and responds to a second type of operation of a user, obtains a target pipeline processing request about a target application component based on a first pipeline program, including:

the user terminal receives and responds to the second type of operation of the user, and displays a pipeline program selection page; the pipeline program selection page at least comprises a first trigger icon corresponding to the first pipeline program, a second trigger icon corresponding to the second pipeline program and selection guide information of the pipeline program;

Under the condition that the user terminal determines that the first trigger icon is selected by a user, generating and displaying a corresponding first setting page based on a first pipelining program;

the user terminal obtains a target pipeline processing request about a target application component through the first setting page.

In one embodiment, the system platform invokes a command execution tool of the target server to execute a target script under a specified directory through the function platform based on the target configuration parameter and the associated information of the target server, so as to feed back a corresponding target processing result to the user terminal, and the method includes:

the system platform generates a corresponding target data processing request based on the target configuration parameters and the associated information of the target server; the target data processing request is sent to a function platform;

the function platform responds to the target data processing request, determines and calls a command execution tool deployed on the target server according to the association information of the target server, and executes a target script under a designated directory based on the target configuration parameters; receiving a processing result fed back by the command execution tool;

the function platform generates a corresponding target processing result according to the processing result; and sending the target processing result to the user terminal.

The present disclosure also provides a data processing method of an application component, applied to a system platform in a data processing system, where the data processing system further includes: a configuration management database, a function platform, a script deployment platform, a script library, a user terminal, and a server, wherein the data processing system is deployed with at least a first pipeline program, and the server is deployed with at least a command execution tool, and the method comprises:

receiving a target script about a target application component, which is generated by a user terminal in response to a first type of operation of a user;

the target script is sent to a script deployment platform; the script deployment platform deploys the target script to a designated directory of a target server corresponding to the target application component through a script library;

receiving a target pipeline processing request about a target application component, which is acquired by a user terminal according to a second type of operation of a user and based on a first pipeline program;

analyzing the target pipeline processing request through the first pipeline program to acquire corresponding target configuration parameters; inquiring a configuration management database through a preset interface to acquire the associated information of a target server corresponding to the target application component;

And calling a command execution tool of the target server to execute the target script under the appointed directory by the function platform based on the target configuration parameters and the associated information of the target server so as to feed back a corresponding target processing result to the user terminal.

The present specification also provides a data processing system comprising at least: the system platform, the configuration management database, the function platform, the script deployment platform, the script library, the user terminal and the server, wherein the data processing system is at least deployed with a first pipeline program, the server is at least deployed with a command execution tool,

the user terminal is used for receiving and responding to the first type of operation of the user and generating a target script related to the target application component; the target script is sent to a system platform;

the system platform is used for forwarding the target script to a script deployment platform;

the script deployment platform is used for deploying the target script to a designated directory of a target server corresponding to the target application component through the script library;

the user terminal is further used for receiving and responding to a second type of operation of a user, and acquiring a target pipeline processing request about a target application component based on the first pipeline program; the target pipeline processing request is sent to a system platform;

The system platform is also used for analyzing the target pipeline processing request through the first pipeline program to acquire corresponding target configuration parameters; inquiring a configuration management database through a preset interface to acquire the associated information of a target server corresponding to the target application component; and calling a command execution tool of the target server to execute the target script under the specified directory through the function platform based on the target configuration parameters and the associated information of the target server so as to feed back a corresponding target processing result to the user terminal.

The present specification also provides a data processing apparatus of an application component, applied to a system platform in a data processing system, where the data processing system further includes: a configuration management database, a function platform, a script deployment platform, a script library, a user terminal, and a server, wherein the data processing system is deployed with at least a first pipeline program, and the server is deployed with at least a command execution tool, and the device comprises:

the first receiving module is used for receiving a target script about a target application component, which is generated by a user terminal in response to a first type of operation of a user;

the sending module is used for sending the target script to a script deployment platform; the script deployment platform deploys the target script to a designated directory of a target server corresponding to the target application component through a script library;

The second receiving module is used for receiving a target pipeline processing request about a target application component, which is acquired by the user terminal according to a second type of operation of the user based on the first pipeline program;

the acquisition module is used for analyzing the target pipeline processing request through the first pipeline program and acquiring corresponding target configuration parameters; inquiring a configuration management database through a preset interface to acquire the associated information of a target server corresponding to the target application component;

and the processing module is used for calling a command execution tool of the target server to execute the target script under the appointed directory through the function platform based on the target configuration parameters and the associated information of the target server so as to feed back a corresponding target processing result to the user terminal.

The present specification also provides a server comprising a processor and a memory for storing processor executable instructions, the processor implementing the steps of the data processing method of the application component when executing the instructions.

The present specification also provides a computer readable storage medium having stored thereon computer instructions which when executed by a processor implement the steps of the data processing method of the application component.

The present specification also provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of the data processing method of the application component.

The data processing method, the device and the data processing system based on the application component provided by the specification can be used for pre-constructing the data processing system at least comprising a system platform, a configuration management database, a function platform, a script deployment platform, a script library, a user terminal and a server before specific implementation. In the implementation, based on the data processing system, the user terminal can generate a target script related to a target application component through the user terminal and send the target script to a system platform in the data processing system; after the system platform forwards the target script to the script deployment platform, the script deployment platform can deploy the target script to the appointed directory of the target server corresponding to the target application component through the script library so as to automatically and accurately complete the deployment of the related script. Then, after receiving a target pipeline processing request about a target application component generated by a user terminal, the system platform can firstly analyze through a first pipeline program to obtain corresponding target configuration parameters; meanwhile, acquiring the associated information of the target server by inquiring a configuration management database; and calling a command execution tool of the target server to execute the target script under the appointed directory by the function platform based on the target configuration parameters and the associated information of the target server so as to efficiently and conveniently operate and obtain the required target processing result. Therefore, the user operation is effectively simplified, the operation threshold of the user is reduced, and the whole processing time is shortened.

Drawings

In order to more clearly illustrate the embodiments of the present disclosure, the drawings that are required for the embodiments will be briefly described below, and the drawings described below are only some embodiments described in the present disclosure, and other drawings may be obtained according to these drawings without inventive effort for a person of ordinary skill in the art.

FIG. 1 is a flow diagram of a method for data processing of an application component provided in one embodiment of the present disclosure;

FIG. 2 is a schematic diagram of the composition of a data processing system based on the data processing method of the application component provided in the present specification;

FIG. 3 is a schematic diagram of one embodiment of a data processing method of an application component provided by embodiments of the present disclosure, in one example scenario;

FIG. 4 is a schematic diagram of one embodiment of a data processing method of an application component provided by embodiments of the present disclosure, in one example scenario;

FIG. 5 is a schematic diagram of one embodiment of a data processing method of an application component provided by embodiments of the present disclosure, in one example scenario;

FIG. 6 is a schematic diagram of one embodiment of a data processing method of an application component provided by embodiments of the present disclosure, in one example scenario;

FIG. 7 is a schematic diagram of one embodiment of a data processing method of an application component provided by embodiments of the present disclosure, in one example scenario;

FIG. 8 is a schematic diagram of one embodiment of a data processing method of an application component provided by embodiments of the present disclosure, in one example scenario;

FIG. 9 is a schematic diagram of the structural composition of a server provided in one embodiment of the present disclosure;

fig. 10 is a schematic structural diagram of a data processing apparatus of an application component according to an embodiment of the present disclosure.

Detailed Description

In order to make the technical solutions in the present specification better understood by those skilled in the art, the technical solutions in the embodiments of the present specification will be clearly and completely described below with reference to the drawings in the embodiments of the present specification, and it is obvious that the described embodiments are only some embodiments of the present specification, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are intended to be within the scope of the present disclosure.

The information data related to the user in the present specification is obtained and used under the condition that the user knows and agrees. And, the information data is acquired, stored, used, processed and the like, which meet the relevant regulations of national laws and regulations.

Referring to fig. 1, an embodiment of the present disclosure provides a data processing method for an application component, where the method is specifically applied to a data processing system. Referring to fig. 2, the data processing system at least includes: system platform, configuration management database, function platform, script deployment platform, script library, user terminal, server, etc. The data processing system is at least provided with a first pipeline program, the server is at least provided with a command execution tool, and when the method is concretely implemented, the method can comprise the following steps:

s101: the user terminal receives and responds to the first type of operation of the user and generates a target script related to the target application component; the target script is sent to a system platform;

s102: the system platform forwards the target script to a script deployment platform;

s103: the script deployment platform deploys the target script to a designated directory of a target server corresponding to the target application component through a script library;

s104: the user terminal receives and responds to a second type of operation of the user, and a target pipeline processing request about a target application component is acquired based on a first pipeline program; the target pipeline processing request is sent to a system platform;

S105: the system platform analyzes the target pipeline processing request through the first pipeline program to acquire corresponding target configuration parameters; inquiring a configuration management database through a preset interface to acquire the associated information of a target server corresponding to the target application component;

s106: and the system platform calls a command execution tool of the target server to execute the target script under the appointed directory through the function platform based on the target configuration parameters and the associated information of the target server so as to feed back a corresponding target processing result to the user terminal.

Based on the embodiment, by utilizing the data processing system, on one hand, the accurate deployment of the target script about the target application component can be automatically completed; on the other hand, the target application assembly can be efficiently and conveniently operated to obtain the target processing result required by the user, so that the user operation can be effectively simplified, the operation threshold of the user is reduced, and the overall processing time is shortened.

In some embodiments, referring to fig. 2, the data processing method of the application component described above may be specifically applied to a data processing system. The data processing system may be a data processing system of a financial transaction service institution (for example, XX bank), or may be a data processing system of a social platform or other institutions or platforms that need to provide and maintain a large number of application components, such as a video website. The data processing system of the financial transaction service is mainly taken as an example for the specific description below. The data processing system of the other institution may refer to related embodiments of the data processing system of the financial transaction service institution. In this regard, the description is not repeated.

Specifically, the data processing system may at least include the following structures: the system comprises a system platform, a configuration management database, a function platform, a script deployment platform, a script library, a user terminal and a server. The data processing system may be a data processing system for an open platform.

The system platform can be specifically understood as a tool platform responsible for overall scheduling of the data processing system. The system is respectively connected with the configuration management database, the function platform, the script deployment platform and the user terminal through corresponding data interfaces. Correspondingly, a user can simply, conveniently and efficiently connect into the data processing system only through a data interface between the user terminal and the system, and can better utilize the data processing system to finish specific data processing related to the application component through a system platform based on the data interface. Specifically, the system platform may be connected to the configuration management database through a preset intersection. Correspondingly, the system platform can efficiently query the configuration management database through the preset intersection.

The configuration management database (Configuration Management Database, CMDB) may be specifically understood as a logical database, which includes information about the full life cycle of configuration items in the data processing system, relationships between configuration items (e.g., physical relationships, real-time communication relationships, non-real-time communication relationships, dependency relationships, etc.), and association information of servers in the data processing system (e.g., IP addresses of servers, CPU configuration parameters of servers, operation data of servers, etc.).

The above-mentioned function platform is specifically understood as a tool platform responsible for the management of specific command execution in a data processing system.

The script deployment platform can be specifically understood as a tool platform responsible for auditing and managing scripts in a data processing system. Specifically, the script deployment platform is also connected with a script library. The script library may specifically be a WIDE script library. The script library can be used for script storage and script deployment. The WIDE script library can be specifically a script library based on a WIDE-visual system building platform.

A server as described above is in particular understood to be a computer device connected to a data processing system and responsible for running in particular one or several application components. Specifically, the relatively large financial transaction service facility includes a plurality of subordinate facilities, such as a data center, a business development center, a development center, and the like, subordinate to the bank. Accordingly, the servers may include servers of different clusters in different subordinate branches. Such as a cluster server of a data center, a cluster server of a business development center, a cluster server of a development center, etc.

Wherein the configuration management database may also be connected to the server through a pre-configured preset data interface (e.g., CMDB interface); correspondingly, the configuration management database can automatically collect and update the associated information of the server in real time through the preset data interface.

In particular, in consideration of the difference of the data parameter requirements of different subordinate institutions on the server, the preset data interfaces can comprise a plurality of data interfaces which are matched with the custom configuration according to the data parameter requirements of different subordinate institutions.

In specific implementation, the configuration management database may first determine the organization identifier of the server; then according to the mechanism identification, determining an adaptive data interface from preset data interfaces; and the server is connected with the data interface to acquire data information such as the associated information of the server.

Further, a command execution tool is also deployed in advance on the server. The command execution tool is connected with the function platform, can receive and respond to an execution command initiated by the function platform, and executes a corresponding application component on the server by executing a specific script.

The command execution tool may specifically include: vacpagent. The vacpatch is specifically a java program matched with the data processing system and capable of receiving and responding to an execution command to execute a script.

The user terminal may specifically be a terminal device deployed on the side of a user (e.g., a developer of a bank, a technician).

In this embodiment, the above server may be specifically understood as a background server capable of implementing functions such as data transmission and data processing. Specifically, the server may be, for example, an electronic device having data operation, storage function and network interaction function. Alternatively, the server may be a software program running in the electronic device that provides support for data processing, storage, and network interactions. In the present embodiment, the number of servers is not particularly limited. The server may be one server, several servers, or a server cluster formed by several servers.

The above-mentioned user terminal can be understood as a front end capable of realizing functions such as data acquisition and data transmission. Specifically, the user terminal may be, for example, an electronic device such as a desktop computer, a tablet computer, a notebook computer, a smart phone, and the like. Alternatively, the client may be a software application capable of running in the electronic device. For example, an APP running on a desktop computer, etc.

In addition, the data processing system may be configured with at least a first pipeline program. The first pipeline program can be specifically understood as a program component which is adapted to the data processing system, can receive and combine resources in the data processing system according to a policy according to a user requirement to put into production of an application component, so as to complete the processes of deployment, suspension, upgrading, release and the like of the related application component. Specifically, the first pipeline program may include: VCDS or VAIM, etc. The VCDS may be a version persistent delivery pipeline program, and the VAIM may be a development platform application version automation installation management pipeline program.

In some more complex data processing scenarios, the data processing system may also be concurrently deployed with a second pipeline program. The second pipeline program is specifically understood to be a pipeline program different from the first pipeline program. Specifically, the second pipeline program may be a previously deployed pipeline program, and the first pipeline program is an upgraded version of the second pipeline program. In a more complex data processing scenario, in addition to helping a user efficiently and conveniently complete data processing of a corresponding application component, a job originally based on a second pipeline program and a dependence of the user on the second pipeline program need to be gradually migrated to a first pipeline program.

Based on the data processing system, a user can efficiently complete data processing related to application components such as deployment, suspension, upgrading, testing, online and the like of the application components through friendly interactive operation, so that the user operation is effectively simplified, the operation threshold of the user is reduced, and the overall processing time is shortened.

In some embodiments, the target application component may be specifically understood as an application component to be deployed and to be run currently. Specifically, the target application component may be an application component that has not been completely new before, or may be an updated version based on an existing application component. Specifically, the target application component may be a transaction record query component, an account identity verification component, a CPU operation monitoring component of a data processing system server, and the like.

In some embodiments, the user terminal may present a more friendly scripting interface to the user based on the first pipelining program when implemented. The user may perform a simpler first type of operation in the scripting interface described above to script related to the target application component. Correspondingly, the user terminal can receive and respond to the first type of operation of the user through the script programming interface to generate a corresponding target script; and sending the target script to the system platform.

The target script may further carry remark data of the user for the target script. Correspondingly, the associated information of the target script can be obtained through analysis and identification based on the remark data.

In addition, the target script may also carry a user identifier of the user and a terminal identifier of the user terminal. Correspondingly, after receiving the target script, the system platform can extract the user identifier and the terminal identifier first; user identity verification is carried out according to the user identification, and terminal identity verification is carried out according to the terminal identification; under the condition that the user authentication is confirmed to pass and the terminal authentication is confirmed to pass, inquiring a user database to confirm whether the binding relationship exists between the user and the user terminal; and forwarding the target script to the script deployment platform under the condition that the binding relation exists.

In some embodiments, referring to fig. 3, the above-mentioned script deployment platform deploys, through a script library, a target script to a specified directory of a target server corresponding to a target application component, where the specific implementation may include the following:

s1: the script deployment platform audits the target script according to a preset audit rule;

s2: the script deployment platform sends the target script to a script library under the condition that the target script audit is confirmed to pass;

s3: storing a target script and associated information of the target script by the script library; and sending the target script to a corresponding target server according to the association information of the target script so as to deploy the target script under the appointed directory of the target server.

Based on the embodiment, the script deployment platform can automatically audit the target script first, and then send the target script to the script library after the automatic audit is passed, and the target script is automatically and safely deployed to the appointed directory of the target server through the script library, so that manual deployment by a user is not needed, and the user operation can be effectively simplified.

The preset auditing rule at least comprises key fields of risk instruction sentences and preset script writing specifications. The preset auditing rule supports real-time updating.

In some embodiments, the association information of the target script may specifically include at least one of the following: script name of the target script, execution rule of the target script, address data of the target script, and the like.

The execution rule of the target script may specifically include a configuration requirement of a server responsible for executing the target script (for example, a cluster identifier of a cluster to which the server belongs, an IP address of the server, a lower limit threshold of a CPU of the server, a lower limit threshold of an IO parameter of the server, etc.), and an execution requirement when the server executes the target script (for example, an execution mode, an execution condition, an execution environment when the server executes the script, a designated deployment directory of the target script in the server, etc.).

In the specific implementation, the script library can obtain the key script content of the target script by analyzing the target script; and combining remark data of the target script with key script content to acquire the associated information of the target script.

In specific implementation, the script library can determine a subsequent server responsible for executing the target script as a target server according to the association information of the target script; and then the target script is sent to a target server and deployed under the appointed directory of the target server.

In some embodiments, referring to fig. 4, the above-mentioned script deployment platform may, when implemented, audit the target script according to a preset audit rule, include the following:

s1: the script deployment platform detects whether a risk instruction statement exists in the target script according to a preset auditing rule;

s2: under the condition that the script deployment platform determines that no risk instruction statement exists in the target script, detecting whether the target script accords with a preset script writing specification according to a preset auditing rule;

s3: and under the condition that the target script accords with the preset script writing specification, determining that the target script passes the auditing.

Based on the embodiment, the script deployment platform can automatically and safely audit whether the target script meets the requirements according to the preset audit rule.

Before implementation, the script deployment platform can combine expert experience and a large number of historical scripts to evaluate safety and regularity of instruction sentences related in the scripts, determine conventional instruction sentences which do not relate to system safety as common instruction sentences and instruction sentences which relate to system safety as risk instruction sentences. Wherein, the risk instruction statement may further include: conventional and system-safe instruction statements, and unconventional and system-safe instruction statements. The script deployment platform can extract key fields in the risk instruction sentences and write the key fields into preset auditing rules. Meanwhile, the script deployment platform can also acquire and combine the specific requirements of a financial transaction service mechanism according to the currently running system programs (such as pipeline programs and the like, operating systems and the like) of the data processing system, determine an adaptive script writing specification, and write the script writing specification into a preset auditing rule as a preset script writing specification.

When the method is implemented, the script deployment platform can generate prompt information for suggesting adjustment when the target script does not accord with the preset script specification under the condition that the target script is determined to not accord with the preset script writing specification; and then the prompt information and the preset script writing specification are sent to the user terminal together so as to prompt the user to adjust the target script according to the preset script writing specification, so that the target script accords with the preset script writing specification, and then the adjusted target script is sent to the system platform again.

In some embodiments, after the script deployment platform detects whether there is a risk instruction statement in the target script according to a preset auditing rule, referring to fig. 5, when the method is specifically implemented, the method may further include the following contents:

s1: the script deployment platform generates a target instruction statement list containing risk instruction statements under the condition that the risk instruction statements exist in the target script; the target instruction statement list is sent to a system platform;

s2: the system platform receives a target instruction statement list;

s3: inquiring and determining whether the risk instruction statement in the target instruction statement list is matched with the user authority according to the user identification of the user by the system platform;

S4: under the condition that the risk instruction statement in the target instruction statement list is determined to be matched with the user permission, the system platform generates first type prompt information for representing the user permission matching; and sending the first type prompt information to the script deployment platform.

Based on the embodiment, the system platform can assist the script deployment platform to efficiently complete accurate and comprehensive auditing of the target script by utilizing the advantages of the data interface.

In the specific implementation, the system platform can acquire and determine the user authority of each user according to the information of the entering years, the job levels, the posts of different users, the security levels of affiliated institutions and responsible projects and the like by inquiring the database; meanwhile, the system platform can combine the historical data to determine the risk level of the risk instruction statement; for example, generally conventional and system security-related instruction statements tend to have a lower risk level than non-conventional and system security-related instruction statements.

Correspondingly, the system platform can query the user database according to the user identification of the user so as to determine the user permission of the user; meanwhile, determining the risk level of the risk instruction statement in the target instruction statement list; and judging whether the risk instruction statement is matched with the user permission by detecting whether the user permission is matched with the risk level of the risk instruction statement.

When the method is implemented, the system platform generates first type prompt information for representing the matching of the user permission under the condition that the risk instruction statement in the target instruction statement list is matched with the user permission; and sending the first type prompt information to the script deployment platform. Correspondingly, after the script platform determines that the first type of prompt information is received, the risk instruction statement in the target script is determined to meet the requirements, and further whether the target script meets the preset script writing specification can be continuously detected.

In some embodiments, after the system platform queries and determines whether the risk instruction statement in the target instruction statement list matches the user authority according to the user identification of the user, the method may further include the following when implemented:

s1: the system platform generates second-type prompt information for representing the unmatched user permission under the condition that the risk instruction statement in the target instruction statement list is unmatched with the user permission;

s2: the system platform sends the second type prompt information to a script deployment platform;

s3: stopping continuously auditing the target script by the script deployment platform under the condition that the second type of prompt information is received; and determining that the target script audit is not passed.

Based on the above embodiment, in the case that the system platform determines that the risk instruction statement in the target instruction statement list is not matched with the user authority of the user, in order to protect the overall data security of the data processing system, it may be determined that the target script audit is not passed, and the risk script is prevented from being deployed on the server.

And under the condition that the target script audit is determined to be failed, the script deployment platform can generate prompt information of failed audit and send the prompt information to the user terminal.

In some embodiments, the data processing system is further deployed with a second pipeline program; wherein the first pipeline program is an upgraded version of the second pipeline program.

Based on the above-described embodiments, it is possible to cope with a complex data processing scenario in which a plurality of different pipeline programs are deployed simultaneously with processing by the data processing method of an application component provided in the present specification.

In some embodiments, referring to fig. 6, the receiving, by the user terminal, and in response to the second type of operation of the user, obtaining, based on the first pipeline program, a target pipeline processing request about the target application component, where the implementation may include:

s1: the user terminal receives and responds to the second type of operation of the user, and displays a pipeline program selection page; the pipeline program selection page at least comprises a first trigger icon corresponding to the first pipeline program, a second trigger icon corresponding to the second pipeline program and selection guide information of the pipeline program;

S2: under the condition that the user terminal determines that the first trigger icon is selected by a user, generating and displaying a corresponding first setting page based on a first pipelining program;

s3: the user terminal obtains a target pipeline processing request about a target application component through the first setting page.

Based on the above embodiment, the user terminal may actively guide the user to set and generate the target pipeline processing request by using the first pipeline program of the updated version, so as to gradually guide the user to complete the related data processing by using the first pipeline program instead of the original second pipeline program.

In some embodiments, the system platform may also analyze and determine program writing differences between the first pipeline program and the second pipeline program; and according to the program writing difference, the existing application components based on the second pipeline program in the data processing system are adjusted so as to gradually and automatically adjust the migration of the existing application components based on the second pipeline program to the application components matched with the first pipeline program. Therefore, the manual adjustment is not needed by the user, and the user operation is further simplified.

In some embodiments, referring to fig. 7, the system platform invokes, through a function platform, a command execution tool of the target server to execute a target script under a specified directory based on the target configuration parameter and the association information of the target server, so as to feed back a corresponding target processing result to the user terminal, where the implementation may include the following:

S1: the system platform generates a corresponding target data processing request based on the target configuration parameters and the associated information of the target server; the target data processing request is sent to a function platform;

s2: the function platform responds to the target data processing request, determines and calls a command execution tool deployed on the target server according to the association information of the target server, and executes a target script under a designated directory based on the target configuration parameters; receiving a processing result fed back by the command execution tool;

s3: the function platform generates a corresponding target processing result according to the processing result; and sending the target processing result to the user terminal.

Based on the above embodiment, after completing the deployment of the target script, the user may efficiently call the corresponding target server through the system platform to execute the target script to run the target application component, so as to obtain the required target processing result.

In some embodiments, after receiving the target processing result, the user terminal may further detect, according to the target processing result, whether the operation effect of the target application component meets a preset operation requirement; and under the condition that the operation effect of the target application component meets the preset operation requirement, determining that the test of the target application component passes, and issuing and online the target application component to the outside.

From the foregoing, before implementation, the data processing method for an application component provided in the embodiments of the present disclosure may pre-construct a data processing system at least including a system platform, a configuration management database, a function platform, a script deployment platform, a script library, a user terminal, and a server. In specific implementation, based on the data processing system, the user terminal can send the generated target script about the target application component to the system platform; after the system platform forwards the target script to the script deployment platform, the script deployment platform can deploy the target script to the appointed directory of the target server corresponding to the target application component through the script library so as to automatically and accurately complete the deployment of the related script. Then, after receiving a target pipeline processing request about a target application component generated by a user terminal, the system platform can firstly analyze through a first pipeline program to obtain a target configuration parameter; meanwhile, acquiring the associated information of the target server by inquiring a configuration management database; and calling a command execution tool of the target server to execute the target script under the appointed directory by the function platform based on the target configuration parameters and the associated information of the target server so as to efficiently and conveniently operate and obtain the required target processing result. Therefore, the user operation is effectively simplified, the operation threshold of the user is reduced, and the whole processing time is shortened.

Referring to fig. 8, an embodiment of the present disclosure further provides a data processing method of an application component, which is applied to a system platform in a data processing system, where the data processing system further includes: the data processing system is provided with at least a first pipeline program, and the server is provided with at least a command execution tool, and the method can comprise the following when being implemented:

s1: receiving a target script about a target application component, which is generated by a user terminal in response to a first type of operation of a user;

s2: the target script is sent to a script deployment platform; the script deployment platform deploys the target script to a designated directory of a target server corresponding to the target application component through a script library;

s3: receiving a target pipeline processing request about a target application component, which is acquired by a user terminal according to a second type of operation of a user and based on a first pipeline program;

s4: analyzing the target pipeline processing request through the first pipeline program to acquire corresponding target configuration parameters; inquiring a configuration management database through a preset interface to acquire the associated information of a target server corresponding to the target application component;

S5: and calling a command execution tool of the target server to execute the target script under the appointed directory by the function platform based on the target configuration parameters and the associated information of the target server so as to feed back a corresponding target processing result to the user terminal.

Referring to fig. 2, the embodiment of the present disclosure further provides a data processing system, which may at least include: the system platform, the configuration management database, the function platform, the script deployment platform, the script library, the user terminal and the server, wherein the data processing system is at least deployed with a first pipeline program, the server is at least deployed with a command execution tool,

The embodiment of the present disclosure further provides a server, as shown in fig. 9, where the server includes a network communication port 901, a processor 902, and a memory 903, where the foregoing structures are connected by an internal cable, so that each structure may perform specific data interaction.

The network communication port 901 may be specifically configured to receive a target script related to a target application component, where the target script is generated by a user terminal in response to a first type of operation of a user.

The processor 902 may be specifically configured to send the target script to a script deployment platform; the script deployment platform deploys the target script to a designated directory of a target server corresponding to the target application component through a script library; receiving a target pipeline processing request about a target application component, which is acquired by a user terminal according to a second type of operation of a user and based on a first pipeline program; analyzing the target pipeline processing request through the first pipeline program to acquire corresponding target configuration parameters; inquiring a configuration management database through a preset interface to acquire the associated information of a target server corresponding to the target application component; and calling a command execution tool of the target server to execute the target script under the appointed directory by the function platform based on the target configuration parameters and the associated information of the target server so as to feed back a corresponding target processing result to the user terminal.

The memory 903 may be used to store a corresponding program of instructions.

In this embodiment, the network communication port 901 may be a virtual port that binds with different communication protocols, so that different data may be sent or received. For example, the network communication port may be a port responsible for performing web data communication, a port responsible for performing FTP data communication, or a port responsible for performing mail data communication. The network communication port may also be an entity's communication interface or a communication chip. For example, it may be a wireless mobile network communication chip, such as GSM, CDMA, etc.; it may also be a Wifi chip; it may also be a bluetooth chip.

In this embodiment, the processor 902 may be implemented in any suitable manner. For example, the processor may take the form of, for example, a microprocessor or processor, and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a programmable logic controller, and an embedded microcontroller, among others. The description is not intended to be limiting.

In this embodiment, the memory 903 may include multiple levels, and in a digital system, the memory may be any memory as long as it can hold binary data; in an integrated circuit, a circuit with a memory function without a physical form is also called a memory, such as a RAM, a FIFO, etc.; in the system, the storage device in physical form is also called a memory, such as a memory bank, a TF card, and the like.

The embodiments of the present specification also provide a computer readable storage medium storing computer program instructions for implementing a data processing method based on the above application component, where the computer program instructions when executed implement: receiving a target script about a target application component, which is generated by a user terminal in response to a first type of operation of a user; the target script is sent to a script deployment platform; the script deployment platform deploys the target script to a designated directory of a target server corresponding to the target application component through a script library; receiving a target pipeline processing request about a target application component, which is acquired by a user terminal according to a second type of operation of a user and based on a first pipeline program; analyzing the target pipeline processing request through the first pipeline program to acquire corresponding target configuration parameters; inquiring a configuration management database through a preset interface to acquire the associated information of a target server corresponding to the target application component; and calling a command execution tool of the target server to execute the target script under the appointed directory by the function platform based on the target configuration parameters and the associated information of the target server so as to feed back a corresponding target processing result to the user terminal.

In the present embodiment, the storage medium includes, but is not limited to, a random access Memory (Random Access Memory, RAM), a Read-Only Memory (ROM), a Cache (Cache), a Hard Disk (HDD), or a Memory Card (Memory Card). The memory may be used to store computer program instructions. The network communication unit may be an interface for performing network connection communication, which is set in accordance with a standard prescribed by a communication protocol.

In this embodiment, the functions and effects of the program instructions stored in the computer readable storage medium may be explained in comparison with other embodiments, and are not described herein.

The embodiments of the present specification also provide a computer program product comprising a computer program which, when executed by a processor, performs the steps of: the user terminal receives and responds to the first type of operation of the user and generates a target script related to the target application component; the target script is sent to a system platform; the system platform forwards the target script to a script deployment platform; the script deployment platform deploys the target script to a designated directory of a target server corresponding to the target application component through a script library; the user terminal receives and responds to a second type of operation of the user, and a target pipeline processing request about a target application component is acquired based on a first pipeline program; the target pipeline processing request is sent to a system platform; the system platform analyzes the target pipeline processing request through the first pipeline program to acquire corresponding target configuration parameters; inquiring a configuration management database through a preset interface to acquire the associated information of a target server corresponding to the target application component; and the system platform calls a command execution tool of the target server to execute the target script under the appointed directory through the function platform based on the target configuration parameters and the associated information of the target server so as to feed back a corresponding target processing result to the user terminal.

Referring to fig. 10, on a software level, the embodiment of the present disclosure further provides a data processing apparatus for an application component, where the apparatus may specifically include the following structural modules:

the first receiving module 1001 may be specifically configured to receive a target script related to a target application component, where the target script is generated by a user terminal in response to a first type of operation of a user;

the sending module 1002 may be specifically configured to send the target script to a script deployment platform; the script deployment platform deploys the target script to a designated directory of a target server corresponding to the target application component through a script library;

the second receiving module 1003 may specifically be configured to receive, according to the second class operation of the user, a target pipeline processing request about the target application component acquired by the user terminal based on the first pipeline program;

the obtaining module 1004 may be specifically configured to parse the target pipeline processing request through the first pipeline program to obtain a corresponding target configuration parameter; inquiring a configuration management database through a preset interface to acquire the associated information of a target server corresponding to the target application component;

the processing module 1005 may specifically be configured to invoke, by using a function platform, a command execution tool of the target server to execute a target script under a specified directory based on the target configuration parameter and the association information of the target server, so as to feed back a corresponding target processing result to the user terminal.

It should be noted that, the units, devices, or modules described in the above embodiments may be implemented by a computer chip or entity, or may be implemented by a product having a certain function. For convenience of description, the above devices are described as being functionally divided into various modules, respectively. Of course, when the present description is implemented, the functions of each module may be implemented in the same piece or pieces of software and/or hardware, or a module that implements the same function may be implemented by a plurality of sub-modules or a combination of sub-units, or the like. The above-described apparatus embodiments are merely illustrative, for example, the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

From the above, the data processing device of the application component provided in the embodiments of the present disclosure can automatically and accurately complete the deployment of the related scripts through the script deployment platform in the data processing system; and the command execution tool of the target server can be called through the function passing platform in the data processing system to execute the target script under the appointed directory, so that the required target processing result can be efficiently and conveniently operated. Therefore, the user operation is effectively simplified, the operation threshold of the user is reduced, and the whole processing time is shortened.

Although the present description provides method operational steps as described in the examples or flowcharts, more or fewer operational steps may be included based on conventional or non-inventive means. The order of steps recited in the embodiments is merely one way of performing the order of steps and does not represent a unique order of execution. When implemented by an apparatus or client product in practice, the methods illustrated in the embodiments or figures may be performed sequentially or in parallel (e.g., in a parallel processor or multi-threaded processing environment, or even in a distributed data processing environment). The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, it is not excluded that additional identical or equivalent elements may be present in a process, method, article, or apparatus that comprises a described element. The terms first, second, etc. are used to denote a name, but not any particular order.

The description may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, classes, etc. that perform particular tasks or implement particular abstract data types. The specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer-readable storage media including memory storage devices.

Although the present specification has been described by way of example, it will be appreciated by those skilled in the art that there are many variations and modifications to the specification without departing from the spirit of the specification, and it is intended that the appended claims encompass such variations and modifications as do not depart from the spirit of the specification.

Claims

1. A data processing method of an application component, applied to a data processing system, the data processing system comprising at least: the method comprises the steps of a system platform, a configuration management database, a function platform, a script deployment platform, a script library, a user terminal and a server, wherein the data processing system is deployed with at least a first pipeline program, and the server is deployed with at least a command execution tool, and the method comprises the following steps:

the system platform forwards the target script to a script deployment platform;

2. The method of claim 1, wherein the script deployment platform deploys the target script to a specified directory of the target server corresponding to the target application component through the script library, comprising:

3. The method of claim 2, wherein the script deployment platform audits the target script according to preset audit rules, comprising:

4. The method of claim 3, wherein after the script deployment platform detects whether there is a risk instruction statement in the target script according to a preset auditing rule, the method further comprises:

the system platform receives a target instruction statement list;

5. The method of claim 4, wherein after the system platform queries and determines whether the risk instruction statement in the target instruction statement list matches the user authority based on the user identification of the user, the method further comprises:

6. The method of claim 2, wherein the association information of the target script comprises at least one of: script name of the target script, execution rule of the target script, address data of the target script.

7. The method of claim 1, wherein the data processing system is further deployed with a second pipeline program; wherein the first pipeline program is an upgraded version of the second pipeline program.

8. The method of claim 7, wherein the user terminal receiving and responding to the second type of operation of the user, obtaining the target pipeline processing request for the target application component based on the first pipeline program, comprises:

9. The method according to claim 1, wherein the system platform, based on the target configuration parameters and the associated information of the target server through the function platform, calls a command execution tool of the target server to execute the target script under the specified directory, so as to feed back the corresponding target processing result to the user terminal, including:

10. A data processing method of an application component, applied to a system platform in a data processing system, the data processing system further comprising: a configuration management database, a function platform, a script deployment platform, a script library, a user terminal, and a server, wherein the data processing system is deployed with at least a first pipeline program, and the server is deployed with at least a command execution tool, and the method comprises:

11. A data processing system comprising at least: the system platform, the configuration management database, the function platform, the script deployment platform, the script library, the user terminal and the server, wherein the data processing system is at least deployed with a first pipeline program, the server is at least deployed with a command execution tool,

12. A data processing apparatus for an application component, for use with a system platform in a data processing system, the data processing system further comprising: a configuration management database, a function platform, a script deployment platform, a script library, a user terminal, and a server, wherein the data processing system is deployed with at least a first pipeline program, and the server is deployed with at least a command execution tool, and the device comprises:

13. A server comprising a processor and a memory for storing processor-executable instructions, which when executed by the processor implement the steps of the method of any one of claims 1 to 9, or 10.

14. A computer readable storage medium having stored thereon computer instructions which, when executed by a processor, implement the steps of the method of any of claims 1 to 9, or 10.

15. A computer program product comprising a computer program which, when executed by a processor, implements the steps of the method of any one of claims 1 to 9, or 10.