WO2019019361A1

WO2019019361A1 - Method and apparatus for processing data of database, computer device, and storage medium

Info

Publication number: WO2019019361A1
Application number: PCT/CN2017/104253
Authority: WO
Inventors: 柴春燕
Original assignee: 上海壹账通金融科技有限公司
Priority date: 2017-07-24
Filing date: 2017-09-29
Publication date: 2019-01-31
Also published as: CN107665233B; CN107665233A

Abstract

A method for processing data of a database. The method comprises: acquiring a data processing task execution instruction (S302); extracting a task identifier in the data processing task execution instruction (S304); acquiring a task script corresponding to the task identifier (S306); extracting a data processing instruction and a data acquiring condition in the task script (S308); acquiring target data from a database corresponding to each database type according to the data acquiring condition (S310); separately creating a temporary data table according to the target data corresponding to each database type (S312); and processing the target data in the temporary data table according to the data processing instruction (S314).

Description

Database data processing method, device, computer device and storage medium

This application claims the priority of the Chinese Patent Application filed on July 24, 2017, the Chinese Patent Application No. 2017106085238, entitled "Database Data Processing Method, Apparatus, Computer Equipment, and Storage Media", the entire contents of which are incorporated by reference. Combined in this application.

Technical field

The present application relates to the field of data processing technologies, and in particular, to a database data processing method, apparatus, computer device, and storage medium.

Background technique

At any time, the development of computer technology requires a large amount of data to be processed by computers. As data processing needs continue to grow, so does the data processing power of computers.

In the process of storing data, data is stored in databases of different database types according to business needs. Traditional data processing techniques can only process data in a database of a single database type. When it comes to data of multiple database types, the data processing efficiency is low.

Summary of the invention

According to various embodiments of the present application, a database data processing method, apparatus, computer device, and storage medium are provided.

A database data processing method, comprising:

Obtaining a data processing task execution instruction;

Extracting a task identifier in the data processing task execution instruction;

Obtaining a task script corresponding to the task identifier;

Extracting data processing instructions and data acquisition conditions in the task script;

Obtaining target data from a database corresponding to each database type according to the data acquisition condition;

Creating a temporary data table according to the target data corresponding to each database type; and

Processing target data in the temporary data table according to the data processing instruction.

A database data processing device comprising:

An instruction acquisition module, configured to acquire a data processing task execution instruction;

An identifier extraction module, configured to extract a task identifier in the data processing task execution instruction;

a script obtaining module, configured to acquire a task script corresponding to the task identifier;

a script parsing module, configured to extract data processing instructions and data acquisition conditions in the task script;

a data acquisition module, configured to acquire target data from a database corresponding to each database type according to the data acquisition condition;

a data table creating module, configured to respectively create a temporary data table according to the target data corresponding to each database type; and

And a data processing module, configured to process the target data in the temporary data table according to the data processing instruction.

A computer device comprising a memory and a processor, wherein the memory stores computer executable instructions that, when executed by the processor, cause the processor to perform the following steps:

Obtaining a data processing task execution instruction;

Extracting a task identifier in the data processing task execution instruction;

Obtaining a task script corresponding to the task identifier;

One or more storage media storing computer executable instructions that, when executed by one or more processors, cause the one or more processors to perform the following steps:

Obtaining a data processing task execution instruction;

Extracting a task identifier in the data processing task execution instruction;

Obtaining a task script corresponding to the task identifier;

Details of one or more embodiments of the present application are set forth in the accompanying drawings and description below. Other features, objects, and advantages of the invention will be apparent from the description and appended claims.

DRAWINGS

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present application, and other drawings can be obtained according to the drawings without any creative work for those skilled in the art.

1 is an application environment diagram of a database data processing method in an embodiment;

2 is a structural block diagram of a server in a database data processing system in an embodiment;

3 is a schematic flow chart of a database data processing method in an embodiment;

4 is a schematic flowchart of a step of reading a task identifier according to a task dependency relationship in an embodiment;

5 is a schematic flow chart of steps of obtaining a custom function in an embodiment;

6 is a flow chart showing the steps of storing a processing result in an embodiment;

Figure 7 is a block diagram showing the structure of a database data processing apparatus in an embodiment;

8 is a structural block diagram of a data processing module in an embodiment;

Figure 9 is a block diagram showing the structure of a database data processing apparatus in another embodiment.

Detailed ways

Exemplary embodiments embodying the features and advantages of the present application will be described in detail in the following description. It should be understood that the present invention is capable of various modifications in the various embodiments, and This application.

Figure 1 is an application environment diagram of a database data processing method. Referring to Figure 1, the database data processing method is applied to a database data processing system. The database data processing system includes a terminal 110 and a server 120, wherein the terminal 110 is connected to the server 120 via a network. The terminal 110 may be a fixed terminal or a mobile terminal, and the fixed terminal may specifically be at least one of a printer, a scanner, and a monitor, and the mobile terminal may specifically be at least one of a tablet computer, a smart phone, a personal data assistant, and a digital camera. .

FIG. 2 is a schematic diagram showing the internal structure of the server 120 in the database data processing system of FIG. 1 in an embodiment. As shown in FIG. 2, the server 120 includes a processor, a non-volatile storage medium, an internal memory, and a network interface connected by a system bus. The processor of server 120 is used to provide computing and control capabilities to support the operation of the entire server 120, the memory for storing data, code instructions, etc., and the network interface for network communication with terminal 110. At least one computer executable instruction is stored on the memory, and the computer executable instructions are executable by the processor to implement the database data processing method applicable to the server 120 provided in the embodiment of the present application. The memory may include a non-volatile storage medium such as a magnetic disk, an optical disk, or a read-only memory (ROM). For example, in one embodiment, the memory includes a non-volatile storage medium and an internal memory; the non-volatile storage medium stores a processing system, a database, and computer-executable instructions, and the database includes a plurality of databases corresponding to the plurality of database types respectively The target data is stored in the database, and the computer executable instructions are executable by the processor to implement the database data processing method described above; the internal memory provides a cache operation for the processing system and the computer executable instructions in the non-volatile storage medium. surroundings.

Those skilled in the art can understand that the structure shown in FIG. 2 is only related to the solution of the present application. The schematic diagram of the partial structure does not constitute a limitation on the server to which the solution of the present application is applied, and the specific server may include more or less components than those shown in FIG. 2, or combine some components, or have Different parts are arranged.

As shown in FIG. 3, in an embodiment, a database data processing method is provided. This embodiment is exemplified by the method applied to the server 120 in FIG. 1, and the method specifically includes the following content:

S302. Acquire a data processing task execution instruction.

In an embodiment, the terminal 110 acquires a user account input by the user, generates a page data acquisition request according to the obtained user account, and sends a page data acquisition request to the server 120. After receiving the page data acquisition request sent by the terminal 110, the server 120 parses the page data acquisition request, and extracts the user account in the page data acquisition request by parsing. The server 120 performs rights verification on the extracted user account, and returns the data processing page data to the terminal 110 according to the page data acquisition request when verifying that the extracted user account has access rights to access the data processing page. After receiving the data processing page data, the terminal 110 displays the data processing page according to the data processing page data. The terminal 110 acquires a task identifier selected by the user in the displayed data processing page, and generates a data processing task execution instruction according to the selected task identifier. The terminal 110 transmits a data processing task execution instruction to the server 120.

S304. Extract a task identifier in the data processing task execution instruction.

In one embodiment, the server 120 receives the data processing task execution instruction sent by the terminal 110, parses the data processing task execution instruction, and extracts the task identifier in the task execution instruction by parsing. The task ID is a unique identifier for the task.

S306. Obtain a task script corresponding to the task identifier.

In one embodiment, the terminal 110 acquires a task identifier corresponding to the task identifier and the task identifier input by the user in the displayed data processing page, and sends the obtained task identifier and task script to the server 120. The server 120 stores the received task identifier and the task script correspondingly. A task script is a script that is executed when a data processing task is executed. After extracting the task identifier, the server 120 queries the task script corresponding to the extracted task identifier in the stored task script, and obtains the query result. Task script.

S308. Extract data processing instructions and data acquisition conditions in the task script.

In one embodiment, after extracting the task script, the server 120 parses the task script and extracts data processing instructions and data acquisition conditions from the task script through parsing. The data processing instruction is an instruction for processing data.

In one embodiment, the server 120 parses the task script, analyzes and identifies the data processing instruction, the data acquisition condition, and the operation resource configuration parameter in the task script, and configures the computing resource for the data processing instruction according to the computing resource configuration parameter.

S310. Acquire target data from a database corresponding to each database type according to a data acquisition condition.

In one embodiment, server 120 may access databases corresponding to multiple database types. The databases corresponding to the plurality of database types may be set on the server 120 or may be set on other servers. The server 120 acquires the access data interface of the database corresponding to the various database types, and obtains the target data that meets the data acquisition condition from the corresponding database by accessing the data access interface.

In an embodiment, the server 120 extracts the database identifier in the data acquisition condition, identifies the database type corresponding to the database identifier, acquires the database access interface of the database type, and obtains the data acquisition condition according to the database access interface from the database corresponding to the database identifier. Target data.

In an embodiment, the server 120 extracts the database type in the data acquisition condition, acquires the database access interface of the database type and the database corresponding to the query database type, and obtains the target data that meets the data acquisition condition from the queryed database according to the database access interface. .

S312. Create a temporary data table according to the target data corresponding to each database type.

In an embodiment, after obtaining the target data corresponding to each database type, the server 120 separately creates a temporary data table in a preset format according to the target data corresponding to each database type, and obtains a temporary data table corresponding to each database type, and a temporary data table. The target data is stored in it.

In an embodiment, S312 specifically includes the following: acquiring a temporary table creation instruction corresponding to each database type; and respectively corresponding to the corresponding database type according to the temporary table creation instruction According to the creation of a temporary data table.

In an embodiment, the server 120 acquires target data corresponding to each database type, acquires a temporary table creation instruction corresponding to each database type, and creates a data temporary table corresponding to each database type according to the temporary table creation instruction, and corresponding each database type. The data format of the target data is converted into a data format that matches the temporary data table, and the target data after the data format conversion is stored in the corresponding temporary data table.

S314: Process the target data in the temporary data table according to the data processing instruction.

In an embodiment, after the server 120 creates the temporary data table corresponding to each database type, the data processing is performed on the target data in the temporary data table corresponding to each database type according to the data processing, and the target in each temporary data table is adopted. The processing of the data is processed.

In this embodiment, the edited task script is acquired according to the data processing task execution instruction, the data processing task is parsed by the task script, and the data processing instruction and the data acquisition condition in the data processing task are extracted, and the data acquisition condition is corresponding to each database type according to the data acquisition condition. Get target data in the database. The temporary data table is respectively created according to the target data corresponding to each database type, and the temporary data table corresponding to each database type is established, and the target data in the temporary data table corresponding to each database type is processed according to the data processing instruction. It is not necessary to separately perform the separate operation on the target data corresponding to each database type, which improves the processing efficiency of the data corresponding to each database type.

As shown in FIG. 4, in an embodiment, S306 specifically includes the step of reading the task identifier according to the task dependency, and the step specifically includes the following content:

S402. Read each task identifier according to the task dependency in the data processing task execution instruction.

In an embodiment, the data processing task execution instruction includes a plurality of task identifiers and task dependencies corresponding to the plurality of task identifiers. The server 120 parses the data processing task execution instruction, extracts the task dependency relationship and the task identifier in the data processing task execution instruction, and reads the task identifier according to the task dependency relationship.

In one embodiment, the task identification in the data processing task execution instructions is a task flow identifier arranged in accordance with a task dependency. The server 120 reads the task identification from the task flow identifier based on the task dependency.

For example, the task flow identifier in the data processing task execution instruction is “1, 2|3|4, 5”, and the task flow identifier includes the task identifiers of task 1, task 2, task 3, task 4, and task 5. Where "," indicates that the task has a dependency, first execute the task corresponding to the task ID before "," and then execute the task corresponding to the task identifier after ","; "|" indicates that the task identifier before and after the "|" can be executed in parallel. Task. The task execution order of "1, 2|3|4, 5" is to execute task 1 first, and after task 1 is executed, perform task 2, task 3, and task 4 in parallel, and parallel in task 2, task 3, and task 4. After the execution is completed, perform task 5.

S404. Obtain a task script corresponding to the read task identifier.

In an embodiment, after the server 120 reads the task identifier from the task execution instruction according to the task dependency, the server 120 queries the task script corresponding to the task identifier in the stored task script to obtain the queried task script.

In this embodiment, the data processing task execution instruction includes a plurality of task identifiers and a task dependency relationship corresponding to the plurality of task identifiers, and the task identifier is read according to the task dependency relationship, and the task script is obtained according to the read task identifier. The task corresponding to each task identifier is executed according to the task dependency relationship, the operation steps of executing the task are simplified, the task execution efficiency is improved, and multiple data processing tasks can be executed according to a data processing task execution instruction, thereby improving data processing efficiency.

As shown in FIG. 5, in an embodiment, S314 specifically includes the step of acquiring a custom function, and the step specifically includes the following:

S502. Extract a custom function identifier in the data processing instruction.

In one embodiment, server 120 parses the data processing instructions by parsing the custom function identifiers in the data processing instructions. Among them, the custom function identifier is a unique identifier of the user-defined function.

S504: Obtain a data processing function from the custom function library according to the custom function identifier.

In one embodiment, the terminal 110 acquires a data processing function input by the user in the data processing page, and sends the acquired data processing function to the server 120. After receiving the data processing function, the server 120 extracts the custom function identifier in the data processing function, and stores the received data processing function and the extracted custom function identifier in the custom function library. Server After extracting the custom function identifier from the data processing instruction, querying the data processing function in the custom function library according to the extracted custom function identifier, and obtaining the data processing function of the query.

S506: Process the target data in the temporary data table according to the acquired data processing function.

In one embodiment, the server 120 processes the target data in the temporary data table according to the acquired data processing function, and processes the target data according to the data processing function to obtain a processing result. The server 120 can transmit the obtained processing result to the terminal 110 to cause the terminal 110 to display in the data processing page.

In this embodiment, the target data in the temporary data table of each database type can be processed according to the user-defined data processing function, so that the processing of the target data is more flexible, and the accuracy and efficiency of the data processing are improved.

As shown in FIG. 6, in an embodiment, the step S314 further includes a step of storing a processing result, where the step further includes the following content:

S602. Acquire a processing result storage instruction.

In one embodiment, the terminal 110 displays the processing result obtained by the server 120 in the data processing page, and when detecting that the result saving button in the data processing page is clicked, triggers the processing result storage instruction, and sends the triggered processing result storage instruction. To the server 120. The server 120 receives the processing result storage instruction transmitted by the terminal 110.

In one embodiment, the server 120 can detect if the data processing process is complete, and upon detecting the end of the data processing process, trigger the processing result storage instruction.

S604. Extract the database type in the processing result storage instruction.

In one embodiment, the server 120 parses the processing result storage instructions by parsing the database types in the processing result storage instructions. The extracted database type is the database type corresponding to the database in which the result is stored.

S606. Convert the processing result obtained by processing the target data into a data format that matches the extracted database type.

In an embodiment, the server 120 obtains a processing result obtained by processing the target data, determines a data format that the extracted database type matches, and performs a data format conversion on the processing result. Convert the processing result to the data format that the extracted database type matches.

S608. Store the processing result after the conversion format to the database corresponding to the extracted database type.

In one embodiment, the server 120 queries the database corresponding to the extracted database type, extracts the data identifier of the processing result, and stores the extracted data identifier and the processing result in the queried database.

In one embodiment, the server 120 extracts the database identifier in the processing result storage instruction, and identifies the database type to which the database corresponding to the extracted database identifier belongs. The server 120 determines the data format corresponding to the identified database type, converts the data format of the processing result into a determined data format, and stores the processed result after the converted format into the database corresponding to the extracted database identifier.

In this embodiment, according to the processing result storage instruction, the database type in the processing result storage instruction is extracted, the processing result is converted into a data format, the data format of the processing result is matched with the database type, and the processing result after the conversion format is stored to the processing. In the database corresponding to the database type in the result storage instruction, the correctness of the data format of the processing result is ensured.

In one embodiment, the user enters a user account and a user password through a browser page and a data processing application page. The terminal 110 acquires the input user account and the user password, generates a page data request according to the obtained user account and the user password, and the terminal 110 sends the page data request to the server 120.

After receiving the page data request, the server 120 extracts the user account and the user password in the page data request, and verifies whether the user corresponding to the user account has the access right according to the user account and the user password. The server 120 returns the data processing page data to the terminal 110 after verifying that the user corresponding to the user account has the access right.

The terminal 110 displays the data processing page based on the data processing page data. The user selects the task identifier in the data processing page, and clicks the data task execution button through the input device of the terminal 110. When detecting that the data task execution button in the data processing page is clicked, the terminal 110 generates a data processing task execution instruction according to the selected task identifier and the task dependency relationship corresponding to the selected task identifier, The data processing task execution instructions are sent to the server 120.

The server 120 extracts the task identifier corresponding to the task identifier and the task identifier in the data processing task execution instruction, and splits the plurality of data processing tasks according to the task dependency relationship and the task identifier. The server 120 extracts a task script according to the task identifiers in each data processing task, and extracts data processing instructions and data acquisition conditions in the task script.

The server 120 queries the target data from the database corresponding to each database type that can be accessed according to the data acquisition condition, and acquires the target data corresponding to each database type. The server 120 acquires a temporary table creation instruction corresponding to each database type, creates a temporary data table corresponding to the database type according to the temporary table creation instruction, and stores the corresponding target data to the temporary data table corresponding to the database type. The temporary data tables corresponding to each database type can be interacted with before. The server 120 processes the target data in the temporary data table corresponding to each database type according to the data processing instruction to obtain a processing result.

The server 120 acquires at least one of a user account, a data processing time, a data processing type, a database type, and a data acquisition condition registered by the terminal 110, according to the obtained user account, data processing time, data processing type, database type, and data acquisition. At least one of the conditions generates a data processing log.

As shown in FIG. 7, in an embodiment, a database data processing apparatus 700 is provided. The apparatus specifically includes the following: an instruction acquisition module 702, an identifier extraction module 704, a script acquisition module 706, a script parsing module 708, and data acquisition. Module 710, data table creation module 712, and data processing module 714.

The instruction acquisition module 702 is configured to acquire a data processing task execution instruction.

The identifier extraction module 704 is configured to extract a task identifier in the data processing task execution instruction.

The script obtaining module 706 is configured to obtain a task script corresponding to the task identifier.

The script parsing module 708 is configured to extract data processing instructions and data acquisition conditions in the task script.

The data obtaining module 710 is configured to use data corresponding to each database type according to the data acquisition condition. Get target data in the library.

The data table creating module 712 is configured to separately create a temporary data table according to the target data corresponding to each database type.

The data processing module 714 is configured to process the target data in the temporary data table according to the data processing instruction.

In one embodiment, the data table creation module 712 is further configured to acquire a temporary table creation instruction corresponding to each database type; and create a temporary data table for the target data corresponding to the corresponding database type according to the temporary table creation instruction.

In one embodiment, the script obtaining module 706 is further configured to: read each task identifier according to the task dependency in the data processing task execution instruction; and acquire a task script corresponding to the read task identifier.

As shown in FIG. 8, in one embodiment, the data processing module 714 specifically includes the following: a function identifier extraction module 714a, a processing function acquisition module 714b, and a processing result obtaining module 714c.

The function identifier extraction module 714a is configured to extract a custom function identifier in the data processing instruction.

The processing function obtaining module 714b is configured to obtain the custom function library according to the custom function identifier Take the data processing function.

The processing result obtaining module 714c is configured to process the target data in the temporary data table according to the acquired data processing function.

As shown in FIG. 9, in one embodiment, the database data processing apparatus 700 specifically includes the following: an instruction acquisition module 716, a type extraction module 718, a format conversion module 720, and a data storage module 722.

The instruction acquisition module 716 is configured to acquire a processing result storage instruction.

The type extraction module 718 is configured to extract a database type in the processing result storage instruction.

The format conversion module 720 is configured to convert the processing result obtained by processing the target data into a data format that matches the extracted database type.

The data storage module 722 is configured to store the processed result after the conversion format to a database corresponding to the extracted database type.

The various modules in the database data processing apparatus described above may be implemented in whole or in part by software, hardware, and combinations thereof. The network interface may be an Ethernet or a wireless network card. Each of the above modules may be embedded in a hardware form or independent of a processor in the server, or may be stored in a memory of the server in a software form, so that the processor calls to perform operations corresponding to the above modules. The processor can be a central processing unit (CPU), a microprocessor, a microcontroller, or the like.

A computer device comprising a memory and a processor, wherein the memory stores computer executable instructions that, when executed by the processor, cause the processor Performing the following steps: acquiring a data processing task execution instruction; extracting a task identifier in the data processing task execution instruction; acquiring a task script corresponding to the task identifier; extracting a data processing instruction and a data acquisition condition in the task script; and obtaining data from each database according to the data acquisition condition The target data is obtained in the database corresponding to the type; the temporary data table is separately created according to the target data corresponding to each database type; and the target data in the temporary data table is processed according to the data processing instruction.

In one embodiment, the task script corresponding to the task identifier is obtained, including: reading each task identifier according to the task dependency relationship in the data processing task execution instruction; and acquiring a task script corresponding to the read task identifier.

In an embodiment, the temporary data table is separately created according to the target data corresponding to each database type, including: obtaining a temporary table creation instruction corresponding to each database type; and temporarily creating a temporary data corresponding to the corresponding database type according to the temporary table creation instruction. data sheet.

In one embodiment, processing the target data in the temporary data table according to the data processing instruction comprises: extracting a custom function identifier in the data processing instruction; and acquiring a data processing function from the custom function library according to the custom function identifier; The target data in the temporary data table is processed according to the obtained data processing function.

In one embodiment, after processing the target data in the temporary data table according to the data processing instruction, the processor further performs the steps of: acquiring a processing result storage instruction; extracting a database type in the processing result storage instruction; performing the target data The processed processing result is converted into a data format that matches the extracted database type; the processed result after the converted format is stored in the database corresponding to the extracted database type.

One or more storage media storing computer executable instructions that, when executed by one or more processors, cause one or more processors to perform the steps of: acquiring data processing task execution instructions; extracting data processing tasks Executing the task identifier in the instruction; acquiring the task script corresponding to the task identifier; extracting the data processing instruction and the data acquisition condition in the task script; acquiring the target data from the database corresponding to each database type according to the data acquisition condition; corresponding to each database type The target data respectively creates a temporary data table; the target data in the temporary data table is processed according to the data processing instruction.

In this embodiment, the edited task script is acquired according to the data processing task execution instruction, the data processing task is parsed by the task script, and the data processing instruction and the data acquisition condition in the data processing task are extracted, and the data acquisition condition is corresponding to each database type according to the data acquisition condition. Get target data in the database. Create a temporary data table according to the target data corresponding to each database type, and establish each database by The temporary data table corresponding to the type is processed by the target data in the temporary data table corresponding to each database type according to the data processing instruction. It is not necessary to separately perform the separate operation on the target data corresponding to each database type, which improves the processing efficiency of the data corresponding to each database type.

One of ordinary skill in the art can understand that all or part of the process of implementing the above embodiments can be completed by computer-executable instructions, which can be stored in a computer readable storage medium. Wherein, the program, when executed, may include the flow of an embodiment of the methods as described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or the like.

The above is only the preferred embodiment of the present application, and is not intended to limit the embodiments of the present application. Those skilled in the art can make corresponding modifications or modifications in accordance with the main concepts and spirit of the present application. The scope of protection of the application shall be subject to the scope of protection required by the claims.

Claims

A database data processing method, comprising:

Obtaining a data processing task execution instruction;

Extracting a task identifier in the data processing task execution instruction;

Obtaining a task script corresponding to the task identifier;

Extracting data processing instructions and data acquisition conditions in the task script;

Obtaining target data from a database corresponding to each database type according to the data acquisition condition;

Creating a temporary data table according to the target data corresponding to each database type; and

Processing target data in the temporary data table according to the data processing instruction.
The method according to claim 1, wherein the obtaining a task script corresponding to the task identifier comprises:

Reading each task identifier according to a task dependency in the data processing task execution instruction; and

Get the task script corresponding to the read task ID.
The method according to claim 2, wherein the creating a temporary data table according to the target data corresponding to each database type comprises:

Obtaining a temporary table creation instruction corresponding to each database type; and

And creating a temporary data table for the target data corresponding to the corresponding database type according to the temporary table creation instruction.
The method according to claim 3, wherein the processing the target data in the temporary data table according to the data processing instruction comprises:

Extracting a custom function identifier in the data processing instruction;

Obtaining a data processing function from a custom function library according to the custom function identifier; and

The target data in the temporary data table is processed according to the acquired data processing function.
The method according to claim 1, wherein after the processing the target data in the temporary data table according to the data processing instruction, the method further comprises:

Obtaining a processing result storage instruction;

Extracting a database type in the processing result storage instruction;

Converting the processed result obtained by processing the target data into a data format matching the extracted database type; and

The processing result after the conversion format is stored to the database corresponding to the extracted database type.
A database data processing device comprising:

An instruction acquisition module, configured to acquire a data processing task execution instruction;

An identifier extraction module, configured to extract a task identifier in the data processing task execution instruction;

a script obtaining module, configured to acquire a task script corresponding to the task identifier;

a script parsing module, configured to extract data processing instructions and data acquisition conditions in the task script;

a data acquisition module, configured to acquire target data from a database corresponding to each database type according to the data acquisition condition;

a data table creating module, configured to respectively create a temporary data table according to the target data corresponding to each database type; and

And a data processing module, configured to process the target data in the temporary data table according to the data processing instruction.
The device according to claim 6, wherein the script acquisition module reads each task identifier according to the task dependency relationship in the data processing task execution instruction; and acquires a task script corresponding to the read task identifier.
The device according to claim 7, wherein the data table creation module is further configured to acquire a temporary table creation instruction corresponding to each database type; and to respectively generate target data corresponding to the corresponding database type according to the temporary table creation instruction Create a temporary data table.
The device according to claim 8, wherein the data processing module comprises:

a function identifier extraction module, configured to extract a custom function identifier in the data processing instruction;

a processing function obtaining module, configured to obtain a data processing function from the custom function library according to the custom function identifier; and

The processing result obtaining module is configured to process the target data in the temporary data table according to the acquired data processing function.
The device according to claim 6, wherein the device further comprises:

An instruction acquisition module, configured to acquire a processing result storage instruction;

a type extraction module, configured to extract a database type in the processing result storage instruction;

a format conversion module, configured to convert the processing result obtained by processing the target data into a data format that matches the extracted database type; and

And a data storage module, configured to store the processed result after the converted format to a database corresponding to the extracted database type.
A computer device comprising a memory and a processor, wherein the memory stores computer executable instructions that, when executed by the processor, cause the processor to perform the following steps:

Obtaining a data processing task execution instruction;

Extracting a task identifier in the data processing task execution instruction;

Obtaining a task script corresponding to the task identifier;

Extracting data processing instructions and data acquisition conditions in the task script;

Obtaining target data from a database corresponding to each database type according to the data acquisition condition;

Creating a temporary data table according to the target data corresponding to each database type;

Processing target data in the temporary data table according to the data processing instruction.
The computer device according to claim 11, wherein the obtaining a task script corresponding to the task identifier comprises:

Reading each task identifier according to a task dependency in the data processing task execution instruction; and

Get the task script corresponding to the read task ID.
The computer device according to claim 12, wherein the creating a temporary data table according to the target data corresponding to each database type comprises:

Obtaining a temporary table creation instruction corresponding to each database type; and

And creating a temporary data table for the target data corresponding to the corresponding database type according to the temporary table creation instruction.
The method according to claim 13, wherein the processing the target data in the temporary data table according to the data processing instruction comprises:

Extracting a custom function identifier in the data processing instruction;

Obtaining a data processing function from a custom function library according to the custom function identifier; and

The target data in the temporary data table is processed according to the acquired data processing function.
The computer device according to claim 11, wherein after processing the target data in the temporary data table according to the data processing instruction, the processor further performs the following steps:

Obtaining a processing result storage instruction;

Extracting a database type in the processing result storage instruction;

Converting the processed result obtained by processing the target data into a data format matching the extracted database type; and

The processing result after the conversion format is stored to the database corresponding to the extracted database type.
One or more storage media storing computer executable instructions that, when executed by one or more processors, cause the one or more processors to perform the following steps:

Obtaining a data processing task execution instruction;

Extracting a task identifier in the data processing task execution instruction;

Obtaining a task script corresponding to the task identifier;

Extracting data processing instructions and data acquisition conditions in the task script;

Obtaining target data from a database corresponding to each database type according to the data acquisition condition;

Creating a temporary data table according to the target data corresponding to each database type;

Processing target data in the temporary data table according to the data processing instruction.
The storage medium according to claim 16, wherein the obtaining a task script corresponding to the task identifier comprises:

Reading each task identifier according to a task dependency in the data processing task execution instruction; and

Get the task script corresponding to the read task ID.
The storage medium according to claim 17, wherein the creating a temporary data table according to the target data corresponding to each database type comprises:

Obtaining a temporary table creation instruction corresponding to each database type; and

And creating a temporary data table for the target data corresponding to the corresponding database type according to the temporary table creation instruction.
The storage medium according to claim 18, wherein the processing the target data in the temporary data table according to the data processing instruction comprises:

Extracting a custom function identifier in the data processing instruction;

Obtaining a data processing function from a custom function library according to the custom function identifier; and

The target data in the temporary data table is processed according to the acquired data processing function.
The storage medium according to claim 16, wherein after the processing the target data in the temporary data table according to the data processing instruction, the processor further performs the following steps:

Obtaining a processing result storage instruction;

Extracting a database type in the processing result storage instruction;

Converting the processed result obtained by processing the target data into a data format matching the extracted database type; and

The processing result after the conversion format is stored to the database corresponding to the extracted database type.