CN114519170A - Data processing method, system, electronic device and medium - Google Patents
Data processing method, system, electronic device and medium Download PDFInfo
- Publication number
- CN114519170A CN114519170A CN202210171378.2A CN202210171378A CN114519170A CN 114519170 A CN114519170 A CN 114519170A CN 202210171378 A CN202210171378 A CN 202210171378A CN 114519170 A CN114519170 A CN 114519170A
- Authority
- CN
- China
- Prior art keywords
- processing
- data
- data processing
- target
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 41
- 238000012545 processing Methods 0.000 claims abstract description 605
- 230000006870 function Effects 0.000 claims description 118
- 238000004590 computer program Methods 0.000 claims description 9
- 238000012216 screening Methods 0.000 claims description 8
- 238000001914 filtration Methods 0.000 claims 1
- 230000006978 adaptation Effects 0.000 abstract description 3
- 238000000034 method Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000013499 data model Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/18—Complex mathematical operations for evaluating statistical data, e.g. average values, frequency distributions, probability functions, regression analysis
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Physics (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Life Sciences & Earth Sciences (AREA)
- Operations Research (AREA)
- Probability & Statistics with Applications (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Algebra (AREA)
- Evolutionary Biology (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Computational Biology (AREA)
- Stored Programmes (AREA)
Abstract
The invention discloses a data processing method, a system, an electronic device and a medium, wherein the data processing method comprises the following steps: acquiring target processing data and at least one field name corresponding to the target processing data; acquiring a processing instruction for the field name, analyzing the processing instruction and obtaining data processing logic, wherein the data processing logic is used for representing specific operation on target processing data; selecting a data processing model corresponding to the processing instruction based on the processing instruction, wherein the data processing model comprises a target function corresponding to the data processing logic; and processing the target processing data based on the target function, the field name and the data processing logic. The data processing method realizes that the corresponding data processing model is selected according to the target processing data to be processed, realizes the adaptation of the target processing data and the data processing model, effectively meets the data processing requirements of users, and improves the flexibility and the processing efficiency of data processing.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a data processing method, system, electronic device, and medium.
Background
Currently, most of financial measurement and calculation performed by financial staff need to configure data processing logic through Excel (office software) for financial data processing, measurement and calculation requirements of different customers are different, so that the measurement and calculation logic needs to be customized again, and the communication time between two parties is long; the existing measuring and calculating tool mainly configures data processing logic through Excel, but the data processing logic through Excel configuration only can use functions supported by Excel software, and the functions have fewer types and cannot realize self-defined functions.
When the existing measuring and calculating tool is used for processing data, only the measuring and calculating logic carried by the measuring and calculating tool can be used, the measuring and calculating logic is few in types and not flexible enough, the user-defined data processing logic cannot be provided for a user, the data processing requirement of the user cannot be effectively met, and the flexibility and the processing efficiency of data processing are reduced.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a data processing method, a system, an electronic device and a medium, aiming at overcoming the defects that in the prior art, when the existing measuring and calculating tool is used for processing data, only the measuring and calculating logic carried by the measuring and calculating tool can be used, the measuring and calculating logic is few in types and not flexible enough, the user-defined data processing logic cannot be provided for a user, the data processing requirement of the user cannot be effectively met, and the flexibility and the processing efficiency of data processing are reduced.
The invention solves the technical problems through the following technical scheme:
in a first aspect, a data processing method is provided, where the data processing method includes:
acquiring target processing data and at least one field name corresponding to the target processing data;
acquiring a processing instruction for the field name, analyzing the processing instruction and obtaining data processing logic, wherein the data processing logic is used for representing specific operation on the target processing data;
selecting a data processing model corresponding to the processing instruction based on the processing instruction, wherein the data processing model comprises an objective function corresponding to the data processing logic;
processing the target process data based on the objective function, the field name, and the data processing logic.
According to the data processing method, the target processing data and at least one field name corresponding to the target processing data are obtained, the processing instruction for the field name is obtained, the processing instruction is analyzed and the data processing logic is obtained, the data processing model corresponding to the processing instruction is selected based on the processing instruction, wherein the data processing model comprises the target function corresponding to the data processing logic, the target processing data is processed based on the target function, the field name and the data processing logic, the corresponding data processing model is selected according to the target processing data to be processed, the target processing data and the data processing model are adapted, the data processing requirements of users are effectively met, and the flexibility and the processing efficiency of data processing are improved.
Preferably, the step of selecting the data processing model corresponding to the processing instruction based on the processing instruction specifically includes:
acquiring the data type of the target processing data;
selecting a corresponding objective function from a data processing model based on the data type and the data processing logic;
wherein the processable data type of the objective function is consistent with the data type of the target processed data.
The data processing method of the invention comprises the steps of acquiring the data type of target processing data; selecting a corresponding objective function from the data processing model based on the data type and the data processing logic; the data type of the processable data of the target function is consistent with the data type of the target processing data, the processing instruction is effectively checked, the wrong processing instruction is eliminated, data processing according to the wrong processing instruction is prevented, the time consumed by data processing is reduced, and the data processing efficiency is further improved.
Preferably, the data processing model includes a plurality of objective functions, a plurality of field names and a plurality of data processing logics, and each objective function, each field name and each data processing logic have a corresponding correspondence;
The data processing method constructs the data processing model through the following steps, and specifically comprises the following steps:
acquiring any processing instruction, analyzing the processing instruction and acquiring a corresponding data processing logic;
acquiring a target function corresponding to the data processing logic;
and acquiring the corresponding relation among the field name, the data processing logic and the target function, and constructing a data processing model for executing any processing instruction based on the corresponding relation.
The data processing method realizes the construction of corresponding data processing models aiming at different processing instructions by means of the constructed data processing models, selects the data processing models corresponding to the processing instructions when the specific processing instructions are obtained, further realizes the operation processing of the data corresponding to different processing instructions, different processing data and different field names, further meets the data processing requirements of users, and further improves the flexibility of data processing.
Preferably, the processing instructions comprise historical processing instructions and current processing instructions;
the step of selecting the data processing model corresponding to the processing instruction based on the processing instruction further comprises:
Acquiring historical processing instructions and data processing models corresponding to the historical processing instructions;
encoding each data processing model to generate a model ID (Identification), wherein the model ID is used for representing the corresponding relation between each historical processing instruction and each data processing model;
acquiring new target processing data and the current processing instruction corresponding to the new target processing data;
judging whether a target instruction matched with the current processing instruction exists in the historical processing instruction or not;
if so, acquiring a target model ID corresponding to the target instruction, and processing the new target processing data based on a target data processing model corresponding to the target model ID;
and if not, processing the new target processing data based on the target function, the field name and the data processing logic.
The data processing method comprises the steps of coding a data processing model corresponding to a historical processing instruction to obtain a model ID, judging whether a target instruction matched with a current processing instruction exists in the historical processing instruction when new target processing data need to be processed according to the current processing instruction, if so, obtaining a target model ID corresponding to the target instruction, and processing the new target processing data based on the target data processing model corresponding to the target model ID; the data processing model corresponding to the current processing instruction does not need to be selected based on the current processing instruction, and the target processing data corresponding to the current processing instruction is directly called for processing, so that the flexibility and the processing efficiency of data processing are further improved.
In a second aspect, there is provided a data processing system comprising:
the data acquisition module is used for acquiring target processing data and at least one field name corresponding to the target processing data;
the instruction acquisition module is used for acquiring a processing instruction of the field name, analyzing the processing instruction and obtaining data processing logic, and the data processing logic is used for representing specific operation on the target processing data;
the screening module is used for selecting a data processing model corresponding to the processing instruction based on the processing instruction, wherein the data processing model comprises a target function corresponding to the data processing logic;
and the data processing module is used for processing the target processing data based on the target function, the field name and the data processing logic.
Preferably, the screening module comprises:
a type acquisition unit configured to acquire a data type of the target processing data;
a function selection unit for selecting a corresponding objective function from a data processing model based on the data type and the data processing logic;
wherein the processable data type of the objective function is consistent with the data type of the target processed data.
Preferably, the data processing model includes a plurality of objective functions, a plurality of field names and a plurality of data processing logics, and each objective function, each field name and each data processing logic have a corresponding relationship;
the data processing model comprises:
the first acquisition module is used for acquiring any processing instruction, analyzing the processing instruction and acquiring a corresponding data processing logic;
the second acquisition module is used for acquiring a target function corresponding to the data processing logic;
and the third acquisition module is used for acquiring the corresponding relation among the field name, the data processing logic and the target function and constructing a data processing model for executing any processing instruction based on the corresponding relation.
Preferably, the processing instructions include historical processing instructions and current processing instructions;
the screening module further comprises:
a model acquisition unit configured to acquire history processing instructions and respective data processing models corresponding to the respective history processing instructions;
the model coding unit is used for coding each data processing model and generating a model ID, wherein the model ID is used for representing the corresponding relation between each historical processing instruction and each data processing model;
The data acquisition module is also used for acquiring new target processing data;
the instruction acquisition module is further used for acquiring the current processing instruction corresponding to the new target processing data;
the instruction judging unit is used for judging whether a target instruction matched with the current processing instruction exists in the historical processing instruction or not;
if yes, the data processing module is used for acquiring a target model ID corresponding to the target instruction; processing the new target processing data based on a target data processing model corresponding to the target model ID;
and if not, the data processing module is used for processing the new target processing data based on the target function, the field name and the data processing logic.
According to the data processing system, through mutual cooperation of the modules and the units, the corresponding data processing model is selected according to the target processing data to be processed, the target processing data and the data processing model are adapted, the data processing requirements of users are effectively met, and the flexibility and the processing efficiency of data processing are improved.
In a third aspect, an electronic device is provided, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the electronic device implements any of the data processing methods described above.
In a fourth aspect, there is provided a computer readable medium having stored thereon computer instructions which, when executed by a processor, implement any of the data processing methods described above.
The positive progress effects of the invention are as follows:
the data processing method comprises the steps of acquiring target processing data and at least one field name corresponding to the target processing data; acquiring a processing instruction for the field name, analyzing the processing instruction and obtaining data processing logic, wherein the data processing logic is used for representing specific operation on target processing data; selecting a data processing model corresponding to the processing instruction based on the processing instruction, wherein the data processing model comprises a target function corresponding to the data processing logic; processing the target processing data based on the target function, the field name and the data processing logic; the method and the device realize the selection of the corresponding data processing model according to the target processing data to be processed, realize the adaptation of the target processing data and the data processing model, effectively meet the data processing requirements of users, and improve the flexibility and the processing efficiency of data processing.
Drawings
Fig. 1 is a schematic flowchart of a data processing method according to embodiment 1 of the present invention;
Fig. 2 is a schematic flowchart of another data processing method according to embodiment 1 of the present invention;
fig. 3 is a schematic flowchart of another data processing method according to embodiment 1 of the present invention;
fig. 4 is a schematic flow chart of another data processing method according to embodiment 1 of the present invention;
fig. 5 is a schematic structural diagram of a data processing system according to embodiment 2 of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to embodiment 3 of the present invention.
Detailed Description
The invention is further illustrated by the following examples, which are not intended to limit the scope of the invention.
Example 1
Fig. 1 is a schematic flow chart of a data processing method provided in this embodiment, and as shown in fig. 1, the data processing method of this embodiment includes:
In this step, first, target data to be processed by a user is obtained, where the target data may be summarized table data, a row header of each row or a column header of each column is referred to as a field name, and the field name is used to represent data characteristics of data content under the field name. There may be multiple corresponding field names in the target data.
And 102, acquiring a processing instruction for the field name, analyzing the processing instruction and obtaining a data processing logic.
Wherein the data processing logic is configured to characterize a specific operation on the target process data.
In this step, a field name-based processing instruction of the user, that is, a processing instruction for the target data is obtained, and the target processing instruction is analyzed to obtain a data processing logic, where the data processing logic is used to represent that the user wants to perform some specific data operation on the target data.
And 103, selecting a data processing model corresponding to the processing instruction based on the processing instruction.
Wherein the data processing model includes an objective function corresponding to the data processing logic.
In this step, since the target processing data corresponds to a plurality of field names, the processing instruction includes a specific operation object, that is, includes data processing for a certain field name or all field names, and a data processing model corresponding to the field name is selected based on information including the field name in the processing instruction, where the data processing model includes a target function corresponding to the data processing logic, and the target function is a function representation form of the data processing logic.
And 104, processing the target processing data based on the target function, the field name and the data processing logic.
In the data processing method in this embodiment, the target processing data and at least one field name corresponding to the target processing data are obtained, the processing instruction for the field name is obtained, the processing instruction is analyzed and the data processing logic is obtained, and the data processing model corresponding to the processing instruction is selected based on the processing instruction, where the data processing model includes a target function corresponding to the data processing logic, and the target processing data is processed based on the target function, the field name and the data processing logic, so that the corresponding data processing model is selected according to the target processing data to be processed, the target processing data is adapted to the data processing model, the data processing requirements of users are effectively met, and the flexibility and the processing efficiency of data processing are improved.
In an optional implementation manner, fig. 2 is a schematic flow chart of a data processing method provided in this implementation manner, and as shown in fig. 2, the step 103 specifically includes:
and step 1031, obtaining the data type of the target processing data.
Wherein the processable data type of the target function is consistent with the data type of the target processed data.
In this step, the processable data type of the target function is consistent with the data type of the target processed data, such as an alphabetic type, a numeric type, or a character string type. If the processable data type of the target function is inconsistent with the data type of the target processed data, it is indicated that the target function cannot process the target processed data, and further effective verification is performed on the processing instruction, the wrong processing instruction is eliminated, data processing according to the wrong processing instruction is prevented, time consumed by data processing is reduced, and data processing efficiency is further improved.
In an optional embodiment, the data processing model includes a plurality of objective functions, a plurality of field names, and a plurality of data processing logics, and each objective function, each field name, and each data processing logic have a corresponding correspondence; fig. 3 is a method for constructing a data processing model according to the present embodiment, and as shown in fig. 3, the method for constructing a data processing model according to the present embodiment specifically includes:
In this step, the processing instruction includes data processing logic for which field names.
in this step, a target function corresponding to the data processing logic is selected from a function library corresponding to the data processing model.
The data processing model comprises a plurality of objective functions, a plurality of field names and a plurality of data processing logics, each objective function, each field name and each data processing logic have corresponding relations, the corresponding relations among the field names, the data processing logics and the objective functions are determined based on a certain field name, a certain data processing logic and a certain objective function which correspond to a certain acquired processing instruction, and the data processing model for executing the processing instruction is constructed based on the corresponding relations.
The data processing method of the embodiment realizes the construction of corresponding data processing models for different processing instructions by means of the constructed data processing models, selects the data processing models corresponding to the processing instructions when specific processing instructions are obtained, further realizes the operation processing of data corresponding to different processing instructions, different processing data and different field names, further meets the data processing requirements of users, and further improves the flexibility of data processing.
In an alternative embodiment, fig. 4 is a schematic flowchart of a data processing method provided in this embodiment, where the processing instruction includes a historical processing instruction and a current processing instruction; as shown in fig. 4, the step 103 further includes:
In this step, the processing instruction includes a historical processing instruction and a current processing instruction, and there is a correspondence between the processing instruction and the data model to obtain each data processing model corresponding to each historical processing instruction.
The model ID is used for representing the corresponding relation between each historical processing instruction and each data processing model.
In this step, each data processing model is encoded based on the correspondence between each historical processing instruction and each data processing model, and a model ID is generated.
If so, step 1037 is performed.
And 1037, acquiring a target model ID corresponding to the target instruction, and processing the new target processing data based on the target data processing model corresponding to the target model ID.
If not, go to step 1041.
And step 1041, processing the new target processing data based on the target function, the field name and the data processing logic.
In this step, a target model ID matching the current processing instruction is selected from the plurality of data processing models, and new target processing data is processed based on the target data processing model corresponding to the target model ID.
In the data processing method in this embodiment, a model ID is obtained by encoding a data processing model corresponding to a historical processing instruction, when new target processing data needs to be processed according to a current processing instruction, it is determined whether a target instruction matching the current processing instruction exists in the historical processing instruction, if so, a target model ID corresponding to the target instruction is obtained, and the new target processing data is processed based on the target data processing model corresponding to the target model ID; the data processing model corresponding to the current processing instruction does not need to be selected based on the current processing instruction, and the target processing data corresponding to the current processing instruction is directly called for processing, so that the flexibility and the processing efficiency of data processing are further improved.
The data processing method of the present invention is further explained below with reference to specific application scenarios.
For example, the target processing data of the user is air ticket related data, the field name corresponding to the air ticket related data includes order amount, monthly transaction amount, service fee collection mode, client name, starting place and destination, etc., if the processing instruction is 'total amount of collected order amount', the processing instruction is analyzed to know that the corresponding data processing logic is summation operation, the corresponding processing object is order amount, a data processing model a of the corresponding summation class is selected, the data processing model a includes a 'summation function', and the air ticket related data is processed based on the summation function, the order amount and the summation operation.
The data type of the order amount is a digital type, the processable data processing type of the summation function is also a digital type, and the summation function is selected to perform subsequent data processing operations only when the data type of the order amount is consistent with the processable data type of the summation function. If a certain processing instruction is 'sum the user name', the processing instruction is analyzed to know that the corresponding data processing logic is sum operation, but the data type of the user name is a character string, and the sum function cannot process the data of the character string type, so that the processing instruction has an error, and an error prompt instruction can be output to prompt a user.
If a certain processing instruction comprises a plurality of field names, if the processing instruction is 'summarizing the order amount and the service charge amount', data corresponding to each field name is processed.
IF a certain processing instruction is 'judge whether the order amount is more than 500', the processing instruction is analyzed to know that the corresponding data processing logic is judgment operation, the judgment result is qualified when the order amount is more than or equal to 500, the judgment result is unqualified when the order amount is less than 500, and the corresponding processing object is the order amount, a data processing model B of a judgment class is selected, the data processing model B comprises an 'IF function (judgment function)', the 'IF function is assigned to the' IF function, and the order amount is processed based on the assigned IF function.
The processing instructions are collected to form a historical processing instruction, and a data processing model corresponding to the historical processing instruction is coded, for example, the historical processing instruction a is 'total sum of collected order amount', the code of the data processing model corresponding to the instruction is A, the historical processing instruction B is 'judgment whether the order amount is more than 500', and the code of the data processing model corresponding to the instruction is B. If a certain user needs to process new target data such as the air ticket related data of 1 month, and the current processing instruction is 'total amount of summarized order sum', it can be judged that a target processing instruction a corresponding to the current processing instruction exists in the historical processing instruction, and the data processing model A corresponding to the target processing instruction a is directly used for processing the air ticket related data of 1 month. And if the target processing instruction corresponding to the current processing instruction does not exist in the historical processing instruction, processing the new target processing data based on the target function 'summation function', the field name 'order amount' and the data processing logic 'summarizing the order amount in the 1 month ticket related data'.
The data processing model comprises a plurality of objective functions, a plurality of field names and a plurality of data processing logics, wherein each objective function, each field name and each data processing logic have corresponding relations, the corresponding relations among the field names, the data processing logics and the objective functions are determined based on a certain field name, a certain data processing logic and a certain objective function which correspond to a certain acquired processing instruction, and the data processing model for executing the processing instruction is constructed based on the corresponding relations.
For example, the objective function includes an IF function, an OR function (OR function), an AND function (AND function), an IFERROR function (false determination function), a MAX function (maximum function), a MIN function (minimum function), a SUM function (summation function), an IFEMPTY function (blank determination function), AND the like.
If the target processing data to be processed by the user corresponds to a new field name and the new field name does not exist in the existing data model, the field name can be newly established, and the data processing model can also be directly newly established to meet the user requirements. How to create the data processing model will be described below.
For example, if a certain target processing data is train ticket data of 2 months, the field name corresponding to the data includes "order amount, insurance amount, etc.," the processing instruction is "summary insurance amount", and the data processing logic is "summation operation", then the corresponding relationship among the field name, the data processing logic, and the target function in the processing instruction is determined as follows: insurance amount-summing function-summing operation. And (3) newly building an interface on the data processing model, clicking the newly added model, entering a model editing interface, selecting the field name 'insurance sum' on the editing interface, selecting a target function from the function list as a summation function, storing the data processing model, and coding the data processing model corresponding to the processing instruction C 'summary insurance sum' into C. If the data processing logic also has other related data, such as threshold data set for different functions or other related assigned value data, the assignment operation is performed on the model editing interface. Each model editing interface includes a field name editing button that can be used to add, modify, or delete field names.
Example 2
Fig. 5 is a schematic structural diagram of a data processing system provided in this embodiment, and as shown in fig. 5, the data processing system includes:
the data acquisition module 1 is used for acquiring target processing data and at least one field name corresponding to the target processing data; the instruction acquisition module 2 is used for acquiring a processing instruction of the field name, analyzing the processing instruction and obtaining data processing logic, and the data processing logic is used for representing specific operation on target processing data; the screening module 3 is used for selecting a data processing model corresponding to the processing instruction based on the processing instruction, wherein the data processing model comprises a target function corresponding to the data processing logic; and the data processing module 4 is used for processing the target processing data based on the target function, the field name and the data processing logic.
The screening module 3 includes: a type acquisition unit 31 for acquiring a data type of the target processing data; a function selection unit 32 for selecting a corresponding objective function from the data processing model based on the data type and the data processing logic; wherein the processable data type of the target function is consistent with the data type of the target processed data.
The data processing model comprises a plurality of objective functions, a plurality of field names and a plurality of data processing logics, and each objective function, each field name and each data processing logic have corresponding relations; the data processing model specifically comprises: the first acquisition module is used for acquiring any processing instruction, analyzing the processing instruction and acquiring a corresponding data processing logic; the second acquisition module is used for acquiring a target function corresponding to the data processing logic; and the third acquisition module is used for acquiring the corresponding relation among the field name, the data processing logic and the target function and constructing a data processing model for executing any processing instruction based on the corresponding relation.
The processing instruction comprises a historical processing instruction and a current processing instruction; the screening module 3 further includes a model obtaining unit 33 for obtaining historical processing instructions and respective data processing models corresponding to the respective historical processing instructions; a model encoding unit 34, configured to encode each data processing model and generate a model ID, where the model ID is used to represent a corresponding relationship between each historical processing instruction and each data processing model; the data acquisition module 1 is also used for acquiring new target processing data; the instruction obtaining module 2 is further configured to obtain a current processing instruction corresponding to the new target processing data; an instruction judging unit 35, configured to judge whether a target instruction matching the current processing instruction exists in the historical processing instruction; if yes, the data processing module 4 is used for acquiring a target model ID corresponding to the target instruction; processing the new target processing data based on the target data processing model corresponding to the target model ID; if not, the data processing module 4 is configured to process the new target processing data based on the target function, the field name, and the data processing logic.
The data processing system of the embodiment realizes that the corresponding data processing model is selected according to the target processing data to be processed by mutually matching the modules and the units, realizes the adaptation of the target processing data and the data processing model, effectively meets the data processing requirement of a user, and improves the flexibility and the processing efficiency of data processing.
Example 3
Fig. 6 is a schematic structural diagram of an electronic device shown in this embodiment, where the electronic device includes a memory, a processor, and a computer program stored in the memory and capable of running on the processor, and the processor executes the computer program to implement the data processing method in embodiment 1. The electronic device 50 shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiment of the present invention. As shown in fig. 6, the electronic device 50 may be embodied in the form of a general purpose computing device, which may be, for example, a server device. The components of the electronic device 50 may include, but are not limited to: the at least one processor 51, the at least one memory 52, and a bus 53 connecting the various system components (including the memory 52 and the processor 51).
The bus 53 includes a data bus, an address bus, and a control bus.
The memory 52 may include volatile memory, such as Random Access Memory (RAM)521 and/or cache memory 522, and may further include Read Only Memory (ROM) 523.
The processor 51 executes various functional applications and data processing, such as the data processing method in embodiment 1 described above, by executing the computer program stored in the memory 52.
The electronic device 50 may also communicate with one or more external devices 54. Such communication may be through an input/output (I/O) interface 55. Moreover, the model-generated electronic device 50 may also communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet) via a network adapter 56. As shown in FIG. 6, network adapter 56 communicates with the other modules of electronic device 50 via bus 53. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with electronic device 50, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID (disk array) systems, tape drives, and data backup storage systems, etc.
It should be noted that although in the above detailed description several units/modules or sub-units/modules of the electronic device are mentioned, such a division is merely exemplary and not mandatory. Indeed, the features and functionality of two or more of the units/modules described above may be embodied in one unit/module according to embodiments of the invention. Conversely, the features and functions of one unit/module described above may be further divided into embodiments by a plurality of units/modules.
Example 4
The present embodiment provides a computer-readable storage medium on which a computer program is stored, the computer program, when executed by a processor, implementing the data processing method in embodiment 1 described above.
More specific examples, among others, that the readable storage medium may employ may include, but are not limited to: a portable disk, a hard disk, random access memory, read only memory, erasable programmable read only memory, optical storage device, magnetic storage device, or any suitable combination of the foregoing.
In a possible implementation, the present invention can also be implemented in the form of a program product, which includes program code for causing a terminal device to execute steps implementing the data processing method in embodiment 1 described above when the program product runs on the terminal device.
Where program code for carrying out the invention is written in any combination of one or more programming languages, the program code may execute entirely on the user device, partly on the user device, as a stand-alone software package, partly on the user device and partly on a remote device or entirely on the remote device.
While specific embodiments of the invention have been described above, it will be understood by those skilled in the art that this is by way of example only, and that the scope of the invention is defined by the appended claims. Various changes and modifications to these embodiments may be made by those skilled in the art without departing from the spirit and scope of the invention, and these changes and modifications are within the scope of the invention.
Claims (10)
1. A data processing method, characterized in that the data processing method comprises:
acquiring target processing data and at least one field name corresponding to the target processing data;
acquiring a processing instruction for the field name, analyzing the processing instruction and obtaining data processing logic, wherein the data processing logic is used for representing specific operation on the target processing data;
Selecting a data processing model corresponding to the processing instruction based on the processing instruction, wherein the data processing model comprises an objective function corresponding to the data processing logic;
processing the target processing data based on the target function, the field name, and the data processing logic.
2. The data processing method of claim 1, wherein the step of selecting the data processing model corresponding to the processing instruction based on the processing instruction specifically comprises:
acquiring the data type of the target processing data;
selecting a corresponding objective function from a data processing model based on the data type and the data processing logic;
wherein the processable data type of the objective function is consistent with the data type of the objective processed data.
3. The data processing method of claim 1, wherein the data processing model comprises a plurality of objective functions, a plurality of field names, and a plurality of data processing logics, each objective function, each field name, and each data processing logic having a corresponding correspondence;
the data processing method constructs the data processing model through the following steps, and specifically comprises the following steps:
Acquiring any processing instruction, analyzing the processing instruction and acquiring a corresponding data processing logic;
acquiring a target function corresponding to the data processing logic;
and acquiring the corresponding relation among the field name, the data processing logic and the target function, and constructing a data processing model for executing any processing instruction based on the corresponding relation.
4. The data processing method of claim 1, wherein the processing instructions include historical processing instructions and current processing instructions;
the step of selecting the data processing model corresponding to the processing instruction based on the processing instruction further comprises:
acquiring historical processing instructions and data processing models corresponding to the historical processing instructions;
coding each data processing model to generate a model ID, wherein the model ID is used for representing the corresponding relation between each historical processing instruction and each data processing model;
acquiring new target processing data and the current processing instruction corresponding to the new target processing data;
judging whether a target instruction matched with the current processing instruction exists in the historical processing instruction or not;
If so, acquiring a target model ID corresponding to the target instruction, and processing the new target processing data based on a target data processing model corresponding to the target model ID;
and if not, processing the new target processing data based on the target function, the field name and the data processing logic.
5. A data processing system, characterized in that the data processing system comprises:
the data acquisition module is used for acquiring target processing data and at least one field name corresponding to the target processing data;
the instruction acquisition module is used for acquiring a processing instruction of the field name, analyzing the processing instruction and obtaining data processing logic, and the data processing logic is used for representing specific operation on the target processing data;
the screening module is used for selecting a data processing model corresponding to the processing instruction based on the processing instruction, wherein the data processing model comprises a target function corresponding to the data processing logic;
and the data processing module is used for processing the target processing data based on the target function, the field name and the data processing logic.
6. The data processing system of claim 5, wherein the filtering module comprises:
a type acquisition unit configured to acquire a data type of the target processing data;
a function selection unit for selecting a corresponding objective function from a data processing model based on the data type and the data processing logic;
wherein the processable data type of the objective function is consistent with the data type of the target processed data.
7. The data processing system of claim 5, wherein the data processing model comprises a plurality of objective functions, a plurality of field names, and a plurality of data processing logics, each objective function, each field name, and each data processing logic having a corresponding correspondence;
the data processing model comprises:
the first acquisition module is used for acquiring any processing instruction, analyzing the processing instruction and acquiring a corresponding data processing logic;
the second acquisition module is used for acquiring a target function corresponding to the data processing logic;
and the third acquisition module is used for acquiring the corresponding relation among the field name, the data processing logic and the target function and constructing a data processing model for executing any processing instruction based on the corresponding relation.
8. The data processing system of claim 5, wherein the processing instructions include historical processing instructions and current processing instructions;
the screening module further comprises:
a model acquisition unit configured to acquire history processing instructions and respective data processing models corresponding to the respective history processing instructions;
the model coding unit is used for coding each data processing model and generating a model ID, wherein the model ID is used for representing the corresponding relation between each historical processing instruction and each data processing model;
the data acquisition module is also used for acquiring new target processing data;
the instruction acquisition module is further used for acquiring the current processing instruction corresponding to the new target processing data;
the instruction judging unit is used for judging whether a target instruction matched with the current processing instruction exists in the historical processing instruction or not;
if yes, the data processing module is used for acquiring a target model ID corresponding to the target instruction; processing the new target processing data based on a target data processing model corresponding to the target model ID;
and if not, the data processing module is used for processing the new target processing data based on the target function, the field name and the data processing logic.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the data processing method according to any one of claims 1 to 4 when executing the computer program.
10. A computer-readable medium, on which computer instructions are stored, which computer instructions, when executed by a processor, carry out a data processing method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210171378.2A CN114519170A (en) | 2022-02-24 | 2022-02-24 | Data processing method, system, electronic device and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210171378.2A CN114519170A (en) | 2022-02-24 | 2022-02-24 | Data processing method, system, electronic device and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114519170A true CN114519170A (en) | 2022-05-20 |
Family
ID=81599500
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210171378.2A Pending CN114519170A (en) | 2022-02-24 | 2022-02-24 | Data processing method, system, electronic device and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114519170A (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109376162A (en) * | 2018-09-03 | 2019-02-22 | 平安普惠企业管理有限公司 | Table data processing method, terminal device and computer readable storage medium |
| CN110837356A (en) * | 2018-08-15 | 2020-02-25 | 北京京东尚科信息技术有限公司 | Data processing method and device |
-
2022
- 2022-02-24 CN CN202210171378.2A patent/CN114519170A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110837356A (en) * | 2018-08-15 | 2020-02-25 | 北京京东尚科信息技术有限公司 | Data processing method and device |
| CN109376162A (en) * | 2018-09-03 | 2019-02-22 | 平安普惠企业管理有限公司 | Table data processing method, terminal device and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10354201B1 (en) | Scalable clustering for mixed machine learning data | |
| US11093354B2 (en) | Cognitively triggering recovery actions during a component disruption in a production environment | |
| CN113868507A (en) | Bidding information acquisition method and device combining RPA and AI and electronic equipment | |
| JP2006048702A (en) | Automatic configuration of transaction-based performance model | |
| CN111291936B (en) | Product life cycle prediction model generation method and device and electronic equipment | |
| CN111210332A (en) | Method and device for generating post-loan management strategy and electronic equipment | |
| CN113538154A (en) | Risk object identification method and device, storage medium and electronic equipment | |
| US11856053B2 (en) | Systems and methods for hybrid burst optimized regulated workload orchestration for infrastructure as a service | |
| CN115689334A (en) | Efficiency analysis method and system of warehouse management system and computer equipment | |
| CN114358742A (en) | Workflow execution method, device, equipment and storage medium | |
| CN113138906A (en) | Call chain data acquisition method, device, equipment and storage medium | |
| CN114519170A (en) | Data processing method, system, electronic device and medium | |
| CN116187675A (en) | Task allocation method, device, equipment and storage medium | |
| CN115345600A (en) | RPA flow generation method and device | |
| CN115526315A (en) | Generation method and device of rating card model | |
| CN109491892B (en) | Project environment configuration method and device | |
| CN111240652A (en) | Data processing method and device, computer storage medium and electronic equipment | |
| CN114416805B (en) | Data checking method and device, computer equipment and storage medium | |
| CN118171917B (en) | Risk assessment method and device for network asset, computer equipment and storage medium | |
| CN109901997B (en) | Financial system upgrading method and device, electronic equipment and storage medium | |
| CN117670521A (en) | Prediction method and device for credit overdue risk, computer equipment and storage medium | |
| CN115170313A (en) | Transaction risk determination method and device and server | |
| CN113886779A (en) | Method for identifying person identity, storage medium and computer program product | |
| CN116204577A (en) | Data export method and device, computer equipment and computer readable storage medium | |
| KR101617651B1 (en) | Data transffer system and method between heterogeneous systems using transaction editor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |