CN113869882A - Data processing method, device and medium - Google Patents
Data processing method, device and medium Download PDFInfo
- Publication number
- CN113869882A CN113869882A CN202111211480.2A CN202111211480A CN113869882A CN 113869882 A CN113869882 A CN 113869882A CN 202111211480 A CN202111211480 A CN 202111211480A CN 113869882 A CN113869882 A CN 113869882A
- Authority
- CN
- China
- Prior art keywords
- data
- branch
- execution
- screening
- target data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 30
- 238000012216 screening Methods 0.000 claims abstract description 117
- 238000000034 method Methods 0.000 claims abstract description 61
- 238000012545 processing Methods 0.000 claims abstract description 42
- 238000004590 computer program Methods 0.000 claims description 13
- 238000001914 filtration Methods 0.000 claims description 9
- 239000002699 waste material Substances 0.000 abstract description 13
- 230000008569 process Effects 0.000 description 34
- 238000010586 diagram Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 239000004519 grease Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/103—Workflow collaboration or project management
Landscapes
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Engineering & Computer Science (AREA)
- Entrepreneurship & Innovation (AREA)
- Operations Research (AREA)
- Economics (AREA)
- Marketing (AREA)
- Data Mining & Analysis (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application discloses a data processing method, a device and a medium, wherein the data processing method comprises the following steps: the method comprises the steps that a flow gateway obtains data sent by a front branch in a workflow model, determines execution branches of the data to be obtained, and judges whether screening conditions exist in the execution branches or not; if the execution branches have the screening conditions, the screening conditions of the execution branches are obtained, so that the execution branches can obtain more accurate data, the data set is screened according to the screening conditions to obtain target data, the target data are sent to the corresponding execution branches, the data set does not need to be sent to each execution branch as a whole, and waste of computing resources is reduced. Therefore, by adopting the data processing mode provided by the application, the data acquired by the execution branch can be more accurate, the subsequent processing can be more accurate, the waste of computing resources can be reduced, and the working efficiency can be improved.
Description
Technical Field
The present application relates to the field of big data, and in particular, to a data processing method, apparatus, and medium.
Background
Office Automation (OA) combines modern Office and computer technologies via a Management Information System (MIS). In the management information system, a Workflow and a business rule between its operation steps are referred to as a Workflow (Workflow). In the automatic office process, the workflow needs to be modeled, namely, the logic and rules between the workflow and each operation step thereof are expressed in a proper model in a computer, and the calculation is carried out on the workflow. By modeling the workflow, documents, information, or tasks may be automatically transferred between multiple participants using a computer according to some predetermined rule to achieve business goals.
In a workflow, when data is transmitted to a process gateway, the data needs to be screened according to the process gateway, but a plurality of groups of data exist in some data sets, the process gateway can copy the data sets integrally and send the data sets to execution branches, so that the data acquired by the relevant execution branches is not accurate enough, errors exist in subsequent processing, and the data sets are copied integrally, so that the waste of computing resources is caused.
Therefore, how to more accurately process the data set is a problem that needs to be solved by those skilled in the art.
Disclosure of Invention
The application aims to provide a data processing method, a data processing device and a data processing medium, so that a data set can be processed more accurately.
In order to solve the above technical problem, the present application provides a data processing method, including:
acquiring data sent by a front branch in a workflow model;
determining execution branches of data to be acquired, and judging whether screening conditions exist in each execution branch;
if yes, obtaining a screening condition of each execution branch, and screening the data set according to the screening condition to obtain target data;
and sending the target data to the corresponding execution branch.
Preferably, the screening conditions include:
the relation between the value of the data and the threshold value meets a preset relation, and the type of the data is a preset type.
Preferably, the screening the data set according to the screening condition to obtain the target data includes:
locating a target data set in which the target data is located, wherein the data comprises a plurality of data sets;
and screening the target data set to obtain the target data meeting the screening condition.
Preferably, after the step of sending the target data to the corresponding execution branch, the method further includes:
if the merging gateway exists, judging whether the types of the output data of different execution branches are consistent and the values of the output data are different;
and if the types of the output data are consistent and the values of the output data are different, merging the output data.
Preferably, the sending the target data to the corresponding execution branch includes:
judging the relation of each execution branch to determine whether each execution branch is a branch to be executed;
wherein the relationship comprises a parallel relationship, a containment relationship and an exclusive relationship;
and sending the target data to each branch to be executed.
Preferably, the data is stored in the form of a list.
Preferably, the screening condition is set according to a workflow.
In order to solve the above technical problem, the present application further provides a data processing apparatus, including:
an acquisition module: the method comprises the steps of obtaining data sent by a front branch in a workflow model;
a judging module: the system comprises an execution branch for determining data to be acquired, judging whether each execution branch has a screening condition, and entering a screening module if the execution branch has the screening condition;
the screening module: the screening conditions are used for obtaining the screening conditions of each execution branch, and the data set is screened according to the screening conditions to obtain target data;
a sending module: the execution branch is used for sending the target data to the corresponding execution branch. In order to solve the above technical problem, the present application further provides a data processing apparatus, including a memory for storing a computer program;
processor for implementing the steps of the data processing method as claimed when executing said computer program.
In order to solve the above technical problem, the present application further provides a computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and the computer program, when executed by a processor, implements the steps of the data processing method according to the claims.
The data processing method provided by the application comprises the following steps: the method comprises the steps that a flow gateway obtains data sent by a front branch in a workflow model, determines execution branches of the data to be obtained, and judges whether screening conditions exist in the execution branches or not; if the execution branches have the screening conditions, the screening conditions of the execution branches are obtained, so that the execution branches can obtain more accurate data, the data set is screened according to the screening conditions to obtain target data, the target data are sent to the corresponding execution branches, the data set does not need to be sent to each execution branch as a whole, and waste of computing resources is reduced. Therefore, by adopting the data processing mode provided by the application, the data acquired by the execution branch can be more accurate, the subsequent processing can be more accurate, the waste of computing resources can be reduced, and the working efficiency can be improved.
In addition, the data processing device and the medium provided by the application correspond to the method, and the effect is the same as the effect.
Drawings
In order to more clearly illustrate the embodiments of the present application, the drawings needed for the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained by those skilled in the art without inventive effort.
Fig. 1 is a schematic view of an application scenario of a data processing method according to an embodiment of the present application;
fig. 2 is a flowchart of a data processing method according to an embodiment of the present application;
fig. 3 is a block diagram of a data processing apparatus according to an embodiment of the present application;
fig. 4 is a block diagram of another data processing apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without any creative effort belong to the protection scope of the present application.
The core of the application is to provide a data processing method, a device and a medium.
In order that those skilled in the art will better understand the disclosure, the following detailed description will be given with reference to the accompanying drawings.
In a workflow processing scene, various process gateways and execution branches exist, when data is transmitted in a workflow model, the process gateways process the data and send the processed data to corresponding execution branches, so that the execution branches execute corresponding operations according to the data. Fig. 1 is an application scenario diagram of a data processing method provided in the present application, and as shown in fig. 1, a splitting gateway obtains data sent by a front branch or a flow node, and determines whether a subsequent execution branch has a screening condition, and if no screening condition exists, copies the data and sends the copied data to the subsequent execution branch; and if the screening conditions exist, acquiring all the screening conditions of the subsequent execution branches, screening the data acquired by the splitting gateway according to the screening conditions, copying the screened data and then sending the copied data to the corresponding execution branches. The data acquired by the execution branch is more accurate, the subsequent processing is more accurate, the waste of computing resources is reduced, and the working efficiency is improved.
Fig. 2 is a flowchart of a data processing method according to an embodiment of the present application, and as shown in fig. 2, the data processing method includes:
s10: and acquiring data sent by a front branch in the workflow model.
In the specific implementation, the workflow which needs to be processed by the computer is modeled to generate the workflow model, namely, the logic and the rules between the workflow and each operation step thereof are expressed in the computer by proper models, and the calculation is carried out on the workflow. The workflow includes a large number of process gateways and process nodes, and these modules work cooperatively to realize the function of transmitting information and tasks.
It should be noted that the data processing method provided in the present application can be applied to any gateway and node in the workflow model, for example: and splitting the gateway to realize the purpose of screening data.
It is understood that the data sent by the front branch may be stored in the form of a cache or a log file. The former scheme is more flexible, and occupies small content space; the latter scheme can occupy a large amount of memory resources, but is safer, and when the workflow model fails, the workflow data can be recovered according to the log file, so that loss is prevented.
S11: determining execution branches of data to be acquired, and judging whether each execution branch has a screening condition.
In a specific implementation, the flow gateway needs to determine whether a subsequent execution branch needs to acquire data, for example, if the current flow gateway is a judgment gateway, the subsequent execution branch only needs to receive a judgment result; and if the current flow gateway is the split gateway, the subsequent execution branch needs to acquire corresponding data.
Further, when a subsequent execution branch needing to acquire data exists, whether a screening condition exists in the subsequent execution branch or not needs to be judged, and if the screening condition does not exist, all the data are copied and then sent to the execution branch; and if the screening condition exists, screening the data according to the screening condition, and sending the screened data to a subsequent execution branch.
It is understood that the data to be acquired is a data set, and only one data set may exist, or a plurality of data sets may be included. The form of the data set may be a table or a document, which is not limited herein.
S12: and if so, obtaining the screening condition of each execution branch, and screening the data set according to the screening condition to obtain the target data.
In specific implementation, if the screening conditions exist in the subsequent execution branches of the current process gateway, all the screening conditions are obtained, and the execution conditions are summarized to the current process gateway. And the flow gateway screens the data set according to the screening conditions to acquire target data required by each branch.
It is understood that the screening conditions include simple screening conditions and complex screening conditions. The simple screening condition includes determining whether the data is greater than, less than, equal to, not equal to, greater than or equal to, or less than or equal to a threshold in the screening condition, or whether the data is included in a range given by the screening condition, or whether the data is in a list in the screening condition. The complex screening condition, in addition to determining the magnitude relationship between the value of the data and the threshold, also includes determining whether the type of the data satisfies a preset type, for example: if the preset type is temperature, only temperature data are screened; and if the preset type in the screening condition is the name, only screening the name data.
It should be noted that, in the workflow execution process, when the process gateway filters the acquired data, all the data transmitted into the process gateway may be filtered; or, the position of the target data, such as a document or a table where the target data is located, may be located according to the filtering condition, for example: when data are screened according to the screening expression and the value-taking expression, a specific list where target data are located is located in workflow data through the value-taking expression, and then the list is split through the screening expression to obtain the target data.
Further, in the data screening process, the user may use an analysis function of a JS Object Notation (JavaScript Object Notation, json) and a script screening function of a Java Unified Expression Language (Java Unified Expression Language) to locate the target data and the split list, or may not use a script provided by the system, which is not limited herein.
S13: and sending the target data to the corresponding execution branch.
In a specific implementation, the process gateway screens the acquired process data to acquire target data, and sends the target data to a corresponding execution branch. It is understood that the target data may be sent to the execution branch in the form of a file, or may be sent to the execution branch in the form of a cache queue.
It should be noted that, in order to further reduce the number of times of copying the target data and improve the efficiency of data transmission, the relationship of subsequent execution branches of the flow gateway may be determined, so as to screen out the branches to be executed, and send the target data only to the execution branches to be executed, thereby reducing the number of times of copying the target data; or screening the subsequent execution branch when the screening condition is obtained, and only obtaining the screening condition of the execution branch to be executed. Wherein, the relation of the subsequent execution branches of the flow gateway comprises: parallel, inclusive, exclusive, etc. If the multiple execution branches are in a parallel relation, executing all the branches; if the multiple branches are accommodating branches, executing all branches meeting the conditions, wherein the number of the branches meeting the conditions can be one or multiple; if multiple branches are exclusive branches, only one eligible branch can be executed.
The embodiment provides a data processing method, which comprises the following steps: the method comprises the steps that a flow gateway obtains data sent by a front branch in a workflow model, determines execution branches of the data to be obtained, and judges whether screening conditions exist in the execution branches or not; if the execution branches have the screening conditions, the screening conditions of the execution branches are obtained, so that the execution branches can obtain more accurate data, the data set is screened according to the screening conditions to obtain target data, the target data are sent to the corresponding execution branches, the data set does not need to be sent to each execution branch as a whole, and waste of computing resources is reduced. Therefore, by adopting the data processing mode provided by the application, the data acquired by the execution branch can be more accurate, the subsequent processing can be more accurate, the waste of computing resources can be reduced, and the working efficiency can be improved.
In particular implementations, the screening conditions include simple screening conditions and complex screening conditions. The simple screening condition includes determining whether the data is greater than, less than, equal to, not equal to, greater than or equal to, or less than or equal to a threshold in the screening condition, or whether the data is included in a range given by the screening condition, or whether the data is in a list in the screening condition.
The complex screening condition includes judging whether the type of the data meets a preset type or not, in addition to judging the size relationship between the value of the data and the threshold value.
In order to achieve better target data screening effect, on the basis of the above embodiment, the screening conditions include:
the relation between the value of the data and the threshold value meets the preset relation, and the type of the data is a preset type.
It should be noted that, in the workflow execution process, when the process gateway filters the acquired data, all the data transmitted into the process gateway may be filtered; or, the position of the target data, such as the document or table where the target data is located,
in specific implementation, the data can be screened by using the screening script and the value-taking script, a specific list where the target data is located in the workflow data through the value-taking expression, and then the list is split through the screening expression to obtain the target data. For example: the data set is { "name": john "," age ": 28", "ids": 10,20,30 }. The attribute ids to the data set is located according to the expression $ ids. And splitting the list by using the screening expression (the specific list positioned by the value-taking expression before). Such as $ { decisionmaker. grease (execution, item,10) }, the filtered list is [20,30 ]. Wherein decisionMaker is a custom filter condition code class. grease is one of the methods: greater than. execution is the context of the flow, containing all data. item is any element in the list to be filtered. The above-mentioned screening expression means that all elements greater than 10 in the list are screened. After the screening condition is executed, the data set on the branch will be { "name": john "," age ": 28", "ids": 20,30 }.
In this embodiment, the relationship between the data value and the threshold and the type of the data are simultaneously used as the screening condition, so that a better target data screening effect is achieved, the target data acquired by the subsequent execution branch is more accurate, and the accuracy of the workflow is improved.
In specific implementation, a flow gateway in a workflow may obtain a large amount of data to be processed, and in order to obtain target data, the data may be traversed to screen out data required by a subsequent execution branch. Analyzing and processing these data one by one and sending the target data to the subsequent execution branch may significantly reduce the efficiency of the workflow in processing the data.
On the basis of the above embodiments, in order to improve the efficiency of the workflow, the method for filtering a data set according to a filtering condition to obtain target data includes:
locating a target data set in which target data is located, wherein the data comprises a plurality of data sets;
and screening the target data set to obtain target data meeting the screening condition.
It can be understood that the data acquired by the process gateway includes a plurality of data sets, where the data sets include lists, queues, files, and the like, and the process gateway needs to locate a target data set where the target data is located first, and it can be understood that one or more target data sets may be provided, which is not limited herein.
The obtained target data set is filtered to obtain target data, and the data may be filtered by using a script file provided by the system, for example: the script operation function of the juel can also be realized by the user writing related programs and screening conditions to screen target data
In this embodiment, the target data set where the target data is located is first located, and then the target data set is screened, so as to obtain the target data meeting the screening condition. The data volume needing traversal processing is reduced, and the data processing speed of the process gateway is improved, so that the working efficiency is improved.
In specific implementation, the process gateway filters all data according to the filtering conditions, and then sends the target data to the corresponding execution branch, so that the subsequent execution branch can only obtain the filtered data, and cannot obtain the complete data, which may affect the subsequent operation of the workflow. To solve this problem, the complete data can be backed up before the data is screened; or merging the data again when the complete data is needed after the execution of the execution branch is finished.
The first method cannot predict whether the subsequent execution branch needs complete data, and if the data is completely copied, the workload of the workflow becomes large, and a large amount of useless data is copied, so the latter method is selected in this embodiment.
On the basis of the above embodiment, after the step of sending the target data to the corresponding execution branch, the method further includes:
if the merging gateway exists, judging whether the types of the output data of different execution branches are consistent and the values of the output data are different;
and if the types of the output data are consistent and the values of the output data are different, merging the output data.
It can be understood that the merge gateway may be set after each split gateway to merge data on all execution branches, or may be set in a special area according to user needs to merge only needed data.
It should be noted that, it needs to be determined whether the storage forms of the data output by the different execution branches are consistent, for example: the data output by each execution branch is a table; and judging whether the types of the output data are consistent or not, and if the types of the data are consistent and the values of the data are different, merging the data. The storage form of the data is not changed in the merging process.
In this embodiment, the merging gateway merges output data of the same type output by different execution branches, so that the subsequent execution branch can obtain complete data, the situation that the subsequent execution branch has errors due to data errors is prevented, and the capacity of processing data by the execution branch is improved.
In a specific implementation, various different types of process gateways exist in the workflow model, such as a parallel gateway, an inclusive gateway, an exclusive gateway, and the like, and a parallel, inclusive, exclusive, and the like relationship also exists between execution branches connected by the same process gateways. After the flow gateway acquires the data sent by the front node and the flow gateway in the workflow model, the screened data is sent to each execution branch, but the execution branches cannot be completely executed, and the number of times of copying the flow data is increased when the data is sent to each execution branch, so that the waste of computing resources is caused.
On the basis of the above embodiment, sending the target data to the corresponding execution branch includes:
judging the relation of each execution branch to determine whether each execution branch is a branch to be executed, wherein the relation comprises a parallel relation, a containment relation and an exclusive relation;
and sending the target data to each branch to be executed.
It can be understood that, when the flow gateway is connected to the first branch, the second branch, and the third branch, if the three execution branches are in a parallel relationship, the three branches are all branches to be executed; if the three branches are in a containment relationship, the branches meeting the conditions of the flow gateway are all branches to be executed, and at the moment, a plurality of branches to be executed or only one branch to be executed can exist; if the three branches are in an exclusive relationship, only one branch satisfying the conditions of the flow gateway is a branch to be executed.
It should be noted that the relationship between the execution branches may be determined before the screening condition is obtained, for example: only obtaining the screening condition of the execution branch to be executed; whether each execution branch is a branch to be executed may also be determined before the target data is sent to the execution branch. The second scheme is adopted in the embodiment.
In this embodiment, whether each branch is a branch to be executed is determined by judging the relationship between each execution branch, so as to ensure that only the target data is sent to the execution branch to be executed, reduce the copy times of the flow data, and prevent the waste of computing resources.
The data workflow model exists in different forms, including texts, tables and the like, and in specific implementation, the tables can better embody the types of data and the relations among different data. On the basis of the above embodiments, the data in this embodiment exists in the form of a list.
Further, the data acquired by the process gateway includes a plurality of data lists, for example: the process gateway firstly positions a target data set where a target data list is located, screens the target data list and acquires target data
It can be understood that the list containing the data may exist in the form of a queue or a linked list in the computer, which is not limited in this embodiment.
In the embodiment, the data is limited to exist in the form of the list, so that the list can be conveniently screened according to the data type and the data value, and the data screening efficiency is improved.
In a specific implementation, a lot of time and energy are needed to construct the workflow model, so that the workflow model can be more suitable for actual work. However, because the daily work is various, a large number of workflow models need to be constructed, which causes waste of labor cost.
On the basis of the above embodiments, the data processing method provided by this embodiment includes setting the screening condition according to the workflow.
It can be understood that the filtering condition in the workflow model can be changed, and when the processed service changes, the user can adapt the workflow model to the current service by changing the filtering condition, thereby expanding the application range of the workflow model.
In the embodiment, a user can set the screening conditions according to different services, so that the workflow model can process more service workflows, and the application range of the workflow model is expanded, thereby saving time and energy.
In the foregoing embodiments, detailed descriptions are given for data processing methods, and the present application also provides embodiments corresponding to the data processing apparatus. It should be noted that the present application describes the embodiments of the apparatus portion from two perspectives, one from the perspective of the function module and the other from the perspective of the hardware.
Since the embodiments of the apparatus portion and the method portion correspond to each other, please refer to the description of the embodiments of the method portion for the embodiments of the apparatus portion, which is not repeated here.
Fig. 3 is a structural diagram of a data processing apparatus provided in the present application, and as shown in fig. 3, the data processing apparatus includes:
the acquisition module 10: the method comprises the steps of obtaining data sent by a front branch in a workflow model;
the judging module 11: the execution branch is used for determining the data to be acquired, judging whether each execution branch has a screening condition, and if so, entering the screening module 12;
the screening module 12: the data set is used for acquiring the screening conditions of each execution branch, and screening the data set according to the screening conditions to acquire target data;
the sending module 13: for sending the target data to the corresponding branch of execution.
The present embodiment provides a data processing apparatus, including: the method comprises the steps that a flow gateway obtains data sent by a front branch in a workflow model, determines execution branches of the data to be obtained, and judges whether screening conditions exist in the execution branches or not; if the execution branches have the screening conditions, the screening conditions of the execution branches are obtained, so that the execution branches can obtain more accurate data, the data set is screened according to the screening conditions to obtain target data, the target data are sent to the corresponding execution branches, the data set does not need to be sent to each execution branch as a whole, and waste of computing resources is reduced. Therefore, by adopting the data processing mode provided by the application, the data acquired by the execution branch can be more accurate, the subsequent processing can be more accurate, the waste of computing resources can be reduced, and the working efficiency can be improved.
Fig. 4 is a structural diagram of a data processing apparatus according to another embodiment of the present application, and as shown in fig. 4, the data processing apparatus includes: a memory 20 for storing a computer program;
a processor 21 for implementing the steps of the method for screening target data as described in the above embodiments when executing the computer program.
The office equipment provided by the embodiment can include, but is not limited to, a smart phone, a tablet computer, a notebook computer or a desktop computer.
The processor 21 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 21 may be implemented in at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 21 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 21 may be integrated with a Graphics Processing Unit (GPU) which is responsible for rendering and drawing the content required to be displayed by the display screen. In some embodiments, the processor 21 may further include an Artificial Intelligence (AI) processor for processing computational operations related to machine learning.
The memory 20 may include one or more computer-readable storage media, which may be non-transitory. Memory 20 may also include high speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In this embodiment, the memory 20 is at least used for storing the following computer program 201, wherein after being loaded and executed by the processor 21, the computer program can implement the relevant steps of screening target data disclosed in any of the foregoing embodiments. In addition, the resources stored in the memory 20 may also include an operating system 202, data 203, and the like, and the storage manner may be a transient storage manner or a permanent storage manner. Operating system 202 may include, among others, Windows, Unix, Linux, and the like. Data 203 may include, but is not limited to, target data, and the like.
In some embodiments, the data processing device may further include a display 22, an input/output interface 23, a communication interface 24, a power supply 25, and a communication bus 26.
Those skilled in the art will appreciate that the configuration shown in FIG. 4 does not constitute a limitation of the data processing apparatus and may include more or fewer components than those shown.
The data processing device provided by the embodiment of the application comprises a memory and a processor, and when the processor executes a program stored in the memory, the following method can be realized: a data processing method.
Finally, the application also provides a corresponding embodiment of the computer readable storage medium. The computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps as set forth in the above-mentioned method embodiments.
It is to be understood that if the method in the above embodiments is implemented in the form of software functional units and sold or used as a stand-alone product, it can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium and executes all or part of the steps of the methods described in the embodiments of the present application, or all or part of the technical solutions. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The data processing apparatus, method, device, and medium provided by the present application are described in detail above. The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. A data processing method, comprising:
acquiring data sent by a front branch in a workflow model;
determining execution branches of data to be acquired, and judging whether screening conditions exist in each execution branch;
if yes, obtaining a screening condition of each execution branch, and screening the data set according to the screening condition to obtain target data;
and sending the target data to the corresponding execution branch.
2. The data processing method of claim 1, wherein the screening condition comprises:
the relation between the value of the data and the threshold value meets a preset relation, and the type of the data is a preset type.
3. The data processing method of claim 2, wherein the filtering the data set according to the filtering condition to obtain target data comprises:
locating a target data set in which the target data is located, wherein the data comprises a plurality of data sets;
and screening the target data set to obtain the target data meeting the screening condition.
4. The data processing method according to claim 1, further comprising, after the step of sending the target data to the corresponding execution branch:
if the merging gateway exists, judging whether the types of the output data of different execution branches are consistent and the values of the output data are different;
and if the types of the output data are consistent and the values of the output data are different, merging the output data.
5. The data processing method of claim 1, wherein sending the target data to the corresponding execution branch comprises:
judging the relation of each execution branch to determine whether each execution branch is a branch to be executed;
wherein the relationship comprises a parallel relationship, a containment relationship and an exclusive relationship;
and sending the target data to each branch to be executed.
6. The data processing method of claim 1, wherein the data is stored in a list.
7. The data processing method according to claim 1, wherein the filtering condition is set according to a workflow.
8. A data processing apparatus, comprising:
an acquisition module: the method comprises the steps of obtaining data sent by a front branch in a workflow model;
a judging module: the system comprises an execution branch for determining data to be acquired, judging whether each execution branch has a screening condition, and entering a screening module if the execution branch has the screening condition;
the screening module: the screening conditions are used for obtaining the screening conditions of each execution branch, and the data set is screened according to the screening conditions to obtain target data;
a sending module: the execution branch is used for sending the target data to the corresponding execution branch.
9. A data processing apparatus comprising a memory for storing a computer program;
a processor for implementing the steps of the data processing method according to any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the steps of the data processing method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111211480.2A CN113869882A (en) | 2021-10-18 | 2021-10-18 | Data processing method, device and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111211480.2A CN113869882A (en) | 2021-10-18 | 2021-10-18 | Data processing method, device and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113869882A true CN113869882A (en) | 2021-12-31 |
Family
ID=79000177
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111211480.2A Pending CN113869882A (en) | 2021-10-18 | 2021-10-18 | Data processing method, device and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113869882A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116016684A (en) * | 2022-12-07 | 2023-04-25 | 中科云谷科技有限公司 | Data distribution method, device and computer readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108647316A (en) * | 2018-05-10 | 2018-10-12 | 北京中电普华信息技术有限公司 | Data processing method and device |
| CN109597826A (en) * | 2018-09-04 | 2019-04-09 | 阿里巴巴集团控股有限公司 | Data processing method, device, electronic equipment and computer readable storage medium |
| CN110738389A (en) * | 2019-09-03 | 2020-01-31 | 深圳壹账通智能科技有限公司 | Workflow processing method and device, computer equipment and storage medium |
| CN110807002A (en) * | 2019-11-05 | 2020-02-18 | 杭州安恒信息技术股份有限公司 | Report generation method, system and equipment based on workflow and storage medium |
| CN112286979A (en) * | 2020-10-30 | 2021-01-29 | 北京明略软件系统有限公司 | Data screening method and device, electronic equipment and storage medium |
-
2021
- 2021-10-18 CN CN202111211480.2A patent/CN113869882A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108647316A (en) * | 2018-05-10 | 2018-10-12 | 北京中电普华信息技术有限公司 | Data processing method and device |
| CN109597826A (en) * | 2018-09-04 | 2019-04-09 | 阿里巴巴集团控股有限公司 | Data processing method, device, electronic equipment and computer readable storage medium |
| CN110738389A (en) * | 2019-09-03 | 2020-01-31 | 深圳壹账通智能科技有限公司 | Workflow processing method and device, computer equipment and storage medium |
| CN110807002A (en) * | 2019-11-05 | 2020-02-18 | 杭州安恒信息技术股份有限公司 | Report generation method, system and equipment based on workflow and storage medium |
| CN112286979A (en) * | 2020-10-30 | 2021-01-29 | 北京明略软件系统有限公司 | Data screening method and device, electronic equipment and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116016684A (en) * | 2022-12-07 | 2023-04-25 | 中科云谷科技有限公司 | Data distribution method, device and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107431696B (en) | Method and cloud management node for application automation deployment | |
| CN108984155B (en) | Data processing flow setting method and device | |
| CN112311617A (en) | Configured data monitoring and alarming method and system | |
| CN110704283A (en) | Method, device and medium for uniformly generating alarm information | |
| CN111143039A (en) | Virtual machine scheduling method and device and computer storage medium | |
| CN110851234A (en) | Log processing method and device based on docker container | |
| CN111221698A (en) | Task data acquisition method and device | |
| CN115048254B (en) | Simulation test method, system, equipment and readable medium for data distribution strategy | |
| CN110633959A (en) | Method, device, equipment and medium for creating approval task based on graph structure | |
| CN111444158A (en) | Long-short term user portrait generation method, device, equipment and readable storage medium | |
| CN114089889B (en) | Model training method, device and storage medium | |
| CN113869882A (en) | Data processing method, device and medium | |
| EP3855316A1 (en) | Optimizing breakeven points for enhancing system performance | |
| CN107633080B (en) | User task processing method and device | |
| CN113626869A (en) | Data processing method, system, electronic device and storage medium | |
| CN116341642B (en) | Data processing method and device, storage medium and electronic equipment | |
| CN117093375A (en) | Server scheduling method, device, equipment and storage medium | |
| CN111459411B (en) | Data migration method, device, equipment and storage medium | |
| CN110727565A (en) | Network equipment platform information collection method and system | |
| CN114817223A (en) | Service data extraction method and device, electronic equipment and storage medium | |
| CN112162831A (en) | Big data analysis method and system, electronic device and storage medium | |
| US8495033B2 (en) | Data processing | |
| CN113128184A (en) | Document content screening method and device for multi-person collaborative editing document | |
| CN111209284A (en) | Metadata-based table dividing method and device | |
| CN115039079A (en) | Managing provenance information for a data processing pipeline |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |