CN116860751A - Data processing method and device, electronic equipment and storage medium - Google Patents
Data processing method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN116860751A CN116860751A CN202310820861.3A CN202310820861A CN116860751A CN 116860751 A CN116860751 A CN 116860751A CN 202310820861 A CN202310820861 A CN 202310820861A CN 116860751 A CN116860751 A CN 116860751A
- Authority
- CN
- China
- Prior art keywords
- data
- structured list
- list data
- dynamic structured
- current dynamic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 37
- 238000012545 processing Methods 0.000 claims abstract description 45
- 238000004590 computer program Methods 0.000 claims description 12
- 238000000034 method Methods 0.000 abstract description 19
- 230000008569 process Effects 0.000 abstract description 7
- 238000005516 engineering process Methods 0.000 abstract description 2
- 238000004891 communication Methods 0.000 description 8
- 230000003068 static effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 238000007429 general method Methods 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The disclosure provides a data processing method, a device, an electronic device and a storage medium, relates to the technical field of data processing, and in particular relates to an update processing technology of structured list data, which can be applied to the technical fields of big data, cloud computing and the like, and comprises the following steps: under the condition that the current dynamic structured list data meets the data updating condition, acquiring reference configuration information of the current dynamic structured list data according to an independent configuration file of the current dynamic structured list data; generating a target data request according to the reference configuration information of the current dynamic structured list data, and acquiring the current dynamic structured list data according to the target data request; and updating the locally stored structured list data according to the current dynamic structured list data. The embodiment of the invention can improve the updating efficiency of the structured list data and the universality of the updating process.
Description
Technical Field
The disclosure relates to the technical field of data processing, in particular to an update processing technology of structured list data, which can be applied to the technical fields of big data, cloud computing and the like.
Background
The structured list data is a serial data structure, can be organized into data capable of being queried, retrieved or counted according to a list form, and is widely applied to the technical fields of big data, cloud computing and the like. For example, schema (schema) as a typical structured list data, generally comprising tables, indexes, data types, sequences, views, stored procedures, primary and foreign keys, etc., may be used to organize objects in a database. The schema data can provide a logic isolation function for the database object, and the application program can use the respective modes to realize safe access right control. At present, how to ensure efficient update of structured list data is always a technical problem focused on the field of structured list data.
Disclosure of Invention
The embodiment of the disclosure provides a data processing method, a device, electronic equipment and a storage medium, which can improve the update efficiency of structured list data and the universality of update processing.
In a first aspect, an embodiment of the present disclosure provides a data processing method, including:
under the condition that the current dynamic structured list data meets the data updating condition, acquiring reference configuration information of the current dynamic structured list data according to an independent configuration file of the current dynamic structured list data;
Generating a target data request according to the reference configuration information of the current dynamic structured list data, and acquiring the current dynamic structured list data according to the target data request;
and updating the locally stored structured list data according to the current dynamic structured list data.
In a second aspect, embodiments of the present disclosure provide a data processing apparatus, including:
the reference configuration information acquisition module is used for acquiring the reference configuration information of the current dynamic structured list data according to the independent configuration file of the current dynamic structured list data under the condition that the current dynamic structured list data is determined to meet the data updating condition;
the current dynamic structured list data acquisition module is used for generating a target data request according to the reference configuration information of the current dynamic structured list data and acquiring the current dynamic structured list data according to the target data request;
and the structured list data updating module is used for updating the locally stored structured list data according to the current dynamic structured list data.
In a third aspect, an embodiment of the present disclosure provides an electronic device, including:
At least one processor; and
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data processing method provided by the embodiment of the first aspect.
In a fourth aspect, embodiments of the present disclosure also provide a non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the data processing method provided by the embodiments of the first aspect.
In a fifth aspect, embodiments of the present disclosure also provide a computer program product comprising a computer program which, when executed by a processor, implements the data processing method provided by the embodiments of the first aspect.
According to the embodiment of the disclosure, the current dynamic structured list data is monitored, and under the condition that the current dynamic structured list data meets the data updating condition, the reference configuration information of the current dynamic structured list data is obtained according to the independent configuration file of the current dynamic structured list data, so that a target data request is generated according to the reference configuration information of the current dynamic structured list data, and the current dynamic structured list data is obtained according to the target data request, thereby updating the locally stored structured list data according to the current dynamic structured list data, solving the problems of low updating efficiency, poor universality and the like of the existing dynamic structured list data, and improving the updating efficiency and the universality of the updating processing of the structured list data.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.
Drawings
The drawings are for a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:
FIG. 1 is a flow chart of a data processing method provided by an embodiment of the present disclosure;
FIG. 2 is a flow chart of another data processing method provided by an embodiment of the present disclosure;
FIG. 3 is a block diagram of a data processing apparatus provided by an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of an electronic device for implementing a data processing method according to an embodiment of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Currently, when performing a data update operation on dynamic structured list data, a relevant code statement such as an if statement is generally used to monitor in a monitor trigger stage to determine whether the data update operation is required. When it is determined that data update is required, a specific HTTP (hypertext transfer protocol ) is called to request acquisition of data to be updated. And finally, the acquired data to be updated and the existing data list are spliced and de-duplicated to realize the data updating operation.
Firstly, at present, a general processing method does not exist in a monitoring triggering stage of dynamic structured list data, which leads to the fact that when a new data updating scene appears, template codes of a data updating processing flow are required to be copied, and adaptive updating and modification are carried out according to the new data updating scene, so that time and labor are wasted, errors are easy to occur, and the efficiency is extremely low. Secondly, the specific data updating processing operation is simply the de-duplication operation after array splicing, and if the data acquisition needs to be updated repeatedly, accurate updating cannot be realized.
In one example, fig. 1 is a flowchart of a data processing method provided in an embodiment of the present disclosure, where the embodiment may be applicable to updating dynamic structured list data according to an independent configuration file, the method may be performed by a data processing apparatus, which may be implemented by software and/or hardware, and may be generally integrated in an electronic device. The electronic device may be a terminal device or a server device, and the embodiment of the disclosure does not limit a specific device type of the electronic device. Accordingly, as shown in fig. 1, the method includes the following operations:
S110, under the condition that the current dynamic structured list data meets the data updating condition, acquiring the reference configuration information of the current dynamic structured list data according to the independent configuration file of the current dynamic structured list data.
The current dynamic structured list data may be structured list data that currently has a dynamic data update requirement. The structured list data may be a data structure organized in the form of at least one list, wherein when a plurality of lists exist, a corresponding mapping relationship can be established between the lists through a list field or list data. Alternatively, the current dynamic structured list data may include dynamic schema data, or the like. Alternatively, the current dynamic structured list data may further include dynamic Catalog (a database term) data, and the embodiment of the present disclosure does not limit the data type and data content of the current dynamic structured list data. The data update condition is a monitoring trigger condition for updating the current dynamic structured list data. Independent configuration files are also known as files that are configured independently of structured list data. That is, the independent configuration file is decoupled from the execution framework of the data processing flow, and the configuration information of the dynamic structured list data is not configured and stored in the execution framework of the data processing flow (hereinafter, simply referred to as the execution framework). All the configuration information for data update involved in the execution framework can be configured in an independent configuration file. That is, the independent profile applies to all dynamic structured list data. The reference configuration information may be configuration information referred to for updating the current dynamic structured list data. It is understood that the reference configuration information may be part of the configuration information in the independent configuration file.
In embodiments of the present disclosure, automated data update operations may be performed on the dynamic structured list data by an execution framework in conjunction with its independent configuration file. That is, the execution frameworks of the independent configuration file and the data processing flow are mutually independent objects. When a certain type of dynamic structured list data needs to be subjected to data updating, an independent configuration file can be firstly configured independently according to the data updating requirement, and an execution framework of a general data processing flow is written. Furthermore, some type of update processing operation of the dynamic structured list data can be performed according to the execution framework in cooperation with the independent configuration file.
Specifically, in the process of performing data update processing, the execution framework may monitor the dynamic structured list data through the data update condition. Alternatively, the type of dynamic structured list data that needs to be monitored may be determined by an independent profile. For example, when the data updating operation needs to be performed on the dynamic schema, the monitoring of the dynamic schema data such as the dynamic schema1, the dynamic schema2, the dynamic schema3 and the like can be determined through an independent configuration file, or the monitoring of all the dynamic schema data can also be configured, so that when the data updating condition is determined to be met, the data updating operation is performed on the dynamic schema data through an execution framework.
If the execution framework determines that the current monitored dynamic structured list data meets the data updating condition, the independent configuration file of the current dynamic structured list data can be accessed to further acquire the reference configuration information of the current dynamic structured list data to be updated through the independent configuration file, so that the current dynamic structured list data is subjected to data updating processing according to the acquired reference configuration information.
S120, generating a target data request according to the reference configuration information of the current dynamic structured list data, and acquiring the current dynamic structured list data according to the target data request.
Wherein the target data request may be applied to request acquisition of corresponding dynamic structured list data.
Accordingly, after the execution framework obtains the reference configuration information of the current dynamic structured list data, the reference configuration information can be parsed to obtain configuration information such as corresponding fields, so that a target data request is generated according to the parsing result of the reference configuration information, and the generated target data request is sent to an object (such as a database) capable of obtaining the current dynamic structured list data, so that the current dynamic structured list data is requested to be obtained.
S130, updating the locally stored structured list data according to the current dynamic structured list data.
It will be appreciated that locally stored structured list data typically includes static structured list data and dynamic structured list data. The static structured list data may include, but is not limited to, a data type such as an ID that is not changed by a user operation, and thus, the static structured list data generally does not have a requirement of dynamic update. The dynamic structured list data may include, for example, but is not limited to, a data type that the user may change b due to user operation, such as form data filled in based on a pulled form. Along with the operation flow of the user, the dynamic structured list data can change in real time, so the dynamic structured list data has the requirement of dynamic update.
In an alternative embodiment of the present disclosure, the current dynamic structured list data may comprise dynamic schema data. The dynamic schema data may be used to generate target objects; wherein the target object comprises at least one of: work cards, system sub-flows, and database data tables.
In one particular example, by efficiently and accurately updating the dynamic schema data, assistance may be provided to connectors that require dynamic retrieval of the schema data. Connectors for dynamically retrieving schema data may include, for example, but are not limited to, connectors for work cards, connectors for system subrows, and connectors for database tables, etc.
For example, in an application scenario for generating an electronic work card, a user may pull form data for generating the work card, where both data that forms a work card form template and data that the user fills in the work card form template belong to schema data. In general, most of data forming a work card form template, such as form ID, belongs to static schema data; the data filled in by the user in the work card form template mostly belongs to dynamic schema data. When a user fills data in the work card form template, the dynamic schema data needs to be updated in real time so as to maintain the accuracy of the dynamic schema data.
For example, in an application scenario that generates a system sub-flow, a user may create a system sub-flow based on a main flow of the system, such as creating an attendance punch sub-flow in a complete work platform. Accordingly, the dynamic schema data of the system sub-flow needs to be updated in real time to maintain the accuracy of the dynamic schema data.
Illustratively, in an application scenario of a database data table, a user may create a table and fill out the data table. Accordingly, the dynamic schema data of the database data table needs to be updated in real time to maintain the accuracy of the dynamic schema data.
In the embodiment of the disclosure, since the independent configuration file of the dynamic structured list data is decoupled from the execution frame of the data update process, when the new type of dynamic structured list data is required to have update requirements, the independent configuration file is only required to be updated, and the code content of the execution frame is not required to be modified or updated, so that the coupling between the data update service requirements and the code logic is reduced, and the readability and maintainability of the data update execution frame are improved, thereby improving the update efficiency of the structured list data and the universality of the update process.
According to the embodiment of the disclosure, the current dynamic structured list data is monitored, and under the condition that the current dynamic structured list data meets the data updating condition, the reference configuration information of the current dynamic structured list data is obtained according to the independent configuration file of the current dynamic structured list data, so that a target data request is generated according to the reference configuration information of the current dynamic structured list data, and the current dynamic structured list data is obtained according to the target data request, thereby updating the locally stored structured list data according to the current dynamic structured list data, solving the problems of low updating efficiency, poor universality and the like of the existing dynamic structured list data, and improving the updating efficiency and the universality of the updating processing of the structured list data.
In an example, fig. 2 is a flowchart of another data processing method provided by an embodiment of the present disclosure, which is an optimization improvement based on the technical solutions of the foregoing embodiments, and provides various specific alternative implementations of determining that current dynamic structured list data meets a data update condition, generating a target data request, and updating locally stored structured list data.
A data processing method as shown in fig. 2, comprising:
s210, acquiring a data update association field of the current dynamic structural list data.
The data update association field may be an association field included in the current dynamic structured list data and may be used to determine whether the current dynamic structured list data needs to be updated.
S220, judging whether a data update associated field of the current dynamic structured list data is matched with a target field, if so, executing S240; otherwise, S230 is performed.
Wherein the target field is a data update association field of the dynamic structured list data to be updated. It is understood that the target field may be configured by a separate configuration file.
Optionally, the data update association field may include, but is not limited to, a connector identification, a data manipulation identification, and a unique identification of the dynamic structured list data.
Wherein the connector identification may be used to uniquely identify the connector. The data operation identification may be used to identify the type of operation of the current dynamically structured list data. The unique identification of the dynamic structured list data may be used to uniquely identify the dynamic structured list data.
S230, determining that the current dynamic structured list data does not meet the data updating condition.
S240, determining that the current dynamic structured list data meets the data updating condition.
That is, when the current dynamic structured list data is subjected to an operation, the execution framework may acquire a data update association field such as a connector identifier, a data operation identifier, and a unique identifier of the current dynamic structured list data, so as to determine whether the current dynamic structured list data needs to be updated according to the acquired data update association field. The judgment basis can be as follows: and matching the data update associated field of the current dynamic structured list data with the target field. And if the data update associated field of the current dynamic structured list data is matched with the target field, determining that the current dynamic structured list data meets the data update condition. If the current dynamic structured list data is determined to meet the data updating condition, the execution framework can further acquire other configuration information contents of the current dynamic structured list data through the independent configuration file. By way of example, other configuration information content of the current dynamic structured list data may include, but is not limited to, naming of configuration information corresponding to the current dynamic structured list data, an interface (API) for obtaining the current dynamic structured list data, a key name of an interface parameter, a save location of the current dynamic structured list data, and the like.
Accordingly, if it is determined that the data update associated field of the current dynamic structured list data does not match the target field, it is determined that the current dynamic structured list data does not satisfy the data update condition. Alternatively, it may be determined that the data update associated field of the current dynamic structured list data does not match the target field, and it may be that at least one type of field in the data update associated field does not match a corresponding field type in the target field.
Optionally, the execution framework may determine, through a general method of encapsulation, whether the current dynamic structured list data meets a data update condition, return corresponding configuration information if the data update condition is met, and return undefined (a special value for indicating that the variable has not yet been assigned) if the data update condition is not met.
According to the technical scheme, whether the current dynamic structured list data needs to be updated or not can be rapidly judged by judging that the current dynamic structured list data meets the data updating condition according to the data updating association field of the current dynamic structured list data, and codes of the execution framework do not need to be modified or updated when a new data updating scene appears, so that the universality and the expansibility of the updating processing of the dynamic structured list data are improved.
In an optional embodiment of the disclosure, before the obtaining the reference configuration information of the current dynamic structured list data according to the independent configuration file of the current dynamic structured list data, the method may further include: determining updated reference configuration information of the dynamic structured list data; wherein the update reference configuration information comprises a data update association field and a data request save configuration field; and generating the independent configuration file according to the updated reference configuration information of the dynamic structured list data.
Wherein the updating reference configuration information is the configuration information used for updating the dynamic structured list data. The data request save configuration field may be configuration information returned after determining that the current dynamic structured list data satisfies the data update condition, and may be used to execute the framework generation target data request.
It will be appreciated that since the independent profiles are generated independently. Thus, before the framework pair dynamic structured list data is executed, the independent configuration file to which it refers may be first generated. Specifically, update reference configuration information such as an update association field and a data request storage configuration field of the dynamic structured list data can be determined, and then an independent configuration file is generated according to the update reference configuration information of the dynamic structured list data.
For example, the data update association field of the independent profile may be used as a trigger for data update, and may include, for example, a connector ID, an operation ID, and a unique identifier (levername) of the schema. And determining a unique dynamic schema according to the data update association field, and when the data update association field is assigned, considering that the corresponding dynamic schema meets the triggering condition of data update. The data request storage configuration field of the independent configuration file may include the name of the configuration, the interface for acquiring the data, the key name of the interface parameter, the storage location of the data, and so on.
According to the technical scheme, the independent configuration files matched with the structured list data in the pre-configuration mode can reduce the coupling between the data updating service requirement and the updating flow logic, and the readability and maintainability of the updating flow are improved.
In an alternative embodiment of the present disclosure, the reference configuration information includes a data request save configuration field. Accordingly, the generating the target data request according to the reference configuration information of the current dynamic structured list data may include the following operations S250 to S270:
s250, determining an interface for requesting to acquire the current dynamic structured list data according to the data request storage configuration field.
Specifically, the execution framework may determine an interface to request acquisition of current dynamic structured list data based on the data request save configuration field. For example, the interface for acquiring data in the data request save configuration field of the independent configuration file is used as the interface for the current dynamic structured list data.
S260, generating a request keyword of the target data request based on the interface of the current dynamic structured list data.
Wherein the request key may be a key, of the target data request.
S270, generating a request value of the target data request according to the above information of the current dynamic structured list data.
The above information of the current dynamic structured list data may be operation data associated with the current dynamic structured list data before the current dynamic structured list data is monitored. The request value of the target data request may be the value of the request key.
In the embodiment of the disclosure, if the execution framework determines that the current dynamic structured list data meets the data update condition, the interface for requesting to acquire the current dynamic structured list data may be determined according to the data request save configuration field, and a request keyword of the target data request is generated based on the determined interface, that is, a field name and a field value of the target data request are determined. Alternatively, the value of the request key of the target data request may be entered by the above information.
According to the technical scheme, the target data request is determined according to the data request storage configuration field, and the request key word and the request value of the target data request are determined, so that the execution framework can accurately acquire the current dynamic structured list data to be updated based on the target data request.
In an optional embodiment of the disclosure, before the generating the request value of the target data request according to the above information of the current dynamic structured list data, the method may further include: acquiring a current attribute value of a current data operator for inputting the current dynamic structured list data; and taking the current attribute value input by the current dynamic structured list data as the above information of the current dynamic structured list data.
Wherein the current data operator is the user operating on the current dynamic structured list data. The current attribute value, i.e. the attribute value input by the current data operator for the current dynamic structured list data, may be, for example, a work card template or data filled in a database data table, etc. Accordingly, the current attribute value input by the current dynamic structured list data can be used as the above information of the current dynamic structured list data, so that the execution framework can accurately acquire the current dynamic structured list data.
S280, acquiring the current dynamic structured list data according to the target data request.
S290, separating the local dynamic structured list data from the locally stored structured list data.
S2110, updating the local dynamic structured list data according to the assignment condition of the local dynamic structured list data and the current dynamic structured list data.
It is understood that locally stored structured list data includes both static structured list data and dynamic structured list data. Because static structured list data does not need to be updated, the execution framework may first separate the local dynamic structured list data from the locally stored structured list data. Meanwhile, because the local dynamic structured list data is possibly assigned, the local dynamic structured list data needs to be updated by comprehensively considering the assignment condition of the local dynamic structured list data so as to realize the update of the data without losing the data.
In an optional embodiment of the disclosure, the updating the local dynamic structured list data according to the assignment situation of the local dynamic structured list data and the current dynamic structured list data may include: under the condition that the assigned data of the local dynamic structured list data is determined to be empty, replacing and updating the local dynamic structured list data according to the current dynamic structured list data; and under the condition that the local dynamic structured list data is determined to have assignment data, replacing and updating the local dynamic structured list data according to the current dynamic structured list data, and assigning the updated local dynamic structured list data according to the assignment data of the local dynamic structured list data.
Specifically, if the local dynamic structured list data is not assigned, the problem of data inheritance is not required to be considered, and the local dynamic structured list data can be directly replaced and updated according to the current dynamic structured list data. Accordingly, if the local dynamic structured list data is assigned, the problem of data inheritance needs to be considered, and after the local dynamic structured list data is updated according to the current dynamic structured list data, the original assignment content needs to be reserved, namely, the updated local dynamic structured list data is assigned according to the assignment data of the local dynamic structured list data.
Illustratively, taking schema data as an example, a local non-dynamic schema may be separated by a naming type of a field, e.g., a non-dynamic schema is characterized by a leverName field not beginning with a dynamic schema savepath. The old dynamic schema stored locally is then completely replaced with the newly acquired dynamic schema. If the old dynamic schema stored locally has been assigned a value, the value may be assigned to the new corresponding dynamic schema. Thus, if the dynamic schema is updated, the user can be updated on the premise of not losing data, so that humanization of updating the dynamic schema data is improved.
In one specific example, when a user pulls a form of a work card and fills out related information, the user finds that the form type is wrong and then pulls a new form of the work card again. At this time, if the execution framework monitors that the data of the work card needs to be updated, the form of the work card re-pulled by the user is obtained to replace the work card form with updated pulling error, and relevant information filled in the work card form with the pulling error by the user is automatically filled in the form of the re-pulled work card, such as information of automatic filling name, age, work department and the like.
According to the technical scheme, whether the current dynamic structured list data meets the data updating condition is judged according to the data updating association field of the current dynamic structured list data, when the data updating condition is confirmed to be met, an interface for requesting to acquire the current dynamic structured list data is confirmed according to the data request storage configuration field in the independent configuration file, a request keyword of a target data request is generated based on the interface of the current dynamic structured list data, a request value of the target data request is generated according to the above information of the current dynamic structured list data, and therefore the current dynamic structured list data is acquired according to the generated target data request. After the current dynamic structured list data is obtained, the local dynamic structured list data is updated according to the assignment condition of the corresponding local dynamic structured list data and the current dynamic structured list data, so that the updating efficiency and the universality of the updating process of the structured list data can be improved, and the humanization and the rationality of the updating of the structured list data can be improved.
In the technical scheme of the disclosure, the related processes of collecting, storing, using, processing, transmitting, providing, disclosing and the like of the personal information (such as data filled by a user) of the user are in accordance with the regulations of related laws and regulations, and the public order harmony is not violated.
It should be noted that any permutation and combination of the technical features in the above embodiments also belong to the protection scope of the present disclosure.
In one example, fig. 3 is a block diagram of a data processing apparatus provided in an embodiment of the present disclosure, where the embodiment of the present disclosure may be applicable to a case where dynamic structured list data is updated according to an independent configuration file, where the apparatus is implemented by software and/or hardware, and specifically configured in an electronic device. The electronic device may be a terminal device or a server device, and the embodiment of the disclosure does not limit a specific device type of the electronic device.
A data processing apparatus 300 as shown in fig. 3, comprising: a reference configuration information acquisition module 310, a current dynamic structured list data acquisition module 320, and a structured list data update module 330. Wherein,,
a reference configuration information obtaining module 310, configured to obtain, when it is determined that the current dynamic structured list data meets a data update condition, reference configuration information of the current dynamic structured list data according to an independent configuration file of the current dynamic structured list data;
A current dynamic structured list data obtaining module 320, configured to generate a target data request according to reference configuration information of the current dynamic structured list data, and obtain the current dynamic structured list data according to the target data request;
and the structured list data updating module 330 is configured to update the locally stored structured list data according to the current dynamic structured list data.
Optionally, the reference configuration information acquisition module 310 is further configured to: acquiring a data update associated field of the current dynamic structured list data; under the condition that the data update associated field of the current dynamic structured list data is matched with the target field, determining that the current dynamic structured list data meets the data update condition; wherein the target field is a data update associated field of the dynamic structured list data to be updated; wherein the data update association field includes a connector identification, a data manipulation identification, and a unique identification of the dynamic structured list data.
Optionally, the data processing apparatus further includes an independent configuration file generating module configured to: determining updated reference configuration information of the dynamic structured list data; wherein the update reference configuration information comprises a data update association field and a data request save configuration field; and generating the independent configuration file according to the updated reference configuration information of the dynamic structured list data.
Optionally, the reference configuration information includes a data request save configuration field; the current dynamic structured list data acquisition module 320 is further configured to: determining an interface for requesting to acquire the current dynamic structured list data according to the data request storage configuration field; generating a request keyword of the target data request based on the interface of the current dynamic structured list data; and generating a request value of the target data request according to the above information of the current dynamic structured list data.
Optionally, the data processing apparatus further comprises an above information determining module for: acquiring a current attribute value of a current data operator for inputting the current dynamic structured list data; and taking the current attribute value input by the current dynamic structured list data as the above information of the current dynamic structured list data.
Optionally, the structured list data update module 330 is further configured to: separating local dynamic structured list data from the locally stored structured list data; and updating the local dynamic structured list data according to the assignment condition of the local dynamic structured list data and the current dynamic structured list data.
Optionally, the structured list data update module 330 is further configured to: under the condition that the assigned data of the local dynamic structured list data is determined to be empty, replacing and updating the local dynamic structured list data according to the current dynamic structured list data; and under the condition that the local dynamic structured list data is determined to have assignment data, replacing and updating the local dynamic structured list data according to the current dynamic structured list data, and assigning the updated local dynamic structured list data according to the assignment data of the local dynamic structured list data.
Optionally, the current dynamic structured list data includes dynamic schema data.
Optionally, the dynamic schema data is used for generating a target object; wherein the target object comprises at least one of: work cards, system sub-flows, and database data tables.
The data processing device can execute the data processing method provided by any embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of the execution method. Technical details not described in detail in this embodiment may be found in the data processing method provided in any embodiment of the present disclosure.
Since the data processing apparatus described above is an apparatus capable of executing the data processing method in the embodiment of the present disclosure, a person skilled in the art will be able to understand the specific implementation of the data processing apparatus of the embodiment and various modifications thereof based on the data processing method described in the embodiment of the present disclosure, so how the data processing apparatus implements the data processing method in the embodiment of the present disclosure will not be described in detail herein. The means employed by those skilled in the art to implement the data processing methods in the embodiments of the present disclosure are within the intended scope of the present disclosure.
In one example, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.
Fig. 4 illustrates a schematic block diagram of an example electronic device 400 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 4, the apparatus 400 includes a computing unit 401 that can perform various suitable actions and processes according to a computer program stored in a Read Only Memory (ROM) 402 or a computer program loaded from a storage unit 408 into a Random Access Memory (RAM) 403. In RAM 403, various programs and data required for the operation of device 400 may also be stored. The computing unit 401, ROM 402, and RAM 403 are connected to each other by a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.
Various components in device 400 are connected to I/O interface 405, including: an input unit 406 such as a keyboard, a mouse, etc.; an output unit 407 such as various types of displays, speakers, and the like; a storage unit 408, such as a magnetic disk, optical disk, etc.; and a communication unit 409 such as a network card, modem, wireless communication transceiver, etc. The communication unit 409 allows the device 400 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The computing unit 401 may be a variety of general purpose and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 401 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 401 performs the respective methods and processes described above, such as a data processing method.
For example, in some embodiments, the data processing method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as the storage unit 408. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 400 via the ROM 402 and/or the communication unit 409. When a computer program is loaded into RAM 403 and executed by computing unit 401, one or more steps of the data processing method described above may be performed. Alternatively, in other embodiments, the computing unit 401 may be configured to perform the data processing method by any other suitable means (e.g. by means of firmware).
Various implementations of the systems and techniques described here above can be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service are overcome. The servers may also be servers of a distributed system or servers that incorporate blockchains.
According to the embodiment of the disclosure, the current dynamic structured list data is monitored, and under the condition that the current dynamic structured list data meets the data updating condition, the reference configuration information of the current dynamic structured list data is obtained according to the independent configuration file of the current dynamic structured list data, so that a target data request is generated according to the reference configuration information of the current dynamic structured list data, and the current dynamic structured list data is obtained according to the target data request, thereby updating the locally stored structured list data according to the current dynamic structured list data, solving the problems of low updating efficiency, poor universality and the like of the existing dynamic structured list data, and improving the updating efficiency and the universality of the updating processing of the structured list data.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel or sequentially or in a different order, provided that the desired results of the technical solutions of the present disclosure are achieved, and are not limited herein.
The above detailed description should not be taken as limiting the scope of the present disclosure. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present disclosure are intended to be included within the scope of the present disclosure.
Claims (21)
1. A data processing method, comprising:
under the condition that the current dynamic structured list data meets the data updating condition, acquiring reference configuration information of the current dynamic structured list data according to an independent configuration file of the current dynamic structured list data;
generating a target data request according to the reference configuration information of the current dynamic structured list data, and acquiring the current dynamic structured list data according to the target data request;
And updating the locally stored structured list data according to the current dynamic structured list data.
2. The data processing method of claim 1, wherein the determining that the current dynamic structured list data satisfies a data update condition comprises:
acquiring a data update associated field of the current dynamic structured list data;
under the condition that the data update associated field of the current dynamic structured list data is matched with the target field, determining that the current dynamic structured list data meets the data update condition;
wherein the target field is a data update associated field of the dynamic structured list data to be updated;
wherein the data update association field includes a connector identification, a data manipulation identification, and a unique identification of the dynamic structured list data.
3. The data processing method of claim 1, further comprising:
determining updated reference configuration information of the dynamic structured list data; wherein the update reference configuration information comprises a data update association field and a data request save configuration field;
and generating the independent configuration file according to the updated reference configuration information of the dynamic structured list data.
4. The data processing method of claim 1, wherein the reference configuration information comprises a data request save configuration field; the generating a target data request according to the reference configuration information of the current dynamic structured list data comprises the following steps:
determining an interface for requesting to acquire the current dynamic structured list data according to the data request storage configuration field;
generating a request keyword of the target data request based on the interface of the current dynamic structured list data;
and generating a request value of the target data request according to the above information of the current dynamic structured list data.
5. The data processing method of claim 4, further comprising:
acquiring a current attribute value of a current data operator for inputting the current dynamic structured list data;
and taking the current attribute value input by the current dynamic structured list data as the above information of the current dynamic structured list data.
6. The data processing method according to claim 1, wherein the updating the locally stored structured list data according to the current dynamic structured list data includes:
Separating local dynamic structured list data from the locally stored structured list data;
and updating the local dynamic structured list data according to the assignment condition of the local dynamic structured list data and the current dynamic structured list data.
7. The data processing method according to claim 6, wherein the updating the local dynamic structured list data according to the assignment of the local dynamic structured list data and the current dynamic structured list data includes:
under the condition that the assigned data of the local dynamic structured list data is determined to be empty, replacing and updating the local dynamic structured list data according to the current dynamic structured list data;
and under the condition that the local dynamic structured list data is determined to have assignment data, replacing and updating the local dynamic structured list data according to the current dynamic structured list data, and assigning the updated local dynamic structured list data according to the assignment data of the local dynamic structured list data.
8. A data processing method according to any of claims 1 to 7, wherein the current dynamic structured list data comprises dynamic schema data.
9. The data processing method of claim 8, wherein the dynamic schema data is used to generate a target object; wherein the target object comprises at least one of: work cards, system sub-flows, and database data tables.
10. A data processing apparatus comprising:
the reference configuration information acquisition module is used for acquiring the reference configuration information of the current dynamic structured list data according to the independent configuration file of the current dynamic structured list data under the condition that the current dynamic structured list data is determined to meet the data updating condition;
the current dynamic structured list data acquisition module is used for generating a target data request according to the reference configuration information of the current dynamic structured list data and acquiring the current dynamic structured list data according to the target data request;
and the structured list data updating module is used for updating the locally stored structured list data according to the current dynamic structured list data.
11. The data processing apparatus of claim 10, wherein the reference configuration information acquisition module is further to:
acquiring a data update associated field of the current dynamic structured list data;
Under the condition that the data update associated field of the current dynamic structured list data is matched with the target field, determining that the current dynamic structured list data meets the data update condition;
wherein the target field is a data update associated field of the dynamic structured list data to be updated;
wherein the data update association field includes a connector identification, a data manipulation identification, and a unique identification of the dynamic structured list data.
12. The data processing apparatus of claim 10, further comprising an independent profile generation module to:
determining updated reference configuration information of the dynamic structured list data; wherein the update reference configuration information comprises a data update association field and a data request save configuration field;
and generating the independent configuration file according to the updated reference configuration information of the dynamic structured list data.
13. The data processing apparatus of claim 10, wherein the reference configuration information comprises a data request save configuration field; the current dynamic structured list data acquisition module is further configured to:
determining an interface for requesting to acquire the current dynamic structured list data according to the data request storage configuration field;
Generating a request keyword of the target data request based on the interface of the current dynamic structured list data;
and generating a request value of the target data request according to the above information of the current dynamic structured list data.
14. The data processing apparatus of claim 13, further comprising an upper information determination module for:
acquiring a current attribute value of a current data operator for inputting the current dynamic structured list data;
and taking the current attribute value input by the current dynamic structured list data as the above information of the current dynamic structured list data.
15. The data processing apparatus of claim 10, wherein the structured listing data update module is further to:
separating local dynamic structured list data from the locally stored structured list data;
and updating the local dynamic structured list data according to the assignment condition of the local dynamic structured list data and the current dynamic structured list data.
16. The data processing apparatus of claim 15, wherein the structured listing data update module is further to:
under the condition that the assigned data of the local dynamic structured list data is determined to be empty, replacing and updating the local dynamic structured list data according to the current dynamic structured list data;
And under the condition that the local dynamic structured list data is determined to have assignment data, replacing and updating the local dynamic structured list data according to the current dynamic structured list data, and assigning the updated local dynamic structured list data according to the assignment data of the local dynamic structured list data.
17. A data processing apparatus according to any of claims 10 to 16, wherein the current dynamic structured list data comprises dynamic schema data.
18. The data processing apparatus of claim 17, wherein the dynamic schema data is used to generate a target object; wherein the target object comprises at least one of: work cards, system sub-flows, and database data tables.
19. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data processing method of any one of claims 1-9.
20. A non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the data processing method of any one of claims 1-9.
21. A computer program product comprising computer programs/instructions which, when executed by a processor, implement the data processing method of any of claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310820861.3A CN116860751A (en) | 2023-07-05 | 2023-07-05 | Data processing method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310820861.3A CN116860751A (en) | 2023-07-05 | 2023-07-05 | Data processing method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116860751A true CN116860751A (en) | 2023-10-10 |
Family
ID=88221121
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310820861.3A Pending CN116860751A (en) | 2023-07-05 | 2023-07-05 | Data processing method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116860751A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117743588A (en) * | 2023-11-20 | 2024-03-22 | 中国科学院成都文献情报中心 | Organic solar cell field experimental modeling method and system based on event ontology |
-
2023
- 2023-07-05 CN CN202310820861.3A patent/CN116860751A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117743588A (en) * | 2023-11-20 | 2024-03-22 | 中国科学院成都文献情报中心 | Organic solar cell field experimental modeling method and system based on event ontology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112860811B (en) | Method and device for determining data blood relationship, electronic equipment and storage medium | |
| KR20210105315A (en) | Method and apparatus for annotating data, device, storage medium and computer program | |
| CN116860751A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN115495473A (en) | Database query method and device, electronic equipment and storage medium | |
| CN116226150A (en) | Data processing method, device, equipment and medium based on distributed database | |
| CN116028517A (en) | Fusion database system and electronic equipment | |
| CN114969444A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN115328917A (en) | Query method, device, equipment and storage medium | |
| CN113742321B (en) | Data updating method and device | |
| CN112783507B (en) | Data stream guiding playback method and device, electronic equipment and readable storage medium | |
| CN118170430B (en) | Method, device, equipment and storage medium for processing call link | |
| CN117997870B (en) | EMS northbound cloud platform docking method and device, electronic equipment and storage medium | |
| CN113609145B (en) | Database processing method, device, electronic equipment, storage medium and product | |
| CN117931506A (en) | Document verification method, device, equipment and storage medium | |
| CN117573677A (en) | Data updating method, device, equipment and medium based on transverse table database structure | |
| CN117938909A (en) | Data transmission method, device, equipment and medium | |
| CN117668114A (en) | Data synchronization method, device, equipment and medium | |
| CN117609150A (en) | Data migration method, device, equipment and medium | |
| CN116186051A (en) | Data updating method, device, equipment and storage medium | |
| CN117278648A (en) | Protocol dynamic adaptation method, device, electronic equipment and storage medium | |
| CN118631652A (en) | Configuration method, device, equipment and storage medium of system route | |
| CN115510838A (en) | Template generation method and device, electronic equipment and storage medium | |
| CN118394323A (en) | Visual control processing method, device, equipment and medium | |
| CN118733877A (en) | Subscription processing method, device and equipment based on large model | |
| CN117331944A (en) | Database table generation method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |