CN113515413B - Data management method and device, electronic equipment and storage medium - Google Patents
Data management method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113515413B CN113515413B CN202110871081.2A CN202110871081A CN113515413B CN 113515413 B CN113515413 B CN 113515413B CN 202110871081 A CN202110871081 A CN 202110871081A CN 113515413 B CN113515413 B CN 113515413B
- Authority
- CN
- China
- Prior art keywords
- data
- processed
- target
- platform
- backup database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000013523 data management Methods 0.000 title claims abstract description 43
- 238000000034 method Methods 0.000 title claims abstract description 41
- 238000007726 management method Methods 0.000 claims abstract description 90
- 230000008859 change Effects 0.000 claims abstract description 49
- 230000001960 triggered effect Effects 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 4
- 238000009877 rendering Methods 0.000 claims description 3
- 238000012986 modification Methods 0.000 abstract description 3
- 230000004048 modification Effects 0.000 abstract description 3
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 19
- 239000007789 gas Substances 0.000 description 8
- 238000013500 data storage Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000013480 data collection Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000002737 fuel gas Substances 0.000 description 1
- 238000009440 infrastructure construction Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000005057 refrigeration Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2358—Change logging, detection, and notification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention discloses a data management method, a data management device, electronic equipment and a storage medium. The method comprises the following steps: acquiring data to be processed from a target platform, and storing the data to be processed to a target management platform; wherein the data to be processed comprises data corresponding to different services; the data to be processed is backed up and stored in a backup database corresponding to the display platform, so that the data in the backup database is displayed; when the target change data in the updated backup database is detected, original data corresponding to the target change data in the target management platform is determined, and a corresponding relation between the original data and the target change data is established so as to manage the data based on the corresponding relation. The technical scheme of the embodiment of the invention can uniformly manage the data to be processed, retain the original data in the target management platform during modification, and can finish the subsequent work of searching and tracing the data.
Description
Technical Field
Embodiments of the present invention relate to data processing technologies, and in particular, to a data management method, a data management device, an electronic device, and a storage medium.
Background
With the rapid development of social economy and the continuous construction and perfection of electric power infrastructure construction, more and more space data are generated.
In the prior art, in order to manage spatial data, different types of data management systems are provided to manage different types of data respectively. For example, by providing a water conservancy data storage and management platform for water conservancy data, a power data storage and management platform is provided for power data.
However, the prior art can collect and manage various types of data, but has poor centralized control capability and more complex management; and once a problem occurs and data needs to be corrected, original data is lost, so that the traceability of the data is lost.
Disclosure of Invention
The embodiment of the invention provides a data management method, a device, electronic equipment and a storage medium, which are used for realizing unified management of data to be processed acquired from a target platform, and only changing data in a backup database, and still retaining original data in the original target management platform, so that the data can be conveniently searched and traced later.
In a first aspect, an embodiment of the present invention provides a data management method, which may include:
obtaining data to be processed from a target platform, and storing the data to be processed to a target management platform; wherein the data to be processed comprises data corresponding to different services;
The data to be processed is backed up and stored in a backup database corresponding to a display platform, so that the data in the backup database is displayed;
when the updating of the target change data in the backup database is detected, original data corresponding to the target change data in the target management platform is determined, and a corresponding relation between the original data and the target change data is established so as to manage the data based on the corresponding relation.
In a second aspect, an embodiment of the present invention further provides a data management apparatus, which may include:
The data acquisition module is used for acquiring data to be processed from the target platform and storing the data to be processed to the target management platform; wherein the data to be processed comprises data corresponding to different services;
The storage module is used for storing the data to be processed in a backup database corresponding to the display platform in a backup manner so as to display the data in the backup database;
And the original data determining module is used for determining original data corresponding to the target change data in the target management platform when the target change data in the backup database is detected to be updated, and establishing a corresponding relation between the original data and the target change data so as to manage the data based on the corresponding relation.
In a third aspect, an embodiment of the present invention further provides an electronic device, which may include:
One or more processors;
A memory for storing one or more programs;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the data management methods provided by any of the embodiments of the present invention.
In a fourth aspect, embodiments of the present invention further provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the data management method provided by any of the embodiments of the present invention.
According to the data management method provided by the embodiment of the invention, the data to be processed is obtained from the target platform, and the data to be processed is stored in the target management platform; wherein the data to be processed comprises data corresponding to different services; and acquiring the data to be processed corresponding to various services through the target platform to perform unified management. The data to be processed is backed up and stored in a backup database corresponding to the display platform, so that the data in the backup database is displayed; when the target change data in the updated backup database is detected, original data corresponding to the target change data in the target management platform is determined, and a corresponding relation between the original data and the target change data is established so as to manage the data based on the corresponding relation. Therefore, the invention carries out unified management on the data to be processed acquired from the target platform, only changes the data in the backup database, still retains the original data in the original target management platform, and can complete subsequent searching and tracing of the data according to the established corresponding relation.
In addition, the data management device, the electronic equipment and the storage medium provided by the invention correspond to the method and have the same beneficial effects.
Drawings
For a clearer description of embodiments of the present invention, the drawings that are required to be used in the embodiments will be briefly described, it being apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to the drawings without inventive effort for those skilled in the art.
FIG. 1 is a flow chart of a data management method according to an embodiment of the present invention;
FIG. 2 is a flowchart of another data management method according to an embodiment of the present invention;
FIG. 3 is a flowchart of another data management method according to an embodiment of the present invention;
FIG. 4 is a block diagram of a data management device according to an embodiment of the present invention;
FIG. 5 is a block diagram of another data management apparatus according to an embodiment of the present invention;
Fig. 6 is a block diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
The core of the invention is to provide a data management method, a device, an electronic device and a storage medium, which are used for uniformly managing the data to be processed acquired from a target platform, and only changing the data in a backup database, and still retaining the original data in the original target management platform, so that the data can be conveniently searched and traced later.
In order to better understand the aspects of the present invention, the present invention will be described in further detail with reference to the accompanying drawings and detailed description.
Example 1
Fig. 1 is a flowchart of a data management method according to an embodiment of the present invention. The method may be performed by a data management device provided by an embodiment of the present invention, where the device may be implemented in software and/or hardware, and the device may be integrated on various user terminals or servers.
As shown in fig. 1, the method in the embodiment of the invention specifically includes the following steps:
s101, acquiring data to be processed from a target platform, and storing the data to be processed to a target management platform; wherein the data to be processed includes data corresponding to different services.
In a specific implementation, the target platform may be an internet of things platform, and the internet of things platform is connected with each sub-platform to obtain platform data of each sub-platform. Illustratively, the sub-platform includes at least one of a water conservancy management platform, an electrical management platform, a thermal management platform, and a gas management platform. Communication interfaces are arranged between the Internet of things platform and each sub-platform, and each sub-platform uploads platform data to the Internet of things platform through the communication interfaces. Specifically, the platform data includes at least one of water conservancy data, electric power data, thermal power data and fuel gas data.
Specifically, the data to be processed can be periodically obtained from the target platform, or the data to be processed can be obtained from the target platform at random set time. The data to be processed comprises data corresponding to different services, and the services comprise at least one of water conservancy service, electric utilization service, refrigeration service and gas service. And storing the acquired data to be processed to a target management platform, wherein the target management platform can comprise a terminal database.
Furthermore, the data to be processed can be stored to the target management platform in the form of a data table and/or a graph, and the data to be processed can also be stored to the target management platform in the form of text records.
S102, backing up and storing the data to be processed in a backup database corresponding to the display platform so as to display the data in the backup database.
Optionally, a backup database is pre-established for backing up the data to be processed acquired from the target platform. Specifically, after the data to be processed is stored in the target management platform, the data to be processed in the target management platform can be mapped into the backup database in a one-to-one correspondence manner according to the storage form, so as to complete the backup of the data to be processed. For example, the data to be processed is stored in the target management platform in the form of a data table, and then all the data tables are mapped into the backup database. Before the data in the backup database is not modified, the data in the backup database is consistent with the data in the target management platform.
Furthermore, the backup database corresponds to the display platform, and the data to be processed in the backup database can be displayed through the display platform. Specifically, the display platform may determine the display content by receiving the display instruction sent by the user terminal, and may specify to display all the data to be processed in the backup database, or may specify to display part to specify the data to be processed.
And S103, when the target change data in the updated backup database is detected, determining the original data corresponding to the target change data in the target management platform, and establishing a corresponding relation between the original data and the target change data so as to manage the data based on the corresponding relation.
Optionally, an instruction may be sent to the backup database through the display platform to change the data to be processed stored in the backup database; and determining the changed data to be processed as target change data, and updating the backup database based on the target change data.
When the target change data in the updated backup database is detected, in order to trace back the original data before the change, the original data corresponding to the target management platform can be determined based on the data information of the target change data in the backup database. The data information includes at least one of a data content, a data name, a data identification, and a storage location before the target modification data is modified. Further, a correspondence between the original data and the target modification data is established to manage the data based on the correspondence.
According to the data management method provided by the embodiment of the invention, the data to be processed is obtained from the target platform, and the data to be processed is stored in the target management platform; wherein the data to be processed comprises data corresponding to different services; and acquiring the data to be processed corresponding to various services through the target platform to perform unified management. The data to be processed is backed up and stored in a backup database corresponding to the display platform, so that the data in the backup database is displayed; when the target change data in the updated backup database is detected, original data corresponding to the target change data in the target management platform is determined, and a corresponding relation between the original data and the target change data is established so as to manage the data based on the corresponding relation. Therefore, the invention carries out unified management on the data to be processed acquired from the target platform, only changes the data in the backup database, still retains the original data in the original target management platform, and can complete subsequent searching and tracing of the data according to the established corresponding relation.
Example two
Fig. 2 is a flowchart of another data management method according to an embodiment of the present invention. The present embodiment is optimized based on the above technical solutions. Optionally, before obtaining the data to be processed from the target platform and storing the data to be processed to the target management platform, the method further includes: receiving data to be processed corresponding to each service based on a target platform, and storing the data to be processed according to service identifiers; or, based on the target platform, receiving the data to be processed corresponding to each service, and storing the data to be processed according to the data type. Optionally, storing the data backup to be processed in a backup database corresponding to the display platform, including: correspondingly storing the data to be processed into a backup database according to each configuration item in a preset configuration table, and updating the data to the management table based on the data tag of the data to be processed; optionally, the method further comprises: when the operation of triggering the target display control is detected, target data to be displayed corresponding to the triggering operation is called from the backup database, and the target data to be displayed is rendered and then displayed. Wherein, the explanation of the same or corresponding terms as the above embodiments is not repeated herein.
As shown in fig. 2, the method in the embodiment of the present invention specifically includes the following steps:
S201, receiving data to be processed corresponding to each service based on a target platform, and storing the data to be processed according to service identifiers; or, based on the target platform, receiving the data to be processed corresponding to each service, and storing the data to be processed according to the data type.
Optionally, a service identifier is set for each service type, and the data to be processed is stored according to the corresponding service identifier based on the data to be processed corresponding to each service type received by the target platform. By way of example, the service type may include at least one of water conservancy, electric power, gas and thermal energy, and the corresponding service identification includes at least one of water conservancy identification, electric power identification, gas identification and thermal energy identification. For example, if the data to be processed is water conservancy data, the data to be processed is stored in a storage position corresponding to the water conservancy identifier. By storing the data to be processed according to the service type, the data of the same service type can be conveniently and uniformly managed.
Further, the data can be stored according to the data type of the data to be processed. By way of example, the data types may include voltage data, current data, power data, heat data, water flow rate data, gas data, and the like. The same type of data may be stored in the specified location of the same type of data. For example, the data to be processed is a voltage value detected by the device, and the data to be processed corresponding to the voltage value is stored according to the voltage type. By storing the data to be processed according to the data type, the data of the same type can be conveniently compared and checked. The manner of storing the data to be processed can be determined by those skilled in the art according to actual requirements, and the embodiment of the present invention is not limited thereto.
S202, acquiring data to be processed from a target platform, and storing the data to be processed to a target management platform; wherein the data to be processed includes data corresponding to different services.
And S203, correspondingly storing the data to be processed into a backup database according to each configuration item in a preset configuration table, and updating the data to be processed into a management table based on a data tag of the data to be processed so as to display the data in the backup database.
In a specific implementation, the data to be processed may be stored in the form of a configuration table. Specifically, a configuration table is preset, and configuration items to be stored are set in the configuration table. By way of example, the configuration item may include at least one of a service to which the data belongs, a data type, a data source, a storage location, a device name to which the data is acquired, and device attribute information. The method comprises the steps of presetting positions of configuration items in a configuration table, determining the configuration items to which data to be processed belong, storing the data to be processed in the positions set in the configuration table of the configuration items to which the data to be processed belong, updating the configuration table after storing the data to be processed, and further completing the storage of the data to be processed in a backup database.
The number of configuration tables may be one or more. Specifically, the configuration table may be set according to a one-to-one correspondence of the service types, for example, the water conservancy data is correspondingly stored in the water conservancy configuration table, and the electric power data is correspondingly stored in the electric power configuration table. Further, a configuration table may include one configuration item or multiple configuration items, so long as all data to be processed can be stored in the backup database, which is not limited in the embodiment of the present invention.
Optionally, a management table may be preset, where the management table includes each service identifier, a data tag of the data to be processed corresponding to each service identifier, and storage information of the data to be processed corresponding to each data tag. Specifically, the data tag may be an identifier composed of at least one of a number, a letter, a character or a symbol, and different data tags are set for different data to be processed, so as to facilitate the differentiated management of a large amount of data to be processed. Further, the service identifier is used for reflecting the service type of the data to be processed, and the service type of the data to be processed is conveniently known by recording the service identifier of each data to be processed in the management table.
Further, the management table includes storage information of the data to be processed, the storage information includes storage positions of the data to be processed in the target management platform and the backup database, and the corresponding data to be processed can be quickly obtained through the storage information. The service type and the storage information of the data to be processed can be quickly known through the data labels recorded in the management table and the configuration table.
Optionally, according to the data tag of the data to be processed, the storage information of the data to be processed in the backup database is added to the position corresponding to the newly added configuration item in the management table. The data to be processed corresponding to each configuration item in the configuration table is associated with the information stored in the management table through the data tag, and the storage information of the data to be processed in the backup database can be added to the position corresponding to the newly added configuration item corresponding to the data tag in the management table through the data tag of the data to be processed, so that the storage position of the data to be processed in the backup database can be quickly and conveniently queried from the management table through the storage information stored in the management table, and the data to be processed can be conveniently called and acquired.
Further, after the data to be processed is stored in the backup database, the management table can be updated based on the data tag of the stored data to be processed, so that the corresponding relationship between the content recorded in the management table and the data to be processed in the configuration table in the backup database is ensured. At least one of the data to be processed and the corresponding data tag in the backup database can be displayed to a display platform so as to facilitate the completion of the searching and viewing operation of the data to be processed.
S204, when the operation of triggering the target display control is detected, target data to be displayed corresponding to the triggering operation is called from the backup database, and the target data to be displayed is rendered and then displayed.
Specifically, at least one control for operating the stored data to be processed can be displayed in the display platform. The controls may include at least one of a show control, a delete control, a modify control, an add control, and a find control. Different operations of the data to be processed are realized by triggering the controls with different functions.
When the operation of triggering the target display control is detected, the current requirement for displaying the target to-be-displayed data is indicated, the target to-be-displayed data corresponding to the triggering operation can be called from the backup database, and the target to-be-displayed data is rendered and then displayed. The rendering means may include at least one of a data enlarged display, a data bolded display, and a data colored display.
Specifically, the target to-be-displayed data to be called can be determined based on the input data label when the operation of the target display control is triggered, or the target to-be-displayed data can be called based on the storage information of the input target to-be-displayed data in the backup database when the operation of the target display control is triggered.
Optionally, when the target display control is detected to be triggered again or periodically, compressing and storing the target to-be-displayed data with the smallest interval with the current time into a historical database, and removing the target to-be-displayed data from the backup database. When the target display control is detected to be triggered again, the requirement for displaying new data to be processed is indicated, in order to save resources of the display platform and the backup database, the displayed target data to be displayed with the minimum time interval can be compressed and stored into the historical database, and the target data to be displayed is removed from the backup database, so that the space of the display platform and the backup database is saved, and the new data to be processed can be stored and displayed better. Furthermore, the displayed target number to be displayed may be compressed to the history database periodically, and a person skilled in the art may set the period duration according to the actual application situation, which is not limited in the embodiment of the present invention.
S205, when the target change data in the updated backup database is detected, determining the original data corresponding to the target change data in the target management platform, and establishing a corresponding relation between the original data and the target change data so as to manage the data based on the corresponding relation.
Optionally, when target change data in the updated backup database is detected, determining a target data tag corresponding to the target change data in the backup database; determining a matching data tag matched with the target data tag in the target management platform, and determining to-be-processed data corresponding to the matching data tag as original data; and establishing a corresponding relation between the original data and the target change data so as to manage the data based on the corresponding relation. Therefore, the corresponding relation between the target change data and the original data is determined based on the data label, and the subsequent tracing of the data is facilitated.
The embodiment of the invention stores the data to be processed according to the service type or the data type, is convenient for searching and classifying the data, and sets the data label for each data to be processed, so as to conveniently determine the corresponding relation between the target management platform and the data to be processed in the backup database; and compressing the displayed target data to be displayed to a historical database, so that space resources of a backup database and a display platform are saved.
Example III
The foregoing details of the embodiments of the data management method are described in detail, and specific application scenarios are given below in order to make the technical solutions of the method further clear to those skilled in the art.
FIG. 3 is a flowchart of another data management method according to an embodiment of the present invention; as shown in fig. 3, after data such as cold, heat, electricity, gas, water and the like are collected, the data are transmitted to corresponding systems for management, and the systems are provided with communication interfaces, so that data to be processed in the systems can be uploaded to an internet of things platform, and data interaction among the systems is achieved. Therefore, on the premise of acquiring the authority, the data to be processed from a plurality of different sources can be acquired from the internet of things platform, and the data to be processed can comprise at least one of electric power data, water conservancy data, gas data and heat energy data.
In a specific implementation, data may be periodically acquired from each system, for example, data may be acquired once a week or a month, so that the workload of acquiring the data is reduced on the premise of ensuring that the data can be acquired.
Alternatively, the data type or service type of the data to be processed may be converted into a form of a data record table and stored in the terminal database. It should be noted that the data record table is specifically a configuration table including at least one configuration item. The terminal database may be understood as a target management platform. And the data to be processed is conveniently and uniformly managed by adopting the form of a data record table for storage. The data to be processed transmitted by the power system may be recorded in a power data record table, the data to be processed transmitted by the water conservancy system may be recorded in a water conservancy data record table, and finally, each data record table is stored in the terminal database.
Alternatively, mapping the data record table to the display database in a one-to-one correspondence manner can be understood as a backup database. And displaying the data record table stored in the display database to the display platform through a pre-constructed visual display platform. Setting data labels for the data to be processed, wherein each data label corresponds to the data to be processed displayed by the display platform one by one, and the data to be processed in the display database can be called and displayed in the display platform through the data labels.
And a parameter acquisition button control is arranged in the visualized display platform, and the data to be processed acquired by the equipment is invoked by triggering the parameter acquisition button control. Furthermore, the display platform can modify the data to be processed in the data record table in the display database through a pre-constructed management control module. In some embodiments, a modified data view tab is provided in the display platform, and the data record table is exposed or closed by operation of the modified data view tab.
In actual engineering, due to different detection positions or faults of acquisition equipment such as sensors, errors exist in data acquisition, and in order to avoid recording wrong data to be processed, when the data to be processed of the same name acquired by a plurality of same equipment at the same time are different, the acquired data to be processed are compared, and the numerical value of the data to be processed with the largest occurrence number is modified into a data record table.
Furthermore, the alarm indexes can be set according to the acquired parameters to be processed in a one-to-one correspondence manner, so that the data to be processed acquired by each device are ensured to have corresponding alarm thresholds. Alternatively, an alarm parameter table may be generated for recording each alarm parameter to centrally manage each alarm index.
Specifically, when the data value to be processed reaches the alarm index, alarm operation is performed. Specifically, whether the acquired data to be processed exceeds the corresponding alarm indexes is determined, if so, alarm prompt can be carried out in a display platform in a pop-up window mode, and the data to be processed exceeding the alarm indexes and the data labels are colored and displayed. Therefore, the manager can quickly check the alarm by adopting a corresponding alarm mechanism, alarm information is displayed in the display platform in a popup window mode, and corresponding data acquisition labels and data to be processed can be colored, so that the display position of the corresponding data to be processed exceeding the alarm index can be quickly found after the popup window is closed, and the manager can quickly develop subsequent processing work.
Furthermore, in order to save the storage space of the terminal database and the display database, a plurality of data record tables can be compressed and stored in the history database, and repeated data record tables in the terminal database and the display database and the history database are removed, so that the storage space is saved. Specifically, a history storage control can be constructed in the display platform, the operation of compressing the data record table to the history database is started by triggering the history storage control, and a storage time record table is generated for recording the time information of storing each data record table to the history database. Further, the operation of compressing and storing the plurality of data record tables in the history database can be periodically and automatically performed.
In order to facilitate data storage, the embodiment of the invention constructs the history storage label in the visual platform, and a user starts the history data storage by clicking the history storage label, and saves the use space of the history database by compressing the data. In addition, in order to prevent forgetting, periodical automatic storage is also possible, the operation of storing to the history database can be performed once every preset time, and the storage time information at the time of storage is recorded into the storage time record table so as to perform time tracing.
Example IV
FIG. 4 is a block diagram of a data management device according to an embodiment of the present invention; the apparatus is used for executing the data management method provided by any of the above embodiments. The device and the data management method of each embodiment belong to the same invention conception, and the details of the embodiment of the data management device, which are not described in detail, can be referred to the embodiment of the data management method. As shown in fig. 4, the apparatus may specifically include:
The data acquisition module 10 is used for acquiring data to be processed from a target platform and storing the data to be processed to a target management platform; wherein the data to be processed comprises data corresponding to different services;
The storage module 11 is configured to store the data to be processed in a backup database corresponding to the display platform, so as to display the data in the backup database;
The original data determining module 12 is configured to determine, when it is detected to update the target change data in the backup database, original data corresponding to the target change data in the target management platform, and establish a correspondence between the original data and the target change data, so as to manage data based on the correspondence.
Optionally, the apparatus further comprises:
The data storage module is used for receiving the data to be processed corresponding to each service based on the target platform and storing the data to be processed according to the service identification before the data to be processed is acquired from the target platform and stored in the target management platform; or, based on the target platform, receiving the data to be processed corresponding to each service, and storing the data to be processed according to the data type.
Optionally, the storage module 11 includes:
The updating management table unit is used for correspondingly storing the data to be processed into the backup database according to each configuration item in the preset configuration table and updating the data to the management table based on the data tag of the data to be processed;
the management table comprises service identifiers, data labels of the data to be processed corresponding to each service identifier and storage information of the data to be processed corresponding to each data label.
Optionally, the apparatus further comprises:
and the adding module is used for adding the storage information of the data to be processed in the backup database to the position corresponding to the newly added configuration item in the management table according to the data label of the data to be processed after the data to be processed is backed up and stored in the backup database corresponding to the display platform.
Optionally, determining the raw data module 12 includes:
The corresponding relation establishing unit is used for determining a corresponding target data label of the target change data in the backup database when the target change data in the backup database is detected to be updated; determining a matching data tag matched with the target data tag in the target management platform, and determining to-be-processed data corresponding to the matching data tag as original data; and establishing a corresponding relation between the original data and the target change data so as to manage the data based on the corresponding relation.
Optionally, the apparatus further comprises:
and the display module is used for calling the target data to be displayed corresponding to the triggering operation from the backup database when the operation of triggering the target display control is detected, and rendering and displaying the target data to be displayed.
Optionally, the apparatus further comprises:
and the rejecting module is used for compressing and storing the target to-be-displayed data with the smallest interval with the current moment into the historical database when the target display control is triggered again or periodically, and rejecting the target to-be-displayed data from the backup database.
The data management device provided by the embodiment of the invention can execute the data management method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
Fig. 5 is a block diagram of another data management apparatus according to an embodiment of the present invention, where, as shown in fig. 5, data to be processed of different service types are collected by a multi-source data collection unit, and the data are stored in a terminal database, for example, cold, hot, electric, gas, water and other data are collected by the data collection unit. In a specific implementation, the data can be acquired randomly or periodically from each system, for example, the data can be acquired once a week or a month, so that the workload of acquiring the data is reduced on the premise of ensuring that the data can be acquired.
Alternatively, the data type or service type of the data to be processed may be converted into a form of a data record table and stored in the terminal database. The terminal database comprises at least one data record table. It should be noted that the data record table is specifically a configuration table including at least one configuration item. And the data to be processed is conveniently and uniformly managed by adopting the form of a data record table for storage. The data to be processed transmitted by the power system may be recorded in a power data record table, the data to be processed transmitted by the water conservancy system may be recorded in a water conservancy data record table, and finally, each data record table is stored in the terminal database.
Optionally, the data record tables are mapped to the display database in a one-to-one correspondence manner to form a display data table, and the display database can be understood as a backup database. Setting data labels for the data to be processed, wherein each data label corresponds to the data to be processed displayed by the display platform one by one, and the data to be processed in the display database can be called and displayed in the display platform through the data labels. Further, the display data table stored in the display database is displayed to the display platform through a pre-constructed visual display platform.
In order to save the storage space of the terminal database and the display database, the management control module can compress a plurality of data record tables and store the data record tables into the history database, and remove the repeated data record tables in the terminal database and the display database and the history database so as to save the storage space. Specifically, a history storage control can be constructed in the display platform, the operation of compressing the data record table to the history database is started by triggering the history storage control, and a storage time record table is generated for recording the time information of storing each data record table to the history database. Further, the operation of compressing and storing the plurality of data record tables in the history database can be periodically and automatically performed.
In order to facilitate data storage, the embodiment of the invention constructs the history storage label in the visual platform, and a user starts the history data storage by clicking the history storage label, and saves the use space of the history database by compressing the data. In addition, in order to prevent forgetting, periodical automatic storage is also possible, the operation of storing to the history database can be performed once every preset time, and the storage time information at the time of storage is recorded into the storage time record table so as to perform time tracing.
It should be noted that, in the embodiment of the data management apparatus, each unit and module included are only divided according to the functional logic, but are not limited to the above-mentioned division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the present invention.
Example five
Fig. 6 is a block diagram of an electronic device according to an embodiment of the present invention. Fig. 6 shows a block diagram of an exemplary electronic device 20 suitable for use in implementing the embodiments of the present invention. The electronic device 20 shown is merely an example and should not be construed to limit the functionality and scope of use of embodiments of the present invention in any way.
As shown in fig. 6, the electronic device 20 is in the form of a general purpose computing device. Components of electronic device 20 may include, but are not limited to: one or more processors or processing units 201, a system memory 202, and a bus 203 that connects the various system components (including the system memory 202 and the processing units 201).
Bus 203 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, micro channel architecture (MAC) bus, enhanced ISA bus, video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.
Electronic device 20 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by electronic device 20 and includes both volatile and nonvolatile media, removable and non-removable media.
The system memory 202 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) 204 and/or cache memory 205. The electronic device 20 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 206 may be used to read from or write to non-removable, nonvolatile magnetic media. A magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk such as a CD-ROM, DVD-ROM, or other optical media may be provided. In these cases, each drive may be coupled to bus 203 through one or more data medium interfaces. Memory 202 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of embodiments of the invention.
A program/utility 208 having a set (at least one) of program modules 207 may be stored in, for example, memory 202, such program modules 207 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 207 generally perform the functions and/or methods of the embodiments described herein.
The electronic device 20 may also communicate with one or more external devices 209 (e.g., keyboard, pointing device, display 210, etc.), one or more devices that enable a user to interact with the electronic device 20, and/or any devices (e.g., network card, modem, etc.) that enable the electronic device 20 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 211. Also, electronic device 20 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet, through network adapter 212. As shown, network adapter 212 communicates with other modules of electronic device 20 over bus 203. It should be appreciated that other hardware and/or software modules may be used in connection with electronic device 20, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
The processing unit 201 executes various functional applications and data processing by running programs stored in the system memory 202.
The electronic equipment provided by the invention can realize the following method: acquiring data to be processed from a target platform, and storing the data to be processed to a target management platform; wherein the data to be processed comprises data corresponding to different services; and acquiring the data to be processed corresponding to various services through the target platform to perform unified management. The data to be processed is backed up and stored in a backup database corresponding to the display platform, so that the data in the backup database is displayed; when the target change data in the updated backup database is detected, original data corresponding to the target change data in the target management platform is determined, and a corresponding relation between the original data and the target change data is established so as to manage the data based on the corresponding relation. Therefore, the invention carries out unified management on the data to be processed acquired from the target platform, only changes the data in the backup database, still retains the original data in the original target management platform, and can complete subsequent searching and tracing of the data according to the established corresponding relation.
Example six
Embodiments of the present invention provide a storage medium containing computer executable instructions which, when executed by a computer processor, are for performing a data management method comprising:
Acquiring data to be processed from a target platform, and storing the data to be processed to a target management platform; wherein the data to be processed comprises data corresponding to different services; and acquiring the data to be processed corresponding to various services through the target platform to perform unified management. The data to be processed is backed up and stored in a backup database corresponding to the display platform, so that the data in the backup database is displayed; when the target change data in the updated backup database is detected, original data corresponding to the target change data in the target management platform is determined, and a corresponding relation between the original data and the target change data is established so as to manage the data based on the corresponding relation. Therefore, the invention carries out unified management on the data to be processed acquired from the target platform, only changes the data in the backup database, still retains the original data in the original target management platform, and can complete subsequent searching and tracing of the data according to the established corresponding relation.
Of course, the storage medium containing the computer executable instructions provided in the embodiments of the present invention is not limited to the method operations described above, and may also perform the related operations in the data management method provided in any embodiment of the present invention.
The computer storage media of embodiments of the invention may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for embodiments of the present invention may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
Claims (5)
1. A method of data management, comprising:
Obtaining data to be processed from a target platform, and storing the data to be processed to a target management platform; wherein the data to be processed comprises data corresponding to different services;
Storing the data to be processed into a backup database according to each configuration item in a preset configuration table, adding the storage information of the data to be processed in the backup database to a position corresponding to a newly added configuration item in a management table according to the data tag of the data to be processed, and updating the data to be processed into the management table based on the data tag of the data to be processed so as to display the data in the backup database;
the management table comprises service identifiers, data tags of data to be processed corresponding to each service identifier and storage information of the data to be processed corresponding to each data tag;
When the updating of the target change data in the backup database is detected, determining a target data tag corresponding to the target change data in the backup database, determining a matching data tag matched with the target data tag in a target management platform, determining to-be-processed data corresponding to the matching data tag as original data, and establishing a corresponding relation between the original data and the target change data so as to manage the data based on the corresponding relation;
when the operation of triggering the target display control is detected, target data to be displayed corresponding to the triggering operation is called from the backup database, and the target data to be displayed is rendered and then displayed;
And when the triggering of the target display control again is detected or the target to-be-displayed data with the smallest interval with the current moment is periodically compressed and stored in a historical database, and the target to-be-displayed data is removed from the backup database.
2. The method of claim 1, further comprising, prior to said obtaining the data to be processed from the target platform and storing the data to be processed to the target management platform:
Receiving data to be processed corresponding to each service based on the target platform, and storing the data to be processed according to service identifiers; or alternatively, the first and second heat exchangers may be,
And receiving data to be processed corresponding to each service based on the target platform, and storing the data to be processed according to the data type.
3. A data management apparatus, comprising:
The data acquisition module is used for acquiring data to be processed from the target platform and storing the data to be processed to the target management platform; wherein the data to be processed comprises data corresponding to different services;
The storage module is used for correspondingly storing the data to be processed into a backup database according to each configuration item in a preset configuration table, adding the storage information of the data to be processed in the backup database to a position corresponding to a newly added configuration item in a management table according to the data tag of the data to be processed, and updating the data to be processed into the management table based on the data tag of the data to be processed so as to display the data in the backup database;
the management table comprises service identifiers, data tags of data to be processed corresponding to each service identifier and storage information of the data to be processed corresponding to each data tag;
The original data determining module is used for determining a target data tag corresponding to target change data in the backup database when the target change data in the backup database is detected to be updated, determining a matching data tag matched with the target data tag in a target management platform, determining to-be-processed data corresponding to the matching data tag as original data, and establishing a corresponding relation between the original data and the target change data so as to manage the data based on the corresponding relation;
The display module is used for calling target data to be displayed corresponding to the triggering operation from the backup database when the operation of triggering the target display control is detected, and rendering and displaying the target data to be displayed;
And the rejecting module is used for compressing and storing the target to-be-displayed data with the smallest interval with the current moment into a historical database when the target display control is triggered again or periodically, and rejecting the target to-be-displayed data from the backup database.
4. An electronic device, comprising:
One or more processors;
A memory for storing one or more programs;
when executed by the one or more processors, causes the one or more processors to implement the data management method of any one of claims 1 and 2.
5. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the data management method according to any one of claims 1 and 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110871081.2A CN113515413B (en) | 2021-07-30 | 2021-07-30 | Data management method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110871081.2A CN113515413B (en) | 2021-07-30 | 2021-07-30 | Data management method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113515413A CN113515413A (en) | 2021-10-19 |
| CN113515413B true CN113515413B (en) | 2024-06-11 |
Family
ID=78067929
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110871081.2A Active CN113515413B (en) | 2021-07-30 | 2021-07-30 | Data management method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113515413B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114579590A (en) * | 2022-03-02 | 2022-06-03 | 苏州酷乐信息科技有限公司 | Multi-source data processing method, device and system and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101344868A (en) * | 2008-08-28 | 2009-01-14 | 北京握奇数据系统有限公司 | Data backup and acquiring method and device |
| WO2014136172A1 (en) * | 2013-03-04 | 2014-09-12 | 株式会社東芝 | Database device, program, and data processing method |
| CN111324295A (en) * | 2018-12-17 | 2020-06-23 | 中国移动通信集团四川有限公司 | Data migration method, device, equipment and medium |
| CN111367922A (en) * | 2020-02-25 | 2020-07-03 | 香港乐蜜有限公司 | Data updating method and related equipment |
-
2021
- 2021-07-30 CN CN202110871081.2A patent/CN113515413B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101344868A (en) * | 2008-08-28 | 2009-01-14 | 北京握奇数据系统有限公司 | Data backup and acquiring method and device |
| WO2014136172A1 (en) * | 2013-03-04 | 2014-09-12 | 株式会社東芝 | Database device, program, and data processing method |
| CN111324295A (en) * | 2018-12-17 | 2020-06-23 | 中国移动通信集团四川有限公司 | Data migration method, device, equipment and medium |
| CN111367922A (en) * | 2020-02-25 | 2020-07-03 | 香港乐蜜有限公司 | Data updating method and related equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113515413A (en) | 2021-10-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111815421B (en) | Tax policy processing method and device, terminal equipment and storage medium | |
| US20210374195A1 (en) | Information processing method, electronic device and storage medium | |
| CN110555150B (en) | Data monitoring method, device, equipment and storage medium | |
| CN110555072A (en) | Data access method, device, equipment and medium | |
| CN112989151B (en) | Data blood relationship display method and device, electronic equipment and storage medium | |
| US20130006888A1 (en) | Autotagging Business Processes | |
| CN109947832A (en) | EXCEL tables of data is generated to method, apparatus, terminal and the storage medium of SQL file | |
| CN110868322A (en) | Network management method, system, device and storage medium for distributed message service | |
| WO2023165256A1 (en) | Information generation method and apparatus, and electronic device | |
| CN113515413B (en) | Data management method and device, electronic equipment and storage medium | |
| CN110990445B (en) | Data processing method, device, equipment and medium | |
| CN114996288A (en) | Data comparison method and device, computer storage medium and electronic equipment | |
| CN112948396A (en) | Data storage method and device, electronic equipment and storage medium | |
| CN113076358A (en) | Report generation method, device, equipment and storage medium | |
| CN114942912B (en) | Network disk file collection method and device, network disk and storage medium | |
| CN111626597A (en) | Equipment alarm method, device, equipment and medium | |
| CN111784176A (en) | Data processing method, device, server and medium | |
| CN115794953A (en) | Data synchronization method, system, device and computer readable medium based on table data | |
| US10664501B2 (en) | Deriving and interpreting users collective data asset use across analytic software systems | |
| CN113792138A (en) | Report generation method and device, electronic equipment and storage medium | |
| CN112905635A (en) | Service processing method, device, equipment and storage medium | |
| CN113127574A (en) | Service data display method, system, equipment and medium based on knowledge graph | |
| CN114282618A (en) | Method, device, equipment and medium for determining user information with abnormal electricity utilization | |
| CN109547290B (en) | Cloud platform garbage data detection processing method, device, equipment and storage medium | |
| CN109710673B (en) | Work processing method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |