CN113568779B - Community data backup system based on routing equipment - Google Patents
Community data backup system based on routing equipment Download PDFInfo
- Publication number
- CN113568779B CN113568779B CN202110710622.3A CN202110710622A CN113568779B CN 113568779 B CN113568779 B CN 113568779B CN 202110710622 A CN202110710622 A CN 202110710622A CN 113568779 B CN113568779 B CN 113568779B
- Authority
- CN
- China
- Prior art keywords
- data
- backup
- information
- community
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
- G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/23—Clustering techniques
Abstract
The invention provides a community data backup system based on routing equipment. A monitoring module: the community data monitoring system is used for embedding a data monitoring program in routing equipment of a community, monitoring community data which pass through the routing equipment and are authorized to be monitored, and generating monitoring information; a data judgment module: the monitoring system is used for carrying out type division on the monitoring information and judging the importance of each type of data; a backup module: determining the backup mode of each type of data according to the importance, and backing up the monitored data based on the backup mode; wherein, the backup mode comprises: incremental backup and full backup. The invention has the beneficial effects that: the invention can divide the importance degree of the data, only backs up the incremental data for the unimportant data, and mainly determines the real-time condition of the equipment. For important equipment data such as fire safety equipment, full data backup is performed, so that unsafe accidents of communities are prevented. And data backup and data visualization are realized.
Description
Technical Field
The invention relates to the technical field of community data backup, in particular to a community data backup system based on routing equipment.
Background
At present, along with the development of internet of things, smart communities and intelligent communities are always popularized, and the popularization rate is higher and higher. In a new digital community, data is the most important community data. Therefore, how to keep the comprehensiveness of the data, keep the data updated in real time, and find the missing data from the backup data when the data is missing is the most important, and therefore, the data backup is very important. In the prior art, data is backed up by a database, the data is generally completely backed up or incrementally backed up after being divided, only one-way backup can be adopted, and if the data is fully backed up, storage resources of the data are greatly occupied; in case of incremental backup, it may cause critical data to be duplicated or data integrity to be problematic at the time of incremental backup, so that data is missing.
Disclosure of Invention
The invention provides a community data backup system based on routing equipment, which is used for solving the problem that in the prior art, data is divided through a database for data backup, the data is generally comprehensively backed up or incrementally backed up after being divided, only single-side backup can be adopted, and the storage resource of the data is greatly occupied.
A routing device based community data backup system, comprising:
and a monitoring module: the community data monitoring system is used for embedding a data monitoring program in routing equipment of a community, monitoring community data which pass through the routing equipment and are authorized to be monitored, and generating monitoring information;
a data judgment module: the monitoring system is used for carrying out type division on the monitoring information and judging the importance of each type of data;
a backup module: determining the backup mode of each type of data according to the importance, and backing up the monitored data based on the backup mode; wherein, the first and the second end of the pipe are connected with each other,
the backup mode comprises the following steps: incremental backup and full backup.
Preferably: the monitoring module comprises:
a program setting unit: the system comprises a service routing device used for determining the service routing device in the community and installing a data monitoring program on the service routing device;
an authorization unit: the data type of the data capable of being monitored is preset through a background, and monitoring authorization is carried out on the data capable of being monitored;
an information arrangement unit: the device is used for determining the data type after monitoring authorization, determining a corresponding data discrimination mode and generating monitoring information; wherein the content of the first and second substances,
the monitoring information comprises: data type, data object, data attributes, and history-related data state.
Preferably: the monitoring module further comprises:
owner management layer: the system is used for counting personal equipment of an owner and generating owner equipment information;
an operation and maintenance management layer; the system comprises a community, a data acquisition unit, a data processing unit and a data processing unit, wherein the community is used for extracting hardware equipment data in the community and generating equipment information;
a system management layer: the system information management system is used for managing the operation data and the basic data in the system and generating system information;
and a logic management layer: the method is used for managing different execution logics in the system and generating execution information.
Preferably: the monitoring module further comprises:
a planar geographic unit: the system comprises a plane map used for building an intelligent community, and position information of each routing device is marked on the plane map;
elevation data unit: the digital elevation model is used for establishing an intelligent community according to the position information;
a texture marking unit: the texture marking module is used for marking the texture in the digital elevation model and establishing digital texture;
an image unit: the system is used for forming a community three-dimensional building and environment entity image after the digital texture is generated;
a three-dimensional display unit: the system is used for carrying out data flow labeling on the three-dimensional community building and environment entity images;
an information generation unit: and marking the equipment for generating the data in each piece of monitoring information when the monitoring information is generated.
Preferably: the data judgment module comprises:
a data processing unit: the monitoring information is identified through a preset data dictionary, and the information content of the monitoring information is determined; wherein the content of the first and second substances,
the information content includes: data type, data generation equipment, data content weight, data range, data retention degree, data functionality, data requirement, data substitutability and original data importance;
a judging unit: the data type of the data generated by different equipment is determined according to the information content, and the importance of the data passing through the routing equipment is calculated through a preset rule, so that an importance value is determined;
an evaluation unit: and the data evaluation value is used for carrying out expected evaluation on the data passing through the routing equipment according to the importance value and determining the data evaluation value.
Preferably, the following components: the judging unit, determining the importance of the data, comprises the following steps:
step 1: according to the information content, determining and establishing an evaluation model of the data according to the following formula:
wherein a represents a data importance evaluation value; d is a radical of ic The characteristic parameter represents the characteristic parameter when the data corresponding to the ith information content is of the type c; p is ik Data corresponding to the ith information content is represented as a target parameter of the kth data generation device; a represents an expected parameter of the data; b represents a data judgment coefficient; d represents a data importance evaluation threshold; 1, 2, 3 … … n; n represents the total volume of the data; k is 1, 2, 3 … … s; s represents the total number of data producing devices;
step 2: according to the evaluation model, introducing a preset judgment parameter model, and determining the importance degree:
wherein, X represents the degree of importance; z is a linear or branched member i The data content weight corresponding to the ith information content; w is a group of i A data range corresponding to the ith information content; q. q of i The data retention degree of community data corresponding to the ith information content; ρ is a unit of a gradient i Data functional parameters of community data corresponding to the ith information content;
representing the data replaceability of the data corresponding to the ith information content under the condition that the importance of the original data is epsilon; e j Data demand parameters of community data corresponding to the ith information content;
preferably, the following components: the backup module comprises:
a mode determination unit: the system is used for establishing a distributed data backup database according to the importance of the data and determining the backup mode of the data;
a database building unit: the system is used for judging the relevance of the data according to the type of the data and establishing a parallel distributed database; wherein the content of the first and second substances,
the simultaneous distributed database includes: an incremental distributed database and a full distributed database;
an incremental backup unit: the data backup method comprises the steps of storing data to an incremental distributed database when the data belong to incremental backup;
a full backup unit: the system comprises a data storage module, a data backup module and a data backup module, wherein the data storage module is used for storing data to a full distributed database when the data belong to a full backup;
a data visualization unit: the system is used for determining different types of visualization tools according to the types of the data and determining visualization information based on the visualization tools; wherein the content of the first and second substances,
the visualization information includes: visual pictures, visual charts, and visual text.
Preferably: the backup module establishes a simultaneous distributed database comprising the steps of:
step S1: based on the data tree model, establishing a tree database in symmetrical distribution; wherein the content of the first and second substances,
one side of the tree database is an incremental distributed database, and the other side of the tree database is a full distributed database;
step S2: establishing a sub-database according to the tree database; wherein the content of the first and second substances,
the sub-databases comprise an equipment sub-database, a grid sub-database, a region sub-database, a building information sub-database, a house information sub-database, a household information sub-database, a property information sub-database and an operation and maintenance sub-database;
and step S3, symmetrically arranging the sub databases on the tree database according to the data relevance.
Preferably: the data visualization unit includes:
data source layer: the generation equipment is used for determining the monitored data according to the parallel distributed database and determining the monitored data;
visualization classification layer: the generation equipment is used for classifying the monitored data according to the monitored data to determine classified data; wherein the content of the first and second substances,
the classification data includes: image data, text data, and discrete data;
visual expression layer: the system is used for determining a visualization tool based on data mapping for the classified data, and performing real-time mapping on the classified data based on the visualization tool to generate dynamic visualization information; wherein the content of the first and second substances,
the visualization tool includes: a text mapping template, an image mapping template, and a chart mapping template.
Preferably, the following components: the data visualization unit generating visualization information further comprises the steps of:
step S1: determining data characteristics based on the simultaneous distributed database:
wherein, a l The content parameter of the first data in the full-scale distributed database is represented; b j A content parameter representing the jth data in the incremental distributed database; 1, 2, 3 … … L; l represents the total number of data in the full-scale distributed database; j is 1, 2, 3 … … m; m represents the total number of data in the incremental distributed database; q. q of l Representing data characteristics of the first data in the full-scale distributed database; q. q.s j Data characteristics representing jth data in the incremental distributed database;
step S2: according to the data characteristics, a data type division model based on a clustering algorithm is constructed, and the membership degrees of different data are determined:
wherein ψ (q) l ) Representing the image membership degree of the first data in the full-quantity distributed database; xi (q) l ) Representing the text membership degree of the ith data in the full-quantity distributed database; ζ (q) l ) Representing the graph membership degree of the ith data in the full-quantity distributed database; f (q) l ) A clustering function representing the first data in the full-scale distributed database;
representing an image attribution coefficient; sigma represents a text attribution coefficient;
representing a graph attribution coefficient; g (q) l ) A normalization function representing the ith data in the full-scale distributed database; psi (q) j ) Representing the image membership degree of jth data in the incremental distributed database; xi (q) j ) Representing the text membership degree of the jth data in the incremental distributed database; ζ (q) j ) Representing the graph membership degree of jth data in the incremental distributed database; f (q) j ) Representing a clustering function of jth data in the incremental distributed database;
representing an image attribution coefficient; g (q) j ) A normalization function representing jth data in the incremental distributed database;
step S3: and determining the maximum membership degree of each data in the parallel distributed database, importing the visualization tools of the corresponding membership types, and generating the visualization data.
The invention has the beneficial effects that: the invention can divide the importance degree of the data, only backs up the incremental data for unimportant data, and mainly determines the real-time condition of the equipment. For important equipment data such as fire safety equipment, full data backup is performed, so that unsafe accidents of communities are prevented. And the data backup is automatic backup, the backup log and the backup mode are automatically selected, and the data can be visualized.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention.
In the drawings:
fig. 1 is a system composition diagram of a community data backup system based on a routing device in an embodiment of the present invention;
fig. 2 is a monitoring module level diagram of a community data backup system based on a routing device in an embodiment of the present invention;
fig. 3 is a concurrent distributed data tree diagram of a community data backup system based on a routing device in an embodiment of the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
As shown in fig. 1, the present invention is a community data backup system based on a routing device, including:
a monitoring module: the community data monitoring system is used for embedding a data monitoring program in routing equipment of a community, monitoring community data which pass through the routing equipment and are authorized to be monitored, and generating monitoring information;
according to the technical scheme, the data monitoring program is arranged in the routing equipment, and then the information of the data passing through the routing equipment is judged, so that various data in a community can be clearly analyzed and classified in an external monitoring and recognizing mode, and the data condition can be monitored.
A data judgment module: the monitoring system is used for carrying out type division on the monitoring information and judging the importance of each type of data; and the type division is to divide the community data according to types and calculate the importance of each type of data.
A backup module: determining the backup mode of each type of data according to the importance, and backing up the monitored data based on the backup mode; wherein the content of the first and second substances,
the backup mode comprises the following steps: incremental backup and full backup.
The principle of the technical scheme is as follows: the invention sets the monitor in the router, and then extracts the data information through the monitor, but only extracts the data information, and does not directly extract the data. Then, judging the importance of the data according to the monitoring information, and backing up the data in different modes according to the importance of the data; the judgment of the importance of the data in the invention is mainly based on the characteristics of the data generated by the equipment, and the characteristics are obtained by monitoring.
The beneficial effects of the above technical scheme are that: the invention can divide data, judge the importance of the data, then back up the data according to the importance, for unimportant data, only back up the incremental data; the data which needs to be extracted continuously, such as video monitoring data and data for incremental backup and full backup, are determined according to the real-time condition of the actual equipment. For important equipment data such as fire safety equipment, full data backup is performed, so that unsafe accidents of communities are prevented. And the backup of the data is automatic backup and can realize data visualization.
As an embodiment of the invention: the monitoring module comprises:
a program setting unit: the system comprises a service routing device used for determining the service routing device in the community and installing a data monitoring program on the service routing device;
an authorization unit: the data type of the data capable of being monitored is preset through a background, and the data capable of being monitored is subjected to monitoring authorization;
an information arrangement unit: the device is used for determining the data type after monitoring authorization, determining a corresponding data discrimination mode and generating monitoring information; wherein the content of the first and second substances,
the monitoring information comprises: data type, data object, data attributes, and history-related data state.
The principle of the technical scheme is as follows: in the invention, because the monitoring program needs to be set in the routing equipment in the community, the routing equipment for executing the service in the community is determined in advance, and then the monitoring program is installed on the routing equipment for executing the service. The authorization unit is mainly used for setting data which can be monitored in the background of the monitoring program, because some data belong to communication data of individual privacy, or identity information of owners in a community, and the like exist, the identity information and the like can be monitored after authorization. For data which can be monitored by authorization, the invention sets a corresponding data discrimination mode and then monitors.
The beneficial effects of the above technical scheme are that: the invention is used for the router to set the monitoring program, set the data type of the data which can be monitored, monitor the data after authorization and ensure the privacy of the user.
As an embodiment of the invention: as shown in fig. 2, the listening module further includes:
owner management layer: the system comprises a data processing module, a data processing module and a data processing module, wherein the data processing module is used for counting personal equipment of an owner and generating owner equipment information;
an operation and maintenance management layer; the system comprises a community, a data acquisition unit, a data processing unit and a data processing unit, wherein the community is used for extracting hardware equipment data in the community and generating equipment information;
a system management layer: the system information management system is used for managing the operation data and the basic data in the system and generating system information;
and a logic management layer: the method is used for managing different execution logics in the system and generating execution information.
The principle of the technical scheme is as follows: the monitoring module comprises three operation layers, wherein the owner management layer is used for extracting the information of personal equipment of an owner and judging which equipment is the own equipment of the owner, and the purpose is not to monitor the data of the owner equipment, and the data belongs to the private information of the owner. And for public equipment in the community, such as elevator data, fire data and the like, the monitoring is carried out only when the data belongs to the public data, and the monitoring is mainly carried out for maintaining the safety of the community. The operation and maintenance management layer determines the hardware devices commonly used in the community and extracts the data of the devices, and the data is monitored. The system management layer is used for determining which systems exist in the community, for example: the fire fighting system and the building monitoring system can manage data of the systems. The logic management layer is used for judging execution logic in different systems and managing the execution logic.
The beneficial effects of the above technical scheme are that: in order to realize the monitoring of data such as community data, equipment and the like, the backup system is divided into a plurality of layers, different layer information is generated according to each layer, and the comprehensive monitoring of the community is realized.
As an embodiment of the present invention: the monitoring module further comprises:
a planar geographic unit: the system comprises a plane map used for building an intelligent community, and position information of each routing device is marked on the plane map; for example: the entire community is displayed by an elevation digital map.
Elevation data unit: the digital elevation model is used for establishing a smart community according to the position information;
a texture marking unit: the texture marking is carried out in the digital elevation model, and digital textures are established; the grammatical markers include the level of different floors and the level of geographic locations, etc.
An image unit: the system is used for forming a community three-dimensional building and environment entity image after the digital texture is generated; the physical image is for monitoring the community.
A three-dimensional display unit: the system is used for carrying out data flow labeling on the three-dimensional community building and environment entity images; indicia of data transmission, for example: fire data is transmitted from any floor to the property.
An information generation unit: and marking the equipment for generating the data in each monitoring message when the monitoring messages are generated.
The principle of the technical scheme is as follows: the invention constructs a community map and marks the position information of each routing device when monitoring. The elevation data unit is used for performing digital simulation on the terrain of the cell, so that texture marking of data in the community can be realized, the texture marking is based on the data volume generated by buildings in the cell, and the texture marking can be generated when the data volume is high. And further judging the data transmission condition in the cell. The image unit is used for determining the condition of the data generated by the building based on the model of the building, realizing the liquidity marking of the data, and determining the trend of the monitored data, wherein the trend of the data is also one of the criteria for judging the importance of the data, and the image unit can determine the data generating equipment and the data receiving equipment.
The beneficial effects of the above technical scheme are that: and constructing a plane map of the community so as to judge whether the routing equipment is normal, complete, monitoring and the like. Based on the digital elevation model, the three-dimensional and visual monitoring data is realized.
As an embodiment of the invention: the data judgment module comprises:
a data processing unit: the monitoring information is identified through a preset data dictionary, and the information content of the monitoring information is determined; wherein the content of the first and second substances,
the information content comprises: data type, data generation equipment, data content weight, data range, data retention degree, data functionality, data requirement, data replaceability and original data importance;
a judging unit: the data type of the data generated by different equipment is determined according to the information content, and the importance of the data passing through the routing equipment is calculated through a preset rule, so that an importance value is determined;
an evaluation unit: and the data evaluation value is determined by performing expected evaluation on the data passing through the routing equipment according to the importance value.
The principle of the technical scheme is as follows: the invention is based on a data dictionary, i.e. a recognition dictionary of data, which can recognize the information content of the monitored information and also can control the monitor to monitor the required information content when processing the data. In the process of calculating the importance, the invention realizes the calculation of the importance according to the data type and the preset rule. The data type may determine which class the data belongs to, and thus the corresponding data generating device. The preset rule belongs to a calculation rule, and the calculation rule is preset, so that the data type is taken as a main judgment factor, the data type is not the format type of the data, but the type of the equipment for generating the data, and the judgment of the data based on the equipment is not important. Of course, other factors, such as data content weight, data retention, data function and data requirement, are also needed for parameterization and comprehensive calculation; in practical implementation, the weight of the information content of the monitored information relative to the total data in the community data is set respectively, and then the average value of the weight is calculated, and then a certain weight threshold value is set to judge whether the data is important. The final expectation evaluation is to evaluate the data according to the expectation after determining the importance of each data, and the expectation is to evaluate the backup, mainly to judge how much memory the data needs to be stored in.
As an embodiment of the present invention: the judging unit, determining the importance of the data, comprises the following steps:
step 1: according to the information content, determining and establishing an evaluation model of the data according to the following formula:
wherein a represents a data importance evaluation value; d is a radical of ic The characteristic parameter represents the characteristic parameter when the data corresponding to the ith information content is of the type c; d is a radical of ij Representing a characteristic parameter when the weight of the data content corresponding to the ith information content is j; p ik Data corresponding to the ith information content is represented as a target parameter of the kth data generation device; a represents an expected parameter of the data; b represents a data judgment coefficient; d represents a data importance evaluation threshold; 1, 2, 3 … … n; n represents the total volume of the data; k is 1, 2, 3 … … s; s represents the total number of data generating devices;
step 2: according to the evaluation model, a preset judgment parameter model is introduced, and the importance degree is determined:
wherein, X represents the degree of importance; z i The data content weight corresponding to the ith information content; w i A data range corresponding to the ith information content; q. q.s i The data retention degree of community data corresponding to the ith information content; rho i The data functional parameters of community data corresponding to the ith information content;
representing the data replaceability of the data corresponding to the ith information content under the condition that the importance of the original data is epsilon; e ij And a data function parameter when the weight of the content of the ith information is j.
The principle of the technical scheme is as follows: the invention establishes an evaluation model of data in step 1, mainly evaluates the importance of the data, ad ic P ik The first evaluation value is used for judging the importance of data of any information content in the crotch of a user with a set weight; ad (R) ij P ik [1-A]B[1-D]Is to calculateA second evaluation of the importance of the data in the expected situation. Then, a composite evaluation value of importance is determined by the sum of the two evaluation values. In step 2, after the data comprehensive evaluation value is determined, the importance of the data can be judged by monitoring the information content in the information, and in the process, the data content weight and the range parameter of the data range are introduced; data retention (retention condition of data in community total data) data functionality parameters, data substitutability, and determining importance value of data.
The beneficial effects of the above technical scheme are that: the importance of the data is calculated by evaluating the characteristic parameters of the data and then introducing the characteristic parameters into the data, so that the importance of each data can be clearly determined, and whether the data is stored or not is judged.
As an embodiment of the present invention: the backup module includes:
a mode determination unit: the system is used for establishing a distributed data backup database according to the importance of the data and determining the backup mode of the data;
a database building unit: the system is used for judging the relevance of the data according to the type of the data and establishing a parallel distributed database; wherein, the first and the second end of the pipe are connected with each other,
the simultaneous distributed database includes: an incremental distributed database and a full distributed database;
an incremental backup unit: the incremental backup system is used for storing the data to an incremental distributed database when the data belongs to the incremental backup;
a full backup unit: the system comprises a data storage module, a data backup module and a data backup module, wherein the data storage module is used for storing data to a full distributed database when the data belongs to a full backup;
a data visualization unit: the data processing device is used for linearizing the data according to the type of the data, generating linear line segments and carrying out curve correlation based on the correlation of the linear line segments to carry out clustering visualization.
The principle of the technical scheme is as follows: the invention can establish a distributed data backup database when data backup is carried out, and judges the relevance of data when the database is established, wherein the relevance is the relevance of the data and incremental backup data or the relevance of the data and full data, so as to establish a parallel-standing distributed database. And finally, the invention carries out data backup through the incremental backup database and the full backup database. The data visualization unit is used for realizing data visualization, and community data are more convenient for community residents to know communities and timely transmit information to community residents when visualization is carried out.
The beneficial effects of the above technical scheme are that: the invention relates to community data, and the community data belongs to spatial data and is more suitable for distributed storage. The parallel distributed database established by the invention overcomes the defect that only full backup and incremental backup can be carried out. And the last unit of visualization is to facilitate community residents to know community data.
As an embodiment of the invention: as shown in fig. 3, the backup module establishes a concurrent distributed database, including the following steps:
step S1: based on the data tree model, establishing a tree database in symmetrical distribution; wherein the content of the first and second substances,
one side of the tree database is an incremental distributed database, and the other side of the tree database is a full distributed database;
step S2: establishing a sub-database according to the tree database; wherein the content of the first and second substances,
the sub-databases comprise an equipment sub-database, a grid sub-database, a region sub-database, a building information sub-database, a house information sub-database, a household information sub-database, a property information sub-database and an operation and maintenance sub-database;
and step S3, symmetrically arranging the sub databases on the tree database according to the data relevance.
The principle and the beneficial effects of the technical scheme are as follows: the method for establishing the simultaneous distributed database comprises three steps, namely firstly establishing a model based on a data tree. And realizing the construction of the parallel data. And then establishing the sub-databases is equivalent to establishing different databases for different devices. And then carrying out attribute arrangement, and conforming to the mode of a distributed database. However, the tree-shaped distributed database is built because the data building is carried out and the databases can be unrelated.
The data visualization unit includes:
data source layer: the generation equipment is used for determining the monitored data according to the parallel distributed database and determining the monitored data;
visualization classification layer: the generation equipment is used for classifying the monitored data according to the monitored data to determine classified data; wherein the content of the first and second substances,
the classification data includes: image data, text data, and discrete data;
visualization expression layer: the visualization tool is used for determining the classification data based on data mapping, and performing real-time mapping on the classification data based on the visualization tool to generate dynamic visualization information; wherein the content of the first and second substances,
the visualization tool comprises: a text mapping template, an image mapping template, and a chart mapping template.
The principle and the beneficial effects of the technical scheme are as follows: in the process of data visualization by the data visualization unit, the invention also adopts a layering and drawing mode, namely data source determination and data visualization classification, wherein the classification is to divide data into three types of image, text and discrete data which can be visualized. And finally, carrying out data mapping on different types of data through a preset visualization tool to determine visualization information.
As an embodiment of the invention:
the data visualization unit generating visualization information further comprises the steps of:
step S1: determining data characteristics based on the simultaneous distributed database:
wherein, a l Content parameter representing the first data in full-scale distributed databaseCounting; b is a mixture of j Representing the content parameter of the jth data in the incremental distributed database; 1, 2, 3 … … L; l represents the total number of data in the full-scale distributed database; j is 1, 2, 3 … … m; m represents the total number of data in the incremental distributed database; q. q of l Representing the data characteristics of the first data in the full-scale distributed database; q. q of j Data characteristics representing jth data in the incremental distributed database;
step S2: according to the data characteristics, a data type division model based on a clustering algorithm is constructed, and the membership degree of different data is determined:
wherein ψ (q) l ) Representing the image membership degree of the first data in the full-quantity distributed database; xi (q) l ) Representing the text membership of the ith data in the full-quantity distributed database; ζ (q) l ) Representing the graph membership degree of the ith data in the full-quantity distributed database; f (q) l ) Representing a clustering function of the first data in the full-scale distributed database;
representing an image attribution coefficient; sigma represents a text attribution coefficient;
representing a graph attribution coefficient; g (q) l ) A normalization function representing the first data in the full-scale distributed database; psi (q) j ) Representing the image membership degree of jth data in the incremental distributed database; xi (q) j ) Representing the text membership degree of the jth data in the incremental distributed database; ζ (q) j ) Representing the graph membership degree of jth data in the incremental distributed database; f (q) j ) Representing jth data in an incrementally distributed databaseA clustering function of (a);
representing an image attribution coefficient; g (q) j ) A normalization function representing jth data in the incremental distributed database;
step S3: and determining the maximum membership degree of each data in the parallel distributed database, importing a visualization tool corresponding to the membership type, and generating visualization data.
The principle of the technical scheme is as follows: when the invention carries out data visualization, firstly, data characteristics are determined according to the parallel distributed database, the data characteristics are respectively calculated and modeled for the full distributed database and the incremental distributed data, and in the calculation process, the invention determines the distribution characteristics of different distributed data through product accumulation operation. In step 2, the invention calculates the membership degree of each part of data through a clustering algorithm based on the data characteristics, and realizes data visualization by matching a corresponding visualization tool according to the membership degree. In the process, the image attribution coefficient, the chart attribution coefficient and the text attribution coefficient are respectively introduced, and the data membership degree is calculated by performing parallel calculation on the attribution coefficients in the clustering function of the data and the data mapping function. In step 3, the invention represents what visualization mode the data is more suitable to adopt based on the maximum membership degree. Of course, when the maximum membership degrees are the same, three visualization modes for representing data can be implemented, and then data visualization is realized through corresponding visualization tools.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (8)
1. A community data backup system based on a routing device is characterized by comprising:
and a monitoring module: the community data monitoring system is used for embedding a data monitoring program in routing equipment of a community, monitoring community data which pass through the routing equipment and are authorized to be monitored, and generating monitoring information;
a data judgment module: the monitoring system is used for carrying out type division on the monitoring information and judging the importance of each type of data;
a backup module: determining the backup mode of each type of data according to the importance, and backing up the monitored data based on the backup mode; wherein the content of the first and second substances,
the backup mode comprises the following steps: incremental backup and full backup;
the data judgment module comprises:
a data processing unit: the monitoring information processing device is used for identifying and processing the monitoring information through a preset data dictionary and determining the information content of the monitoring information; wherein the content of the first and second substances,
the information content includes: data type, data generation equipment, data content weight, data range, data retention degree, data functionality, data requirement, data substitutability and original data importance;
a judging unit: the data type of the data generated by different equipment is determined according to the information content, and the importance of the data passing through the routing equipment is calculated through a preset rule to determine an importance value;
an evaluation unit: the data evaluation device is used for performing backup expectation evaluation on data passing through the routing device and determining a data evaluation value;
the judging unit, determining the importance of the data, comprises the following steps:
step 1: according to the information content, determining and establishing an evaluation model of the data through the following formula:
wherein a represents a data importance evaluation value; d ic The characteristic parameter represents the characteristic parameter when the data corresponding to the ith information content is of the type c; d ij Number corresponding to ith information contentAccording to the characteristic parameter when the content weight is j; p is ik Data corresponding to the ith information content is represented as a target parameter of the kth data generation device; a represents an expected parameter of the data; b represents a data judgment coefficient; d represents a data importance evaluation threshold; 1, 2, 3 … … n; n represents the total volume of the data; k is 1, 2, 3 … … s; s represents the total number of data producing devices;
and 2, step: according to the evaluation model, introducing a preset judgment parameter model, and determining the importance degree:
wherein, X represents the degree of importance; z is a linear or branched member i The data content weight corresponding to the ith information content; w is a group of i A data range corresponding to the ith information content; q. q.s i The data retention degree of community data corresponding to the ith information content; ρ is a unit of a gradient i Data functional parameters of community data corresponding to the ith information content;
representing the data replaceability of the data corresponding to the ith information content under the condition that the importance of the original data is epsilon; e ij And a data function parameter when the weight of the content of the ith information is j.
2. The routing device-based community data backup system according to claim 1, wherein said listening module comprises:
a program setting unit: the system comprises a data monitoring module, a data monitoring module and a data transmission module, wherein the data monitoring module is used for determining service routing equipment in a community and installing a data monitoring program on the service routing equipment;
an authorization unit: the data type of the data capable of being monitored is preset through a background, and the data capable of being monitored is subjected to monitoring authorization;
an information arrangement unit: and the data type determining module is used for determining the data type after the monitoring authorization, determining a corresponding data distinguishing mode and generating monitoring information.
3. The routing device-based community data backup system of claim 1, wherein the listening module further comprises:
owner management layer: the system is used for counting personal equipment of an owner and generating owner equipment information;
an operation and maintenance management layer; the system comprises a community, a data acquisition unit, a data processing unit and a data processing unit, wherein the community is used for extracting hardware equipment data in the community and generating equipment information;
a system management layer: the system information management system is used for managing the operation data and the basic data in the system and generating system information;
and a logic management layer: the method is used for managing different execution logics in the system and generating execution information.
4. The routing device-based community data backup system of claim 1, wherein the listening module further comprises:
a planar geographic unit: the system comprises a plane map used for building an intelligent community, and position information of each service routing device is marked on the plane map;
elevation data unit: the digital elevation model is used for establishing an intelligent community according to the position information;
a texture marking unit: the texture marking is carried out in the digital elevation model, and digital textures are established;
an image unit: the system is used for forming a community three-dimensional building and environment entity image after the digital texture is generated;
a three-dimensional display unit: the system is used for performing data flow annotation on the three-dimensional community building and environment entity images;
an information generation unit: and marking the equipment for generating the data in each monitoring message when the monitoring messages are generated.
5. The routing device-based community data backup system of claim 1, wherein the backup module comprises:
a mode determination unit: the system is used for establishing a distributed data backup database according to the importance of the data and determining the backup mode of the data;
a database building unit: the system is used for judging the relevance of the data according to the type of the data and establishing a parallel distributed database; wherein, the first and the second end of the pipe are connected with each other,
the simultaneous distributed database includes: an incremental distributed database and a full distributed database;
an incremental backup unit: the data backup method comprises the steps of storing data to an incremental distributed database when the data belong to incremental backup;
a full backup unit: the system comprises a data storage module, a data backup module and a data backup module, wherein the data storage module is used for storing data to a full distributed database when the data belong to a full backup;
a data visualization unit: the system is used for determining different types of visualization tools according to the types of the data and determining visualization information based on the visualization tools; wherein the content of the first and second substances,
the visualization information includes: visual pictures, visual charts, and visual text.
6. The routing device-based community data backup system of claim 5, wherein said backup module building a simultaneous distributed database comprises the steps of:
step S1: based on the data tree model, a tree database in symmetrical distribution is established; wherein, the first and the second end of the pipe are connected with each other,
one side of the tree database is an incremental distributed database, and the other side of the tree database is a full distributed database;
step S2: establishing a sub-database according to the tree database; wherein, the first and the second end of the pipe are connected with each other,
the sub-databases comprise an equipment sub-database, a grid sub-database, a region sub-database, a building information sub-database, a house information sub-database, a household information sub-database, a property information sub-database and an operation and maintenance sub-database;
and step S3, symmetrically arranging the sub databases on the tree database according to the data relevance.
7. The routing device-based community data backup system according to claim 5, wherein said data visualization unit comprises:
data source layer: the generation equipment is used for determining the monitored data according to the parallel distributed database and determining the monitored data;
visualization classification layer: the generation equipment is used for classifying the monitored data according to the monitored data to determine classified data; wherein the content of the first and second substances,
the classification data includes: image data, text data, and discrete data;
visualization expression layer: the system is used for determining a visualization tool based on data mapping for the classified data, and performing real-time mapping on the classified data based on the visualization tool to generate dynamic visualization information; wherein the content of the first and second substances,
the visualization tool comprises: a text mapping template, an image mapping template, and a chart mapping template.
8. The routing device-based community data backup system of claim 5, wherein said data visualization unit generating visualization information further comprises the steps of:
step S1: determining data characteristics based on the simultaneous distributed database:
wherein, a l The content parameter represents the first data in the full-scale distributed database; b is a mixture of j Representing the content parameter of the jth data in the incremental distributed database; 1, 2, 3 … … L; l represents the total number of data in the full-scale distributed database; j is 1, 2, 3 … … m; m represents the total number of data in the incremental distributed database; q. q.s l Representing the data characteristics of the first data in the full-scale distributed database; q. q.s j Representing an incrementally distributed databaseThe data characteristics of the jth data in the data base;
step S2: according to the data characteristics, a data type division model based on a clustering algorithm is constructed, and the membership degrees of different data are determined:
wherein ψ (q) l ) Representing the image membership degree of the first data in the full-quantity distributed database; xi (q) l ) Representing the text membership degree of the ith data in the full-quantity distributed database; ζ (q) l ) Representing the graph membership degree of the ith data in the full-quantity distributed database; f (q) l ) A clustering function representing the first data in the full-scale distributed database;
representing an image attribution coefficient; sigma represents a text attribution coefficient;
representing a graph attribution coefficient; g (q) l ) A normalization function representing the ith data in the full-scale distributed database; psi (q) j ) Representing the image membership degree of jth data in the incremental distributed database; xi (q) j ) Representing the text membership of jth data in the incremental distributed database; ζ (q) j ) Representing the graph membership degree of the ith data in the incremental distributed database; f (q) j ) A clustering function representing jth data in the incremental distributed database;
representing an image attribution coefficient; g (q) j ) A normalization function representing jth data in the incremental distributed database;
step S3: and determining the maximum membership degree of each data in the parallel distributed database, importing the visualization tools of the corresponding membership types, and generating the visualization data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110710622.3A CN113568779B (en) | 2021-06-25 | 2021-06-25 | Community data backup system based on routing equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110710622.3A CN113568779B (en) | 2021-06-25 | 2021-06-25 | Community data backup system based on routing equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113568779A CN113568779A (en) | 2021-10-29 |
| CN113568779B true CN113568779B (en) | 2022-07-26 |
Family
ID=78162757
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110710622.3A Active CN113568779B (en) | 2021-06-25 | 2021-06-25 | Community data backup system based on routing equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113568779B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105224424A (en) * | 2015-10-28 | 2016-01-06 | 广州杰赛科技股份有限公司 | A kind of backup method and system |
| CN105320576A (en) * | 2014-05-30 | 2016-02-10 | 中国电信股份有限公司 | Device and method for database backup |
| US10146630B1 (en) * | 2015-04-14 | 2018-12-04 | EMC IP Holding Company LLC | Block changes framework for delta file incremental backup |
| CN111177122A (en) * | 2019-12-29 | 2020-05-19 | 苏州浪潮智能科技有限公司 | Database backup method, device, equipment and computer readable storage medium |
| CN112527552A (en) * | 2019-09-18 | 2021-03-19 | 中兴通讯股份有限公司 | Disaster recovery method, device, local point and storage medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9154826B2 (en) * | 2011-04-06 | 2015-10-06 | Headwater Partners Ii Llc | Distributing content and service launch objects to mobile devices |
| CN110866170A (en) * | 2019-10-18 | 2020-03-06 | 中国科学院信息工程研究所 | Importance evaluation method, search method and system for Tor darknet service based on site quality |
| CN112820416A (en) * | 2021-02-26 | 2021-05-18 | 重庆市公共卫生医疗救治中心 | Major infectious disease queue data typing method, typing model and electronic equipment |
-
2021
- 2021-06-25 CN CN202110710622.3A patent/CN113568779B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105320576A (en) * | 2014-05-30 | 2016-02-10 | 中国电信股份有限公司 | Device and method for database backup |
| US10146630B1 (en) * | 2015-04-14 | 2018-12-04 | EMC IP Holding Company LLC | Block changes framework for delta file incremental backup |
| CN105224424A (en) * | 2015-10-28 | 2016-01-06 | 广州杰赛科技股份有限公司 | A kind of backup method and system |
| CN112527552A (en) * | 2019-09-18 | 2021-03-19 | 中兴通讯股份有限公司 | Disaster recovery method, device, local point and storage medium |
| CN111177122A (en) * | 2019-12-29 | 2020-05-19 | 苏州浪潮智能科技有限公司 | Database backup method, device, equipment and computer readable storage medium |
Non-Patent Citations (3)
| Title |
|---|
| "Optimal Distribution of Nonperiodic Full and Incremental Backups";Gregory Levitin等;《IEEE Transactions on Systems, Man, and Cybernetics: Systems》;20171031;第47卷(第12期);第3310-3320页 * |
| "公文管理系统的设计与实现";何颖;《中国优秀硕士学位论文全文数据库 信息科技辑》;20180415(第04期);全文 * |
| 开放平台测试环境维护;杨祖龙等;《中国金融电脑》;20110507(第05期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113568779A (en) | 2021-10-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106952159B (en) | Real estate collateral risk control method, system and storage medium | |
| CN106570778A (en) | Big data-based data integration and line loss analysis and calculation method | |
| CN106327062A (en) | Method for evaluating state of power distribution network equipment | |
| Yan et al. | Research on the comprehensive evaluation of business intelligence system based on BP neural network | |
| CN115270277B (en) | Building design method based on BIM | |
| CN112488371B (en) | Pipeline intelligent early warning method and system based on big data | |
| CN111062686A (en) | Mobile intelligent supervision and control method and system based on digital model | |
| CN102591929B (en) | Library data processing system and data processing method thereof | |
| CN109857782A (en) | A kind of Monitor of Logging Data Processing System | |
| CN111798162A (en) | Risk monitoring method and device based on neural network | |
| KR102379472B1 (en) | Multimodal data integration method considering spatiotemporal characteristics of disaster damage | |
| CN116975990B (en) | Management method and system for three-dimensional model of oil-gas chemical engineering wharf | |
| CN109284978B (en) | System and method for accurately identifying poverty-stricken user | |
| CN116596281B (en) | Lightweight three-dimensional property management system | |
| CN113568779B (en) | Community data backup system based on routing equipment | |
| CN115686280A (en) | Deep learning model management system, method, computer device and storage medium | |
| CN116624226A (en) | Coal mine disaster data acquisition, analysis and visual display system | |
| CN115481941A (en) | Multifunctional area combined intelligent security management method and system | |
| CN114138741A (en) | Historical data analysis platform | |
| CN114091944A (en) | Cloud-end-coordinated distribution network engineering field operation analysis decision system | |
| CN113852204A (en) | Three-dimensional panoramic monitoring system and method for transformer substation with digital twin | |
| CN113486115A (en) | Talent information management system based on big data | |
| CN112732773A (en) | Uniqueness checking method and system for relay protection defect data | |
| CN112364263A (en) | Multi-dimensional data-based group renting house identification method, device, equipment and medium | |
| CN117436770B (en) | BIM-based building engineering construction management method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |