CN115510151A

CN115510151A - Method and device for guaranteeing equipment data consistency, electronic equipment and storage medium

Info

Publication number: CN115510151A
Application number: CN202110690832.0A
Authority: CN
Inventors: 朱雪梅; 李玉天
Original assignee: Zhejiang Uniview Technologies Co Ltd
Current assignee: Zhejiang Uniview Technologies Co Ltd
Priority date: 2021-06-22
Filing date: 2021-06-22
Publication date: 2022-12-23

Abstract

The embodiment of the invention discloses a method and a device for guaranteeing equipment data consistency, electronic equipment and a storage medium. The method for guaranteeing the data consistency of the equipment comprises the following steps: respectively determining the device attribute information stored in the first storage space and the second storage space; determining a first target device set in the first storage space and a second target device set in the second storage space according to the device attribute information; and comparing the devices in the first target device set and the second target device set, determining abnormal devices according to comparison results, and checking the abnormal devices to ensure the consistency of the device data in the distributed system. According to the embodiment of the invention, the device attribute information stored in different storage spaces is counted and compared, the device range with inconsistent device data is quickly narrowed, the abnormal device is quickly positioned, the number of devices needing to be compared is reduced, and the problem of device data consistency in a distributed system is efficiently solved.

Description

Method and device for guaranteeing equipment data consistency, electronic equipment and storage medium

Technical Field

The embodiment of the invention relates to the technical field of data processing, in particular to a method and a device for guaranteeing equipment data consistency, electronic equipment and a storage medium.

Background

The video monitoring service can utilize network transmission to network the dispersed independent image acquisition points, thereby realizing the cross-region unified monitoring, the unified storage management and the resource sharing. In order to meet the continuously expanded service requirements, the current video monitoring system adopts a distributed architecture to support the access of high-capacity front-end equipment, and is of great importance in ensuring the long-term stable operation under the condition of high capacity and the accuracy and consistency of system data.

Generally, data inconsistency is more likely to occur under the conditions of large data volume, high concurrent write operation or unstable cluster state, and compensation and error correction are needed to avoid the problem of inaccurate stored data for the distributed data inconsistency. However, in the case of a million-level video device in a distributed system, if the device data is compared one by one to correct errors, huge workload is caused, and the solution efficiency of the data consistency problem is low.

Disclosure of Invention

The embodiment of the invention provides a method and a device for guaranteeing equipment data consistency, electronic equipment and a storage medium, and the method and the device can be used for efficiently solving the problem of equipment data consistency in a distributed system.

In a first aspect, an embodiment of the present invention provides a method for guaranteeing device data consistency, where the device is an access device in a distributed system, and the distributed system at least includes a first storage space and a second storage space, and includes:

respectively determining the device attribute information stored in the first storage space and the second storage space;

determining a first target device set in the first storage space and a second target device set in the second storage space according to the device attribute information;

and comparing the devices in the first target device set and the second target device set, determining abnormal devices according to comparison results, and checking the abnormal devices to ensure the consistency of device data in the distributed system.

In a second aspect, an embodiment of the present invention further provides an apparatus for guaranteeing data consistency of a device, where the device is an access device in a distributed system, and the distributed system at least includes a first storage space and a second storage space, and includes:

the device information determining module is used for respectively determining the device attribute information stored in the first storage space and the second storage space;

a device set determining module, configured to determine a first target device set in the first storage space and a second target device set in the second storage space according to the device attribute information;

and the abnormal equipment determining module is used for comparing the equipment in the first target equipment set and the second target equipment set, determining abnormal equipment according to a comparison result, and checking the abnormal equipment to ensure the consistency of the equipment data in the distributed system.

In a third aspect, an embodiment of the present invention further provides an electronic device, including:

one or more processors;

a storage device for storing one or more programs,

when the one or more programs are executed by the one or more processors, the one or more processors implement the method for guaranteeing device data consistency according to any embodiment of the invention.

In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method for guaranteeing device data consistency according to any embodiment of the present invention.

The method comprises the steps of respectively determining equipment attribute information stored in a first storage space and equipment attribute information stored in a second storage space; determining a first target device set in the first storage space and a second target device set in the second storage space according to the device attribute information; and comparing the devices in the first target device set and the second target device set, determining abnormal devices according to comparison results, and checking the abnormal devices to ensure the consistency of device data in the distributed system. According to the embodiment of the invention, the device attribute information stored in different storage spaces is counted and compared, the device range with inconsistent device data is quickly reduced, the abnormal device is quickly positioned, the number of devices needing to be compared is reduced, and the problem of device data consistency in a distributed system is efficiently solved.

Drawings

Fig. 1 is a flowchart of a method for guaranteeing device data consistency according to a first embodiment of the present invention;

fig. 2 is a flowchart of a method for guaranteeing device data consistency according to a second embodiment of the present invention;

fig. 3 is a flowchart of a method for guaranteeing device data consistency according to a third embodiment of the present invention;

fig. 4 is a schematic structural diagram of a device for guaranteeing device data consistency according to a fourth embodiment of the present invention;

fig. 5 is a schematic structural diagram of an electronic device in a fifth embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.

Example one

Fig. 1 is a flowchart of a method for guaranteeing device data consistency according to a first embodiment of the present invention, where the embodiment is applicable to solve the situation of device data consistency in a distributed system, a device is an access device in the distributed system, and the distributed system at least includes a first storage space and a second storage space. The method can be executed by a device for guaranteeing device data consistency, the device can be implemented in a software and/or hardware manner, and can be configured in an electronic device, for example, the electronic device can be a device with communication and computing capabilities, such as a background server. As shown in fig. 1, the method specifically includes:

step 101, determining device attribute information stored in the first storage space and the second storage space respectively.

In a distributed-based storage system, data storage can be stored in different types of spaces correspondingly in different storage modes, for example, a block of memory is applied for storage, that is, the storage space is a memory space; or storing the data into a redis, namely the storage space is a redis space; or stored in a database, that is, the storage space is a database space. Different storage modes have different characteristics, the access speed in the memory is fastest, the cost is high, and the method is suitable for frequent access and small data; the speed in the redis is slower than that of a memory but faster than that of a database, but the data stability is not high, so that the redis is suitable for frequent access and one part of data is also stored in the database; the database is stored in the hard disk, has the slowest speed, but has low cost and high data reliability, and is suitable for storing data which can not be frequently accessed and needs to be stored for a long time. Different storage modes can be used according to different requirements and scenes, and generally, multiple storage modes can be simultaneously used according to different services.

In the embodiment of the present invention, the distributed system includes at least two storage manners, for example, in the distributed system, the access device information is simultaneously stored in the database, the memory, and the redis, and all the access device information accessed in the distributed system is stored in each storage space, where the access device information includes the device code, the device attribute information, and the like. The device code refers to a unique identity code of the access device, the device attribute information refers to characteristic information representing a connection attribute between the access device and the system, and optionally, the device attribute information includes at least one of the following: the present invention relates to a method for providing access equipment, and more particularly, to a method for providing access equipment, which includes providing state information and domain information, where the state information is information representing online and offline states of the access equipment, and the domain information is information divided according to a control region of the access equipment, for example, the domain information may be divided according to a region to which the access equipment belongs, or may be divided according to a service industry of the access equipment, and is not limited herein. Illustratively, the domain information is divided into an intra-domain and an inter-domain, the intra-domain refers to a range directly controlled by the distributed system, the inter-domain refers to a range directly controlled by the distributed system of other systems and shared to the distributed system, and the inter-domain can be further divided into different inter-domains according to different inter-domains of the directly controlled distributed system, for example, the domain information of the intra-domain device is represented by 0, the domain information of different inter-domain devices is represented by other non-0 characters, and when the representation characters of the domain information of two devices are the same non-0 character, the two devices are represented as the same inter-domain device; when the characterization characters of the domain information of the two devices are different non-0 characters, the two devices are represented as different inter-domain devices; when the characterization character of the domain information to which the two devices belong is 0, the two devices are indicated as intra-domain devices.

Specifically, the access device may be a monitoring device, and the distributed system is a video monitoring distributed system. In the method, the device information is stored in the first storage space and the second storage space when the video monitoring device accesses the video monitoring distributed system, wherein the number of spaces in the first storage space and the second storage space is not limited in the embodiment of the invention, for example, the first storage space may include at least two storage modes, such as redis storage and memory storage, the device information stored in each storage mode is respectively compared with the second storage space for consistency, and the first storage mode and the second storage mode are only used for distinguishing different storage spaces and are not limited in the manner of the storage space. Device attribute information of all monitoring devices stored in the first storage space and the second storage space is determined.

Step 102, determining a first target device set in the first storage space and a second target device set in the second storage space according to the device attribute information.

And dividing a first target device set from all the devices stored in the first storage space according to the device attribute information, and dividing a second target device set from all the devices stored in the second storage space according to the device attribute information, so that all the devices stored in the storage space do not need to be compared one by one, and the comparison workload is reduced. And the target equipment set which needs to be compared is divided according to the equipment attribute information, so that the division result is more accurate.

Specifically, the devices with inconsistent device numbers corresponding to the same device attribute information in the two storage spaces are divided into target device sets. Illustratively, when the device attribute information is state information, respectively counting the number of offline devices and the number of online devices in a database and a memory, or respectively counting the number of offline devices and the number of online devices in the database and a redis, and if the number of offline devices and the number of online devices in two storage spaces are consistent, indicating that the device data has consistency; if the total number of the devices in the two storage spaces is consistent but the number of the offline devices is not consistent with the number of the online devices, determining that the online devices in the first storage space are a first target device set, and determining that the online devices in the second storage space are a second target device set; or determining the offline device in the first storage space as a first target device set, and determining the offline device in the second storage space as a second target device set; for example, because the total number of devices is consistent, in order to improve the comparison efficiency, one of the fewer devices may be selected as the target device set, and if the total number of the offline devices is smaller than the total number of the online devices, it is determined that the offline devices in the first storage space are the first target device set, and it is determined that the offline devices in the second storage space are the second target device set; if the total number of the devices in the two storage spaces is inconsistent, determining that the online devices in the first storage space are a first target online device set and the offline devices are a first target offline device set, determining that the online devices in the second storage space are a second target online device set and the offline devices are a second target offline device set, and respectively comparing the device sets with the same state information.

In one possible embodiment, the device attribute information includes status information and/or home domain information;

accordingly, step 102 includes:

determining whether the number of devices with the same state information and/or the same affiliated domain information in the first storage space and the second storage space is consistent;

if the device data in the distributed system are consistent, determining that the device data in the distributed system are consistent;

if the target state information is inconsistent with the device number, determining that the target state information with inconsistent device number is the state information to be inquired, and/or determining that the target domain information with inconsistent device number is the domain information to be inquired;

and determining a first target device set for the device of the state information to be queried and/or the domain information to which the device belongs according to the state information in the first storage space, and determining a second target device set for the device of the domain information to be queried and/or the state information in the second storage space.

In the embodiment of the present invention, one of the status information and the domain information may be selected as the compared device attribute information, or two types of the status information and the domain information may be simultaneously selected as the compared device attribute information.

Specifically, whether the number of the selected devices with the same device attribute information to be compared is consistent in the two storage spaces is determined, and if the number of the selected devices with the same device attribute information is consistent, the device data is consistent; if the attribute information of the target device is inconsistent with the attribute information of the target device, the inconsistent device attribute information is determined to be the attribute information of the target device, and the target device set is determined from the first storage space and the second storage space according to the attribute information of the target device.

For example, when determining the target device set according to the state information, the specific determination method refers to the above example, and is not described herein again. When a target device set is determined according to the domain information, the number of devices in the database and the memory and the number of devices between different domains are respectively counted, or the number of devices in the database and the number of devices between different domains are respectively counted, if the number of devices in the database and the number of devices between the same domains in two storage spaces are consistent, the consistency of the device data is represented; if the number of the devices in the domain in the two storage spaces or the number of the devices in the same domain are not consistent, determining the devices in the domain in the first storage space as a first target device set, and determining the devices in the domain in the second storage space as a second target device set; or determining inter-domain devices with different quantities in the first storage space as a first target device set, and determining the inter-domain devices in the second storage space as a second target device set; if the quantity of the intra-domain devices and the quantity of the inter-domain devices in the two storage devices are different, the intra-domain devices in the first storage space are determined to be a first target intra-domain device set and the inter-domain devices are determined to be a first target inter-domain device set, the intra-domain devices in the second storage space are determined to be a second target intra-domain device set and the inter-domain devices are determined to be a second target inter-domain device set, and the device sets with the same affiliated domain information are respectively compared. When the target device set is determined according to the state information and the domain information, the device set is divided according to the two pieces of device attribute information at the same time, and the specific division method refers to embodiment two, which is not described herein again.

And 103, comparing the devices in the first target device set with the devices in the second target device set, determining abnormal devices according to comparison results, and checking the abnormal devices to ensure the consistency of the device data in the distributed system.

After the target device sets needing to be compared are divided from the storage spaces, devices with the same device codes in the target device sets can be compared one by one, and abnormal devices are determined according to comparison results. Since the device attribute information in the first target device set and the second target device set is the same, if the target device code exists in the first target device set but does not exist in the second target device set, the target device corresponding to the target device code is an abnormal device. If the abnormal equipment is probably residual equipment, the residual equipment is deleted; or the abnormal device may be a missing device, completing the device in the missing storage space; or the abnormal equipment may be equipment with inaccurate equipment attribute information, the inaccurate equipment attribute information of the abnormal equipment is adaptively modified.

In one possible embodiment, step 103 includes:

determining that the device with the largest number in the first target device set and the second target device set is a comparison target device set, and determining that the device with the smallest number is an auxiliary target device set;

after the target equipment set and the auxiliary target equipment set are sorted according to equipment code comparison, determining intermediate equipment in the comparison target equipment set by adopting a dichotomy method;

searching in the auxiliary target device set according to the device code of the intermediate device;

and determining whether the intermediate equipment is abnormal equipment or not according to the search result.

In the embodiment of the invention, after the devices in the target device set are sequenced, the dichotomy searching method is carried out on the target device set with a large number, the number of the devices which need to be compared one by one is further reduced through the dichotomy searching method, and the data consistency determining efficiency is improved.

Specifically, the number of devices in the first target device set and the second target device set is respectively determined, the device set with the large number of devices is used as a comparison target device set which needs to be searched by the bisection method, and the other device set is used as an auxiliary target device set. And meanwhile, the equipment in the two target equipment sets is sorted, and the sorting according to the equipment codes can ensure that the sorting standards are the same and the comparison is convenient because the equipment codes are the only identification codes of the equipment. Optionally, other features that uniquely identify the devices may be ranked to ensure that the ranking criteria are the same.

And determining and comparing intermediate equipment in the target equipment set by adopting a bisection method, searching the equipment in the auxiliary target equipment set through the equipment code of the equipment, and if the equipment code is searched and the equipment attribute information in the target equipment set is the same, indicating that the equipment information of the equipment is consistent in two storage spaces and is not abnormal equipment. If the device code is not found, the intermediate device does not exist in the auxiliary target device set and belongs to abnormal devices.

In a possible embodiment, determining whether the intermediate device is an abnormal device according to the search result includes:

if the device code of the intermediate device is not inquired in the auxiliary target device set, determining that the intermediate device is an abnormal device;

and determining abnormal equipment in the rest equipment sets in the comparison target equipment set by adopting the bisection method again.

If the device code is not found, the intermediate device does not exist in the auxiliary target device set and belongs to abnormal devices, the abnormal devices are marked, a new intermediate device is determined by adopting the dichotomy again in the comparison target device set with the abnormal devices deleted, and whether the new intermediate device is the abnormal device or not is determined until all the abnormal devices are found. For example, if the difference between the number of devices in the comparison target device set and the number of devices in the auxiliary target device set is determined as the number of abnormal devices, the dichotomy is adopted to search and determine the abnormal devices, and when the determined number of the abnormal devices reaches the standard, the search is stopped. The process that all devices in the target device set need to be compared one by one is avoided, and the determining efficiency of data consistency is improved.

if the device code of the intermediate device is inquired in the auxiliary target device set, determining that the intermediate device is not an abnormal device;

comparing the consistency of the quantity of the intermediate equipment before or after the positions of the target equipment set and the auxiliary target equipment set are compared;

and if not, determining the new intermediate equipment by adopting the dichotomy again, and determining whether the new intermediate equipment is abnormal equipment or not according to the search result.

If the device code is found, and the device attribute information in the target device set is the same, the device information of the device is consistent in the two storage spaces and is not abnormal. And if the front and rear quantities are inconsistent in the two target equipment sets, determining a new target equipment at the inconsistent position by adopting a bisection method again, and determining whether the new intermediate equipment is abnormal equipment until all abnormal equipment is found out.

Illustratively, the number of the devices before comparing the positions of the target device set is 20, the number of the devices after the positions is 21, the number of the devices before comparing the positions of the auxiliary target device set is 18, and the number of the devices after comparing the positions is 20, which indicates that the corresponding numbers of the front and rear positions are not consistent, new intermediate devices need to be respectively determined in the device sets before comparing the positions of the intermediate devices in the target device set or after comparing the positions of the intermediate devices in the target device set, and the two new intermediate devices are searched in the auxiliary target device set to determine whether the two new intermediate devices are abnormal devices.

In one possible embodiment, the first storage space is a reference storage space;

correspondingly, the checking of the abnormal equipment comprises the following steps:

determining the search results and the state information of the abnormal equipment in the first storage space and the second storage space;

if the abnormal equipment exists in the first storage space and the second storage space and the state information is inconsistent, correcting the state information of the abnormal equipment in the second storage space according to the state information of the abnormal equipment in the first storage space;

if the abnormal equipment does not exist in the first storage space and exists in the second storage space, deleting the abnormal equipment in the second storage space;

and if the abnormal equipment exists in the first storage space and does not exist in the second storage space, adding the abnormal equipment in the second storage space according to the abnormal equipment in the first storage space.

The reference storage space represents that the storage space has certain credibility, and the device data stored in the storage space is taken as a standard. Specifically, the database stores the full information of all the video monitoring devices, and the transaction atomicity and the rollback mechanism of the database effectively guarantee the correctness of the data in the database, so that the device data in the memory and the redis are subject to the database data when updating. In the embodiment of the present invention, it is determined that the first storage space is the reference storage space, that is, the storage manner of the first storage space is database storage, but since the first storage space and the second storage space in the embodiment only distinguish the storage spaces and do not limit the order, the first storage space is the reference storage space only as an example.

After the abnormal device is determined, compensation correction needs to be performed on the abnormal device to ensure consistency of device data in all storage spaces. And performing compensation correction on the equipment data of the abnormal equipment by taking the equipment data in the reference storage space as a standard. Specifically, the search result and the state information of the abnormal device in the first storage space and the second storage space are determined, and if the abnormal device exists in both the first storage space and the second storage space and the state information is inconsistent, the device data in the second storage space needs to be corrected by using the device data in the reference storage space as a standard. If the abnormal device does not exist in the first storage space and exists in the second storage space, the abnormal device belongs to the residual data, and the abnormal device in the second storage space is deleted. And if the abnormal equipment exists in the first storage space and does not exist in the second storage space, indicating that the equipment data of the abnormal equipment is missing, and completing the abnormal equipment in the second storage space by taking the equipment data in the reference storage space as a standard.

According to the embodiment of the invention, the device attribute information stored in different storage spaces is counted and compared, the device range with inconsistent device data is quickly reduced, abnormal devices are quickly positioned, the number of devices needing to be compared is reduced, and the problem of device data consistency in a video monitoring distributed system is efficiently solved.

Example two

Fig. 2 is a flowchart of a method for guaranteeing device data consistency according to a second embodiment of the present invention, and this embodiment further optimizes based on the foregoing embodiment, and as shown in fig. 2, the method specifically includes:

step 201, determining device attribute information stored in the first storage space and the second storage space respectively, wherein the device attribute information includes state information and domain information.

Specifically, the state information and the belonging domain information of all the monitoring devices stored in the first storage space and the second storage space are respectively determined.

Step 202, determining whether the number of the devices with the same state information in the first storage space and the second storage space is consistent.

Firstly, the number of online devices and the number of offline devices in the first storage space and the second storage space are respectively counted, and one-time proofreading is performed.

And step 203, if the number of the devices with the same state information is consistent, determining that the device data in the distributed system has consistency.

If the number of the online devices and the number of the offline devices are consistent in the two storage spaces, the data of the current devices are consistent, the state information to be inquired does not need to be determined, the operation for guaranteeing the data consistency of the devices is finished, and the attribute information of the devices is determined again after the next operation.

And step 204, if the number of the devices with the same state information is inconsistent, determining that the target state information with inconsistent number of the devices is the state information to be inquired.

If the information is inconsistent with the information, the state information to be inquired needs to be determined, and the range of the equipment needing to be compared is narrowed according to the state information to be inquired. Specifically, if the number of devices in the online state and the number of devices in the offline state in the first storage space and the second storage space are not consistent, but the total number of the devices is consistent, any one of the state information in the online state and the offline state is determined as the target state information. For example, in order to reduce the number of devices, a smaller number of target status information may be selected as the status information to be queried. For example, the online device in the first storage space is 200, and the offline device in the first storage space is 100; and if the online device in the second storage space is 250 and the offline device in the second storage space is 50, determining that the offline state is the state information to be inquired. If the total number of the devices is inconsistent, the online state and the offline state are determined to be target state information at the same time, and the offline state and the online state are respectively compared.

Step 205, determining a first intermediate device set for the device to be queried according to the state information in the first storage space, and determining a second intermediate device set for the device to be queried according to the state information in the second storage space.

And after the state information to be inquired is determined through once proofreading, narrowing the inconsistent range of the equipment data according to the state information to be inquired. Illustratively, when the state information to be queried is in an offline state, offline devices in the first storage space form a first intermediate device set, and offline devices in the second storage space form a second intermediate device set.

And step 206, determining whether the number of the devices with the same domain information in the first intermediate device set and the second intermediate device set is consistent.

And performing secondary correction according to the domain information to further narrow the comparison range of the inconsistent equipment data. And respectively counting the number of devices in the centralized domain of the first intermediate device and the second intermediate device and the number of devices in different domains, and performing secondary proofreading.

And step 207, if the number of the devices with the same domain information is consistent, determining that the device data in the distributed system has consistency.

If the number of the device data in the domain is consistent with the number of the devices between the domains, the device data in the domain or between the domains is considered to have consistency. And if the quantity of the intra-domain device data is consistent with that of the same inter-domain device, determining that the device data in the distributed system has consistency.

And step 208, if the number of the devices with the same domain information is inconsistent, determining that the target domain information with inconsistent number of the devices is the domain information to be inquired.

If the two pieces of domain information are not consistent, the domain information to be inquired needs to be determined, and the range of the equipment needing to be compared is further narrowed according to the domain information to be inquired. Specifically, if the number of devices belonging to the same domain is inconsistent between the first intermediate device set and the second intermediate device set, it is determined that the domain is the domain information to which the target belongs, and the devices of the domain information to which the target belongs need to be compared. Illustratively, for example, the first set of intermediate devices is 200 devices within the domain, and 100 devices between the domains; and if the number of the devices in the domain and the number of the devices between the domains are different, the information of the domain to which the domain belongs in the domain and the information of the domain to which the domain belongs between the domains are determined to be the state information to be inquired, and the state information to be inquired are respectively compared. For another example, further division may be performed among the domains, for example, division into a first domain and a second domain, and device quantity statistics is performed on different domains, and domain information belonging to the domains with inconsistent quantities is determined as domain information to be queried.

Step 209, determining a first target device set for the device to be queried about the domain information according to the domain information in the first intermediate device set, and determining a second target device set for the device to be queried about the domain information according to the domain information in the second intermediate device set.

And after determining the information of the domain to be queried through secondary proofreading, narrowing the inconsistent range of the equipment data according to the information of the domain to be queried. Illustratively, when the domain information to be queried is a domain to which the domain belongs, the domain to which the domain belongs in the first intermediate device set constitutes a first target device set, and the domain to which the domain belongs in the second intermediate device set constitutes a second target device set.

Step 210, comparing the devices in the first target device set and the second target device set, determining abnormal devices according to the comparison result, and checking the abnormal devices to ensure the consistency of the device data in the distributed system.

When devices in the first target device set and the second target device set are compared, the dichotomy comparison method described in the first embodiment may be adopted, which is not described herein again. After the abnormal device is determined, compensation correction is performed on the abnormal device, and a specific method for compensation correction is described in the first embodiment, which is not described herein again. The timing of the correction can be determined according to actual conditions. Illustratively, the correction operation is performed every time one abnormal device is determined, or after all abnormal devices are determined, the abnormal devices are corrected uniformly.

According to the embodiment of the invention, by combining the characteristics of actual video monitoring equipment, the inconsistency of data is quickly reduced to the minimum range by adopting the statistical comparison of the equipment state quantity and the attribute of the belonging domain, then the abnormal node is quickly positioned by adopting a binary search comparison method after the equipment is coded and sequenced, and the data is corrected by taking the database data as the reference, so that the problem of the data consistency of million-level video equipment of a video monitoring distributed system can be efficiently solved.

EXAMPLE III

Fig. 3 is a flowchart of a method for guaranteeing device data consistency in a third embodiment of the present invention, where this embodiment is a preferred embodiment, and as shown in fig. 3, the method specifically includes:

firstly, respectively counting the online quantity and the offline quantity of the devices in a database, a memory and a redis, and comparing the memory and the redis with the database one by one. And if the total number of the equipment is consistent through comparison, and the online number and the offline number are consistent with the database, the equipment data are considered to have consistency, the current process is ended, and the next preset correction time is waited to start the correction process. If the total number is consistent but the online quantity and the offline quantity are inconsistent, the online quantity and the offline quantity are continuously judged, and the party with the small quantity is selected to continuously judge. If the total number is not consistent, which indicates that the number of the devices is not consistent, both the online device and the offline device need to be continuously judged.

And then, continuously carrying out classification statistics according to different domains to which the equipment belongs to obtain the quantity in the domains and the quantity of the equipment between different domains. If the number of the devices in the domain or between the same domains is consistent, the data is consistent, the current process is ended, and the next set time is waited for starting the proofreading. If the number of the devices in the domain or between the same domains is inconsistent, which indicates that the states are inconsistent or the devices are inconsistent, the devices in the database, the memory and the redis are respectively sequenced, the middle device is obtained by the party with the larger number by adopting the dichotomy, and the corresponding device is found in different storage spaces through the middle device. If not, comparing whether the database is abnormal equipment or not, if so, respectively counting the number before and after to obtain the side with inconsistent number, and repeating the steps by analogy to judge by adopting a dichotomy until all the abnormal equipment is found.

After the abnormal equipment is found, taking database data as a standard, if the abnormal equipment does not exist in the memory or the redis and exists in the database, the abnormal equipment is data missing, and completing according to the equipment data in the database; if the abnormal equipment exists in the memory or the redis and does not exist in the database, the abnormal equipment is data residue, and the abnormal equipment in the memory or the redis is deleted; if the abnormal device exists in the memory or the redis and also exists in the database, but the device attribute information is inconsistent, the device data in the memory and the redis is corrected according to the device data in the database.

And after the correction is finished, carrying out a new round of statistics on the global equipment again, confirming that all abnormal equipment are updated, and restarting the process for correction if the abnormal equipment is inconsistent. The calibration process brings certain performance loss, and in order not to influence the normal service use of users, the calibration can be performed at fixed time during the non-user use period every day according to the user use habit.

The embodiment of the invention starts a proofreading task at regular time during the non-use period of a user by combining the characteristics of actual video monitoring equipment, firstly adopts equipment state statistics to compare and narrow the range, selects one with less quantity when the quantity is inconsistent to continuously judge, then carries out statistics and comparison according to the domain attribute of the equipment to quickly narrow the inconsistency of the data to the minimum range, finally adopts a binary search comparison method after sorting according to equipment codes to quickly position an abnormal equipment node, corrects by taking database data as reference, and can efficiently solve the problem of data consistency of million-level video equipment of a video monitoring distributed system.

Example four

Fig. 4 is a schematic structural diagram of a device for guaranteeing device data consistency in a fourth embodiment of the present invention, which is applicable to solve the situation of device data consistency in a distributed system. The device is an access device in a distributed system, where the distributed system at least includes a first storage space and a second storage space, as shown in fig. 4, and includes:

a device information determining module 410, configured to determine device attribute information stored in the first storage space and the second storage space respectively;

a device set determining module 420, configured to determine a first target device set in the first storage space and a second target device set in the second storage space according to the device attribute information;

an abnormal device determining module 430, configured to compare devices in the first target device set and the second target device set, determine an abnormal device according to a comparison result, and correct the abnormal device to ensure consistency of device data in the distributed system.

According to the embodiment of the invention, the device attribute information stored in different storage spaces is counted and compared, the device range with inconsistent device data is quickly reduced, the abnormal device is quickly positioned, the number of devices needing to be compared is reduced, and the problem of device data consistency in a distributed system is efficiently solved.

Optionally, the device attribute information includes state information and/or domain information;

correspondingly, the device set determining module 420 is specifically configured to:

determining whether the number of devices in the first storage space and the second storage space, of which the state information and/or the belonging domain information are the same, is consistent;

and determining a first target device set for the device to be queried for the state information and/or the domain information according to the state information in the first storage space, and determining a second target device set for the device to be queried for the domain information according to the state information in the second storage space.

Optionally, the device attribute information includes state information and domain information;

determining whether the number of devices with the same state information in the first storage space and the second storage space is consistent;

if the number of the devices with the same state information is consistent, determining that the device data in the distributed system is consistent;

if the number of the devices with the same state information is inconsistent, determining that the target state information with the inconsistent number of the devices is the state information to be inquired;

determining a first intermediate device set for the device to be queried according to the state information in the first storage space, and determining a second intermediate device set for the device to be queried according to the state information in the second storage space;

determining whether the number of devices with the same domain information in the first intermediate device set and the second intermediate device set is consistent;

if the number of the devices with the same domain information is consistent, determining that the device data in the distributed system has consistency;

if the number of the devices with the same number of the belonging domain information is inconsistent, determining that the target belonging domain information with inconsistent number of the devices is the information of the belonging domain to be inquired;

and determining a first target device set for the device to be queried about the domain information according to the domain information in the first intermediate device set, and determining a second target device set for the device to be queried about the domain information according to the domain information in the second intermediate device set.

Optionally, the abnormal device determining module includes:

the device set comparison unit is used for determining that the device set with the largest number in the first target device set and the second target device set is a comparison target device set, and the device set with the smallest number is an auxiliary target device set;

an intermediate device determining unit, configured to determine an intermediate device in the comparison target device set by using a bisection method after the comparison target device set and the auxiliary target device set are sorted according to device codes;

the intermediate device searching unit is used for searching in the auxiliary target device set according to the device code of the intermediate device;

and the abnormal equipment determining unit is used for determining whether the intermediate equipment is abnormal equipment or not according to the search result.

Optionally, the abnormal device determining unit is specifically configured to:

comparing the consistency of the quantity of the intermediate equipment before or after the positions of the comparison target equipment set and the auxiliary target equipment set;

and if the difference is not consistent, determining new intermediate equipment by adopting the dichotomy again, and determining whether the new intermediate equipment is abnormal equipment or not according to the search result.

Optionally, the first storage space is a reference storage space;

correspondingly, the abnormal device determining module includes a device data correcting unit, and is specifically configured to:

determining the search result and the state information of the abnormal equipment in the first storage space and the second storage space;

if the abnormal device does not exist in the first storage space and exists in the second storage space, deleting the abnormal device in the second storage space;

The device for guaranteeing the equipment data consistency provided by the embodiment of the invention can execute the method for guaranteeing the equipment data consistency provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the method for guaranteeing the equipment data consistency.

EXAMPLE five

Fig. 5 is a schematic structural diagram of an electronic device according to a fifth embodiment of the present invention. FIG. 5 illustrates a block diagram of an exemplary electronic device 12 suitable for use in implementing embodiments of the present invention. The electronic device 12 shown in fig. 5 is only an example and should not bring any limitation to the function and the scope of use of the embodiment of the present invention.

As shown in FIG. 5, electronic device 12 is embodied in the form of a general purpose computing device. The components of electronic device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory device 28, and a bus 18 that couples various system components including the system memory device 28 and the processing unit 16.

Bus 18 represents one or more of any of several types of bus structures, including a memory device bus or memory device controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, industry Standard Architecture (ISA) bus, micro-channel architecture (MAC) bus, enhanced ISA bus, video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

Electronic device 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by electronic device 12 and includes both volatile and nonvolatile media, removable and non-removable media.

The system storage 28 may include computer system readable media in the form of volatile storage, such as Random Access Memory (RAM) 30 and/or cache storage 32. The electronic device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 5, and commonly referred to as a "hard drive"). Although not shown in FIG. 5, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Storage 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.

A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in storage 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the described embodiments of the invention.

Electronic device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, etc.) or display 24, and may also communicate with one or more devices that enable a user to interact with device 12, and/or with any devices (e.g., network card, modem, etc.) that enable device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Also, the electronic device 12 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet) via the network adapter 20. As shown in FIG. 5, the network adapter 20 communicates with the other modules of the electronic device 12 via the bus 18. It should be appreciated that although not shown in FIG. 5, other hardware and/or software modules may be used in conjunction with electronic device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, to name a few.

The processing unit 16 executes various functional applications and data processing by running a program stored in the system storage device 28, for example, implementing a method for guaranteeing data consistency of a device provided in an embodiment of the present invention, where the device is an access device in a distributed system, and the distributed system at least includes a first storage space and a second storage space, and includes:

EXAMPLE six

The sixth embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the method for guaranteeing data consistency of a device provided in the sixth embodiment of the present invention is implemented, where the device is an access device in a distributed system, and the distributed system at least includes a first storage space and a second storage space, and includes:

respectively determining the equipment attribute information stored in the first storage space and the second storage space;

Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C + +, or the like, as well as conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A method for guaranteeing device data consistency is characterized in that a device is an access device in a distributed system, the distributed system at least comprises a first storage space and a second storage space, and the method comprises the following steps:

2. The method according to claim 1, wherein the device attribute information comprises status information and/or domain information;

correspondingly, determining a first target device set in the first storage space and a second target device set in the second storage space according to the device attribute information includes:

determining whether the number of devices in the first storage space and the second storage space, which are the same as the state information and/or the belonging domain information, is consistent;

3. The method of claim 1, wherein the device attribute information comprises status information and home domain information;

4. The method of claim 1, wherein comparing the devices in the first target device set and the second target device set, and determining abnormal devices according to the comparison result comprises:

determining that the most devices in the first target device set and the second target device set are comparison target device sets, and the least devices in the first target device set and the second target device set are auxiliary target device sets;

after the comparison target equipment set and the auxiliary target equipment set are sorted according to equipment codes, determining intermediate equipment in the comparison target equipment set by adopting a dichotomy;

5. The method of claim 4, wherein determining whether the intermediate device is an abnormal device according to the search result comprises:

6. The method of claim 4, wherein determining whether the intermediate device is an abnormal device according to the search result comprises:

7. The method of claim 1, wherein the first storage space is a reference storage space;

correspondingly, the checking of the abnormal device comprises the following steps:

8. A device for guaranteeing device data consistency is characterized in that the device is an access device in a distributed system, the distributed system at least comprises a first storage space and a second storage space, and the device comprises:

and the abnormal equipment determining module is used for comparing the equipment in the first target equipment set and the second target equipment set, determining abnormal equipment according to a comparison result, and checking the abnormal equipment to ensure the equipment data consistency in the distributed system.

9. An electronic device, comprising:

one or more processors;

a storage device for storing one or more programs,

when executed by the one or more processors, cause the one or more processors to implement the method for safeguarding the consistency of device data as recited in any one of claims 1-7.

10. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, is adapted to carry out a method for safeguarding the consistency of data of a device according to any one of claims 1 to 7.