CN114745150B - Redundancy consistency detection and arbitration method and system for Web application - Google Patents
Redundancy consistency detection and arbitration method and system for Web application Download PDFInfo
- Publication number
- CN114745150B CN114745150B CN202210175331.3A CN202210175331A CN114745150B CN 114745150 B CN114745150 B CN 114745150B CN 202210175331 A CN202210175331 A CN 202210175331A CN 114745150 B CN114745150 B CN 114745150B
- Authority
- CN
- China
- Prior art keywords
- algorithm
- file
- comparison
- consistency
- configuration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 238000001514 detection method Methods 0.000 title claims description 32
- 230000008569 process Effects 0.000 claims abstract description 37
- 238000001914 filtration Methods 0.000 claims abstract description 19
- 230000007246 mechanism Effects 0.000 claims abstract description 10
- 238000005457 optimization Methods 0.000 claims abstract description 10
- 238000004458 analytical method Methods 0.000 claims description 35
- 238000007726 management method Methods 0.000 claims description 34
- 238000010606 normalization Methods 0.000 claims description 28
- 238000012545 processing Methods 0.000 claims description 19
- 238000012544 monitoring process Methods 0.000 claims description 11
- 238000005516 engineering process Methods 0.000 claims description 10
- 238000003745 diagnosis Methods 0.000 description 6
- 230000003247 decreasing effect Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012550 audit Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 230000002829 reductive effect Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 238000000547 structure data Methods 0.000 description 1
- 230000007474 system interaction Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/14—Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic
- H04L63/1408—Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic by monitoring network traffic
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The invention provides a method and a system for detecting and judging redundancy consistency for Web application, comprising the following steps: combining various objects involved in the redundancy consistency arbitration process; according to the number of files to be judged, different comparison strategies and optimization methods are used to obtain a consistency judging result; aiming at different types of files, different files are compared with basic algorithm realization, and the algorithms are uniformly managed; providing a basic parser and a normalizer for common file types, and expanding corresponding parsing and normalizing algorithms of other types of files by utilizing an algorithm registration mechanism; and (3) carrying out statistics by managing applicable object types, object features and algorithm efficiency according to each algorithm, and optimally combining each basic data comparison algorithm to obtain comparison of the abstract syntax tree. The invention enables the user to customize the arbitrated content by arbitrating the content filtering configuration and the sensitive information appointed configuration, and improves the arbitrating accuracy by filtering the non-sensitive dynamic information.
Description
Technical Field
The invention relates to the technical field of network security, in particular to a redundancy consistency detection and arbitration method and system for Web application.
Background
With the development of technologies such as the internet of things and the arrival of web3.0 era, importance of information systems in daily life and industrial internet is prominent, and reliability and safety of information systems such as electronic commerce systems and industrial control systems are basic problems to be solved. According to the '2020 China Internet network security report', the remote attack behavior initiated by an internal host exceeds 2176.4 ten thousand times a day, the prompting interception times of counterfeit webpages reach 3.9 hundred million times a year, and the risk of a Web information system is high; in the aspect of industrial Internet, 20% of key generation management systems such as energy, rail transit and the like have high-risk security holes, and the security risk situation on the Internet side of an industrial control system is severe.
Besides the system facilities such as a firewall and a security audit system, the security protection of the important information system often uses a isomorphic or heterogeneous multi-executor redundancy parallel operation mode to improve the reliability and security of the system. The system architecture of the multi-executable redundancy needs to perform consistency arbitration on interactive data (such as JSON, HTML, javaScript files) generated by each executable, and detect errors, bypass attacks and the like existing in the system while providing uniform interactive input/output. The accuracy, expandability and arbitration efficiency of consistency arbitration directly influence the reliability and safety of the whole system, the system interaction mode and the system working efficiency.
The existing consistency arbitration technology mainly focuses on redundancy judgment modes and redundancy consistency strategies, an arbitrated object is simple (usually stream data, structure data and the like), the consistency strategies are usually fixed, an application system and a scene are single, and the consistency arbitration technology is difficult to be applied to a complex information system. Therefore, the consistency judging method which is wide in application range, configurable and expandable has great application prospect.
The patent document with the publication number of CN110427387A discloses a data consistency detection method and a device, which are used for screening and reorganizing business event data by collecting the business event data in real time and constructing corresponding event information based on event types corresponding to the business event data. And then, based on the corresponding business rule, carrying out data consistency detection on the constructed event information. Based on the event type and the corresponding business rule, the business event is detected in real time, so that the business event is audited in the event, the problem of data consistency is detected before the user finds the problem, and the stability of a business system is ensured. And the detection of the service data of each service center is realized by utilizing a script rule mode. Each online business event can form one-to-one monitoring and detection, and a normalized and standardized business online and correction flow is formed. The consistency detection object of the patent is business event data; attention is paid to how to generate a comparison object for service time data acquired in real time, the patent adopts the generation of the comparison object based on service rules, and the core is the generation process of the comparison object; the patent is a comparison between two groups of objects, and the comparison process and algorithm are not clear; the invention processes the comparison among a plurality of groups of objects, the number of the comparison objects is more than or equal to 2, and a clear consistency detection and judgment flow and various comparison algorithms required by the invention are provided.
Therefore, a new technical solution needs to be proposed.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to provide a method and a system for detecting and judging redundancy consistency for Web application.
The invention provides a redundancy consistency detection and arbitration method for Web application, which comprises the following steps:
step S1: combining various objects involved in the redundancy consistency arbitration process through the position of the object to be arbitrated, the consistency arbitration policy, the arbitration content filtering configuration and the sensitive information appointed configuration to obtain an arbitrated file;
Step S2: according to the number of files to be judged, different comparison strategies and optimization methods are used to obtain consistency judging results, and the consistency judging results can be positioned to different files;
step S3: according to the consistency judging result, aiming at different types of files, different files are compared with a basic algorithm to realize, and the algorithm is uniformly managed;
Step S4: providing a basic parser and a normalizer for common file types, and expanding corresponding parsing and normalizing algorithms of other types of files by utilizing an algorithm registration mechanism;
Step S5: and comparing basic data structures in the abstract syntax tree, wherein the data structures of the set and the array are compared with different processing algorithms, and the comparison of the abstract syntax tree is obtained by managing and counting the applicable object types, object characteristics and algorithm efficiency according to each algorithm and optimizing and combining each basic data comparison algorithm.
Preferably, in the step S1, each configuration item has a default value, and the configuration items have a priority relationship, and the configuration items are obtained in real time by updating the monitoring technology through the configuration file.
Preferably, the step S2 manages a total consistency voting algorithm, a complex voting algorithm, a majority consistency voting algorithm and a median voting algorithm, and a specific strategy algorithm is selected and called according to a configuration file to obtain a consistency arbitration result; and when the files are inconsistent, returning a judging result immediately, simultaneously continuing asynchronous inconsistent detection analysis, positioning inconsistent files, and positioning inconsistent information through file comparison basic algorithm management service.
Preferably, the step S3 includes file analysis and normalization algorithm management and basic data comparison algorithm management, and the file analysis and normalization algorithm is invoked to analyze the file to be compared to generate a normalized data structure, and the basic data comparison algorithm is invoked to specifically compare each part in the data structure to perform pairwise comparison of the file; and when the file comparison finds out the inconsistency, returning a comparison result immediately, continuing to complete file comparison, and asynchronously returning a file inconsistency checking analysis result to obtain positioning information of inconsistent information.
Preferably, the step S4 optimizes the generated abstract syntax tree in the normalization process, and in the file parsing and normalization process, filters configuration and sensitive information assignment configuration according to the content of the configuration file, generates a corresponding configuration object, and uses a filter mode to clip the abstract syntax tree; conflict processing is performed at the normalizer according to the priority of each configuration item and the conflict processing policy.
The invention also provides a system for detecting and judging the redundancy consistency of the Web application, which comprises the following modules:
Module M1: combining various objects involved in the redundancy consistency arbitration process through the position of the object to be arbitrated, the consistency arbitration policy, the arbitration content filtering configuration and the sensitive information appointed configuration to obtain an arbitrated file;
module M2: according to the number of files to be judged, different comparison strategies and optimization systems are used to obtain consistency judging results, and the consistency judging results can be positioned to different files;
module M3: according to the consistency judging result, aiming at different types of files, different files are compared with a basic algorithm to realize, and the algorithm is uniformly managed;
Module M4: providing a basic parser and a normalizer for common file types, and expanding corresponding parsing and normalizing algorithms of other types of files by utilizing an algorithm registration mechanism;
Module M5: and comparing basic data structures in the abstract syntax tree, wherein the data structures of the set and the array are compared with different processing algorithms, and the comparison of the abstract syntax tree is obtained by managing and counting the applicable object types, object characteristics and algorithm efficiency according to each algorithm and optimizing and combining each basic data comparison algorithm.
Preferably, each configuration item in the module M1 has a default value, and the configuration items have a priority relationship, and the real-time configuration item is obtained by updating the monitoring technology through the configuration file.
Preferably, the module M2 manages a total consistency voting algorithm, a complex voting algorithm, a majority consistency voting algorithm and a median voting algorithm, and calls a specific strategy algorithm according to the selection of the configuration file to obtain a consistency arbitration result; and when the files are inconsistent, returning a judging result immediately, simultaneously continuing asynchronous inconsistent detection analysis, positioning inconsistent files, and positioning inconsistent information through file comparison basic algorithm management service.
Preferably, the module M3 includes file analysis and normalization algorithm management and basic data comparison algorithm management, analyzes the file to be compared by calling the file analysis and normalization algorithm to generate a normalized data structure, and calls the basic data comparison algorithm to specifically compare each part in the data structure to perform pairwise comparison of the files; and when the file comparison finds out the inconsistency, returning a comparison result immediately, continuing to complete file comparison, and asynchronously returning a file inconsistency checking analysis result to obtain positioning information of inconsistent information.
Preferably, the module M4 optimizes the generated abstract syntax tree in the normalization process, and in the file parsing and normalization process, decides the content filtering configuration and the sensitive information appointed configuration according to the configuration file, generates a corresponding configuration object, and uses a filter mode to cut the abstract syntax tree; conflict processing is performed at the normalizer according to the priority of each configuration item and the conflict processing policy.
Compared with the prior art, the invention has the following beneficial effects:
1. The invention improves the application range of the consistency redundancy consistency check and arbitration method through the flexible configuration and expansion mechanism of the redundancy consistency strategy, the file comparison algorithm and the basic data comparison algorithm, and realizes the monitoring of arbitration tasks through the arbitration process tracking;
2. the invention enables the user to customize the arbitrated content by arbitrating the content filtering configuration and the sensitive information appointed configuration, and improves the arbitrating accuracy by filtering the non-sensitive dynamic information;
3. according to the invention, the consistency judgment and the non-consistency diagnosis efficiency are improved through the combination and optimization of various layers of algorithms such as the non-consistency file asynchronous diagnosis and the basic data comparison algorithm in the judgment process.
Drawings
Other features, objects and advantages of the present invention will become more apparent upon reading of the detailed description of non-limiting embodiments, given with reference to the accompanying drawings in which:
FIG. 1 is a diagram of a redundancy consistency detection arbitration function for a Web application of the present invention;
FIG. 2 is a flow chart of the redundancy consistency arbitration detection for Web applications of the present invention.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the present invention, but are not intended to limit the invention in any way. It should be noted that variations and modifications could be made by those skilled in the art without departing from the inventive concept. These are all within the scope of the present invention.
According to the invention, the consistency arbitration process is combined in stages and layers, and flexible configuration is carried out on three layers of the redundancy consistency policy, the file comparison algorithm and the basic data comparison algorithm, so that the consistency arbitration is configurable and expandable, the applicable scene range is improved, and the arbitration of different data types is conveniently optimized. And monitoring the arbitration task through the arbitration process tracking, and finding out the performance bottleneck to perform optimization expansion. The invention solves the problem of error arbitration caused by dynamic information (such as time information, unique identification information and the like) in certain scenes by utilizing the filtering configuration of the arbitrated content and the designated configuration of the sensitive information, and improves the accuracy and the efficiency of arbitration by utilizing the designation of the sensitive information. The invention provides an asynchronous diagnosis function of a judging object, and timely returns a judging result when inconsistent data is found in the judging process, and simultaneously starts the asynchronous diagnosis function, thereby realizing consistency/inconsistency analysis of a judging object set on the premise of not affecting judging efficiency.
The redundancy consistency detection and arbitration method for the Web application provides configurable and expandable consistency arbitration service and inconsistency detection and analysis capability for the isomorphic/heterogeneous redundancy system, can monitor the arbitration process, can rapidly locate performance bottlenecks and improve arbitration efficiency through optimization and expansion. During arbitration, the data stream is handled as a special file. The method mainly comprises the functional service modules of configuration file management, multi-file arbitration algorithm management, file comparison basic algorithm management, file analysis and normalization algorithm management, basic data comparison algorithm management and the like, as shown in figure 1.
Profile management service: the service combines various objects involved in the redundancy consistency arbitration process through configuration items such as 'pending object position', 'consistency arbitration policy', 'arbitration content filtering configuration', 'sensitive information designated configuration', and the like, so as to efficiently and accurately complete a consistency detection arbitration task. In order to prevent situations such as partial configuration deletion, configuration item conflict and the like, each configuration item has a default value, and the configuration items have a priority relation. And the real-time effect of the configuration items is realized through a configuration file updating monitoring technology.
Multi-file arbitration algorithm management service: the service uses different comparison strategies and optimization methods, such as a file mixed arbitration method, according to the number of files to be arbitrated, so as to obtain consistency arbitration results in the shortest time possible, and can position difference files for detection analysis. The service calls the file comparison basic algorithm management service to complete specific file comparison. In addition, the service also manages the consistency arbitration policies such as a total consistency voting algorithm ',acomplex voting algorithm',amajority voting algorithm, a median voting algorithm, and the like, and a specific policy algorithm is selected and called according to the configuration file to obtain a consistency arbitration result. The service returns a judging result immediately when the files are inconsistent, and simultaneously continues asynchronous inconsistent detection analysis to locate inconsistent files, and further accurately locates inconsistent information through file comparison basic algorithm management service.
File comparison basic algorithm management service: the service pair realizes pairwise comparison of files. Aiming at different types of files, different files are compared with basic algorithm implementations, and the algorithm implementations are uniformly managed to achieve extensible and optimized implementation of the algorithm. The service mainly comprises two parts: file analysis and normalization algorithm management and basic data comparison algorithm management, analyzing files to be compared by calling the file analysis and normalization algorithm to generate a normalized data structure, and then calling the basic data comparison algorithm to conduct specific comparison on each part in the data structure to realize pairwise comparison of the files. When the file comparison finds out the inconsistency, the service immediately returns a comparison result, and continues to complete file comparison, asynchronously returns a file inconsistency checking analysis result, and achieves accurate positioning of inconsistent information.
File parsing and normalization algorithm management module: the module is used for carrying out grammar analysis on the file in the file comparison process, analyzing and normalizing the file to generate a unified abstract grammar tree, wherein the abstract grammar tree consists of basic data structures such as a set, an array and the like. The module provides a basic parser and a normalizer for commonly used file types, and utilizes an algorithm registration mechanism to facilitate expansion of corresponding parsing and normalization algorithms for other types of files. The generated abstract syntax tree may be optimized during the normalization process. In the process of file analysis and normalization, the configuration object can be generated according to the configuration file 'arbitrating content filtering configuration' and 'sensitive information designated configuration', and the abstract syntax tree is cut by using a filter mode. Wherein, the arbitrated content filter for filtering the content is used for definitely not comparing the dynamic information of the arbitrated, such as ID, time, etc.; the sensitive information designator, which designates sensitive information, is used to define the information that must be arbitrated. To avoid configuration item conflicts in the 'arbitrated content filtering configuration' and the 'sensitive information designation configuration', conflict processing is performed at the normalizer according to the priority of each configuration item and the conflict processing policy.
And the basic data comparison algorithm management module: the module compares basic data structures in the abstract syntax tree, wherein data structures such as a set, an array and the like can be compared with different processing algorithms, statistics is carried out by managing applicable object types, object features, algorithm efficiency and the like according to each algorithm, and each basic data comparison algorithm is optimally combined to complete efficient comparison work of the abstract syntax tree. In addition, the module provides a comparison algorithm expansion mode by utilizing an algorithm registration mechanism, so that the algorithm can be conveniently optimized and increased or decreased.
The above-described respective redundancy check arbitration function and service call interaction efficiently produce a consistency arbitration result and an inconsistency diagnosis detection result, as shown in fig. 2.
The redundancy consistency detection and arbitration method for the Web application firstly analyzes the configuration file to generate a configuration object, acquires a path where a file set to be compared is located according to the configuration object, and identifies the file set object, the number of the file set object, the file type and other attributes. And then, calling a multi-file comparison algorithm management service, selecting a multi-file comparison strategy and a consistency comparison strategy according to the attributes such as file types, comparison file numbers and the like, and calling a corresponding file comparison basic algorithm through a file comparison technology algorithm management service to conduct file comparison. When the file comparison starts, an arbitrated content filter and a sensitive information specifier are automatically configured, and compared information is cut off in the file analysis and normalization process through a filter mode, so that an optimized abstract syntax tree is generated. Aiming at comparison of basic data structures in abstract syntax trees, according to data structure characteristics, a basic data comparison algorithm management module is utilized to call a corresponding efficient set comparison algorithm, an array comparison algorithm and the like for comparison, and comparison results are summarized into a file comparison basic algorithm to generate pairwise file comparison results. In the process of comparing the basic data structures of the abstract syntax tree, if inconsistent conditions are met, immediately returning inconsistent results to a file comparison basic algorithm, and simultaneously continuing the comparison analysis of the abstract syntax tree. The file comparison basic algorithm management service returns the file comparison basic result to the multi-file arbitration algorithm, selects a corresponding arbitration algorithm according to the consistency arbitration policy configuration, and generates a consistency arbitration result of the file set according to the multi-file comparison result.
And providing a unified service interface for the outside by the consistency arbitration service, updating the configuration object in real time by using a monitoring tool such as WatchConfig and the like according to the properties configuration file, and acquiring configuration item information through the configuration object in the consistency arbitration service. The configuration file supports regular expressions to support arbitrating content filtering configurations and sensitive information specification configurations, etc. In the multi-file comparison process, comparing two files with each other for two file sets and three file sets; for the even number of comparison files, processing according to a strategy, and if no configuration related strategy exists, randomly selecting (the number of files is-1) files from the strategy by default to perform consistency arbitration; for more than three file comparisons, the file can be reduced to two file or three file comparisons in a file splicing manner, so that the consistency judging efficiency is improved. When the file is analyzed in the file comparison process, the existing file analysis method can be registered and used, for example, fastJson related analysis methods can be registered and used for JSON files, and the data information which does not need comparison is filtered by using a filter mode. The basic data structure obtained in the file analysis process can form an abstract syntax tree, and the abstract syntax tree is optimized to avoid repeated comparison. When inconsistent data is encountered in the comparison process of the abstract syntax tree, a thread is generated to return a comparison result to a file comparison basic algorithm, and the main process continues the comparison analysis of the file abstract syntax tree so as to carry out inconsistency diagnosis on the inconsistent files. And finally, converging the multi-file comparison result into a multi-file arbitration algorithm, selecting a large number of strategies such as consistency arbitration and the like according to configuration, and obtaining a consistency result by using a corresponding consistency arbitration algorithm. The whole arbitration process can be used for task monitoring, and all algorithms related to the arbitration process are combined and optimized through process factor collection such as all task time and the like.
The invention also provides a system for detecting and judging the redundancy consistency of the Web application, which comprises the following modules:
Module M1: combining various objects involved in the redundancy consistency arbitration process through the position of the object to be arbitrated, the consistency arbitration policy, the arbitration content filtering configuration and the sensitive information appointed configuration to obtain an arbitrated file; each configuration item has a default value, the configuration items have a priority relation, and a real-time configuration item is obtained through a configuration file updating monitoring technology.
Module M2: according to the number of files to be judged, different comparison strategies and optimization systems are used to obtain consistency judging results, and the consistency judging results can be positioned to different files; managing a total consistency voting algorithm, a complex voting algorithm, a majority consistency voting algorithm and a median voting algorithm, and selecting and calling a specific strategy algorithm according to a configuration file to obtain a consistency arbitration result; and when the files are inconsistent, a judging result is returned immediately, asynchronous inconsistent detection analysis is continuously carried out, inconsistent files are positioned, and inconsistent information is accurately positioned through file comparison basic algorithm management service.
Module M3: according to the consistency judging result, aiming at different types of files, different files are compared with a basic algorithm to realize, and the algorithm is uniformly managed; the method comprises file analysis and normalization algorithm management and basic data comparison algorithm management, wherein files to be compared are analyzed by calling the file analysis and normalization algorithm to generate a normalized data structure, and specific comparison is carried out on each part in the data structure by calling the basic data comparison algorithm to carry out pairwise comparison on the files; and when the file comparison finds out the inconsistency, returning a comparison result immediately, continuing to complete file comparison, and asynchronously returning a file inconsistency checking analysis result to obtain accurate positioning information of inconsistent information.
Module M4: providing a basic parser and a normalizer for common file types, and expanding corresponding parsing and normalizing algorithms of other types of files by utilizing an algorithm registration mechanism; optimizing the generated abstract syntax tree in the normalization process, filtering configuration and designating configuration according to the content of the configuration file in the file analysis and normalization process, generating a corresponding configuration object, and cutting the abstract syntax tree by using a filter mode; conflict processing is performed at the normalizer according to the priority of each configuration item and the conflict processing policy.
Module M5: and comparing basic data structures in the abstract syntax tree, wherein the data structures of the set and the array are compared with different processing algorithms, and carrying out statistics by managing applicable object types, object characteristics and algorithm efficiency according to each algorithm to optimally combine each basic data comparison algorithm so as to obtain high-efficiency comparison of the abstract syntax tree. The algorithm registration mechanism is utilized to provide a comparison algorithm expansion mode, so that the algorithm can be conveniently optimized and increased or decreased.
Those skilled in the art will appreciate that the invention provides a system and its individual devices, modules, units, etc. that can be implemented entirely by logic programming of method steps, in addition to being implemented as pure computer readable program code, in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers, etc. Therefore, the system and various devices, modules and units thereof provided by the invention can be regarded as a hardware component, and the devices, modules and units for realizing various functions included in the system can also be regarded as structures in the hardware component; means, modules, and units for implementing the various functions may also be considered as either software modules for implementing the methods or structures within hardware components.
The foregoing describes specific embodiments of the present application. It is to be understood that the application is not limited to the particular embodiments described above, and that various changes or modifications may be made by those skilled in the art within the scope of the appended claims without affecting the spirit of the application. The embodiments of the application and the features of the embodiments may be combined with each other arbitrarily without conflict.
Claims (10)
1. The redundancy consistency detection and arbitration method for the Web application is characterized by comprising the following steps of:
step S1: combining various objects involved in the redundancy consistency arbitration process through the position of the object to be arbitrated, the consistency arbitration policy, the arbitration content filtering configuration and the sensitive information appointed configuration to obtain an arbitrated file;
step S2: according to the number of files to be judged, different comparison strategies and optimization methods are used to obtain consistency judging results, and the consistency judging results are positioned to different files;
step S3: according to the consistency judging result, aiming at different types of files, different file comparison basic algorithms are realized, and the file comparison basic algorithms are uniformly managed;
Step S4: providing a basic parser and a normalizer for common file types, and expanding corresponding parsing and normalizing algorithms of other types of files by utilizing an algorithm registration mechanism;
Step S5: and comparing basic data structures in the abstract syntax tree, wherein the data structures of the set and the array are compared with different processing algorithms, and the comparison of the abstract syntax tree is obtained by managing and counting the applicable object types, object characteristics and algorithm efficiency according to each algorithm and optimizing and combining each basic data comparison algorithm.
2. The Web application-oriented redundancy consistency detection and arbitration method according to claim 1, wherein each configuration item in the step S1 has a default value, and the configuration items have a priority relationship, and the configuration items are obtained in real time by a configuration file updating monitoring technology.
3. The Web application-oriented redundancy consistency detection arbitration method according to claim 1, wherein the step S2 manages a total consistency voting algorithm, a complex voting algorithm, a majority consistency voting algorithm, and a median voting algorithm, and calls a specific policy algorithm according to a configuration file selection to obtain a consistency arbitration result; and when the files are inconsistent, returning a judging result immediately, simultaneously continuing asynchronous inconsistent detection analysis, positioning inconsistent files, and positioning inconsistent information through file comparison basic algorithm management service.
4. The Web application-oriented redundancy consistency detection and arbitration method according to claim 1, wherein the step S3 includes file analysis and normalization algorithm management and basic data comparison algorithm management, wherein the files to be compared are analyzed by calling the file analysis and normalization algorithm to generate a normalized data structure, and the basic data comparison algorithm is called to conduct specific comparison on each part in the data structure to conduct pairwise comparison on the files; and when the file comparison finds out the inconsistency, returning a comparison result immediately, continuing to complete file comparison, and asynchronously returning a file inconsistency checking analysis result to obtain positioning information of inconsistent information.
5. The Web application-oriented redundancy check arbitration method according to claim 1, wherein the step S4 optimizes the abstract syntax tree generated in the normalization process, and generates a corresponding configuration object according to configuration file arbitration content filtering configuration and sensitive information designated configuration in the file parsing and normalization process, and clips the abstract syntax tree using a filter mode; conflict processing is performed at the normalizer according to the priority of each configuration item and the conflict processing policy.
6. A Web application-oriented redundancy consistency detection arbitration system, the system comprising:
Module M1: combining various objects involved in the redundancy consistency arbitration process through the position of the object to be arbitrated, the consistency arbitration policy, the arbitration content filtering configuration and the sensitive information appointed configuration to obtain an arbitrated file;
module M2: according to the number of files to be judged, different comparison strategies and optimization systems are used to obtain consistency judging results, and the consistency judging results can be positioned to different files;
module M3: according to the consistency judging result, aiming at different types of files, different files are compared with a basic algorithm to realize, and the algorithm is uniformly managed;
Module M4: providing a basic parser and a normalizer for common file types, and expanding corresponding parsing and normalizing algorithms of other types of files by utilizing an algorithm registration mechanism;
Module M5: and comparing basic data structures in the abstract syntax tree, wherein the data structures of the set and the array are compared with different processing algorithms, and the comparison of the abstract syntax tree is obtained by managing and counting the applicable object types, object characteristics and algorithm efficiency according to each algorithm and optimizing and combining each basic data comparison algorithm.
7. The Web application-oriented redundancy consistency detection arbitration system according to claim 6, wherein each configuration item in the module M1 has a default value, and the configuration items have a priority relationship, and the configuration items are obtained in real time by using a configuration file update monitoring technology.
8. The Web application-oriented redundancy consistency detection arbitration system according to claim 6, wherein the module M2 manages a total consistency voting algorithm, a complex voting algorithm, a majority consistency voting algorithm, and a median voting algorithm, and invokes a specific policy algorithm according to a configuration file selection to obtain a consistency arbitration result; and when the files are inconsistent, returning a judging result immediately, simultaneously continuing asynchronous inconsistent detection analysis, positioning inconsistent files, and positioning inconsistent information through file comparison basic algorithm management service.
9. The Web application-oriented redundancy consistency detection arbitration system according to claim 6, wherein the module M3 includes file parsing and normalization algorithm management, basic data comparison algorithm management, parses a file to be compared by calling the file parsing and normalization algorithm to generate a normalized data structure, and calls the basic data comparison algorithm to perform specific comparison on each part in the data structure to perform pairwise comparison of the files; and when the file comparison finds out the inconsistency, returning a comparison result immediately, continuing to complete file comparison, and asynchronously returning a file inconsistency checking analysis result to obtain positioning information of inconsistent information.
10. The Web application-oriented redundancy check and arbitration system according to claim 6, wherein the module M4 optimizes the abstract syntax tree generated during normalization, and generates a corresponding configuration object according to configuration file arbitration content filtering configuration and sensitive information designating configuration during file parsing and normalization, and clips the abstract syntax tree using a filter mode; conflict processing is performed at the normalizer according to the priority of each configuration item and the conflict processing policy.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210175331.3A CN114745150B (en) | 2022-02-24 | 2022-02-24 | Redundancy consistency detection and arbitration method and system for Web application |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210175331.3A CN114745150B (en) | 2022-02-24 | 2022-02-24 | Redundancy consistency detection and arbitration method and system for Web application |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114745150A CN114745150A (en) | 2022-07-12 |
| CN114745150B true CN114745150B (en) | 2024-04-16 |
Family
ID=82274751
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210175331.3A Active CN114745150B (en) | 2022-02-24 | 2022-02-24 | Redundancy consistency detection and arbitration method and system for Web application |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114745150B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110750802A (en) * | 2019-10-14 | 2020-02-04 | 创元网络技术股份有限公司 | Framework for protecting key data based on mimicry defense |
| CN112702205A (en) * | 2020-12-24 | 2021-04-23 | 中国人民解放军战略支援部队信息工程大学 | Method and system for monitoring status of executive under mimicry DHR architecture |
| CN113315755A (en) * | 2021-04-27 | 2021-08-27 | 华东计算技术研究所（中国电子科技集团公司第三十二研究所） | Mimicry decision system and method based on strategy |
| WO2021169080A1 (en) * | 2020-02-27 | 2021-09-02 | 南京红阵网络安全技术研究院有限公司 | Mimicry defense decision method and system based on partial homomorphic encryption algorithm |
| CN113515354A (en) * | 2021-03-30 | 2021-10-19 | 南京大学 | Unified processing system and method based on environment context consistency |
| CN113556315A (en) * | 2021-05-31 | 2021-10-26 | 中电科数字科技(集团)有限公司 | Grid-based big data storage integrity verification method, system and medium |
-
2022
- 2022-02-24 CN CN202210175331.3A patent/CN114745150B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110750802A (en) * | 2019-10-14 | 2020-02-04 | 创元网络技术股份有限公司 | Framework for protecting key data based on mimicry defense |
| WO2021169080A1 (en) * | 2020-02-27 | 2021-09-02 | 南京红阵网络安全技术研究院有限公司 | Mimicry defense decision method and system based on partial homomorphic encryption algorithm |
| CN112702205A (en) * | 2020-12-24 | 2021-04-23 | 中国人民解放军战略支援部队信息工程大学 | Method and system for monitoring status of executive under mimicry DHR architecture |
| CN113515354A (en) * | 2021-03-30 | 2021-10-19 | 南京大学 | Unified processing system and method based on environment context consistency |
| CN113315755A (en) * | 2021-04-27 | 2021-08-27 | 华东计算技术研究所（中国电子科技集团公司第三十二研究所） | Mimicry decision system and method based on strategy |
| CN113556315A (en) * | 2021-05-31 | 2021-10-26 | 中电科数字科技(集团)有限公司 | Grid-based big data storage integrity verification method, system and medium |
Non-Patent Citations (1)
| Title |
|---|
| 基于拟态防御架构的多余度裁决建模与风险分析;李卫超;张铮;王立群;邬江兴;;信息安全学报(第05期);第64-74页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114745150A (en) | 2022-07-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10678669B2 (en) | Field content based pattern generation for heterogeneous logs | |
| CN110708204B (en) | Abnormity processing method, system, terminal and medium based on operation and maintenance knowledge base | |
| CN110928718B (en) | Abnormality processing method, system, terminal and medium based on association analysis | |
| US9449072B2 (en) | Automatic log sensor tuning | |
| US10057285B2 (en) | System and method for auditing governance, risk, and compliance using a pluggable correlation architecture | |
| US8423950B2 (en) | Method and apparatus for optimizing performance and network traffic in distributed workflow processing | |
| US9992269B1 (en) | Distributed complex event processing | |
| CN111817891A (en) | Network fault processing method and device, storage medium and electronic equipment | |
| CN104246786A (en) | Field selection for pattern discovery | |
| Jeong et al. | Anomaly teletraffic intrusion detection systems on hadoop-based platforms: A survey of some problems and solutions | |
| CN104615936B (en) | Cloud platform VMM layer behavior monitoring method | |
| CN112559237B (en) | Operation and maintenance system troubleshooting method and device, server and storage medium | |
| US20130282649A1 (en) | Deterministic finite automation minimization | |
| WO2022135257A1 (en) | Machine-learning-based signature matching optimization method for intrusion detection system | |
| CN113468019A (en) | Hbase-based index monitoring method, device, equipment and storage medium | |
| CN104246787A (en) | Parameter adjustment for pattern discovery | |
| CN112612832B (en) | Node analysis method, device, equipment and storage medium | |
| CN113836237A (en) | Method and device for auditing data operation of database | |
| RU180789U1 (en) | DEVICE OF INFORMATION SECURITY AUDIT IN AUTOMATED SYSTEMS | |
| CN114745150B (en) | Redundancy consistency detection and arbitration method and system for Web application | |
| CN112182025A (en) | Log analysis method, device, equipment and computer readable storage medium | |
| CN113282606A (en) | Data processing method, data processing device, storage medium and computing equipment | |
| CN116483831B (en) | Recommendation index generation method for distributed database | |
| Lee et al. | Detecting anomaly teletraffic using stochastic self-similarity based on Hadoop | |
| CN114706893A (en) | Fault detection method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |