WO2015103879A1 - 一种基于规则优化的数据防火墙修复方法及系统 - Google Patents

一种基于规则优化的数据防火墙修复方法及系统 Download PDF

Info

Publication number
WO2015103879A1
WO2015103879A1 PCT/CN2014/084624 CN2014084624W WO2015103879A1 WO 2015103879 A1 WO2015103879 A1 WO 2015103879A1 CN 2014084624 W CN2014084624 W CN 2014084624W WO 2015103879 A1 WO2015103879 A1 WO 2015103879A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
rules
rule
firewall
attribute
Prior art date
Application number
PCT/CN2014/084624
Other languages
English (en)
French (fr)
Inventor
卢长烛
贾西贝
Original Assignee
深圳市华傲数据技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市华傲数据技术有限公司 filed Critical 深圳市华傲数据技术有限公司
Publication of WO2015103879A1 publication Critical patent/WO2015103879A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources

Definitions

  • the present invention relates to the field of data repair, and in particular, to a method and system for repairing a data firewall based on rule optimization.
  • the main data systems of these group companies have a unified and strict data management mechanism.
  • the head office will carefully clean the main data.
  • subordinate companies or branches do not have such a perfect data management system.
  • Each subsidiary or branch office often has its own input method when entering the business data to be processed, so that the data forms of different subsidiaries or branches cannot be consistent.
  • errors will be introduced into the main database during the data modification process. In this case, data quality errors may be caused by inconsistent data standards or human factors, which affects the quality of the company's overall data. Therefore, a data repair method for monitoring and repairing data entry is required.
  • the present invention has been made to solve one of the above drawbacks.
  • the present invention provides a method and system for repairing a data firewall based on rule optimization.
  • the firewall system is triggered and optimized according to the determined correct data and the pre-defined rules in the system.
  • the data is reviewed and repaired to further ensure the correctness of the data to be entered, and a data repair method and system for ensuring data correctness and data quality are realized.
  • an embodiment of the present invention provides a method for repairing a data firewall based on rule optimization, the method comprising: triggering a firewall system when the parent system monitors data of the subsystem to be entered into the database; and the firewall system determines the correctness by interacting with the user. Data; the firewall system reviews other uncertain data according to the above correct data and rules, and marks the wrong data; the subsystem updates the above error data according to the reference data, and records the updated data into the child.
  • a database of the system comprising: the firewall system pre-optimizing the rules.
  • firewall system pre-optimizing the rule specifically includes the following steps:
  • the firewall system obtains a list of known rules and a set of determined data attribute sets
  • the user interaction determines that the correct data includes the correct attributes in the data.
  • the determined set of data attributes is determined based on user interaction determining the correct data.
  • said user interaction to determine correct data comprises determining attributes of the data.
  • said determining, according to the logical order of the rules, their dependencies are performed according to attribute values of the rules.
  • said marking the erroneous data comprises marking an error attribute of the data.
  • the updating the erroneous data comprises updating a corresponding attribute of the erroneous data according to a correct value to which the data in the reference data belongs.
  • the invention triggers the firewall system and optimizes other uncertain data according to the determined correct data and the pre-defined rules in the system, thereby further ensuring that the data to be entered is correct.
  • sexuality a data repair method that guarantees data correctness and data quality is realized.
  • Another embodiment of the present invention provides a data firewall repairing system based on rule optimization, the system comprising: a data triggering unit, configured to trigger a firewall system when the parent system monitors data of the subsystem to be entered into the database; the data interaction unit Used by the firewall system to determine the correct data by interacting with the user; the data auditing unit is used by the firewall system to review other uncertain data according to the above correct data and rules, and mark the wrong data; the data update unit, And the subsystem is configured to update the error data according to the reference data, and input the updated data into a database of the subsystem, where the system includes: a rule optimization unit, configured to pre-optimize the rule by the firewall system .
  • firewall system in the rule optimization unit pre-optimizing the rule specifically includes the following steps:
  • the firewall system obtains a list of known rules and a set of determined data attribute sets
  • the invention Traversing the rule set VSet, if the rule set VSet is empty, outputting the confirmed attribute set, otherwise, reviewing and repairing the determined attribute corresponding to the rule in the rule set VSet, and finding other rules introduced by the rule through the dependency, and the rules are The corresponding determined attribute is placed in the rule set VSet step.
  • the invention triggers the firewall system and optimizes other uncertain data according to the determined correct data and the pre-defined rules in the system, thereby further ensuring that the data to be entered is correct.
  • sexuality a data repair system that guarantees data correctness and data quality.
  • FIG. 1 is a schematic flowchart of a method for repairing a data firewall based on rule optimization according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of a specific process of pre-optimizing rules according to another embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a data firewall repair system based on rule optimization according to another embodiment of the present invention.
  • the invention provides a data firewall repairing method and system based on rule optimization.
  • the invention triggers the firewall system by monitoring the data to be recorded by the subsystem, and optimizes according to the determined correct data and the pre-defined rules in the system. Uncertain data is reviewed and repaired to further ensure the correctness of the data to be entered, and a data repair method and system for ensuring data correctness and data quality is realized.
  • FIG. 1 is a schematic flowchart of a method for repairing a data firewall based on rule optimization according to the present invention, which specifically includes the following steps.
  • Step S110 When the parent system monitors the data of the subsystem to be entered into the database, the firewall system is triggered.
  • Step S120 The firewall system determines the correct data by interacting with the user.
  • the user interaction determines that the correct data includes the correct attributes in the data.
  • the correct attribute is judged based on the user's experience, and the user interaction determines that the correct data can be an attribute in a certain data. For example, there is a data to be determined that contains the following attributes: A, B, C, D, E, F, G, H, I.
  • the user can determine one of the pieces according to his own experience and can also determine that the entire data attribute is correct.
  • Step S130 The firewall system reviews other uncertain data according to the above-mentioned correct data and rules, and marks the erroneous data, and the firewall system pre-optimizes the rules.
  • the firewall system pre-optimizing the rules specifically includes the following steps:
  • the firewall system obtains a list of known rules and a set of determined data attribute sets
  • the determined set of data attributes is determined based on user interaction determining the correct data.
  • the determining, based on the logical order of the rules, their dependencies are performed according to attribute values of the rules.
  • the traversal order of the rules is different, and the result of the deduced audit attribute is different.
  • the dependency relationship between the rules needs to be determined according to the attribute value of the rule. For example, it is known that Three rules Rule1: (A, Am)-> (B, Bm)
  • (D '0').
  • Rule2 depends on Rule1 and Rule3 at the same time. That is, when the attribute values contained in any of Rule1 and Rule3 are confirmed, the attribute value of Rule2 may be confirmed. For example, the user interaction determines that the correct attribute is A.
  • the final set of attributes ⁇ B, C ⁇ will be returned as attributes that can be validated by review, and if they are wrong, they can be fixed.
  • Step S140 The subsystem updates the above erroneous data according to the reference data, and records the updated data into the database of the subsystem.
  • the marking the erroneous data includes marking an error attribute of the data
  • updating the erroneous data includes updating a corresponding attribute of the erroneous data according to a correct value to which the data in the reference data belongs.
  • the invention triggers the firewall system and optimizes other uncertain data according to the determined correct data and the pre-defined rules in the system, thereby further ensuring that the data to be entered is correct.
  • sexuality a data repair method that guarantees data correctness and data quality is realized.
  • FIG. 3 is a schematic diagram of a rule-based optimization data firewall repair system according to another embodiment of the present invention.
  • the data triggering unit 10 is configured to: when the parent system monitors data of a subsystem to be entered into a database, Trigger the firewall system.
  • the data interaction unit 20 is used by the firewall system to determine the correct data by interacting with the user.
  • the user interaction determines that the correct data includes the correct attribute in the data, the correct attribute is determined according to the experience of the user, and the user interaction determines that the correct data can be an attribute in a certain data.
  • the correct data can be an attribute in a certain data.
  • the user can determine one of the pieces according to his own experience and can also determine that the entire data attribute is correct.
  • the data review unit 30 is used by the firewall system to review other uncertain data based on the correct data and rules described above, and to flag the erroneous data.
  • the data review unit 30 includes a rule optimization unit 50 for the firewall system to pre-optimize the rules.
  • the firewall system pre-optimizing the rule specifically includes the following steps:
  • the firewall system obtains a list of known rules and a set of determined data attribute sets
  • the data updating unit 40 is configured to: the subsystem updates the erroneous data according to the reference data, and records the updated data into a database of the subsystem.
  • the updating of the erroneous data includes updating a corresponding attribute of the erroneous data according to a correct value to which the data in the reference data belongs.
  • the invention triggers the firewall system and optimizes other uncertain data according to the determined correct data and the pre-defined rules in the system, thereby further ensuring that the data to be entered is correct.
  • sexuality a data repair system that guarantees data correctness and data quality.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Computer And Data Communications (AREA)

Abstract

一种基于规则优化的数据防火墙修复方法，包括：当母系统监测到子系统有待录入数据库的数据时，触发防火墙系统；防火墙系统通过与用户交互来确定正确的数据；防火墙系统对所述规则预先进行优化，根据正确的数据和规则来审核其他不确定的数据并对错误的数据进行标记；子系统根据参考数据对上述错误的数据进行更新。通过对子系统待录入数据的监测，触发防火墙系统并依据已确定的正确数据和对系统中预先制定的规则进行优化对其他不确定数据进行审核与修复，从而进一步确保待录入数据的正确性，实现了一种保证数据正确和数据质量的数据修复方法及系统。另外，还提供一种基于规则优化的数据防火墙修复系统。

Description

一种基于规则优化的数据防火墙修复方法及系统 技术领域
本发明涉及数据修复领域，尤其涉及一种基于规则优化的数据防火墙修复方法及系统。
 背景技术
大型的集团控股公司，拥有总公司和分散到各地的若干子公司或分公司。这些集团股份总公司主数据系统，都有统一、严格的数据管理机制；同时，为了提高基础数据质量，降低业务数据分析处理难度，提高业务数据准确性，总公司会对主数据进行认真的清洗和维护，然而下属的子公司或分公司则并没有如此完善的数据管理体系， 每个子公司或分公司在录入待处理的业务数据时，常常都有自己的输入方式，使得不同子公司或分公司的数据形式无法保持一致。甚至于，因为不同的子公司或分公司最终都会把自己的业务数据汇总到主数据中，在数据的先后修改过程中，会引入错误到主数据库当中。这种情况下，就会因为数据标准不一致或者人为因素会导致数据的错误，影响了公司整体数据的质量，因此需要一种对数据录入时就进行监控与修复的数据修复方法。
 发明内容
为此，本发明为了解决上述缺陷之一。
因而本发明提供一种基于规则优化的数据防火墙修复方法及系统，通过对子系统待录入数据的监测，触发防火墙系统并依据已确定的正确数据和对系统中预先制定的规则进行优化对其他不确定数据进行审核与修复，从而进一步确保待录入数据的正确性，实现了一种保证数据正确和数据质量的数据修复方法及系统。
所以，本发明一个实施例提供一种基于规则优化的数据防火墙修复方法，该方法包括：当母系统监测到子系统有待录入数据库的数据时，触发防火墙系统；防火墙系统通过与用户交互来确定正确的数据；防火墙系统根据上述正确的数据和规则来审核其他不确定的数据，并对错误的数据进行标记；子系统根据参考数据对上述错误的数据进行更新，并将更新后的数据录入到子系统的数据库，所述方法包括：所述防火墙系统对所述规则预先进行优化。
进一步地，所述防火墙系统对所述规则预先进行优化具体包括以下步骤：
防火墙系统获取已知规则列表和已确定的数据属性集合步骤；
根据所述规则的逻辑顺序确定它们的依赖关系步骤；
从上述规则中确定能直接应用的规则集合VSet步骤；
遍历规则集合VSet，如果规则集合VSet为空，则输出确认的属性集合，否则，审核和修复规则集合VSet中规则对应的确定属性，并通过依赖关系找到所述规定推出的其他规则，将这些规则对应的确定属性放入到规则集合VSet中步骤。
优选地，所述用户交互确定正确的数据包括数据中的正确属性。
优选地，所述已确定的数据属性集合根据用户交互确定正确的数据来确定。
优选地，所述用户交互来确定正确的数据包括确定数据的属性。
优选地，所述依据所述规则的逻辑顺序确定它们的依赖关系依据所述规则的属性值进行。
优选地，所述对错误的数据进行标记包括对数据的错误属性进行标记。
优选地，所述对错误的数据进行更新包括根据参考数据中数据所属的正确值更新所述错误数据的对应属性。本发明通过对子系统待录入数据的监测，触发防火墙系统并依据已确定的正确数据和对系统中预先制定的规则进行优化对其他不确定数据进行审核与修复，从而进一步确保待录入数据的正确性，实现了一种保证数据正确和数据质量的数据修复方法。
本发明另一个实施例提供一种基于规则优化的数据防火墙修复系统，所述系统包括：数据触发单元，用于当母系统监测到子系统有待录入数据库的数据时，触发防火墙系统；数据交互单元，用于防火墙系统通过与用户交互来确定正确的数据；数据审核单元，用于防火墙系统根据上述正确的数据和规则来审核其他不确定的数据，并对错误的数据进行标记；数据更新单元，用于子系统根据参考数据对上述错误的数据进行更新，并将更新后的数据录入到子系统的数据库，所述系统包括：规则优化单元，用于所述防火墙系统对所述规则预先进行优化。
进一步地，所述规则优化单元中所述防火墙系统对所述规则预先进行优化具体包括以下步骤：
防火墙系统获取已知规则列表和已确定的数据属性集合步骤；
根据所述规则的逻辑顺序确定它们的依赖关系步骤；
从上述规则中确定能直接应用的规则集合VSet步骤；
遍历规则集合VSet，如果规则集合VSet为空，则输出确认的属性集合，否则，审核和修复规则集合VSet中规则对应的确定属性，并通过依赖关系找到所述规定推出的其他规则，将这些规则对应的确定属性放入到规则集合VSet中步骤。本发明通过对子系统待录入数据的监测，触发防火墙系统并依据已确定的正确数据和对系统中预先制定的规则进行优化对其他不确定数据进行审核与修复，从而进一步确保待录入数据的正确性，实现了一种保证数据正确和数据质量的数据修复系统。
附图说明
图1是本发明一个实施例提供的一种基于规则优化的数据防火墙修复方法的流程示意图。
图2是本发明另一个实施例提供的规则预先进行优化具体流程的示意图。
图3是本发明另一个实施例提供的一种基于规则优化的数据防火墙修复系统的示意图。
具体实施方式
为了使本发明的目的、技术方案及优点更加清楚明白，以下结合附图及实施例，对本发明进行进一步的详细说明。应当理解，此处所描述的具体实施例仅仅用于解释本发明，并不用于限定本发明。
本发明提供一种基于规则优化的数据防火墙修复方法及系统，本发明通过对子系统待录入数据的监测，触发防火墙系统并依据已确定的正确数据和对系统中预先制定的规则进行优化对其他不确定数据进行审核与修复，从而进一步确保待录入数据的正确性，实现了一种保证数据正确和数据质量的数据修复方法及系统。
附图1是本发明提供的一种基于规则优化的数据防火墙修复方法的流程示意图，具体包括以下步骤。
步骤S110：当母系统监测到子系统有待录入数据库的数据时，触发防火墙系统。
步骤S120：防火墙系统通过与用户交互来确定正确的数据。
在本步骤中，所述用户交互确定正确的数据包括数据中的正确属性。所述正确属性根据用户的经验进行判断，所述用户交互来确定正确的数据可以为一条确定数据里的属性。例如：有一条待确定数据包含以下多个属性：A、B、C、D、E、F、G、H、I。用户既可以根据自身经验确定其中某一条也可以确定整条数据属性均为正确。
步骤S130：防火墙系统根据上述正确的数据和规则来审核其他不确定的数据，并对错误的数据进行标记，所述防火墙系统对所述规则预先进行优化。
在本步骤中，如图2本发明一个实施例提供的规则预先进行优化具体流程的示意图所示，所述防火墙系统对所述规则预先进行优化具体包括以下步骤：
防火墙系统获取已知规则列表和已确定的数据属性集合步骤；
根据所述规则的逻辑顺序确定它们的依赖关系步骤；
从上述规则中确定能直接应用的规则集合VSet步骤；
遍历规则集合VSet，如果规则集合VSet为空，则输出确认的属性集合，否则，审核和修复规则集合VSet中规则对应的确定属性，并通过依赖关系找到所述规定推出的其他规则，将这些规则对应的确定属性放入到规则集合VSet中步骤。
所述已确定的数据属性集合根据用户交互确定正确的数据来确定。所述依据所述规则的逻辑顺序确定它们的依赖关系依据所述规则的属性值进行。在本步骤中，对规则的遍历顺序不同，会是推导出来的审核属性结果不一样，那么在本步骤中需要先根据规则的属性值来确定所述规则间的依赖关系，例如，已知有三条规则Rule1:（A，Am）-> (B，Bm)||（），Rule2:（B，Bm）-> (C，Cm)||（），Rule3:（E，Em）-> (B，Bm)||（D =‘0’）。根据这三条规则的属性可知Rule2同时依赖于Rule1和Rule3，也即当Rule1和Rule3中任意一个规则包含的属性值确认后，Rule2的属性值才有可能确认。比如用户交互确定正确属性为A，根据上述规则应用，首先利用Rule1，即当前VSet = {Rule1}。因为VSet不为空，所以我们根据Rule1可以推导出属性B能够被确认。因为Rule2依赖于Rule1，由此得到Rule2在当前情况下是可用的规则，把它放入VSet，此时，VSet = {Rule2}，Rule1已经用完，被删除了。再次使用VSet，能够确认属性C。而此时，VSet是为空了，没有更多的规则可用了。最后属性{B、C}的集合会被返回，作为经过审核能够确认的属性，如果错误，则可以修复它们。
步骤S140：子系统根据参考数据对上述错误的数据进行更新，并将更新后的数据录入到子系统的数据库。
在本步骤中，所述对错误的数据进行标记包括对数据的错误属性进行标记，所述对错误的数据进行更新包括根据参考数据中数据所属的正确值更新所述错误数据的对应属性。如上例中，发现B和C的值为错误，那么我们就把Bm的值更新到B上、Cm的值更新到C上。本发明通过对子系统待录入数据的监测，触发防火墙系统并依据已确定的正确数据和对系统中预先制定的规则进行优化对其他不确定数据进行审核与修复，从而进一步确保待录入数据的正确性，实现了一种保证数据正确和数据质量的数据修复方法。
如图3所示是本发明另一个实施例提供的一种基于规则优化的数据防火墙修复系统的示意图，具体为：数据触发单元10用于当母系统监测到子系统有待录入数据库的数据时，触发防火墙系统。
数据交互单元20用于防火墙系统通过与用户交互来确定正确的数据。
在数据交互单元20中，所述用户交互确定正确的数据包括数据中的正确属性，所述正确属性根据用户的经验进行判断，所述用户交互来确定正确的数据可以为一条确定数据里的属性。例如：有一条待确定数据包含以下多个属性：A、B、C、D、E、F、G、H、I。用户既可以根据自身经验确定其中某一条也可以确定整条数据属性均为正确。
数据审核单元30用于防火墙系统根据上述正确的数据和规则来审核其他不确定的数据，并对错误的数据进行标记。
所述数据审核单元30包括规则优化单元50，所述规则优化单元50用于所述防火墙系统对所述规则预先进行优化。
在所述规则优化单元50中，所述防火墙系统对所述规则预先进行优化具体包括以下步骤：
防火墙系统获取已知规则列表和已确定的数据属性集合步骤；
根据所述规则的逻辑顺序确定它们的依赖关系步骤；
从上述规则中确定能直接应用的规则集合VSet步骤；
遍历规则集合VSet，如果规则集合VSet为空，则输出确认的属性集合，否则，审核和修复规则集合VSet中规则对应的确定属性，并通过依赖关系找到所述规定推出的其他规则，将这些规则对应的确定属性放入到规则集合VSet中步骤。
数据更新单元40，用于子系统根据参考数据对上述错误的数据进行更新，并将更新后的数据录入到子系统的数据库。
在数据更新单元40中，所述对错误的数据进行更新包括根据参考数据中数据所属的正确值更新所述错误数据的对应属性。本发明通过对子系统待录入数据的监测，触发防火墙系统并依据已确定的正确数据和对系统中预先制定的规则进行优化对其他不确定数据进行审核与修复，从而进一步确保待录入数据的正确性，实现了一种保证数据正确和数据质量的数据修复系统。
以上内容是结合具体的优选实施方式对本发明所作的进一步详细说明，不能认定本发明的具体实施只局限于这些说明。对于本发明所属技术领域的普通技术人员来说，在不脱离本发明构思的前提下，还可以做出若干简单推演或替换。

Claims (1)

  1. 1.一种基于规则优化的数据防火墙修复方法，该方法包括：当母系统监测到子系统有待录入数据库的数据时，触发防火墙系统；防火墙系统通过与用户交互来确定正确的数据；防火墙系统根据上述正确的数据和规则来审核其他不确定的数据，并对错误的数据进行标记；子系统根据参考数据对上述错误的数据进行更新，并将更新后的数据录入到子系统的数据库，其特征在于，所述方法包括：所述防火墙系统对所述规则预先进行优化。
    2. 根据权利要求1所述的方法，其特征在于，所述防火墙系统对所述规则预先进行优化具体包括以下步骤：
    防火墙系统获取已知规则列表和已确定的数据属性集合步骤；
    根据所述规则的逻辑顺序确定它们的依赖关系步骤；
    从上述规则中确定能直接应用的规则集合VSet步骤；
    遍历规则集合VSet，如果规则集合VSet为空，则输出确认的属性集合，否则，审核和修复规则集合VSet中规则对应的确定属性，并通过依赖关系找到所述规定推出的其他规则，将这些规则对应的确定属性放入到规则集合VSet中步骤。
    3. 根据权利要求1所述的方法，其特征在于，所述用户交互确定正确的数据包括数据中的正确属性。
    4.根据权利要求2所述的方法，其特征在于，所述已确定的数据属性集合根据用户交互确定正确的数据来确定。
    5. 根据权利要求1或3所述的方法，其特征在于，所述用户交互来确定正确的数据包括确定数据的属性。
    6. 根据权利要求2所述的方法，其特征在于，所述依据所述规则的逻辑顺序确定它们的依赖关系依据所述规则的属性值进行。
    7.根据权利要求1所述的方法，其特征在于，所述对错误的数据进行标记包括对数据的错误属性进行标记。
    8. 根据权利要求1或7所述的方法，其特征在于，所述对错误的数据进行更新包括根据参考数据中数据所属的正确值更新所述错误数据的对应属性。
    9.一种基于防火墙的数据修复方系统，所述系统包括：数据触发单元，用于当母系统监测到子系统有待录入数据库的数据时，触发防火墙系统；
    数据交互单元，用于防火墙系统通过与用户交互来确定正确的数据；
    数据审核单元，用于防火墙系统根据上述正确的数据和规则来审核其他不确定的数据，并对错误的数据进行标记；
    数据更新单元，用于子系统根据参考数据对上述错误的数据进行更新，并将更新后的数据录入到子系统的数据库，其特征在于，所述系统包括：规则优化单元，用于所述防火墙系统对所述规则预先进行优化。
    10. 根据权利要求9所述的系统，其特征在于，所述规则优化单元中所述防火墙系统对所述规则预先进行优化具体包括以下步骤：
    防火墙系统获取已知规则列表和已确定的数据属性集合步骤；
    根据所述规则的逻辑顺序确定它们的依赖关系步骤；
    从上述规则中确定能直接应用的规则集合VSet步骤；
    遍历规则集合VSet，如果规则集合VSet为空，则输出确认的属性集合，否则，审核和修复规则集合VSet中规则对应的确定属性，并通过依赖关系找到所述规定推出的其他规则，将这些规则对应的确定属性放入到规则集合VSet中步骤。
PCT/CN2014/084624 2014-01-07 2014-08-18 一种基于规则优化的数据防火墙修复方法及系统 WO2015103879A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410006102.4 2014-01-07
CN201410006102.4A CN104268007A (zh) 2014-01-07 2014-01-07 一种事件请求分布式调度方法和系统

Publications (1)

Publication Number Publication Date
WO2015103879A1 true WO2015103879A1 (zh) 2015-07-16

Family

ID=52159531

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/084624 WO2015103879A1 (zh) 2014-01-07 2014-08-18 一种基于规则优化的数据防火墙修复方法及系统

Country Status (2)

Country Link
CN (1) CN104268007A (zh)
WO (1) WO2015103879A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106779376A (zh) * 2016-12-02 2017-05-31 温瑭玮 一种快速触发服务器数据检索及数据分析的方法
CN108206789A (zh) * 2016-12-20 2018-06-26 英业达科技有限公司 分段式处理请求的负载均衡系统及其方法
CN108733469B (zh) * 2017-04-24 2021-09-03 北京京东尚科信息技术有限公司 一种分布式系统任务执行的方法和装置
CN110569252B (zh) * 2018-05-16 2023-04-07 杭州海康威视数字技术股份有限公司 一种数据处理系统及方法
CN112231114A (zh) * 2020-09-22 2021-01-15 深圳云天励飞技术股份有限公司 一种事件处理方法及相关设备
CN112597173A (zh) * 2021-03-08 2021-04-02 成都虚谷伟业科技有限公司 一种分布式数据库集群系统对等处理系统及处理方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101706909A (zh) * 2009-11-18 2010-05-12 山东浪潮齐鲁软件产业股份有限公司 一种面向企业数据集成的全面数据质量管理方法
CN103309907A (zh) * 2012-03-16 2013-09-18 上海安捷力信息系统有限公司 对不同来源的业务数据进行规范化处理的方法及系统
CN103713967A (zh) * 2013-12-04 2014-04-09 深圳市华傲数据技术有限公司 一种基于规则优化的数据防火墙修复方法及系统

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7958509B2 (en) * 2005-12-21 2011-06-07 International Business Machines Corporation Method and system for scheduling of jobs
CN102073546B (zh) * 2010-12-13 2013-07-10 北京航空航天大学 一种云计算环境中分布式计算模式下的任务动态调度方法
CN102541640B (zh) * 2011-12-28 2014-10-29 厦门市美亚柏科信息股份有限公司 一种集群gpu资源调度系统和方法
KR20130119285A (ko) * 2012-04-23 2013-10-31 한국전자통신연구원 클러스터 컴퓨팅 환경에서의 자원 할당 장치 및 그 방법
CN103064745B (zh) * 2013-01-09 2015-09-09 苏州亿倍信息技术有限公司 一种任务分配处理的方法及系统

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101706909A (zh) * 2009-11-18 2010-05-12 山东浪潮齐鲁软件产业股份有限公司 一种面向企业数据集成的全面数据质量管理方法
CN103309907A (zh) * 2012-03-16 2013-09-18 上海安捷力信息系统有限公司 对不同来源的业务数据进行规范化处理的方法及系统
CN103713967A (zh) * 2013-12-04 2014-04-09 深圳市华傲数据技术有限公司 一种基于规则优化的数据防火墙修复方法及系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
FAN. WENFEI ET AL.: "CerFix: A System for Cleaning Data with Certain Fixes", PROCEEDINGS OF THE VLDB ENDOWMENT, vol. 4, no. 12, 3 September 2011 (2011-09-03) *

Also Published As

Publication number Publication date
CN104268007A (zh) 2015-01-07

Similar Documents

Publication Publication Date Title
WO2015103880A1 (zh) 一种对批量数据进行自动修复的方法及系统
WO2015103879A1 (zh) 一种基于规则优化的数据防火墙修复方法及系统
CN103019718B (zh) 在集中式源控制环境中使用分布式源控制
US10380143B2 (en) Merging of distributed datasets
WO2015088066A1 (ko) 소프트웨어 품질 평가 모듈과 방법 및 소프트웨어 품질 평가 방법을 실행하기 위한 프로그램을 기록한 컴퓨터로 판독가능한 기록매체
US20120226658A1 (en) Data model versioning for document databases
CN101950296B (zh) 云数据审计的方法及系统
WO2016045193A1 (zh) 一种文件索引组织及修复的方法及装置
Dwaraki et al. GitFlow: Flow revision management for software-defined networks
CN106201502A (zh) 一种跨主机应用程序部署方法及装置
WO2021218142A1 (zh) 数据迁移方法、装置、电子设备及计算机可读存储介质
Matsumura et al. Case report form reporter: a key component for the integration of electronic medical records and the electronic data capture system
CN111367924B (zh) 数据同步方法、装置、电子设备、存储介质
WO2011065660A4 (ko) 계산 시뮬레이션 모사 시스템 및 그 방법
WO2015088067A1 (ko) 소프트웨어 품질 요소 추출 모듈과 방법 및 소프트웨어 품질 요소 추출 방법을 실행하기 위한 프로그램을 기록한 컴퓨터로 판독가능한 기록매체
Edwards Google/SkyWater and the Promise of the Open PDK
CN103716301A (zh) 一种基于防火墙的数据修复方法及系统
WO2015103878A1 (zh) 一种基于防火墙的数据修复方法及系统
WO2009116748A2 (ko) 예약된 컴포넌트 컨테이너 기반 소프트웨어 개발 방법 및 장치
US10832809B2 (en) Case management model processing
CN107544813A (zh) 一种静态库配置的切换方法和系统
CN103713967A (zh) 一种基于规则优化的数据防火墙修复方法及系统
WO2015081725A1 (zh) 一种数据防火墙系统修复数据方法和系统
WO2015067087A1 (zh) 一种属性集推荐方法和装置
Kowalewski artshop: A continuous integration and quality assessment framework for model-based software artifacts

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14877848

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14877848

Country of ref document: EP

Kind code of ref document: A1