CN105786950A - Method and device for processing data - Google Patents
Method and device for processing data Download PDFInfo
- Publication number
- CN105786950A CN105786950A CN201511020530.3A CN201511020530A CN105786950A CN 105786950 A CN105786950 A CN 105786950A CN 201511020530 A CN201511020530 A CN 201511020530A CN 105786950 A CN105786950 A CN 105786950A
- Authority
- CN
- China
- Prior art keywords
- rule
- simple conjunction
- condition
- sequence number
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention discloses a method and a device for processing data. The method comprises the steps of receiving massive data flows, normalizing the massive data and extracting to generate massive structural data; according to keyword fields of at least one preset condition, and according to the keyword fields, matching the structural data; and if the keyword fields with matched contents of the structural data are the same as the keyword fields of the condition of a simple conjunctive formula, acquiring corresponding rule information, and processing the structural data according to the rule information. According to the method and device for processing the data disclosed by the embodiment of the invention, the rules can be customized in real time according to user demand, and the instantaneity is strong; and the customization of rules adopts a standard template, thus the expandability is good; the rules are managed and dispatched in a unified manner via a rule center, and a plurality of systems can be supports; and meanwhile as the rules acquired by the method can be updated in real time, the system stability can be ensured.
Description
Technical field
The present embodiments relate to the technical field of computer information safe, particularly relate to a kind of method processing data and device.
Background technology
Along with the development of information technology, increasing industry needs to be monitored business datum analyzing, and searches the special or specific behavior in data, and for processing accordingly.Ratio is if desired for offender, sensitive words are monitored, and some website needs special IP or account are carried out arranging of blacklist or white list.
Traditional monitoring alarm is roughly divided into two classes: storehouse table data, for be stored in database table by transferring structural data after daily record data normalization to, are inquired about and then carried out Business Processing by a class.The mode treatment effeciency that this kind detects afterwards is low, especially when the data volume of storage reaches a certain amount of time, and lacks ageing, it is impossible to respond in time；Another kind of for adopting the mode of hard coded to mate in real time data, the program coding of correspondence is carried out for task each time, this kind of mode can meet ageing requirement, but when in the face of of a great variety, type is changeable and large batch of business rule, developer is difficult to this is made timely respond to, and business personnel also cannot individually carry out service deployment.
Summary of the invention
The embodiment of the present invention proposes a kind of method processing data and device, it is intended to the problem solving how data carry out operation real-time, expansible, customizable.
First aspect, a kind of method processing data, described method includes:
Receive mass data flow, described mass data is generated after normalized and extraction process the structural data of magnanimity；
Key word field according at least one default condition, and according to described key word fields match structural data, the form of described Rule Information is the form of disjunctive normal form, and described disjunctive normal form includes at least one simple conjunction, and described simple conjunction includes at least one condition；
If the key word field of the content matching of described structural data is identical with the key word field of the condition of described simple conjunction, then obtains the Rule Information of correspondence, and process described structural data according to described Rule Information.
Preferably, if the key word field of the content matching of described structural data is identical with the key word field of the condition of described simple conjunction, then obtain the Rule Information of correspondence, including:
Obtain and all key word fields of the content matching in described structural data, and according to each key word field formation condition respectively；
If all conditions that described all key word fields generate can hit the condition of described simple conjunction simultaneously, then obtain the Rule Information that described simple conjunction is corresponding.
Preferably, if all conditions of described all key word fields generation can hit the condition of described simple conjunction simultaneously, then obtain the Rule Information that described simple conjunction is corresponding, including:
In the inverted index table prestored, inquire about the sequence number of the simple conjunction of correspondence according to described condition, and record the number of times of the sequence number every time inquiring about described simple conjunction；
If the number of times inquiring about the sequence number of described simple conjunction is identical with the number of the condition of described simple conjunction, then from rule identity map table, obtain the sequence number of the disjunctive normal form corresponding with described simple conjunction；
Sequence number according to described disjunctive normal form determines the Rule Information of correspondence from the Rule Information table prestored.
Preferably, described according to the described Rule Information described structural data of process, including:
According to the filtercondition in described Rule Information, from described structural data, obtain the data content meeting described filtercondition；
According to the operational motion in described data processing rule, the data content after filtering is carried out the process corresponding with described operational motion.
Preferably, before described reception mass data flow, also include:
Service center is according to standardization expansible xml language description rule information, and described Rule Information is sent to normalisation rule resolution system, described Rule Information is made up of rule type rule_type, algorithm rule_systemid, rule mark ruleid, logic rules rule, rule-based filtering condition rule_filter, rule action rule_action；
After described normalisation rule resolution system receives described Rule Information, described Rule Information is resolved, described Rule Information is splitted into the form of disjunctive normal form, and be that each simple conjunction subrule in described disjunctive normal form distributes a subrule_id, record the condition number hitnum of each simple conjunction simultaneously；
Wherein, described rule type rule_type is used for defining rule execution action, increases including rule, deletes, updates operation；
Described algorithm rule_systemid issues the operation system of rule for indicating；
Described rule mark ruleid is used for identifying every rule；
Described logic rules rule for representing the logic rule expression of Business Processing, described logic rule expression be support by with or, the complex logic expression formula that forms of bracket；
Described rule-based filtering condition rule_filter is for representing the condition that rule hiting data to filter；
Described rule action rule_action is used for description rule hiting data institute operation to be performed.
Preferably, described method also includes:
The rule type of every rule is obtained from described Rule Information；
If described rule type is for increasing rule, then in the regular data prestored, increase described rule；
If described rule type is deletion rule, then in the regular data prestored, delete the rule of correspondence.
Preferably, described in the regular data prestored, increase described rule, including:
The sequence number of each condition of described simple conjunction and corresponding described simple conjunction is stored in described inverted index table；
The sequence number of described simple conjunction is stored in described identity map table with the sequence number of corresponding disjunctive normal form；
The sequence number of described disjunctive normal form and corresponding Rule Information are stored in described Rule Information table.
Preferably, the described rule deleting correspondence in the regular data prestored, including:
From described deletion rule, obtain the sequence number of disjunctive normal form and corresponding Rule Information, and in described Rule Information table, delete the sequence number of described disjunctive normal form and corresponding Rule Information；
Sequence number according to described disjunctive normal form, obtain the sequence number of corresponding simple conjunction and the condition number of described simple conjunction, and in described rule identity map table, delete the sequence number of the simple conjunction of the sequence number of described disjunctive normal form, correspondence and the condition number of described simple conjunction；
Sequence number according to described simple conjunction, obtains the condition of described simple conjunction, and deletes the sequence number of described simple conjunction and corresponding condition in the described table of falling ranking index.
Preferably, described method also includes:
If rule type is for increasing rule, then obtain the simple conjunction in described increase rule；
According to the simple conjunction in described increase rule, whether the rule that inquiry prestores there is identical simple conjunction, if having, then deleting the Rule Information corresponding with described simple conjunction.
Second aspect, a kind of device processing data, described device includes:
Receiver module, is used for receiving mass data flow, and described mass data generates the structural data of magnanimity after normalized and extraction process；
Matching module, for the key word field according at least one condition preset, and according to described key word fields match structural data, the form of described Rule Information is the form of disjunctive normal form, described disjunctive normal form includes at least one simple conjunction, and described simple conjunction includes at least one condition；
First acquisition module, if the key word field for the content matching of described structural data is identical with the key word field of the condition of described simple conjunction, then obtains the Rule Information of correspondence；
Processing module, for processing described structural data according to described Rule Information.
Preferably, described first acquisition module, including:
First acquiring unit, for obtaining all key word fields with the content matching in described structural data, and according to each key word field formation condition respectively；
Second acquisition unit, if can hit the condition of described simple conjunction in all conditions for the generation of described all key word fields simultaneously, then obtains the Rule Information that described simple conjunction is corresponding.
Preferably, described second acquisition unit, it is used for:
In the inverted index table prestored, inquire about the sequence number of the simple conjunction of correspondence according to described condition, and record the number of times of the sequence number every time inquiring about described simple conjunction；
If the number of times inquiring about the sequence number of described simple conjunction is identical with the number of the condition of described simple conjunction, then from rule identity map table, obtain the sequence number of the disjunctive normal form corresponding with described simple conjunction；
Sequence number according to described disjunctive normal form determines the Rule Information of correspondence from the Rule Information table prestored.
Preferably, described processing module, including:
3rd acquiring unit, for according to the filtercondition in described Rule Information, obtaining the data content meeting described filtercondition from described structural data；
Processing unit, for according to the operational motion in described data processing rule, carrying out the process corresponding with described operational motion to the data content after filtering.
Preferably, described device also includes:
Sending module, for according to standardization expansible xml language description rule information, and described Rule Information is sent to normalisation rule resolution system, described Rule Information is made up of rule type rule_type, algorithm rule_systemid, rule mark ruleid, logic rules rule, rule-based filtering condition rule_filter, rule action rule_action；
Parsing module, after receiving described Rule Information for resolution system, described Rule Information is resolved, described Rule Information is splitted into the form of disjunctive normal form, and be that each simple conjunction subrule in described disjunctive normal form distributes a subrule_id, record the condition number hitnum of each simple conjunction simultaneously；
Wherein, described rule type rule_type is used for defining rule execution action, increases including rule, deletes, updates operation；
Described algorithm rule_systemid issues the operation system of rule for indicating；
Described rule mark ruleid is used for identifying every rule；
Described logic rules rule for representing the logic rule expression of Business Processing, described logic rule expression be support by with or, the complex logic expression formula that forms of bracket；
Described rule-based filtering condition rule_filter is for representing the condition that rule hiting data to filter；
Described rule action rule_action is used for description rule hiting data institute operation to be performed.
Preferably, described device also includes:
Second acquisition module, for obtaining the rule type of every rule from described Rule Information；
Increase module, if for described rule type for increasing rule, then increasing described rule in the regular data prestored；
First removing module, if being deletion rule for described rule type, then deletes the rule of correspondence in the regular data prestored.
Preferably, described increase module, including:
First memory element, for being stored in the sequence number of each condition of described simple conjunction and corresponding described simple conjunction in described inverted index table；
Second memory element, for being stored in the sequence number of described simple conjunction in described identity map table with the sequence number of corresponding disjunctive normal form；
3rd memory element, for being stored in the sequence number of described disjunctive normal form and corresponding Rule Information in described Rule Information table.
Preferably, described removing module, including:
First deletes unit, for obtaining the sequence number of disjunctive normal form and corresponding Rule Information from described deletion rule, and deletes the sequence number of described disjunctive normal form and corresponding Rule Information in described Rule Information table；
Second deletes unit, for the sequence number according to described disjunctive normal form, obtain the sequence number of corresponding simple conjunction and the condition number of described simple conjunction, and in described rule identity map table, delete the sequence number of the simple conjunction of the sequence number of described disjunctive normal form, correspondence and the condition number of described simple conjunction；
3rd deletes unit, for the sequence number according to described simple conjunction, obtains the condition of described simple conjunction, and deletes the sequence number of described simple conjunction and corresponding condition in the described table of falling ranking index.
Preferably, described device also includes:
3rd acquisition module, if for rule type for increasing rule, then obtaining the simple conjunction in described increase rule；
Second removing module, for according to the simple conjunction in described increase rule, whether having identical simple conjunction in the rule that inquiry prestores, if having, then deletes the Rule Information corresponding with described simple conjunction.
The embodiment of the present invention provides a kind of method processing data and device, by receiving mass data flow, described mass data generates after normalized and extraction process the structural data of magnanimity；Key word field according at least one default condition, and according to described key word fields match structural data；If the key word field of the content matching of described structural data is identical with the key word field of the condition of described simple conjunction, then obtain the Rule Information of correspondence, and process described structural data according to described Rule Information, by the demand real-time customization rule according to user, real-time；And the customization of rule uses normalized template, extensibility is strong；Rule is by rule center unified management and issues, and can support multiple system；Meanwhile because the rule of the present invention program can real-time update, thus ensureing the stable stalwartness of system.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of a kind of method processing data that the embodiment of the present invention one provides；
Fig. 2 is the structural representation of a kind of inverted index table that the embodiment of the present invention provides；
Fig. 3 is the structural representation of a kind of rule identity map table that the embodiment of the present invention provides；
Fig. 4 is the structural representation of a kind of Rule Information table that the embodiment of the present invention provides；
Fig. 5 is the schematic flow sheet of a kind of method processing data that the embodiment of the present invention two provides；
Fig. 6 is a kind of master server of providing of the embodiment of the present invention and structural representation from machine；
Fig. 7 is the another kind of master server that provides of the embodiment of the present invention and structural representation from machine；
Fig. 8 is the schematic flow sheet of a kind of method processing data that the embodiment of the present invention three provides；
Fig. 9 is the schematic flow sheet of a kind of method processing data that the embodiment of the present invention four provides；
Figure 10 is the high-level schematic functional block diagram of a kind of device processing data that the embodiment of the present invention five provides.
Detailed description of the invention
Technical scheme is further illustrated below in conjunction with accompanying drawing and by detailed description of the invention.It is understood that specific embodiment described herein is used only for explaining the present invention, but not limitation of the invention.It also should be noted that, for the ease of describing, accompanying drawing illustrate only part related to the present invention but not entire infrastructure.
It should be mentioned that, some exemplary embodiments are described as the process as flow chart description or method before being discussed in greater detail exemplary embodiment.Although every step is described as the process of order by flow chart, but many steps therein can be implemented concurrently, concomitantly or simultaneously.Additionally, the order of every step can be rearranged.When its step completes, described process can be terminated, it is also possible to have the additional step being not included in accompanying drawing.Described process can correspond to method, function, code, subroutine, subprogram etc..
Embodiment one
Fig. 1 is the schematic flow sheet of a kind of method processing data that the embodiment of the present invention one provides.The method can be performed by the device processing data, and wherein this device can be realized by software and/or hardware.As it is shown in figure 1, the method includes:
Step 101, receives mass data flow, described mass data generates the structural data of magnanimity after normalized and extraction process；
Concrete, receiving mass data flow from machine, mass data flow is obtained after data process the structural data of magnanimity, the mode of process includes but not limited to: normalized, extraction process etc..
Step 102, key word field according at least one default condition, and according to described key word fields match structural data, the form of described Rule Information is the form of disjunctive normal form, described disjunctive normal form includes at least one simple conjunction, and described simple conjunction includes at least one condition；
Concrete, for instance operation system Y needs on the IP of 123.123.123.123, search account be examplesohu.com or telephone number be 13800138000 people's qq chat message, then individually put alarm in storage.The regular texture then formed should be:
Rule_type:add；
rule_systemid:Y；
Ruleid:10000123, this id are that rule center generates for rule, and by rule center unified management, id must keep uniqueness；
Rule:(IP=123.123.123.123) with ((account=examplesohu.com) or (telephone number=13800138000))；
Rule_filter: data set=qq chat；
Rule_action: alarm identifier=true；
Disjunctive normal form form: (IP=123.123.123.123) and (account=examplesohu.com) or (IP=123.123.123.123) and (telephone number=13800138000)；
Subrule:
SubruleA:(IP=123.123.123.12) with (account=examplesohu.com)
subrule_idA:a123
hitnumA:2
SubruleB:(IP=123.123.123.123) with (telephone number=13800138000)
subrule_idB:a124
hitnumB:2
sub_subrule:
Sub_subrule_1:(IP=123.123.123.123)
Sub_subrule_2:(account=examplesohu.com)
Sub_subrule_3:(telephone number=13800138000)
Wherein, subruleA, subruleB are simple conjunction, subruleA includes (IP=123.123.123.12) and (account=examplesohu.com) two conditions, and subruleB includes (IP=123.123.123.123) and (telephone number=13800138000) two conditions.Coupling key word field be IP=123.123.123.123,Account=examplesohu.com and telephone number=13800138000。
Step 103, if the key word field of the content matching of described structural data is identical with the key word field of the condition of described simple conjunction, then obtains the Rule Information of correspondence, and processes described structural data according to described Rule Information.
Concrete, according to three key word field IP=123.123.123.123 of coupling,Account =examplesohu.com and telephone number=13800138000Content in coupling structural data, concrete mode is as follows:
Preferably, if the key word field of the content matching of described structural data is identical with the key word field of the condition of described simple conjunction, then obtain the Rule Information of correspondence, including:
Obtain and all key word fields of the content matching in described structural data, and according to each key word field formation condition respectively；
If all conditions that described all key word fields generate can hit the condition of described simple conjunction simultaneously, then obtain the Rule Information that described simple conjunction is corresponding.
Concrete,If a certain structural data energy Match IP=123.123.123.123 and account simultaneously =examplesohu.com, then by each key word field formation condition of coupling, for instance, IP=123.123.123.123 is generated sub_subrule_1,By account=examplesohu.comGenerate sub_subrule_2, the condition generated can hit simple conjunction subruleA:(IP=123.123.123.12 simultaneously) and (account=examplesohu.com), then obtain corresponding rule according to the simple conjunction subruleA of hit.
Preferably, if all conditions of described all key word fields generation can hit the condition of described simple conjunction simultaneously, then obtain the Rule Information that described simple conjunction is corresponding, including:
In the inverted index table prestored, inquire about the sequence number of the simple conjunction of correspondence according to described condition, and record the number of times of the sequence number every time inquiring about described simple conjunction；
If the number of times inquiring about the sequence number of described simple conjunction is identical with the number of the condition of described simple conjunction, then from rule identity map table, obtain the sequence number of the disjunctive normal form corresponding with described simple conjunction；
Sequence number according to described disjunctive normal form determines the Rule Information of correspondence from the Rule Information table prestored.
Concrete, if the condition that the key word field according to coupling generates is sub_subrule_1 and sub_subrule_2, inverted index table as shown in Figure 2 is inquired about the simple conjunction subruleA corresponding with described condition, if two conditions of simple conjunction subruleA can be hit simultaneously, then obtain from regular identity map table as shown in Figure 3 and described rule mark ruleid:10000123 corresponding for simple conjunction subruleA, from the Rule Information table shown in Fig. 4 a and Fig. 4 b, obtain Rule Information according to described rule mark.
Preferably, described according to the described Rule Information described structural data of process, including:
According to the filtercondition in described Rule Information, from described structural data, obtain the data content meeting described filtercondition；
According to the operational motion in described data processing rule, the data content after filtering is carried out the process corresponding with described operational motion.
Concrete, by ruleid to Rule Information table obtains the ruleinfo of correspondence.Obtaining rule-based filtering condition, the rule of data hit is filtered, the rule after filtration is the final rule of data hit.Take out rule action, data are operated accordingly.The operation system of correspondence it is pushed to by rule_systemid.Operation system carries out Real-time Alarm or other business operations to pushing the data come.
The embodiment of the present invention provides a kind of method processing data, by receiving mass data flow, described mass data generates after normalized and extraction process the structural data of magnanimity；Key word field according at least one default condition, and according to described key word fields match structural data；If the key word field of the content matching of described structural data is identical with the key word field of the condition of described simple conjunction, then obtain the Rule Information of correspondence, and process described structural data according to described Rule Information, by the demand real-time customization rule according to user, real-time；And the customization of rule uses normalized template, extensibility is strong；Rule is by rule center unified management and issues, and can support multiple system；Meanwhile because the rule of the present invention program can real-time update, thus ensureing the stable stalwartness of system.
Embodiment two
With reference to the schematic flow sheet that Fig. 5, Fig. 5 are a kind of methods processing data that the embodiment of the present invention two provides.The method can be performed by the device processing data, and wherein this device can be realized by software and/or hardware.As it is shown in figure 5, the method includes:
Step 501, the service center of master server is according to standardization expansible xml language description rule information, and described Rule Information is sent to normalisation rule resolution system, described Rule Information is made up of rule type rule_type, algorithm rule_systemid, rule mark ruleid, logic rules rule, rule-based filtering condition rule_filter, rule action rule_action；
Concrete, as shown in Figure 6, service center passes through normalisation rule, uses standardization expansible xml language description rule information, Rule Information after standardization is by rule type, algorithm, rule id, logic rules, rule-based filtering condition, rule action etc. partly forms.
Step 502, after the described normalisation rule resolution system of master server receives described Rule Information, described Rule Information is resolved, described Rule Information is splitted into the form of disjunctive normal form, and be that each simple conjunction subrule in described disjunctive normal form distributes a subrule_id, record the condition number hitnum of each simple conjunction simultaneously；
Wherein, described rule type rule_type is used for defining rule execution action, increases including rule, deletes, updates operation；
Described algorithm rule_systemid issues the operation system of rule for indicating；
Described rule mark ruleid is used for identifying every rule；
Described logic rules rule for representing the logic rule expression of Business Processing, described logic rule expression be support by with or, the complex logic expression formula that forms of bracket；
Described rule-based filtering condition rule_filter is for representing the condition that rule hiting data to filter；
Described rule action rule_action is used for description rule hiting data institute operation to be performed.
Concrete, after rule parsing system receives the rule of sending down service, rule is resolved, rule is splitted into the form of disjunctive normal form, and to its new id (subrule_id) of each simple conjunction (subrule), record the condition number (hitnum) of each simple conjunction simultaneously.
Step 503, receives mass data flow from machine, described mass data generates the structural data of magnanimity after normalized and extraction process；
Step 504, from machine according to the key word field of at least one condition preset, and according to described key word fields match structural data, the form of described Rule Information is the form of disjunctive normal form, described disjunctive normal form includes at least one simple conjunction, and described simple conjunction includes at least one condition；
Step 505, if identical with the key word field of the condition of described simple conjunction from the key word field of the content matching of the described structural data of machine, then obtain the Rule Information of correspondence, and processes described structural data according to described Rule Information.
Concrete, it is the another kind of master server that provides of the embodiment of the present invention and the structural representation from machine with reference to Fig. 7, Fig. 7.This structure adopts the Redis master-slave pattern supported, read-write service is responsible for by main frame, is only responsible for read operation from machine.Principal and subordinate's mechanism of Redis ensure that the renewal of main frame can be synchronized to from machine fast and accurately, and its incremental update implementation also ensure that the consumption of Internet resources will not be very serious.
Host deployments, on rule parsing system server, is deployed to rule match system from machine, ensures except the master-slave synchronisation of redis cluster with this, the redis operation of individual node.Updating of main frame operates, is all in-local from the query manipulation of machine, is greatly saved Internet resources.
The embodiment of the present invention provides a kind of method processing data, master server service center is according to standardization expansible xml language description rule information, and described Rule Information is sent to the normalisation rule resolution system from machine, after described normalisation rule resolution system receives described Rule Information, described Rule Information is resolved, and according to resolving the rule obtained, data are processed, principal and subordinate's mechanism ensure that the renewal of main frame can be synchronized to from machine fast and accurately, and its incremental update implementation also ensure that the consumption of Internet resources will not be very serious, and the renewal operation of main frame, it it is all in-local from the query manipulation of machine, it is greatly saved Internet resources.
Embodiment three
With reference to the schematic flow sheet that Fig. 8, Fig. 8 are a kind of methods processing data that the embodiment of the present invention three provides.The method can be performed by the device processing data, and wherein this device can be realized by software and/or hardware.To illustrate on the basis of embodiment one, as shown in Figure 8, the method includes:
Step 801, obtains the rule type of every rule from described Rule Information；
Concrete, obtain the rule type in every rule information, i.e. rule_type.
Step 802, if described rule type is for increasing rule, then increases described rule in the regular data prestored；
Concrete, if rule_type is add, then in the regular data prestored, increasing described rule, the mode increasing rule is as follows:
Preferably, described in the regular data prestored, increase described rule, including:
The sequence number of each condition of described simple conjunction and corresponding described simple conjunction is stored in described inverted index table；
The sequence number of described simple conjunction is stored in described identity map table with the sequence number of corresponding disjunctive normal form；
The sequence number of described disjunctive normal form and corresponding Rule Information are stored in described Rule Information table.
Concrete, wall scroll logic rules expression formula is splitted into the form of disjunctive normal form, sub_subrule and subrule_id is added in inverted index table, it is key that subrule_id splices hitnum, ruleid is value access rules identity map table, is added in Rule Information table by ruleid and ruleinfo.
Step 803, if described rule type is deletion rule, then deletes the rule of correspondence in the regular data prestored；
Concrete, if rule_type is del, then in the regular data prestored, delete described rule, the mode of deletion rule is as follows:
Preferably, the described rule deleting correspondence in the regular data prestored, including:
From described deletion rule, obtain the sequence number of disjunctive normal form and corresponding Rule Information, and in described Rule Information table, delete the sequence number of described disjunctive normal form and corresponding Rule Information；
Sequence number according to described disjunctive normal form, obtain the sequence number of corresponding simple conjunction and the condition number of described simple conjunction, and in described rule identity map table, delete the sequence number of the simple conjunction of the sequence number of described disjunctive normal form, correspondence and the condition number of described simple conjunction；
Sequence number according to described simple conjunction, obtains the condition of described simple conjunction, and deletes the sequence number of described simple conjunction and corresponding condition in the described table of falling ranking index.
Concrete, Rule Information table is inquired about ruleinfo corresponding to ruleid, and deletes this record.From ruleinfo, take out subrule_id#hitnum, delete in rule identity map table, from ruleinfo, take out sub_subrule, delete in inverted index table.
Step 804, receives mass data flow, described mass data generates the structural data of magnanimity after normalized and extraction process；
Step 805, key word field according at least one default condition, and according to described key word fields match structural data, the form of described Rule Information is the form of disjunctive normal form, described disjunctive normal form includes at least one simple conjunction, and described simple conjunction includes at least one condition；
Step 806, if the key word field of the content matching of described structural data is identical with the key word field of the condition of described simple conjunction, then obtains the Rule Information of correspondence, and processes described structural data according to described Rule Information.
The embodiment of the present invention provides a kind of method processing data, by obtaining the rule type of every rule from described Rule Information, if described rule type is for increasing rule, in the regular data prestored, then increase described rule, if described rule type is deletion rule, then delete in the regular data prestored correspondence rule, it is possible to ensure the present invention program rule can real-time update, thus ensureing the stable stalwartness of system.
Embodiment four
With reference to the schematic flow sheet that Fig. 9, Fig. 9 are a kind of methods processing data that the embodiment of the present invention four provides.The method can be performed by the device processing data, and wherein this device can be realized by software and/or hardware.To illustrate on the basis of embodiment three, as it is shown in figure 9, the method includes:
Step 901, obtains the rule type of every rule from described Rule Information；
Step 902, if rule type is for increasing rule, then obtains the simple conjunction in described increase rule；
Whether step 903, according to the simple conjunction in described increase rule, have identical simple conjunction in the rule that inquiry prestores, if having identical simple conjunction in the rule prestored of inquiry, then deletes the Rule Information corresponding with described simple conjunction.
Step 904, if not having identical simple conjunction in the rule prestored of inquiry, then increases described rule in the regular data prestored；
Step 905, if described rule type is deletion rule, then deletes the rule of correspondence in the regular data prestored.
The embodiment of the present invention provides a kind of method processing data, by obtaining the rule type of every rule from described Rule Information, if rule type is for increasing rule, then obtain the simple conjunction in described increase rule, according to the simple conjunction in described increase rule, whether the rule that inquiry prestores there is identical simple conjunction, if the rule prestored of inquiry has identical simple conjunction, then delete the Rule Information corresponding with described simple conjunction, thus avoiding the corresponding multiple rules of a simple conjunction, reduce the probability of maloperation.
Embodiment five
With reference to the high-level schematic functional block diagram that Figure 10, Figure 10 are a kind of devices processing data that the embodiment of the present invention five provides.This device can process the method for data by execution and realize, and wherein this device can be realized by software and/or hardware.As shown in Figure 10, this device includes:
Receiver module 1001, is used for receiving mass data flow, and described mass data generates the structural data of magnanimity after normalized and extraction process；
Matching module 1002, for the key word field according at least one condition preset, and according to described key word fields match structural data, the form of described Rule Information is the form of disjunctive normal form, described disjunctive normal form includes at least one simple conjunction, and described simple conjunction includes at least one condition；
First acquisition module 1003, if the key word field for the content matching of described structural data is identical with the key word field of the condition of described simple conjunction, then obtains the Rule Information of correspondence；
Preferably, described first acquisition module 1003, including:
First acquiring unit, for obtaining all key word fields with the content matching in described structural data, and according to each key word field formation condition respectively；
Second acquisition unit, if can hit the condition of described simple conjunction in all conditions for the generation of described all key word fields simultaneously, then obtains the Rule Information that described simple conjunction is corresponding.
Preferably, described second acquisition unit, it is used for:
In the inverted index table prestored, inquire about the sequence number of the simple conjunction of correspondence according to described condition, and record the number of times of the sequence number every time inquiring about described simple conjunction；
If the number of times inquiring about the sequence number of described simple conjunction is identical with the number of the condition of described simple conjunction, then from rule identity map table, obtain the sequence number of the disjunctive normal form corresponding with described simple conjunction；
Sequence number according to described disjunctive normal form determines the Rule Information of correspondence from the Rule Information table prestored.
Processing module 1004, for processing described structural data according to described Rule Information.
Preferably, described processing module, including:
3rd acquiring unit, for according to the filtercondition in described Rule Information, obtaining the data content meeting described filtercondition from described structural data；
Processing unit, for according to the operational motion in described data processing rule, carrying out the process corresponding with described operational motion to the data content after filtering.
Further, described device also includes:
Sending module, for according to standardization expansible xml language description rule information, and described Rule Information is sent to normalisation rule resolution system, described Rule Information is made up of rule type rule_type, algorithm rule_systemid, rule mark ruleid, logic rules rule, rule-based filtering condition rule_filter, rule action rule_action；
Parsing module, after receiving described Rule Information for resolution system, described Rule Information is resolved, described Rule Information is splitted into the form of disjunctive normal form, and be that each simple conjunction subrule in described disjunctive normal form distributes a subrule_id, record the condition number hitnum of each simple conjunction simultaneously；
Wherein, described rule type rule_type is used for defining rule execution action, increases including rule, deletes, updates operation；
Described algorithm rule_systemid issues the operation system of rule for indicating；
Described rule mark ruleid is used for identifying every rule；
Described logic rules rule for representing the logic rule expression of Business Processing, described logic rule expression be support by with or, the complex logic expression formula that forms of bracket；
Described rule-based filtering condition rule_filter is for representing the condition that rule hiting data to filter；
Described rule action rule_action is used for description rule hiting data institute operation to be performed.
Further, described device also includes:
Second acquisition module, for obtaining the rule type of every rule from described Rule Information；
Increase module, if for described rule type for increasing rule, then increasing described rule in the regular data prestored；
First removing module, if being deletion rule for described rule type, then deletes the rule of correspondence in the regular data prestored.
Preferably, described increase module, including:
First memory element, for being stored in the sequence number of each condition of described simple conjunction and corresponding described simple conjunction in described inverted index table；
Second memory element, for being stored in the sequence number of described simple conjunction in described identity map table with the sequence number of corresponding disjunctive normal form；
3rd memory element, for being stored in the sequence number of described disjunctive normal form and corresponding Rule Information in described Rule Information table.
Preferably, described removing module, including:
First deletes unit, for obtaining the sequence number of disjunctive normal form and corresponding Rule Information from described deletion rule, and deletes the sequence number of described disjunctive normal form and corresponding Rule Information in described Rule Information table；
Second deletes unit, for the sequence number according to described disjunctive normal form, obtain the sequence number of corresponding simple conjunction and the condition number of described simple conjunction, and in described rule identity map table, delete the sequence number of the simple conjunction of the sequence number of described disjunctive normal form, correspondence and the condition number of described simple conjunction；
3rd deletes unit, for the sequence number according to described simple conjunction, obtains the condition of described simple conjunction, and deletes the sequence number of described simple conjunction and corresponding condition in the described table of falling ranking index.
Further, described device also includes:
3rd acquisition module, if for rule type for increasing rule, then obtaining the simple conjunction in described increase rule；
Second removing module, for according to the simple conjunction in described increase rule, whether having identical simple conjunction in the rule that inquiry prestores, if having, then deletes the Rule Information corresponding with described simple conjunction.
The embodiment of the present invention provides a kind of device processing data, by receiving mass data flow, described mass data generates after normalized and extraction process the structural data of magnanimity；Key word field according at least one default condition, and according to described key word fields match structural data；If the key word field of the content matching of described structural data is identical with the key word field of the condition of described simple conjunction, then obtain the Rule Information of correspondence, and process described structural data according to described Rule Information, by the demand real-time customization rule according to user, real-time；And the customization of rule uses normalized template, extensibility is strong；Rule is by rule center unified management and issues, and can support multiple system；Meanwhile because the rule of the present invention program can real-time update, thus ensureing the stable stalwartness of system.
Note, above are only presently preferred embodiments of the present invention and institute's application technology principle.It will be appreciated by those skilled in the art that and the invention is not restricted to specific embodiment described here, various obvious change can be carried out for a person skilled in the art, readjust and substitute without departing from protection scope of the present invention.Therefore, although the present invention being described in further detail by above example, but the present invention is not limited only to above example, when without departing from present inventive concept, other Equivalent embodiments more can also be included, and the scope of the present invention is determined by appended right.
Claims (10)
1. the method processing data, it is characterised in that described method includes:
Receive mass data flow, described mass data is generated after normalized and extraction process the structural data of magnanimity；
Key word field according at least one default condition, and according to described key word fields match structural data, the form of described Rule Information is the form of disjunctive normal form, and described disjunctive normal form includes at least one simple conjunction, and described simple conjunction includes at least one condition；
If the key word field of the content matching of described structural data is identical with the key word field of the condition of described simple conjunction, then obtains the Rule Information of correspondence, and process described structural data according to described Rule Information.
2. method according to claim 1, it is characterised in that if the key word field of the content matching of described structural data is identical with the key word field of the condition of described simple conjunction, then obtain the Rule Information of correspondence, including:
Obtain and all key word fields of the content matching in described structural data, and according to each key word field formation condition respectively；
If all conditions that described all key word fields generate can hit the condition of described simple conjunction simultaneously, then obtain the Rule Information that described simple conjunction is corresponding；
If all conditions that described all key word fields generate can hit the condition of described simple conjunction simultaneously, then obtain the Rule Information that described simple conjunction is corresponding, including:
In the inverted index table prestored, inquire about the sequence number of the simple conjunction of correspondence according to described condition, and record the number of times of the sequence number every time inquiring about described simple conjunction；
If the number of times inquiring about the sequence number of described simple conjunction is identical with the number of the condition of described simple conjunction, then from rule identity map table, obtain the sequence number of the disjunctive normal form corresponding with described simple conjunction；
Sequence number according to described disjunctive normal form determines the Rule Information of correspondence from the Rule Information table prestored.
3. method according to claim 1, it is characterised in that described according to the described Rule Information described structural data of process, including:
According to the filtercondition in described Rule Information, from described structural data, obtain the data content meeting described filtercondition；
According to the operational motion in described data processing rule, the data content after filtering is carried out the process corresponding with described operational motion.
4. the method according to claims 1 to 3 any one, it is characterised in that before described reception mass data flow, also include:
Service center is according to standardization expansible xml language description rule information, and described Rule Information is sent to normalisation rule resolution system, described Rule Information is made up of rule type rule_type, algorithm rule_systemid, rule mark ruleid, logic rules rule, rule-based filtering condition rule_filter, rule action rule_action；
After described normalisation rule resolution system receives described Rule Information, described Rule Information is resolved, described Rule Information is splitted into the form of disjunctive normal form, and be that each simple conjunction subrule in described disjunctive normal form distributes a subrule_id, record the condition number hitnum of each simple conjunction simultaneously；
Wherein, described rule type rule_type is used for defining rule execution action, increases including rule, deletes, updates operation；
Described algorithm rule_systemid issues the operation system of rule for indicating；
Described rule mark ruleid is used for identifying every rule；
Described logic rules rule for representing the logic rule expression of Business Processing, described logic rule expression be support by with or, the complex logic expression formula that forms of bracket；
Described rule-based filtering condition rule_filter is for representing the condition that rule hiting data to filter；
Described rule action rule_action is used for description rule hiting data institute operation to be performed.
5. the method according to claims 1 to 3 any one, it is characterised in that described method also includes:
The rule type of every rule is obtained from described Rule Information；
If described rule type is for increasing rule, then in the regular data prestored, increase described rule；
If described rule type is deletion rule, then in the regular data prestored, delete the rule of correspondence；
Described in the regular data prestored, increase described rule, including:
The sequence number of each condition of described simple conjunction and corresponding described simple conjunction is stored in described inverted index table；
The sequence number of described simple conjunction is stored in described identity map table with the sequence number of corresponding disjunctive normal form；
The sequence number of described disjunctive normal form and corresponding Rule Information are stored in described Rule Information table；
The described rule deleting correspondence in the regular data prestored, including:
From described deletion rule, obtain the sequence number of disjunctive normal form and corresponding Rule Information, and in described Rule Information table, delete the sequence number of described disjunctive normal form and corresponding Rule Information；
Sequence number according to described disjunctive normal form, obtain the sequence number of corresponding simple conjunction and the condition number of described simple conjunction, and in described rule identity map table, delete the sequence number of the simple conjunction of the sequence number of described disjunctive normal form, correspondence and the condition number of described simple conjunction；
Sequence number according to described simple conjunction, obtains the condition of described simple conjunction, and deletes the sequence number of described simple conjunction and corresponding condition in the described table of falling ranking index.
6. method according to claim 5, it is characterised in that described method also includes:
If rule type is for increasing rule, then obtain the simple conjunction in described increase rule；
According to the simple conjunction in described increase rule, whether the rule that inquiry prestores there is identical simple conjunction, if having, then deleting the Rule Information corresponding with described simple conjunction.
7. the device processing data, it is characterised in that described device includes:
Receiver module, is used for receiving mass data flow, and described mass data generates the structural data of magnanimity after normalized and extraction process；
Matching module, for the key word field according at least one condition preset, and according to described key word fields match structural data, the form of described Rule Information is the form of disjunctive normal form, described disjunctive normal form includes at least one simple conjunction, and described simple conjunction includes at least one condition；
First acquisition module, if the key word field for the content matching of described structural data is identical with the key word field of the condition of described simple conjunction, then obtains the Rule Information of correspondence；
Processing module, for processing described structural data according to described Rule Information.
8. device according to claim 7, it is characterised in that described first acquisition module, including:
First acquiring unit, for obtaining all key word fields with the content matching in described structural data, and according to each key word field formation condition respectively；
Second acquisition unit, if can hit the condition of described simple conjunction in all conditions for the generation of described all key word fields simultaneously, then obtains the Rule Information that described simple conjunction is corresponding；
Described second acquisition unit, is used for:
In the inverted index table prestored, inquire about the sequence number of the simple conjunction of correspondence according to described condition, and record the number of times of the sequence number every time inquiring about described simple conjunction；
If the number of times inquiring about the sequence number of described simple conjunction is identical with the number of the condition of described simple conjunction, then from rule identity map table, obtain the sequence number of the disjunctive normal form corresponding with described simple conjunction；
Sequence number according to described disjunctive normal form determines the Rule Information of correspondence from the Rule Information table prestored.
9. device according to claim 7, it is characterised in that described processing module, including:
3rd acquiring unit, for according to the filtercondition in described Rule Information, obtaining the data content meeting described filtercondition from described structural data；
Processing unit, for according to the operational motion in described data processing rule, carrying out the process corresponding with described operational motion to the data content after filtering.
10. the device according to claim 7 to 9 any one, it is characterised in that described device also includes:
Sending module, for according to standardization expansible xml language description rule information, and described Rule Information is sent to normalisation rule resolution system, described Rule Information is made up of rule type rule_type, algorithm rule_systemid, rule mark ruleid, logic rules rule, rule-based filtering condition rule_filter, rule action rule_action；
Parsing module, after receiving described Rule Information for resolution system, described Rule Information is resolved, described Rule Information is splitted into the form of disjunctive normal form, and be that each simple conjunction subrule in described disjunctive normal form distributes a subrule_id, record the condition number hitnum of each simple conjunction simultaneously；
Wherein, described rule type rule_type is used for defining rule execution action, increases including rule, deletes, updates operation；
Described algorithm rule_systemid issues the operation system of rule for indicating；
Described rule mark ruleid is used for identifying every rule；
Described logic rules rule for representing the logic rule expression of Business Processing, described logic rule expression be support by with or, the complex logic expression formula that forms of bracket；
Described rule-based filtering condition rule_filter is for representing the condition that rule hiting data to filter；
Described rule action rule_action is used for description rule hiting data institute operation to be performed；
Described device also includes:
Second acquisition module, for obtaining the rule type of every rule from described Rule Information；
Increase module, if for described rule type for increasing rule, then increasing described rule in the regular data prestored；
First removing module, if being deletion rule for described rule type, then deletes the rule of correspondence in the regular data prestored；
Described increase module, including:
First memory element, for being stored in the sequence number of each condition of described simple conjunction and corresponding described simple conjunction in described inverted index table；
Second memory element, for being stored in the sequence number of described simple conjunction in described identity map table with the sequence number of corresponding disjunctive normal form；
3rd memory element, for being stored in the sequence number of described disjunctive normal form and corresponding Rule Information in described Rule Information table；
Described removing module, including:
First deletes unit, for obtaining the sequence number of disjunctive normal form and corresponding Rule Information from described deletion rule, and deletes the sequence number of described disjunctive normal form and corresponding Rule Information in described Rule Information table；
Second deletes unit, for the sequence number according to described disjunctive normal form, obtain the sequence number of corresponding simple conjunction and the condition number of described simple conjunction, and in described rule identity map table, delete the sequence number of the simple conjunction of the sequence number of described disjunctive normal form, correspondence and the condition number of described simple conjunction；
3rd deletes unit, for the sequence number according to described simple conjunction, obtains the condition of described simple conjunction, and deletes the sequence number of described simple conjunction and corresponding condition in the described table of falling ranking index；
Described device also includes:
3rd acquisition module, if for rule type for increasing rule, then obtaining the simple conjunction in described increase rule；
Second removing module, for according to the simple conjunction in described increase rule, whether having identical simple conjunction in the rule that inquiry prestores, if having, then deletes the Rule Information corresponding with described simple conjunction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511020530.3A CN105786950A (en) | 2015-12-30 | 2015-12-30 | Method and device for processing data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511020530.3A CN105786950A (en) | 2015-12-30 | 2015-12-30 | Method and device for processing data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105786950A true CN105786950A (en) | 2016-07-20 |
Family
ID=56390369
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201511020530.3A Pending CN105786950A (en) | 2015-12-30 | 2015-12-30 | Method and device for processing data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105786950A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106503214A (en) * | 2016-11-03 | 2017-03-15 | 北京中安智达科技有限公司 | A kind of complex rule matching process based on Redis memory databases |
| CN106570064A (en) * | 2016-10-10 | 2017-04-19 | 上海瀚之友信息技术服务有限公司 | Real time calculating system and method for general structural data |
| CN106874354A (en) * | 2016-12-28 | 2017-06-20 | 北京五八信息技术有限公司 | A kind of daily record data screening technique and device |
| CN108509478A (en) * | 2017-11-23 | 2018-09-07 | 平安科技（深圳）有限公司 | Fractionation call method, electronic device and the storage medium of regulation engine file |
| CN109857833A (en) * | 2018-12-30 | 2019-06-07 | 贝壳技术有限公司 | A kind of regulation engine implementation method, device and electronic equipment |
| CN110188113A (en) * | 2019-05-09 | 2019-08-30 | 厦门市美亚柏科信息股份有限公司 | Method, device and storage medium for comparing data by using complex expression |
| CN110287255A (en) * | 2019-05-23 | 2019-09-27 | 深圳壹账通智能科技有限公司 | Data sharing method, device and computer equipment based on user behavior |
| CN110442633A (en) * | 2019-08-12 | 2019-11-12 | 南京医渡云医学技术有限公司 | Structural data generation method and device, storage medium and electronic equipment |
| CN110502546A (en) * | 2019-08-22 | 2019-11-26 | 郑州阿帕斯科技有限公司 | A kind of data processing method and device |
| CN110750539A (en) * | 2019-10-16 | 2020-02-04 | 杭州安恒信息技术股份有限公司 | Redis database-based information query method and device and electronic equipment |
| CN111930383A (en) * | 2020-06-30 | 2020-11-13 | 广西东信易联科技有限公司 | Business processing engine based on lightweight rule and processing method of business system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6662235B1 (en) * | 2000-08-24 | 2003-12-09 | International Business Machines Corporation | Methods systems and computer program products for processing complex policy rules based on rule form type |
| CN101216825A (en) * | 2007-12-29 | 2008-07-09 | 朱廷劭 | Indexing key words extraction/ prediction method, on-line advertisement recommendation method and device |
| CN101751434A (en) * | 2008-12-16 | 2010-06-23 | 北大方正集团有限公司 | Meta search engine ranking method and Meta search engine |
| WO2011061631A1 (en) * | 2009-11-20 | 2011-05-26 | Kim Mo | Intelligent search system |
| CN103064842A (en) * | 2011-10-20 | 2013-04-24 | 北京中搜网络技术股份有限公司 | Information subscription processing device and information subscription processing method |
| CN104750781A (en) * | 2015-03-06 | 2015-07-01 | 合一信息技术（北京）有限公司 | Advertisement retrieval method |
-
2015
- 2015-12-30 CN CN201511020530.3A patent/CN105786950A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6662235B1 (en) * | 2000-08-24 | 2003-12-09 | International Business Machines Corporation | Methods systems and computer program products for processing complex policy rules based on rule form type |
| CN101216825A (en) * | 2007-12-29 | 2008-07-09 | 朱廷劭 | Indexing key words extraction/ prediction method, on-line advertisement recommendation method and device |
| CN101751434A (en) * | 2008-12-16 | 2010-06-23 | 北大方正集团有限公司 | Meta search engine ranking method and Meta search engine |
| WO2011061631A1 (en) * | 2009-11-20 | 2011-05-26 | Kim Mo | Intelligent search system |
| CN103064842A (en) * | 2011-10-20 | 2013-04-24 | 北京中搜网络技术股份有限公司 | Information subscription processing device and information subscription processing method |
| CN104750781A (en) * | 2015-03-06 | 2015-07-01 | 合一信息技术（北京）有限公司 | Advertisement retrieval method |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106570064A (en) * | 2016-10-10 | 2017-04-19 | 上海瀚之友信息技术服务有限公司 | Real time calculating system and method for general structural data |
| CN106503214A (en) * | 2016-11-03 | 2017-03-15 | 北京中安智达科技有限公司 | A kind of complex rule matching process based on Redis memory databases |
| CN106874354A (en) * | 2016-12-28 | 2017-06-20 | 北京五八信息技术有限公司 | A kind of daily record data screening technique and device |
| CN108509478A (en) * | 2017-11-23 | 2018-09-07 | 平安科技（深圳）有限公司 | Fractionation call method, electronic device and the storage medium of regulation engine file |
| WO2019100646A1 (en) * | 2017-11-23 | 2019-05-31 | 平安科技（深圳）有限公司 | Method, electronic device, and storage medium for splitting and calling rule engine file |
| CN109857833A (en) * | 2018-12-30 | 2019-06-07 | 贝壳技术有限公司 | A kind of regulation engine implementation method, device and electronic equipment |
| CN110188113A (en) * | 2019-05-09 | 2019-08-30 | 厦门市美亚柏科信息股份有限公司 | Method, device and storage medium for comparing data by using complex expression |
| CN110188113B (en) * | 2019-05-09 | 2022-05-13 | 厦门市美亚柏科信息股份有限公司 | Method, device and storage medium for comparing data by using complex expression |
| CN110287255A (en) * | 2019-05-23 | 2019-09-27 | 深圳壹账通智能科技有限公司 | Data sharing method, device and computer equipment based on user behavior |
| CN110442633A (en) * | 2019-08-12 | 2019-11-12 | 南京医渡云医学技术有限公司 | Structural data generation method and device, storage medium and electronic equipment |
| CN110502546A (en) * | 2019-08-22 | 2019-11-26 | 郑州阿帕斯科技有限公司 | A kind of data processing method and device |
| CN110750539A (en) * | 2019-10-16 | 2020-02-04 | 杭州安恒信息技术股份有限公司 | Redis database-based information query method and device and electronic equipment |
| CN111930383A (en) * | 2020-06-30 | 2020-11-13 | 广西东信易联科技有限公司 | Business processing engine based on lightweight rule and processing method of business system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105786950A (en) | Method and device for processing data | |
| US10237295B2 (en) | Automated event ID field analysis on heterogeneous logs | |
| CN102918534B (en) | Inquiry pipeline | |
| CN112434059B (en) | Data processing method, data processing device, computer equipment and storage medium | |
| CN103827810A (en) | Asset model import connector | |
| CN110855473A (en) | Monitoring method, device, server and storage medium | |
| CN112685433B (en) | Metadata updating method and device, electronic equipment and computer-readable storage medium | |
| CN103678494A (en) | Method and device for client side and server side data synchronization | |
| CN111026874A (en) | Data processing method and server of knowledge graph | |
| JP2009099124A (en) | Method and system for data construction | |
| CN111859132A (en) | Data processing method and device, intelligent equipment and storage medium | |
| CN115858513A (en) | Data governance method, data governance device, computer equipment and storage medium | |
| CN113672692B (en) | Data processing method, data processing device, computer equipment and storage medium | |
| CN104378233A (en) | Equipment unified management method, incorporation method and corresponding devices | |
| CN112860653A (en) | Government affair information resource catalog management method and system | |
| Rama Satish et al. | Hybrid optimization in big data: error detection and data repairing by big data cleaning using CSO-GSA | |
| CN114138778A (en) | Data processing system, method, device, equipment and computer readable medium | |
| JP7381290B2 (en) | Computer system and data management method | |
| JP2016143388A (en) | Log information classification device, log information classification method and program | |
| CN113065801A (en) | Organization architecture management method, device, equipment and storage medium | |
| WO2015125483A1 (en) | Telegraphic message conversion system and telegraphic message conversion method for use in m2m | |
| CN112257284A (en) | Design knowledge tracing method and system in CAD system based on block chain | |
| JP5466191B2 (en) | Access control system, server management device, data storage device, access control method, server management program, and data storage program | |
| JP7466416B2 (en) | Asset management device and asset management program | |
| WO2014177201A1 (en) | Method and system for storing geometrical objects in a database |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination |