CN110287174A - A kind of data filtering engine and system and filter method - Google Patents

A kind of data filtering engine and system and filter method Download PDF

Info

Publication number
CN110287174A
CN110287174A CN201910385548.5A CN201910385548A CN110287174A CN 110287174 A CN110287174 A CN 110287174A CN 201910385548 A CN201910385548 A CN 201910385548A CN 110287174 A CN110287174 A CN 110287174A
Authority
CN
China
Prior art keywords
rule
filtering
udf
data
code tree
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910385548.5A
Other languages
Chinese (zh)
Inventor
杨超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Shanyi Shanmei Technology Co Ltd
Original Assignee
Beijing Shanyi Shanmei Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Shanyi Shanmei Technology Co Ltd filed Critical Beijing Shanyi Shanmei Technology Co Ltd
Priority to CN201910385548.5A priority Critical patent/CN110287174A/en
Publication of CN110287174A publication Critical patent/CN110287174A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/215Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors

Abstract

The present invention relates to a kind of data filtering engine and system and filter methods, belong to data cleansing technical field.The data filtering engine includes: rule-interpreter, is configured for converting filtering rule to corresponding code tree, and the code tree includes at least a UDF;And filtering module, it is configured for calling the UDF processing initial data in the filtering rule, determines whether the initial data meets the filtering rule according to the output valve of UDF final in each filtering rule.The present invention not only reduces the communication cost of rule author and developer, simplifies the process of exploitation and test, and can change filter condition by alteration ruler, adaptable, easy to operate.

Description

A kind of data filtering engine and system and filter method
Technical field
The present invention relates to data cleansing technical field, particularly a kind of data filtering engine and system and filtering side Method.
Background technique
In internet of today, big data era, data cleansing is a more and more important thing.For an enterprise or For one platform, daily, even per second a large amount of internal data and/or external data can be all generated.Hash is not only Valuable space can be occupied, data analysis is can also interfere with, causes the consequence that errors of analytical results is big, with a low credibility.Even having May also be different with the format of data, same type data, it needs to be normalized, or count initial data According to completion or deletion, then can just continue to use.
Filter out necessity that hash is data cleansing and important processing means.Common filters are roots According to needing to design different Filtering systems, hash is distinguished by setting screening, filtering rule.In actual implementation, institute It states screening, the design of filtering rule and the filtering rule is applied in data cleansing usually by different department or different Personnel complete.For example, in a vehicle transaction platform, according to the rules, only meeting the information of vehicles of Platform Requirements just can be with It is published on platform.Usually, platform product manager formulates filtering rule, for determining which information for being submitted to platform can To announce in platform, which information cannot be announced in platform.Platform development personnel implement the filtering rule in the platform, will The information filtering for meeting filtering rule is fallen, to prevent the information announcement on platform.Due to background difference, in order to accurate The filtering rule that product manager formulates is implemented on ground, and developer needs to link up and confirm repeatedly with product manager, though one very The change of fraction, it is also desirable to which the confirmation of product manager, this mode not only increase the communication cost of both sides, consume both sides A large amount of energy, and extend exploitation and test process.
Summary of the invention
For the technical problems in the prior art, the invention proposes a kind of data filtering engine and system and filterings Method simplifies the process of exploitation with test for reducing cost is linked up.
In order to solve the above-mentioned technical problems, the present invention provides a kind of data filtering engines, comprising: rule-interpreter, warp It is configured to convert filtering rule to corresponding code tree, the code tree includes at least a UDF (User Defined Function custom function);And filtering module, it is configured for calling the UDF processing original number in the filtering rule According to determining whether the initial data meets the filtering rule according to the output valve of UDF final in each filtering rule.
Preferably, the rule-interpreter includes: rule analysis unit, is configured for identifying symbol from filtering rule Close the function keyword of syntax rule;And function matching unit, it is configured for by matching the function keyword and The UDF of registration determines UDF corresponding with the filtering rule;And code tree generation unit, it is configured for basis and has determined that UDF generate filtering rule code tree.
Preferably, the structure of the code tree includes UDF title, type and parameter list, wherein type and parameter list It can be sky.
Preferably, the data filtering engine further include: regular loading module is configured for according to rule load ginseng Number load filtering rule, and the filtering rule is passed into the rule-interpreter.
Preferably, the data filtering engine further include: configuration loading module, be configured for loading the rule plus The filtration parameter that the parameter and filtering module used when carrying parameter, converting corresponding code tree for filtering rule uses.
Preferably, the data filtering engine further include: UDF loading module is configured for load filtering rule generation UDF in code tree.
The present invention provides a kind of data filtering systems, comprising: system configuration module is configured for configuring the rule The parameter and filtration parameter used when loading parameter, converting corresponding code tree for filtering rule;Udf module is configured use In acquiring and registering with more than one UDF;And data filtering engine, being configured for will be according to rule load parameter load Filtering rule is converted into code tree, reads initial data according to filtration parameter, and the UDF in code tree is called to handle the original number According to.
The present invention also provides a kind of regular conversion methods, comprising: carries out the meaning of a word, syntax and semantics to a filtering rule Analysis, therefrom extract function keyword;The function keyword is matched with known UDF, is identified and the mistake The corresponding UDF of filter rule;And according to the UDF identified, code tree is generated, the code tree includes at least a UDF.
Preferably, the structure of the code tree includes UDF title, type and parameter list, wherein type and parameter list It can be sky.
Preferably, the code tree is one or more layers structure, when for one layer or more structure, in current structure layer Parameter list in include next structure sheaf UDF title, type and parameter list.
Preferably, the parameter list includes multiple parameters, and the parameter includes in variable, constant and particular file name One or more.
The present invention provides a kind of data filtering methods, comprising: call filtering rule in UDF handle respectively one it is original Data;And determine whether the initial data meets the filtering according to the output valve of UDF final in each filtering rule Rule.
Preferably, the data filtering method further comprises: when the initial data meets a filtering rule, Marking the initial data is hash;And when the initial data does not meet whole filtering rules, mark the original Beginning data are useful data.
Preferably, final UDF is the logic judgment function of "Yes" and " non-" in each filtering rule, is further wrapped It includes: when the output valve of final UDF is "Yes" in each filtering rule, determining that the initial data meets the filtering rule Then;When the output valve of final UDF is " non-" in each filtering rule, determine that the initial data meets the filtering rule
Preferably, the data filtering method further include: filtering rule is loaded according to rule load parameter, wherein institute Stating rule load parameter includes filtering rule storage address and filtering rule title;Correspondence is converted to by the filtering rule of load Code tree, the code tree include at least a UDF.
Preferably, the data filtering method further include: the configuration rule loads parameter and converts filtering rule For the parameter used when corresponding code tree.
Preferably, the data filtering method further include: acquire and register with more than one UDF.
Preferably, the data filtering method further include: initial data, the original are read according to the filtration parameter of configuration Beginning data include more than one for indicating the field of information attribute.
Filtering rule in the present invention is write using defined language format, and filtering rule is abstracted as specifically UDF handles initial data by calling UDF, to achieve the purpose that filter initial data.The present invention not only reduces rule The then communication cost of maker and developer simplifies the process of exploitation and test, and can be changed by alteration ruler Become filter condition, it is adaptable, easy to operate.
Detailed description of the invention
In the following, the preferred embodiment of the present invention will be described in more detail in conjunction with attached drawing, in which:
Fig. 1 is the functional block diagram of data filtering system according to an embodiment of the invention;
Fig. 2 is the functional block diagram of data filtering engine according to an embodiment of the invention;
Fig. 3 is the functional block diagram of rule-interpreter according to an embodiment of the invention;And
Fig. 4 is the flow chart according to an embodiment of the invention for converting filtering rule to tree structure;
Fig. 5 is the process according to an embodiment of the invention that an initial data is handled using a filtering rule Figure;And
Fig. 6 is the flow chart of data filtering method according to an embodiment of the invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
In the following detailed description, the specific embodiment for being used to illustrate the application as the application a part may refer to Each Figure of description.In the accompanying drawings, similar appended drawing reference describes substantially similar component in different drawings.This Shen Each specific embodiment please has carried out description detailed enough following, so that having the general of ability domain-dependent knowledge and technology Logical technical staff can implement the technical solution of the application.It should be appreciated that can also be using other embodiments or to the application Embodiment carry out structure, logic or electrical property change.
As shown in Figure 1, being a kind of functional block diagram of data filtering system provided by the invention, the data filtering system packet It includes: system configuration module 1, udf module 2 and data filter engine 3.Wherein, the system configuration module 1 is for configuring each seed ginseng It is used in number, such as rule load parameter, the parameter that uses when converting corresponding code tree for filtering rule and filter process Filtration parameter.A plurality of filtering rule 4 is stored in storage device, the filtering rule 4 that should be used when in order to load data filtering, Rule load parameter is needed to configure, the rule load parameter includes the rule name of the storage address of filtering rule, filtering rule Claim, can also include regular quantity.Root when filtering rule is converted corresponding code tree by data filtering engine 3 in the present invention According to the difference of rule, the parameter of the correspondence UDF in code tree is different.Thus, system configuration module 1 also needs to configure each seed ginseng Number, variable name, the even filename of black and white lists.In addition, system configuration module 1 also configures the filtering used when data filtering Parameter, such as: the label side of the storage address of initial data, the frequency for reading initial data, original data volume, hash Formula, storage address, storage address of useful data etc..
Filtering rule is used the language with prescribed form to write by the present invention, corresponding one kind of each filtering rule or one Kind or more processing operation, processing operation is abstracted as UDF by the present invention.In order to meet different processing operations, pass through the UDF Module 2 acquires and registers with UDF.It, can be directly using the UDF write, if without alignment processing for conventional UDF The UDF of operation, developer are write UDF using python, are then registered in system by udf module 2.For example, using Python realizes that the process of an addition function add (a, b) is as follows:
According to the function that may be used in filtering rule, the present invention collects by udf module 2 and has registered various UDF For subsequent use.
Data filtering engine 3 is used to convert code tree for filtering rule, and the UDF in code tree is called to handle original number According to.Wherein, as shown in Fig. 2, being the functional block diagram of data filtering engine 3.The data filtering engine 3 in the present embodiment includes Rule-interpreter 31, filtering module 32, configuration loading module 33, UDF loading module 34 and regular loading module 35.Wherein, match It sets loading module 33 to be connected with system configuration module 1, the rule load parameter for configuring system configuration module 1 is such as advised The then filename of store path, filtering rule title, variable name or the black and white lists that need to load, is sent to rule-interpreter 31, Filtration parameter is sent to filtering module 32.
Regular loading module 35 loads filtering rule according to rule load parameter, and the rule-interpreter 31 is by each mistake Filter rule is converted into corresponding code tree, and the code tree includes at least two elements of a UDF and its parameter.Implement at one In example, as shown in figure 3, rule-interpreter 31 includes that rule analysis unit 311, function matching unit 312 and code tree generate list Member 313.Wherein, filtering rule is read in the character one of the rule analysis unit 311 1 character, it will be more by morphological analysis A character combination is at word, number etc., by syntactic analysis, checks whether word made of aforementioned combinatorial, number are correct, thus Obtain function keyword and parameter, the parameter can be variable or filename, be analyzed by the meaning of a word, discriminant function keyword and Parameter whether grammaticality.Function matching unit 312 matches function keyword and its parameter with registered UDF, So that it is determined that UDF corresponding with the filtering rule and its parameter.Code tree generation unit 313 is generated according to UDF and its parameter The code tree of filtering rule.Wherein, the structure of the code tree includes UDF title, three elements of type and parameter list, In, it also may include multiple parameters that parameter list, which can be sky,.
For example, the rule-interpreter 31 converts the process of tree structure as schemed for an addition function add (a, b) It is as follows shown in 4:
Step S100 reads in a filtering rule to one character, one character.In the present embodiment, filtering rule It is then addition function " add (a, b) ".
Step S101, by morphological analysis by multiple character combinations at word, number etc..In the present embodiment, morphology point Analysis the result is that obtaining " add " " (" " a " ", " " b " ") " this 6 symbols.So as to identify function keyword " add " and ginseng Number " a ", " b ".
Step S102 judges that the combination of this 6 symbols is grammaticality by semantic analysis, if met, in step Rapid S103 generates code tree to be terminated if not meeting syntax rule, parses the failure of this filtering rule.
Step S103, according to UDF title, type and parameter list these three Element generation code trees.For example, by step The semantic analysis of S102 can determine whether out " add " " (" " a " ", " " b " ") " this 6 symbol grammaticalities.Thus generate code It sets under platform:
In the present embodiment, the code tree is one layer of structure, and the code tree is also possible to multilayered structure, example Such as, for be using a cell-phone number front three number 400 cell-phone number as the UDF obtained when filtering rule be equals The code tree that (substr (phone, 0,3), ' 400 ') is generated is as follows:
Code tree in the present embodiment includes double-layer structure: first parameter in the parameter list plist of first layer is One UDF title, the structure of type and parameter list, nesting in this way realize whether phone number is to start with 400 Judgement judges in current information phone number field then to judge whether the information meets this filtering rule.
UDF loading module 34 loads the UDF in filtering rule code tree, in order to the calling of filtering module 32.
Filtering module 32 reads data according to filtration parameter, such as every 5 seconds in specified database or specified storage address The initial data generated in 5 seconds in the past is read, handles the initial data one by one using the filtering rule of load.Implement at one In example, initial data stores one by one, the corresponding information of an initial data.Every initial data includes multiple fields, each One attribute of field corresponding informance.For example, including such as " brand ", " vehicle ", " color ", " row in a car rent information Attributes, each attribute such as amount " " car owner's description ", " car owner's quotation " correspond to specific content.In initial data, using data word The corresponding attribute of section, facilitates subsequent calls UDF to handle.
Since the filtering rule currently loaded have been converted into the tree structure with three elements via rule-interpreter 31, So as shown in Figure 5 using the process that a filtering rule handles an initial data:
Step S200 obtains the code tree of a filtering rule.
Step S201 calls one or more UDF in code tree to handle the initial data.For example, current overanxious When the code tree of rule is equals (substr (phone, 0,3), ' 400 ') in previous examples, what calling had loaded Substr function obtains first three bit digital of telephone number.Specifically, this original is searched according to the variable " phone " in parameter As all fields in data take from the telephone number if finding the corresponding field " telephone number " of variable " phone " Front three xxx out.Then equals function is called, judges whether xxx is identical as 400, if identical, calculated result is Otherwise "Yes" is " non-".In this embodiment, the result of equals function is final calculation result.
Step S202 judges whether final calculation result is "Yes", if YES, illustrates that this initial data meets this Filtering rule determines that this initial data is hash then in step S203, in step S204, according to configuration label and This initial data is marked in storage rule, and stores and arrive designated position.If final calculation result is " non-", explanation This initial data does not meet this filtering rule, then in step S205, judges whether that there are also unused filtering rules, if Have, then in step S206, takes out next filtering rule, go to step S201.If currently without unused filtered Filter determines that this initial data is useful data, and store and advise according to the label of configuration in step S204 then in step S207 Then, this initial data is marked, and stores and arrive designated position.
The filtering rule loaded is respectively adopted to each initial data and filters one by one for filtering module, when meeting a mistake When filter rule, that is, it can be identified as hash, when not meeting whole filtering rules, that is, can be identified as useful data.
As shown in fig. 6, the flow diagram of the data filtering method provided for one embodiment of the invention, the method packet It includes:
Step S300 reads a collection of initial data according to the temporal frequency of system configuration.
Step S301 takes out an initial data in order from this batch of initial data.
Step S302 handles this initial data, specific process flow such as Fig. 4 institute with the filtering rule of load respectively Show.
Step S303, judges whether this initial data meets a filtering rule therein.In the present invention, described every Final UDF is the logic judgment function of "Yes" and " non-" in one filtering rule, and final UDF's is defeated in each filtering rule When value is "Yes" out, determine that the initial data meets the filtering rule;The output of final UDF in each filtering rule When value is " non-", determine that the initial data does not meet the filtering rule.If this initial data meets a filtering rule Then, then in step S304, confirm that the data is hash, be then marked, store.If this initial data is not inconsistent Any one filtering rule is closed, then in step S306, confirms that the data is useful data, then turns to step S305.
Step S305 judges whether the data is the last item data, if it is not, then switch process S301, again Access evidence is filtered.If the data is the last item data in the batch data, terminate to this batch of initial data Filtering.
Using filtration system of the present invention, product manager need to only write filtering rule using defined language, this Filtering rule is abstracted as specific UDF by the filter engine of system, data is handled by calling UDF, to reach filtering The purpose of data.The method that this system provides reduces the communication cost of product manager and developer, simplifies exploitation and surveys The process of examination, and filter condition can be changed by alteration ruler, it is adaptable, easy to operate.
Above-described embodiment is used for illustrative purposes only, and is not limitation of the present invention, in relation to the general of technical field Logical technical staff can also make a variety of changes and modification without departing from the present invention, therefore, all equivalent Technical solution also should belong to scope disclosed by the invention.

Claims (18)

1. a kind of data filtering engine, comprising:
Rule-interpreter is configured for converting filtering rule to corresponding code tree, and the code tree includes at least one UDF;And
Filtering module is configured for calling the UDF processing initial data in the filtering rule, according to each filtering rule In the output valve of final UDF determine whether the initial data meets the filtering rule.
2. data filtering engine according to claim 1, the rule-interpreter include:
Rule analysis unit is configured for identifying the function keyword of grammaticality from filtering rule;And
Function matching unit is configured for by matching the function keyword and registered UDF, the determining and filtering The corresponding UDF of rule;And
Code tree generation unit is configured for generating the code tree of filtering rule according to fixed UDF.
3. data filtering engine according to claim 1 or 2, the structure of the code tree includes UDF title, type and ginseng Three elements of ordered series of numbers table, wherein type and parameter list can be sky.
4. data filtering engine according to claim 1 or 2, further includes:
Regular loading module is configured for according to rule load parameter load filtering rule, and the filtering rule is transmitted To the rule-interpreter.
5. data filtering engine according to claim 4, further includes:
Loading module is configured, is configured for loading the rule load parameter, converts corresponding code tree for filtering rule When the parameter that the uses and filtration parameter that uses of filtering module.
6. data filtering engine according to claim 1, further includes:
UDF loading module, the UDF being configured in load filtering rule code tree.
7. a kind of data filtering system, comprising:
System configuration module is configured for configuring the rule load parameter, converts corresponding code tree for filtering rule When the parameter that uses and filtration parameter;
Udf module is configured for acquiring and registering with more than one UDF;And
Data filtering engine is configured for that code tree will be converted into according to the filtering rule of rule load parameter load, according to Filtration parameter reads initial data, and the UDF in code tree is called to handle the initial data.
8. a kind of rule conversion method, comprising:
The analysis that the meaning of a word, syntax and semantics are carried out to a filtering rule, therefrom extracts function keyword;
The function keyword is matched with known UDF, identifies UDF corresponding with the filtering rule;And
Code tree is generated according to the UDF identified, the code tree includes at least a UDF.
9. rule conversion method according to claim 8, the structure of the code tree includes UDF title, type and parameter List, wherein type and parameter list can be sky.
10. rule conversion method according to claim 9, the code tree is one or more layers structure, when described It include the UDF title of next structure sheaf, type and ginseng when code tree is one layer or more structure, in the parameter list of current structure layer Ordered series of numbers table.
11. rule conversion method according to claim 9, the parameter list includes multiple parameters, and the parameter is to become One or more of amount, constant and particular file name.
12. a kind of data filtering method, comprising:
The UDF in filtering rule is called to handle an initial data respectively;And
Determine whether the initial data meets the filtering rule according to the output valve of UDF final in each filtering rule.
13. data filtering method according to claim 12, further comprises:
When the initial data meets a filtering rule, marking the initial data is hash;And
When the initial data does not meet whole filtering rules, marking the initial data is useful data.
14. data filtering method according to claim 12 or 13, wherein final UDF in each filtering rule For the logic judgment function of "Yes" and " non-", further comprise: the output valve of final UDF is "Yes" in each filtering rule When, determine that the initial data meets the filtering rule;The output valve of final UDF is " non-" in each filtering rule When, determine that the initial data meets the filtering rule
15. data filtering method according to claim 12, further includes:
According to rule load parameter load filtering rule, wherein it is described rule load parameter include filtering rule storage address and Filtering rule title;With
The filtering rule of load is converted into corresponding code tree, the code tree includes at least a UDF.
16. data filtering method according to claim 15, further includes:
The parameter for configuring the rule load parameter and being used when converting corresponding code tree for filtering rule.
17. data filtering method according to claim 15, further includes:
Acquire and register with more than one UDF.
18. data filtering method according to claim 12, further includes:
Initial data is read according to the filtration parameter of configuration, the initial data includes more than one for indicating information attribute Field.
CN201910385548.5A 2019-05-09 2019-05-09 A kind of data filtering engine and system and filter method Pending CN110287174A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910385548.5A CN110287174A (en) 2019-05-09 2019-05-09 A kind of data filtering engine and system and filter method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910385548.5A CN110287174A (en) 2019-05-09 2019-05-09 A kind of data filtering engine and system and filter method

Publications (1)

Publication Number Publication Date
CN110287174A true CN110287174A (en) 2019-09-27

Family

ID=68001777

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910385548.5A Pending CN110287174A (en) 2019-05-09 2019-05-09 A kind of data filtering engine and system and filter method

Country Status (1)

Country Link
CN (1) CN110287174A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7039702B1 (en) * 2002-04-26 2006-05-02 Mcafee, Inc. Network analyzer engine system and method
CN103116620A (en) * 2013-01-29 2013-05-22 中国电力科学研究院 Unstructured data safe filtering method based on strategy
CN104331278A (en) * 2014-10-15 2015-02-04 南京航空航天大学 Instruction filtering method and device for specifications of ARINC661
WO2017008650A1 (en) * 2015-07-13 2017-01-19 阿里巴巴集团控股有限公司 Device and method for filtering data
CN106681781A (en) * 2015-11-05 2017-05-17 腾讯科技(深圳)有限公司 Implementation method and system for real-time computing service

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7039702B1 (en) * 2002-04-26 2006-05-02 Mcafee, Inc. Network analyzer engine system and method
CN103116620A (en) * 2013-01-29 2013-05-22 中国电力科学研究院 Unstructured data safe filtering method based on strategy
CN104331278A (en) * 2014-10-15 2015-02-04 南京航空航天大学 Instruction filtering method and device for specifications of ARINC661
WO2017008650A1 (en) * 2015-07-13 2017-01-19 阿里巴巴集团控股有限公司 Device and method for filtering data
CN107038161A (en) * 2015-07-13 2017-08-11 阿里巴巴集团控股有限公司 A kind of device for filtering data and method
CN106681781A (en) * 2015-11-05 2017-05-17 腾讯科技(深圳)有限公司 Implementation method and system for real-time computing service

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
陈鑫等: "对Linux系统中的iptables过滤模块的改进", 《南京邮电学院学报》 *

Similar Documents

Publication Publication Date Title
US5963953A (en) Method, and system for product configuration
CN108520073A (en) Air control data integration method, device, equipment and computer readable storage medium
EP1909196B1 (en) Discovery of services matching a service request
CN110247811A (en) A kind of alarm method and relevant apparatus of internet of things equipment
US20050144166A1 (en) Method for assisting in automated conversion of data and associated metadata
US20040158562A1 (en) Data quality system
CN108846020A (en) Knowledge mapping automated construction method, system are carried out based on multi-source heterogeneous data
US11379670B1 (en) Automatically populating responses using artificial intelligence
CN101930465A (en) Be used to handle the method for document
CN111800404B (en) Method and device for identifying malicious domain name and storage medium
CN111370132B (en) Electronic file analysis method and device, computer equipment and storage medium
CN110263155A (en) The training method and system of data classification method, data classification model
CN110442597A (en) A kind of accurate lookup method of automobile parts
Kornyshova et al. Method families concept: application to decision-making methods
CN108345658A (en) Algorithm calculates decomposing process, server and the storage medium of track
CN110175276A (en) Infringing information acquisition methods, device, computer equipment and storage medium
CN110287174A (en) A kind of data filtering engine and system and filter method
CN115357286B (en) Program file comparison method and device, electronic equipment and storage medium
CN109947715A (en) Log alarm method and device
CN107368500A (en) Data pick-up method and system
CN113344674A (en) Product recommendation method, device, equipment and storage medium based on user purchasing power
CN109165297B (en) Universal entity linking device and method
CN100498770C (en) Hardware/software partition for high performance structured data transformation and method
CN112084167A (en) Authority filtering method and device and storage medium
CN110837547A (en) Method and device for understanding multi-intention text in man-machine interaction

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination