CN107862425B - Wind control data acquisition method, device and system and readable storage medium - Google Patents
Wind control data acquisition method, device and system and readable storage medium Download PDFInfo
- Publication number
- CN107862425B CN107862425B CN201710759272.3A CN201710759272A CN107862425B CN 107862425 B CN107862425 B CN 107862425B CN 201710759272 A CN201710759272 A CN 201710759272A CN 107862425 B CN107862425 B CN 107862425B
- Authority
- CN
- China
- Prior art keywords
- rule
- data
- control data
- wind control
- wind
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0635—Risk analysis of enterprise or organisation activities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/80—Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
- G06F16/81—Indexing, e.g. XML tags; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/80—Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
- G06F16/84—Mapping; Conversion
- G06F16/86—Mapping to a database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Human Resources & Organizations (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Economics (AREA)
- Strategic Management (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- General Business, Economics & Management (AREA)
- Development Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- Marketing (AREA)
- Finance (AREA)
- Technology Law (AREA)
- Accounting & Taxation (AREA)
- Educational Administration (AREA)
- Software Systems (AREA)
- Game Theory and Decision Science (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- Debugging And Monitoring (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a wind control data acquisition method, which comprises the following steps: receiving a service data acquisition request initiated by a service program, and determining wind control data to be acquired based on the request; determining the collection batch of the wind control data to be collected and the configuration of a data collection interface based on a preset wind control data collection configuration file; and in each acquisition batch, acquiring the wind control data from the data system in a concurrent mode according to the data acquisition interface configuration corresponding to the current acquisition batch. The invention also discloses a wind control data processing device, a wind control data processing system and a computer readable storage medium. According to the invention, through a serial and parallel data acquisition mode, the real-time performance of data acquisition is ensured while the system performance is considered, and further the service level is improved.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a wind control data acquisition method, wind control data processing equipment and system and a computer readable storage medium.
Background
In some special industries, such as the financial industry, to ensure that the service provided to the client is real-time, accurate and safe, it is common to perform risk control management on the data during the service providing process. The existing risk control management generally needs to collect data in a plurality of different service systems, but the real-time performance of the existing risk control management is difficult to guarantee in the aspect of data collection, and further the service quality is influenced.
Disclosure of Invention
The invention mainly aims to provide a wind control data acquisition method, wind control data processing equipment and system and a computer readable storage medium, and aims to solve the technical problem that the real-time performance of the existing risk control management is difficult to guarantee in the aspect of data acquisition, and the service quality is further influenced.
In order to achieve the above object, the present invention provides a wind control data acquisition method, including the steps of:
receiving a service data acquisition request initiated by a service program, and determining wind control data to be acquired based on the request;
determining the collection batch of the wind control data to be collected and the configuration of a data collection interface based on a preset wind control data collection configuration file;
and in each acquisition batch, acquiring the wind control data from the data system in a concurrent mode according to the data acquisition interface configuration corresponding to the current acquisition batch.
Optionally, the method for acquiring wind control data further includes:
splicing the collected wind control data to obtain an extensible markup language (XML) message;
sending the XML message to a rule engine for rule operation, and receiving a rule operation result returned by the rule engine;
and returning the rule operation result to the corresponding service program.
Optionally, the assembling the collected wind control data to obtain the XML message includes:
based on a preset message configuration file, assembling and generating a corresponding XML message;
wherein, the message configuration file is at least configured with: each node of the XML message, the parent-child relationship among the nodes, the attribute of each node and the value-taking path of the attribute value of each node.
Optionally, the performing, by the rule engine, a rule operation on the XML packet includes:
the rule engine analyzes the XML message to obtain an initial data queue, and inputs the initial data queue to a working memory for rule operation;
sequentially carrying out pattern matching on each initial data and rules in a built-in rule knowledge base according to a queue sequence based on a preset pattern matching algorithm, wherein the pattern matching algorithm at least comprises any one of a Rete algorithm, a Tread algorithm and a leaves algorithm;
and if so, performing rule operation on the initial data by adopting the matched rule, and outputting a rule operation result.
Optionally, the performing, by the rule engine, a rule operation on the XML packet further includes:
when the rule matched with the initial data does not exist in the rule knowledge base, the rule engine judges whether the rule can be formed by inheriting or combining original rules in the rule knowledge base;
if yes, generating a rule matched with the initial data by inheriting or combining the original rule in the rule knowledge base, performing rule operation on the initial data by using the rule, and outputting a rule operation result.
Further, to achieve the above object, the present invention also provides a wind-controlled data processing apparatus, including:
a memory storing a wind control data processing program;
a processor configured to execute the wind-controlled data processing program to perform operations comprising:
receiving a service data acquisition request initiated by a service program, and determining wind control data to be acquired based on the request;
determining the collection batch of the wind control data to be collected and the configuration of a data collection interface based on a preset wind control data collection configuration file;
and in each acquisition batch, acquiring the wind control data from the data system in a concurrent mode according to the data acquisition interface configuration corresponding to the current acquisition batch.
Optionally, the processor further executes the wind control data processing program to perform the following operations:
splicing the collected wind control data to obtain an XML message;
sending the XML message to a rule engine for rule operation, and receiving a rule operation result returned by the rule engine;
and returning the rule operation result to the corresponding service program.
Optionally, the assembling processing of the collected wind control data performed by the processor to obtain the XML message includes:
based on a preset message configuration file, assembling and generating a corresponding XML message;
wherein, the message configuration file is at least configured with: each node of the XML message, the parent-child relationship among the nodes, the attribute of each node and the value-taking path of the attribute value of each node.
Further, in order to achieve the above object, the present invention further provides a wind control data processing system, which includes a plurality of service programs, a plurality of data systems, and any one of the above wind control data processing devices.
Further, to achieve the above object, the present invention also provides a computer readable storage medium, on which a wind-controlled data processing program is stored, and when the wind-controlled data processing program is executed by a processor, the wind-controlled data processing program implements the steps of the wind-controlled data acquisition method according to any one of the above items.
According to the method and the device, after the wind control data to be collected are determined, the collection batch and the data collection interface configuration of the wind control data to be collected are determined based on the preset wind control data collection configuration file, and finally the wind control data are collected from one or more data systems in a concurrent mode according to the collection batch and the data collection interface configuration, namely the wind control data of different data systems are divided into batches, and then the data systems in each batch are concurrently called to collect the wind control data, so that the real-time performance of data collection can be guaranteed, the problem of system performance reduction caused by concurrent collection cannot exist in a serial and parallel data collection mode, and the service level is improved.
Drawings
Fig. 1 is a schematic structural diagram of a wind-controlled data processing device in a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of a first embodiment of a method for collecting wind control data according to the present invention;
FIG. 3 is a schematic flow chart of a wind control data acquisition method according to a second embodiment of the present invention;
fig. 4 is a schematic structural diagram of a wind-controlled data processing system according to an embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As shown in fig. 1, fig. 1 is a schematic structural diagram of a wind-controlled data processing device in a hardware operating environment according to an embodiment of the present invention.
The wind control data processing equipment in the embodiment of the invention can be a PC (personal computer), a server, a smart phone, a tablet personal computer, an electronic book reader, a portable computer and other equipment with a display function.
As shown in fig. 1, the wind-controlled data processing apparatus may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a memory device separate from the processor 1001 described above.
Optionally, the wind-controlled data processing device may further include a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, a WiFi module, and the like.
Those skilled in the art will appreciate that the configuration of the wind control data processing apparatus shown in fig. 1 does not constitute a limitation of the wind control data processing apparatus and may include more or less components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, the memory 1005, which is a kind of computer-readable storage medium, may include therein an operating system, a network communication module, a user interface module, and a wind-controlled data processing program. The operating system is a program for managing and controlling the wind control data processing equipment and software resources, and supports the operation of a network communication module, a user interface module, a wind control data processing program and other programs or software; the network communication module is used for managing and controlling the network interface 1002; the user interface module is used to manage and control the user interface 1003.
In the wind-controlled data processing apparatus shown in fig. 1, the network interface 1004 is mainly used for connecting to a system background and performing data communication with the system background; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; the wind-control data processing apparatus calls the wind-control data processing program stored in the memory 1005 by the processor 1001, and performs the following steps:
receiving a service data acquisition request initiated by a service program, and determining wind control data to be acquired based on the request;
determining the collection batch of the wind control data to be collected and the configuration of a data collection interface based on a preset wind control data collection configuration file;
and in each acquisition batch, acquiring the wind control data from the data system in a concurrent mode according to the data acquisition interface configuration corresponding to the current acquisition batch.
Further, the wind-control data processing apparatus calls, through the processor 1001, a wind-control data processing program stored in the memory 1005 to perform the following operations:
splicing the collected wind control data to obtain an extensible markup language (XML) message;
sending the XML message to a rule engine for rule operation, and receiving a rule operation result returned by the rule engine;
and returning the rule operation result to the corresponding service program.
Further, the wind-control data processing apparatus calls, through the processor 1001, a wind-control data processing program stored in the memory 1005 to perform the following operations:
based on a preset message configuration file, assembling and generating a corresponding XML message;
wherein, the message configuration file is at least configured with: each node of the XML message, the parent-child relationship among the nodes, the attribute of each node and the value-taking path of the attribute value of each node.
Further, the wind-controlled data processing apparatus calls, through the processor 1001, the wind-controlled data processing program stored in the memory 1005 to trigger the rules engine to perform the following operations:
analyzing the XML message to obtain an initial data queue, and inputting the initial data queue to a working memory for rule operation;
sequentially carrying out pattern matching on each initial data and rules in a built-in rule knowledge base according to a queue sequence based on a preset pattern matching algorithm, wherein the pattern matching algorithm at least comprises any one of a Rete algorithm, a Tread algorithm and a leaves algorithm;
and if so, performing rule operation on the initial data by adopting the matched rule, and outputting a rule operation result.
Further, the wind-controlled data processing apparatus calls, through the processor 1001, the wind-controlled data processing program stored in the memory 1005 to trigger the rules engine to perform the following operations:
when the rule matched with the initial data does not exist in the rule knowledge base, judging whether the rule can be formed by inheriting or combining the original rule in the rule knowledge base;
if yes, generating a rule matched with the initial data by inheriting or combining the original rule in the rule knowledge base, performing rule operation on the initial data by using the rule, and outputting a rule operation result.
Based on the hardware structure of the wind control data processing equipment, the invention provides various embodiments of the wind control data acquisition method.
Referring to fig. 2, fig. 2 is a schematic flow chart of a first embodiment of the wind control data acquisition method of the present invention. In this embodiment, the wind control data acquisition method includes:
step S10, receiving a service data acquisition request initiated by a service program, and determining wind control data to be acquired based on the request;
in this embodiment, the service program is specifically a program for executing related services based on the wind control data, such as a service program for querying personal information, a service program for applying for loan, and the like. And the wind control data refers to data for risk control management. In order to ensure the accuracy and the safety of data, a manager generally needs to perform risk control management on data used by all service programs, so that the wind control data processing equipment can determine corresponding wind control data to be acquired when receiving a service data acquisition request.
For example, when the service program a initiates a collection request for personal information data, the type of the wind control data to be collected and the data system to which the wind control data belongs may be determined according to the collection request. For example, the determined wind control data is of a personal information data type and is located in a personal information data system.
In this embodiment, the number of service programs initiating the service data acquisition request is not limited, and meanwhile, the number of service data acquisition requests initiated by a single service program is also not limited, which is determined according to an actual scenario.
Step S20, determining the collection batch of the wind control data to be collected and the configuration of a data collection interface based on a preset wind control data collection configuration file;
in this embodiment, a wind control data acquisition configuration file is configured in advance, and based on the configuration file, an acquisition batch of wind control data and interface configuration for acquiring wind control data between the wind control data processing equipment system and each data system are determined.
In the configuration file, each collection batch corresponds to one or more data systems, that is, the wind control data to be collected in each batch is distributed in one or more data systems, and the required wind control data is collected from the corresponding data systems specifically according to the configuration of the data collection interface corresponding to the collection batch. It should be noted that, in this embodiment, the wind control data is collected through the interface, so that each system can be shielded.
Optionally, in an embodiment, based on the service processing characteristics of the service program, the wind control data that needs to be acquired by the same service program is divided into multiple acquisition batches, and in each acquisition batch, the wind control data acquired by a current acquisition batch depends on the wind control data acquired by a previous acquisition batch. For example, if the service program B needs to collect the loan condition information of the user, it is determined that the wind control data that needs to be collected includes the user personal information, the bank account information, the loan details, and the like, and therefore, the collection of the user personal information, the collection of the user bank account information, and the collection of the loan details under the bank account in the first batch can be divided into three collection batches.
And step S30, acquiring the wind control data from the data system in a concurrent mode in each acquisition batch according to the data acquisition interface configuration corresponding to the current acquisition batch.
In this embodiment, when data needs to be acquired by using multiple acquisition batches, the wind control data is acquired from one or more data systems in a concurrent manner in each acquisition batch according to the configuration of the data acquisition interface corresponding to the current acquisition batch. That is, serial collection is performed among the collection batches, and parallel collection is performed on the data systems in the same collection batch, so that the real-time performance of data collection can be improved while the system operation performance is ensured.
In this embodiment, after determining the wind control data to be collected, a collection batch and a data collection interface configuration of the wind control data to be collected are determined based on a preset wind control data collection configuration file, and finally, according to the collection batch and the data collection interface configuration, the wind control data are collected from one or more data systems in a concurrent manner, that is, the wind control data of different data systems are divided into batches, and then each batch of data systems is concurrently called to collect the wind control data, so that through a serial and parallel data collection manner, the real-time performance of data collection can be ensured, meanwhile, the problem of system performance degradation caused by concurrent collection does not exist, and the service level is improved.
Referring to fig. 3, fig. 3 is a schematic flow chart of a wind control data acquisition method according to a second embodiment of the present invention. Based on the first embodiment of the method, in this embodiment, the method for acquiring wind control data further includes:
step S40, splicing the collected wind control data to obtain extensible markup language (XML) messages;
in this embodiment, the wind control data is specifically character string type data, and assembling the wind control data also means that the character strings are spliced into an XML format message. The embodiment is not limited to the way of splicing the character strings into the XML format message, and is specifically set according to actual needs.
For example, the Xml serializer class in C # is used to perform Xml serialization on the wind control data, and further generate a corresponding Xml format message. For another example, the wind control data may be assembled by using an apend method of a string buffer class in Java, so as to generate an XML format message.
Optionally, in an embodiment of the method for acquiring wind control data of the present invention, in view of the fact that the types of the acquired wind control data are many and are convenient to distinguish in the assembling process, in this embodiment, a corresponding XML message is assembled and generated specifically based on a preset message configuration file; wherein, the message configuration file is at least configured with: each node of the XML message, the parent-child relationship among the nodes, the attribute of each node and the value-taking path of the attribute value of each node. In the message assembling process, the wind control data of each collection batch is used as a message node, and the data collected in the current collection batch and the data collected in the previous collection batch have a parent-child node relationship between corresponding nodes in the XML message.
Step S50, sending the XML message to a rule engine for rule operation, and receiving a rule operation result returned by the rule engine;
the rule engine separates business decisions from application program codes, writes business decisions using predefined semantic modules, accepts data input, interprets business rules, and makes business decisions according to the rules. In short, the rule engine gives answers to questions according to the provided data and the set rules, and then performs corresponding operations.
For example, if the data input to the rule engine is "the car is red, the car is sports, the driver is male, and the driver is between 16 and 25 years old", the result of the output is "the insurance fee is increased by 20%" after the rule arithmetic processing by the rule engine. From this example it can be seen that: each rule is a set of conditional results, and a rule may be used in conjunction with other rules to determine the final result. For example, the rules in the example only produce increments and also need to work with the cardinality-determining rules to determine the final rate.
In this embodiment, the rule engine includes a rule knowledge base for performing rule operations, and performs rule operations on the wind control data in the input XML message based on the rule knowledge base, and outputs a rule operation result. The rule operation not only comprises the verification of the integrity and the accuracy of the data, but also comprises the judgment of whether the data meets the service condition.
The rule knowledge base specifically refers to a database for storing various data types and rules thereof. The data types refer to different data types and comprise data entities and various attributes for describing the data entities; the attributes comprise various natural attributes and social attributes of the data entity; the rule is a set of preset conditions that are met by each attribute of the data type, and is used for checking the data to be checked (namely, the wind control data in the XML message). The rule knowledge base is preset, and not only comprises various service data types and rules thereof, but also comprises various data types and rules thereof commonly used in real life. For example, the data type: a person, the natural attributes of the person including: sex, date of birth, age, etc.; the social attributes include: job title, ID card number, ID card address, etc. Conventionally, the sex is classified as male or female, the age is 0-150 years, the job may include manager, chief, group leader or county leader, city leader, province leader, etc., the title includes father, husband, son, uncle, etc., and the length of the identification number is 15 digits or 18 digits, etc.
For example, the wind control data in the XML message is requested by the loan service program, and the wind control data includes, for example, basic information of the borrower, historical loan conditions of the borrower, credit conditions of the borrower, basic conditions and requirements of the loan, and the like, and the rule engine performs rule operation on the wind control data in the XML message, for example, based on loan rules preset in the rule knowledge base, determines whether the borrower can loan, what the loan risk is, and returns the result to the loan service program as a rule operation result.
And step S60, returning the rule operation result to the corresponding business program.
In this embodiment, after the wind control data is acquired, the wind control data needs to be further subjected to wind control management, specifically, a rule engine is used to perform rule operation on the wind control data, so that the security of the wind control data is ensured.
In this embodiment, in order to facilitate regular operation processing on the wind control data and improve processing efficiency, the collected wind control data is assembled into an XML message, so that each wind control data can be stored and transmitted.
The XML message adopts an extensible markup language format, and is a markup language for marking an electronic file to make the electronic file have a structure. In electronic computers, a label refers to a symbol of information that can be understood by a computer, and by this label, various information can be handled between computers, such as it can be used to label data, define data types, and the like. At the same time, the extensible markup language provides a unified approach to describe and exchange structured data independent of the application or vendor, and is an effective tool for processing distributed structural information today.
In this embodiment, the specific processing mode and process for executing the rule operation by the rule engine are not limited, and are specifically set according to actual needs. And after the rule engine outputs the rule operation result, the wind control data processing equipment returns the rule operation result to the corresponding service program, and the service program performs corresponding service processing based on the rule operation result.
Further optionally, in an embodiment of the wind control data acquisition method of the present invention, the performing, by the rule engine, a rule operation on the XML message includes:
step S501, the rule engine analyzes the XML message to obtain an initial data queue, and inputs the initial data queue to a working memory for rule operation;
step S502, sequentially carrying out pattern matching on each initial data and rules in a built-in rule knowledge base according to a queue sequence based on a preset pattern matching algorithm, wherein the pattern matching algorithm at least comprises any one of a Rete algorithm, a Tread algorithm and a leaves algorithm;
and step S503, if the initial data are matched with the initial data, performing rule operation on the initial data by adopting the matched rules, and outputting rule operation results.
In this embodiment, the rule engine parses the XML message to obtain an initial data queue that needs to perform rule operations, for example, the XmlSerializer class is used to perform reverse serialization processing on the XML message to perform parsing, and obtain an initial data queue, and then the initial data queue is input into a working memory of the rule engine to perform rule operations.
For rule matching, the following is generally defined: a condition part, corresponding to a rule, also called LHS (left-hand side); the fact part, corresponding to the input data, is also called RHS (right-hand side).
Assuming that there are N rules in the rule knowledge base of the rule engine, there are P patterns in the condition part of each rule on average, and there are M facts to be processed at a certain time point, the rule matching content is: for each rule r, judging whether the current fact o satisfies lhs (r) ═ True, if so, performing rule operation on the instance r (o) of the rule r, namely the rule + the fact that satisfies the rule, and generally adopting the following processing ideas:
(1) taking one r out of N rules;
(2) taking a combination c of P facts from the M facts;
(3) adopting a pattern matching algorithm to carry out matching test, namely testing whether c is matched with LHS (r), and if LHS (r (c)) is True, namely the rule is matched with the input data, adding RHS (r (c)) into a rule operation processing queue;
(4) if there are other combinations c of the M facts, then (3) is executed;
(5) and (5) taking out the next rule r and executing (2).
In this embodiment, the pattern matching algorithm at least includes any one of a Rete algorithm, a Tread algorithm, and a leaves algorithm, and is specifically set according to actual needs.
Further optionally, in an embodiment of the wind control data acquisition method of the present invention, the performing, by the rule engine, a rule operation on the XML packet further includes:
step S504, when the rule matched with the initial data does not exist in the rule knowledge base, the rule engine judges whether the rule can be formed by inheriting or combining the original rule in the rule knowledge base;
and step S505, if yes, generating a rule matched with the initial data by inheriting or combining the original rule in the rule knowledge base, performing rule operation on the initial data by using the rule, and outputting a rule operation result.
Since the rule knowledge base in this embodiment is preset, there are some rules that are not included in the rule knowledge base. Therefore, if data matching of the rule is required, a new rule needs to be generated by another method.
Therefore, in the rule knowledge base, when there is no rule matching with the data, it is necessary to first determine the data type of the data, and determine whether the data type can be formed by inheriting or combining the original data types preset in the rule database. For example, the data type of a certain data does not exist in the rule knowledge base, and therefore, the analysis and judgment are performed according to the attribute of the data. For example, the data includes attributes "name", "gender" and "age", and the attributes exist in the attribute of the data type "person" in the rule knowledge base through analysis and judgment, so the rule of the data can be formed by inheriting the rule of the original data type "person" preset in the rule knowledge base. For another example, since the data type of a certain data does not exist in the rule database, the analysis and determination are performed based on the attribute of the data, for example, the data includes the attributes "name", "sex", "age" and "academic calendar", the attributes exist in the attribute of the data type "person" and the data type "academic" in the rule knowledge base, and thus the rule of the data can be formed by combining the rules of the original data types "person" and "academic" preset in the rule knowledge base.
In this embodiment, since the rule repository of the present invention is not able to completely exhaust and include various rules, for a rule that does not exist in the rule repository, a new rule needs to be regenerated and added to the rule repository. Through the inheritance or combination mode, the workload of reprogramming development can be reduced, and the size of the rule knowledge base can be reduced to a certain extent, so that redundant data is reduced.
Referring to fig. 4, fig. 4 is a schematic structural diagram of an embodiment of a wind-controlled data processing system according to the present invention. In this embodiment, the wind control data processing system includes a plurality of service programs 10, a plurality of data systems 30, and the wind control data processing device 20 described above.
As shown in fig. 4, the service program 10 is specifically a program for executing related services based on the wind control data, such as a query personal information service program, a loan application service program, and the like.
The wind control data processing device 20 is configured to collect data (referred to as wind control data for short) for performing risk control management from each data system 30, perform relevant processing, and return the data to the service program 10.
The data system 30 stores various kinds of wind control data, such as user identity information in a public security system, personal credit information in a pedestrian system, information on deposit, loan, mortgage, etc. in a local system.
In this embodiment, the wind-control data processing device 20 mainly includes:
1. a data acquisition module: for collecting the wind control data, such as customer identity information, personal credit information, loan information, etc., from each data system 30 based on the data collection request of the business program 10;
2. a data processing module: the system and method are used for assembling the wind control data acquired by the data acquisition module from each data system 30 into XML messages for being transmitted to a rule engine (for example, a Blaze rule engine) to perform rule operation, and feeding back operation results to the corresponding service program 10.
In this embodiment, after the wind control data to be collected is determined, the collection batch and the data collection interface configuration of the wind control data to be collected are determined based on a preset wind control data collection configuration file, and finally, the wind control data are collected from a plurality of data systems in a concurrent manner according to the collection batch and the data collection interface configuration, that is, the wind control data of different data systems are divided into batches, and then each batch of data systems are concurrently called to collect the wind control data, so that through a serial and parallel data collection manner, the real-time performance of data collection can be ensured, meanwhile, the problem of system performance degradation caused by concurrent collection does not exist, and the service level is improved.
Further, the present invention also provides a computer readable storage medium, on which a wind-control data processing program is stored, and when executed by a processor, the wind-control data processing program implements the following operations:
receiving a service data acquisition request initiated by a service program, and determining wind control data to be acquired based on the request;
determining the collection batch of the wind control data to be collected and the configuration of a data collection interface based on a preset wind control data collection configuration file;
and in each acquisition batch, acquiring the wind control data from the data system in a concurrent mode according to the data acquisition interface configuration corresponding to the current acquisition batch.
Further, the wind-control data processing program when executed by the processor further performs the following operations:
splicing the collected wind control data to obtain an extensible markup language (XML) message;
sending the XML message to a rule engine for rule operation, and receiving a rule operation result returned by the rule engine;
and returning the rule operation result to the corresponding service program.
Further, the wind-control data processing program when executed by the processor further performs the following operations:
based on a preset message configuration file, assembling and generating a corresponding XML message;
wherein, the message configuration file is at least configured with: each node of the XML message, the parent-child relationship among the nodes, the attribute of each node and the value-taking path of the attribute value of each node.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (6)
1. A wind control data acquisition method is characterized by comprising the following steps:
receiving a service data acquisition request initiated by a service program, and determining wind control data to be acquired based on the request;
determining a collection batch of wind control data to be collected and data collection interface configuration based on a preset wind control data collection configuration file, wherein the wind control data required to be collected by the same service program is divided into a plurality of collection batches, in each collection batch, the wind control data collected by the current collection batch depends on the wind control data collected by the previous collection batch, and the wind control data required to be collected by each collection batch is distributed in one or more data systems;
in each acquisition batch, acquiring wind control data from a data system in a concurrent mode according to the data acquisition interface configuration corresponding to the current acquisition batch;
splicing the collected wind control data to obtain an extensible markup language (XML) message;
sending the XML message to a rule engine for rule operation, and receiving a rule operation result returned by the rule engine;
returning the rule operation result to a corresponding service program;
the assembling processing of the collected wind control data to obtain the XML message comprises the following steps:
based on a preset message configuration file, assembling and generating a corresponding XML message;
wherein, the message configuration file is at least configured with: each node of the XML message, the parent-child relationship among the nodes, the attribute of each node and the value-taking path of the attribute value of each node.
2. The method of claim 1, wherein the rule engine performing a rule operation on the XML message comprises:
the rule engine analyzes the XML message to obtain an initial data queue, and inputs the initial data queue to a working memory for rule operation;
sequentially carrying out pattern matching on each initial data and rules in a built-in rule knowledge base according to a queue sequence based on a preset pattern matching algorithm, wherein the pattern matching algorithm at least comprises any one of a Rete algorithm, a Tread algorithm and a leaves algorithm;
and if so, performing rule operation on the initial data by adopting the matched rule, and outputting a rule operation result.
3. The method of claim 2, wherein the rule engine performing rule operations on the XML messages further comprises:
when the rule matched with the initial data does not exist in the rule knowledge base, the rule engine judges whether the rule can be formed by inheriting or combining original rules in the rule knowledge base;
if yes, generating a rule matched with the initial data by inheriting or combining the original rule in the rule knowledge base, performing rule operation on the initial data by using the rule, and outputting a rule operation result.
4. A wind-controlled data processing apparatus, characterized in that the wind-controlled data processing apparatus comprises:
a memory storing a wind control data processing program;
a processor configured to execute the wind-controlled data processing program to perform operations comprising:
receiving a service data acquisition request initiated by a service program, and determining wind control data to be acquired based on the request;
determining a collection batch of wind control data to be collected and data collection interface configuration based on a preset wind control data collection configuration file, wherein the wind control data required to be collected by the same service program is divided into a plurality of collection batches, in each collection batch, the wind control data collected by the current collection batch depends on the wind control data collected by the previous collection batch, and the wind control data required to be collected by each collection batch is distributed in one or more data systems;
in each acquisition batch, acquiring wind control data from a data system in a concurrent mode according to the data acquisition interface configuration corresponding to the current acquisition batch;
the processor further executes the wind-controlled data processing program to perform the following operations:
splicing the collected wind control data to obtain an XML message;
sending the XML message to a rule engine for rule operation, and receiving a rule operation result returned by the rule engine;
returning the rule operation result to a corresponding service program;
the processor executes the collected wind control data to perform splicing processing, and the operation of obtaining the XML message comprises the following steps:
based on a preset message configuration file, assembling and generating a corresponding XML message;
wherein, the message configuration file is at least configured with: each node of the XML message, the parent-child relationship among the nodes, the attribute of each node and the value-taking path of the attribute value of each node.
5. A wind-controlled data processing system, characterized in that the wind-controlled data processing system comprises a number of service programs, a number of data systems and the wind-controlled data processing device of claim 4.
6. A computer-readable storage medium, characterized in that a wind-controlled data processing program is stored on the computer-readable storage medium, which, when executed by a processor, implements the steps of the wind-controlled data acquisition method according to any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710759272.3A CN107862425B (en) | 2017-08-29 | 2017-08-29 | Wind control data acquisition method, device and system and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710759272.3A CN107862425B (en) | 2017-08-29 | 2017-08-29 | Wind control data acquisition method, device and system and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107862425A CN107862425A (en) | 2018-03-30 |
| CN107862425B true CN107862425B (en) | 2021-12-07 |
Family
ID=61699281
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710759272.3A Active CN107862425B (en) | 2017-08-29 | 2017-08-29 | Wind control data acquisition method, device and system and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107862425B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110210786B (en) * | 2019-06-14 | 2021-07-09 | 恒生电子股份有限公司 | Method and device for processing advance wind control |
| CN110717661A (en) * | 2019-09-27 | 2020-01-21 | 武汉极意网络科技有限公司 | Method and device for updating wind control rule |
| CN112860419A (en) * | 2019-11-27 | 2021-05-28 | 阿里巴巴集团控股有限公司 | Multi-instance task execution method and device, terminal equipment and computer storage medium |
| CN111640000A (en) * | 2020-04-17 | 2020-09-08 | 四川新网银行股份有限公司 | Data source calling method based on real-time decision |
| CN111815175B (en) * | 2020-07-08 | 2021-01-29 | 睿智合创(北京)科技有限公司 | Five-layer structure XML language interactive application method in nested list form |
| CN111949829B (en) * | 2020-09-01 | 2024-06-07 | 辽宁振兴银行股份有限公司 | XML analysis and wind control variable generation method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102609875A (en) * | 2012-01-20 | 2012-07-25 | 中国工商银行股份有限公司 | Method and system for concurrently and dynamically processing bank data |
| CN102722814A (en) * | 2012-06-01 | 2012-10-10 | 汪德嘉 | Self-adaption controllable management system for cheat risk of online transaction |
| CN103235807A (en) * | 2013-04-19 | 2013-08-07 | 浪潮集团山东通用软件有限公司 | Data extracting and processing method supporting high-concurrency large-volume data |
| CN106296399A (en) * | 2015-06-11 | 2017-01-04 | 交通银行股份有限公司 | The data processing method of business rule formulation and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8930301B2 (en) * | 2013-05-31 | 2015-01-06 | Linkedin Corporation | Systems and methods for content response prediction |
-
2017
- 2017-08-29 CN CN201710759272.3A patent/CN107862425B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102609875A (en) * | 2012-01-20 | 2012-07-25 | 中国工商银行股份有限公司 | Method and system for concurrently and dynamically processing bank data |
| CN102722814A (en) * | 2012-06-01 | 2012-10-10 | 汪德嘉 | Self-adaption controllable management system for cheat risk of online transaction |
| CN103235807A (en) * | 2013-04-19 | 2013-08-07 | 浪潮集团山东通用软件有限公司 | Data extracting and processing method supporting high-concurrency large-volume data |
| CN106296399A (en) * | 2015-06-11 | 2017-01-04 | 交通银行股份有限公司 | The data processing method of business rule formulation and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107862425A (en) | 2018-03-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107862425B (en) | Wind control data acquisition method, device and system and readable storage medium | |
| CN109344170B (en) | Stream data processing method, system, electronic device and readable storage medium | |
| CN111580874B (en) | System safety control method and system for data application and computer equipment | |
| CN111427971B (en) | Business modeling method, device, system and medium for computer system | |
| WO2019179030A1 (en) | Product purchasing prediction method, server and storage medium | |
| US20220291966A1 (en) | Systems and methods for process mining using unsupervised learning and for automating orchestration of workflows | |
| CN110851298A (en) | Abnormality analysis and processing method, electronic device, and storage medium | |
| CN115936895A (en) | Risk assessment method, device and equipment based on artificial intelligence and storage medium | |
| CN113434542B (en) | Data relationship identification method and device, electronic equipment and storage medium | |
| CN114219596A (en) | Data processing method based on decision tree model and related equipment | |
| US11605012B2 (en) | Framework for processing machine learning model metrics | |
| CN112085611A (en) | Asynchronous data verification method and device, electronic equipment and storage medium | |
| CN109544348B (en) | Asset security screening method, device and computer readable storage medium | |
| CN116450723A (en) | Data extraction method, device, computer equipment and storage medium | |
| CN113867700B (en) | Model construction method, display platform, server and storage medium | |
| CN114237798A (en) | Data processing method, device, server and storage medium | |
| CN113094595A (en) | Object recognition method, device, computer system and readable storage medium | |
| US9613105B1 (en) | Streamlined data entry based on data relationships | |
| KR101617651B1 (en) | Data transffer system and method between heterogeneous systems using transaction editor | |
| CN117390023A (en) | Data aggregation method, data aggregation device, apparatus, and storage medium | |
| CN115829768A (en) | Data calculation method, device and equipment based on rule engine and storage medium | |
| CN116757851A (en) | Data configuration method, device, equipment and storage medium based on artificial intelligence | |
| CN117649305A (en) | Personalized claim micro-service management method, device, equipment and storage medium | |
| CN117034173A (en) | Data processing method, device, computer equipment and storage medium | |
| CN115169355A (en) | Product configuration method, device, equipment and medium based on attribute level |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |