CN110929879A - Business decision logic updating method based on decision engine and model platform - Google Patents
Business decision logic updating method based on decision engine and model platform Download PDFInfo
- Publication number
- CN110929879A CN110929879A CN201911075958.6A CN201911075958A CN110929879A CN 110929879 A CN110929879 A CN 110929879A CN 201911075958 A CN201911075958 A CN 201911075958A CN 110929879 A CN110929879 A CN 110929879A
- Authority
- CN
- China
- Prior art keywords
- decision
- decision logic
- logic
- current
- result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000004519 manufacturing process Methods 0.000 claims abstract description 66
- 238000012360 testing method Methods 0.000 claims abstract description 48
- 238000003860 storage Methods 0.000 claims abstract description 13
- 238000005457 optimization Methods 0.000 claims description 65
- 238000004590 computer program Methods 0.000 claims description 23
- 238000011156 evaluation Methods 0.000 claims description 21
- 238000012544 monitoring process Methods 0.000 claims description 17
- 238000004458 analytical method Methods 0.000 claims description 15
- 238000009826 distribution Methods 0.000 claims description 13
- 238000003066 decision tree Methods 0.000 claims description 10
- 238000012545 processing Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000010835 comparative analysis Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000012417 linear regression Methods 0.000 description 1
- 238000007477 logistic regression Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 238000007637 random forest analysis Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/04—Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem"
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0635—Risk analysis of enterprise or organisation activities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0637—Strategic management or analysis, e.g. setting a goal or target of an organisation; Planning actions based on goals; Analysis or evaluation of effectiveness of goals
Abstract
The application relates to a business decision logic updating method and device based on a decision engine and a model platform, computer equipment and a storage medium. The method comprises the following steps: the method comprises the steps of obtaining decision logic to be tested and historical service data, testing the decision logic to be tested according to the historical service data to obtain a test result, optimizing the decision logic according to the test result and an expected value corresponding to the historical service data to obtain optimized decision logic, obtaining current decision logic and production service data, respectively making a decision on the production service data according to the optimized decision logic and the current decision logic, updating the optimized decision logic into the current decision logic when the decision result of the optimized decision logic is superior to the decision result of the current decision logic, performing double check on the decision logic through the historical service data and the generated service data before the decision logic is operated on line, and improving the rationality of the service decision logic.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method and an apparatus for updating business decision logic based on a decision engine and a model platform, a computer device, and a storage medium.
Background
With the development of economy, financial business faces the situation that financial risks are complex and changeable, financial supervision is stricter, and the supervision is carefully updated and iterated faster and faster. In the current financial system of the power system, the wind control rules are coupled with the models and the business strategies and other logics of the business system and are dispersed in all corners of the business system. The implementation of business decision logic such as wind control rules and models, business policies, etc. is invisible to the business experts.
When business decision logic needs to be updated, relevant business personnel submit the implementation of the wind control rules, the models and the business strategies to IT (Internet Technology) personnel, and the IT personnel need to complete the implementation of the change of the wind control rules, the models and the business strategies in a week or longer, so that the processing flow is complex and the requirement of market change is difficult to meet. Once the deployment is online, the updated service decision logic cannot be verified, so that the rationality of the service decision logic is poor.
Disclosure of Invention
In view of the foregoing, there is a need to provide a business decision logic updating method, apparatus, computer device and storage medium based on a decision engine and a model platform, which can improve the rationality of updated business decision logic.
A business decision logic update method based on a decision engine and a model platform, the method comprising:
obtaining decision logic to be tested and historical service data, and testing the decision logic to be tested according to the historical service data to obtain a test result;
optimizing the decision logic according to the test result and the expected value corresponding to the historical service data to obtain an optimized decision logic;
obtaining current decision logic and production service data, and respectively making a decision on the production service data according to the optimization decision logic and the current decision logic;
and when the decision result of the optimization decision logic is better than the decision result of the current decision logic, updating the optimization decision logic to the current decision logic.
In one embodiment, the obtaining the decision logic to be tested and the historical traffic data includes:
responding to model definition operation, and acquiring a wind control decision rule and a service decision rule corresponding to the model definition operation;
determining a decision logic to be tested according to the wind control decision rule and the business decision rule;
and acquiring historical service data corresponding to the decision logic to be tested.
In one embodiment, after the updating the optimization decision logic to the current decision logic when the decision result of the optimization decision logic is better than the decision result of the current decision logic, the method further includes:
acquiring a service to be decided, and determining a current decision logic corresponding to the service to be decided;
and performing decision analysis on the service to be decided according to the current decision logic to obtain a service decision result.
In one embodiment, the performing decision analysis on the service to be decided according to the current decision logic to obtain a service decision result includes:
performing wind control evaluation on the service to be decided according to the wind control decision rule in the current decision logic to obtain a wind control evaluation result;
and performing service decision on the service to be decided according to the service decision rule in the current decision logic and the wind control evaluation result to obtain a service decision result.
In one embodiment, the obtaining the current decision logic and the production service data, and the deciding the production service data according to the optimized decision logic and the current decision logic respectively includes:
acquiring distribution ratio parameters of the optimization decision logic and the current decision logic;
according to the distribution proportion parameter, dividing the production business data into first type production business data corresponding to the optimization decision logic and second type production business data corresponding to the current decision logic;
according to the optimization decision logic, making a decision on the first type of production service data to obtain a decision result of the optimization decision logic;
and according to the current decision logic, making a decision on the second type of production service data to obtain a decision result of the current decision logic.
In one embodiment, the updating the optimization decision logic to be after the current decision logic when the decision result of the optimization decision logic is better than the decision result of the current decision logic further includes:
and acquiring the data to be decided and the decision result corresponding to the current decision logic, and generating a monitoring report containing the data to be decided and the decision result, wherein the monitoring report is used for optimizing the current decision logic.
In one embodiment, the decision logic comprises at least one of a rule, a rule stream, a decision tree, a decision table, and a score card.
A business decision logic updating apparatus based on a decision engine and a model platform, the apparatus comprising:
the test module is used for acquiring decision logic to be tested and historical service data, and testing the decision logic to be tested according to the historical service data to obtain a test result;
the optimization module is used for optimizing the decision logic according to a test result and an expected value corresponding to the historical service data to obtain an optimized decision logic;
the decision module is used for acquiring the current decision logic and the production service data and respectively making a decision on the production service data according to the optimized decision logic and the current decision logic;
and the updating module is used for updating the optimization decision logic into the current decision logic when the decision result of the optimization decision logic is superior to the decision result of the current decision logic.
A computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:
obtaining decision logic to be tested and historical service data, and testing the decision logic to be tested according to the historical service data to obtain a test result;
optimizing the decision logic according to the test result and the expected value corresponding to the historical service data to obtain an optimized decision logic;
obtaining current decision logic and production service data, and respectively making a decision on the production service data according to the optimization decision logic and the current decision logic;
and when the decision result of the optimization decision logic is better than the decision result of the current decision logic, updating the optimization decision logic to the current decision logic.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
obtaining decision logic to be tested and historical service data, and testing the decision logic to be tested according to the historical service data to obtain a test result;
optimizing the decision logic according to the test result and the expected value corresponding to the historical service data to obtain an optimized decision logic;
obtaining current decision logic and production service data, and respectively making a decision on the production service data according to the optimization decision logic and the current decision logic;
and when the decision result of the optimization decision logic is better than the decision result of the current decision logic, updating the optimization decision logic to the current decision logic.
According to the business decision logic updating method, device, computer equipment and storage medium based on the decision engine and the model platform, the decision logic to be tested is tested and optimized through historical business data to obtain the optimized decision logic, the primary check of the decision logic is realized, then the optimized decision logic and the currently-executed decision logic are used for deciding the generated business data, the secondary check of the decision logic is realized, the double check is performed on the decision logic before the decision logic is operated on line through the historical business data and the generated business data, and the rationality of the business decision logic is improved.
Drawings
FIG. 1 is a diagram illustrating an application scenario of a business decision logic updating method based on a decision engine and a model platform according to an embodiment;
FIG. 2 is a flow diagram illustrating a business decision logic update method based on a decision engine and a model platform according to an embodiment;
FIG. 3 is a flow chart illustrating a business decision logic updating method based on a decision engine and a model platform in another embodiment;
FIG. 4 is a flow chart illustrating a business decision logic updating method based on a decision engine and a model platform in yet another embodiment;
FIG. 5 is a block diagram of a business decision logic updating apparatus based on a decision engine and a model platform according to an embodiment;
FIG. 6 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The business decision logic updating method based on the decision engine and the model platform can be applied to the application environment shown in fig. 1. Wherein the model platform 102 is in communication with the decision engine 104 over a network. The model platform 102 uploads the deployed decision logic to be tested to the decision engine 104, and after receiving the decision logic to be tested, the decision engine 104 obtains historical service data corresponding to the decision logic to be tested, and tests the decision logic to be tested according to the historical service data to obtain a test result. And then, optimizing the decision logic according to the test result and the expected value corresponding to the historical service data to obtain the optimized decision logic. The decision engine 104 acquires the current decision logic and the production service data, and decides the production service data according to the optimized decision logic and the current decision logic; and when the decision result of the optimization decision logic is better than that of the current decision logic, updating the optimization decision logic to the current decision logic. The model platform 102 may be a terminal, including but not limited to various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices, and the decision engine 104 may be a server implemented by an independent server or a server cluster composed of a plurality of servers.
In one embodiment, as shown in fig. 2, a business decision logic updating method based on a decision engine and a model platform is provided, which is described by taking the method as an example of being applied to the decision engine in fig. 1, and includes the following steps S210 to S240.
S210, obtaining the decision logic to be tested and the historical service data, and testing the decision logic to be tested according to the historical service data to obtain a test result.
With diversified development of the business form of the electric power, in an electric power financial system, in order to improve decision-making capability, business rules, a wind control model and business strategies are adopted to realize business decision-making. The business decision is a processing process for analyzing through a certain rule based on business data to obtain a processing conclusion related to the business data. Decision logic refers to rules for performing decision analysis. In a traditional business decision system, rules, models and a business system are strongly coupled together, and IT (information technology) personnel are required to implement the modification and deployment of the business rules and the wind control models.
In one embodiment, the decision logic includes at least one of a rule, a rule flow, a decision tree, a decision table, and a score card.
In one embodiment, the decision logic to be tested is determined by manual configuration. The configuration objects comprise a rule set formed by rules, a graphical decision tree, a decision table, a rule flow, a scoring card and the like, and according to the decision requirement of the service, one or more rules in the rule set, the graphical decision tree, the decision table, the rule flow, the scoring card and the like are defined in a combined mode to obtain the wind control model, the scoring card and the service rule applicable to different scenes. The wind control model, the scoring card and the service rule which are suitable for different scenes have different IDs (Identity documents). One scene corresponds to a set of decision logic.
The rule set is a rule set formed in order to ensure the definition and efficiency of defining, executing and maintaining the rules, and each rule in the rule set can be started to be executed through the call of the rule flow task. The rule flow is defined by elements such as events, loops, branches and tasks, and defines the execution sequence of steps maintained in the decision flow in the form of a graph, and rules in the rule set can be reused in multiple rule flows. The graphical decision tree describes a series of dependency conditions before a decision is taken. Decision tables are a series of look-up tables whose rows and columns represent different conditions, and the resulting action or returned data is defined by the content of the intersection of the two. The scorecard is a special form of table that examines the different attributes and characteristics of an object or transaction and assigns weights based on these values, with all the basic weights adding to give a total score.
Business rules refer to all conditions that need to be considered when operating a business decision. Each condition can be embodied based on a rule set, a decision table, a decision tree and a score card, the wind control Model mainly refers to a Scorecard Model (score Model), and also supports a basic PMML (Predictive Model Markup Language) Model, including regression (Linear regression, Logistic regression), Treemodes (decision tree), Random Forest Trees and Mining Model (minimum Model), and one or more of them can be selected to realize decision judgment of partial service data or all service data according to an actual application scene. Wherein, the wind control model can also be constructed based on one or more of a rule set, a graphical decision tree, a decision table, a rule flow and a score card.
And determining a rule set, a graphical decision tree, a decision table, a rule flow, a scoring card, a wind control model and a corresponding combination sequence by defining each condition and a judgment sequence among the conditions to obtain a decision logic under the scene. The decision logic is a set of rules which are obtained by considering condition configuration of each party and are executed in sequence, only theoretical data are needed, and the rules can be formally used online only after being tested, so the decision logic obtained by definition is used as the decision logic to be tested.
The historical service data refers to the existing data of the service scene corresponding to the decision logic to be tested. The service scene comprises electric charge collection, electric commerce, electric power industry credit and the like. In an embodiment, the historical service data may be recorded in a form of a table, for example, a row in the table corresponds to one service data, and a decision result of each service data may be obtained by importing each item of data in the table, and executing a decision logic to be tested.
And S220, optimizing the decision logic according to the test result and the expected value corresponding to the historical service data to obtain the optimized decision logic.
The expected value corresponding to the historical service data refers to the corresponding optimal decision result according to the actual situation in reality. When the decision logic to be tested has better rationality, the result of decision processing on the historical service data by the decision logic is the same as the expected value or the error is in a set allowable range. Specifically, when the error between the test result and the expected value is within a set allowable range, the decision logic to be tested is directly used as the optimized decision logic, when the error between the test result and the expected value exceeds the set allowable range, the part to be optimized in the decision logic is determined through comparative analysis of the test result, wherein the part to be optimized can be one or more rules, possibly a rule stream, possibly a score card and the like, the decision logic is optimized based on the comparative analysis result, and the test is repeated until the error between the test result and the expected value is within the set allowable range, so that the optimized decision logic is obtained.
And S230, acquiring the current decision logic and the production service data, and respectively deciding the production service data according to the optimized decision logic and the current decision logic.
The current decision logic refers to the decision logic which is executed on the line, and the application scene of the current decision logic is the same as that of the optimization decision logic. The actual production business data on the line is taken as a decision object, and the decision is respectively made by using the current decision logic and the optimization decision logic, so that the decision result of the optimization decision logic and the decision result of the current decision logic can be obtained.
In one embodiment, two decision processes may be performed simultaneously on the same production business data through the current decision logic and the optimization decision logic. In another embodiment, the generated data may be divided into two parts, one part using the current decision logic for decision processing, and the other part using the optimized decision logic for decision processing.
S240, when the decision result of the optimization decision logic is better than the decision result of the current decision logic, the optimization decision logic is updated to the current decision logic.
The comparison of the decision results may be evaluated according to predetermined indicators, such as the conversion rate of a VIP (VIP) client, to obtain quantitative decision result data. The step of updating the optimized decision logic to the current decision logic by comparing the numerical values of the quantized decision result data means that the optimized decision logic replaces the original decision logic on the line, so that the replacement and updating process of the service decision logic is realized.
According to the business decision logic updating method based on the decision engine and the model platform, the decision logic to be tested is tested and optimized through historical business data to obtain the optimized decision logic, primary check of the decision logic is achieved, then the optimized decision logic and the currently-implemented decision logic are used for deciding the generated business data, secondary check of the decision logic is achieved, online and offline double check is conducted on the decision logic before the decision logic is operated online through the historical business data and the generated business data, and the rationality of the business decision logic is improved.
In one embodiment, obtaining the decision logic and historical traffic data to be tested comprises:
and responding to the model definition operation, and acquiring a wind control decision rule and a service decision rule corresponding to the model definition operation. And determining the decision logic to be tested according to the wind control decision rule and the business decision rule. And acquiring historical service data corresponding to the decision logic to be tested.
The model definition operation refers to a process of defining decision logic of a specified application scenario by a user. Taking a scoring model as an example, in model application, the scoring model needs to be applied to business operation, which needs to embed decision applications, such as approval, quota, post-credit warning, collection, etc., into each link of a credit life cycle, in these decision applications, the business rules and risk policies of various risk management are incorporated into one embodiment instead of just calculation of the scoring model, the wind control decision rules may include admission rules, anti-fraud rules, credit evaluation rules, scoring card models, credit granting measurement rules, other wind control rules, etc., the business decision rules may include settlement rules, investment rules, etc., form decision logic according to the wind control decision rules and the business decision rules, and obtain historical business data corresponding to the decision logic according to an application scenario.
In one embodiment, after updating the optimized decision logic to the current decision logic when the decision result of the optimized decision logic is better than the decision result of the current decision logic, steps S310 to S320 are further included.
S310, obtaining the service to be decided, and determining the current decision logic corresponding to the service to be decided.
S320, according to the current decision logic, performing decision analysis on the service to be decided to obtain a service decision result.
The service to be decided refers to data which needs to be subjected to decision evaluation based on the service decision logic of the scene. Taking the service to be decided as credit service data as an example, when a decision engine receives a decision request uploaded by a model platform, matching a corresponding current decision logic according to a scene identifier carried by the decision request and the corresponding credit service data and according to the scene identifier, and performing decision analysis on the credit service data through the current decision logic to obtain a decision result.
In a specific embodiment, also taking the service to be decided as credit service data as an example, the decision engine sequentially bases on admission rules in the current decision logic, such as the year of 18; information verification rules, such as name, identification card number, and whether the owners of the bank cards are the same; blacklist rules, such as whether blacklisted persons are listed for banks and other units or enterprises; and (4) performing decision processing on the credit business data according to an anti-fraud rule, such as whether a larger fraud risk exists or not, and the like, and finally grading each item of credit business data according to the grading card model to determine the credit line of the user.
In one embodiment, the decision engine encapsulates the current decision logic, provides a set of API (application programming Interface) interfaces, issues the service data from the service system to the decision engine in real time, performs analysis and calculation according to the current decision logic, and outputs the calculated decision result to the service system in real time. The business system calls the business link of the decision engine to obtain a decision result, and the calling party, namely the business system, executes the corresponding business process according to the decision result.
In one embodiment, performing decision analysis on a service to be decided according to a current decision logic to obtain a service decision result includes: and performing wind control evaluation on the service to be decided according to a wind control decision rule in the current decision logic to obtain a wind control evaluation result. And performing service decision on the service to be decided according to the service decision rule and the wind control evaluation result in the current decision logic to obtain a service decision result.
The wind control decision rule is mainly used for wind control evaluation and determining the business risk of the user, and the business decision rule is mainly used for determining whether the business is executed and how to execute the business according to the business risk and the business rule. In one embodiment, the decision may be made based on the business system's risk preference for each business and the business decision rules. Specifically, the risk preference is the size of a tolerable risk coefficient formulated by the business, the risk coefficient is set by the business requirement, and the risk coefficient can be manually configured through model definition operation.
In one embodiment, obtaining the current decision logic and the production service data, and deciding the production service data according to the optimized decision logic and the current decision logic respectively comprises steps S410 to S440.
S410, obtaining distribution ratio parameters of the optimization decision logic and the current decision logic.
And S420, dividing the production service data into first type production service data corresponding to the optimization decision logic and second type production service data corresponding to the current decision logic according to the distribution proportion parameters.
S430, according to the optimization decision logic, making a decision on the first type of production service data to obtain a decision result of the optimization decision logic.
S440, according to the current decision logic, making a decision on the second type production service data to obtain a decision result of the current decision logic.
In one embodiment, the optimized decision logic and the current decision logic are tested online by champion challenger testing. Specifically, the current decision logic is taken as a champion strategy, the optimized decision logic is taken as a challenger strategy, and the distribution proportion parameter is the ratio of the processing capacity of the champion to the industrial business data to the processing capacity of the challenger to the industrial business data. The distribution proportion parameters determine the proportion of the production service data to enter the champion strategy, and the proportion of the production service data to be tested as the challenger strategy can obtain the champion strategy and the decision result obtained by the challenger strategy. The optimization decision logic as the challenger strategy can comprise a plurality of logic. Taking the example of two challenger policies, 60% of the production business data can be allocated to the champion policy, and the rest of the production business data is distributed to the challenger policies, i.e. each challenger policy occupies 20%.
In one embodiment, when the decision result of the optimized decision logic is better than the decision result of the current decision logic, after the optimized decision logic is updated to the current decision logic, the method further includes: and acquiring the data to be decided and the decision result corresponding to the current decision logic, and generating a monitoring report containing the data to be decided and the decision result, wherein the monitoring report is used for optimizing the current decision logic.
By monitoring the decision result, automatic monitoring, alarming and manual processing of strategy calling can be realized even in non-working time such as night, holidays and the like.
In addition, the monitoring report can also analyze the capability of the current decision logic, and provides a data basis for the optimization of rules and models in the current decision logic.
It should be understood that although the various steps in the flow charts of fig. 2-4 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2-4 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least some of the sub-steps or stages of other steps.
In one embodiment, as shown in fig. 5, there is provided a business decision logic updating apparatus based on a decision engine and a model platform, including: a testing module 510, an optimization module 520, a decision module 530, and an update module 540, wherein:
the testing module 510 is configured to obtain a decision logic to be tested and historical service data, and test the decision logic to be tested according to the historical service data to obtain a test result;
the optimization module 520 is configured to optimize the decision logic according to the test result and the expected value corresponding to the historical service data to obtain an optimized decision logic;
a decision module 530, configured to obtain a current decision logic and production service data, and respectively make a decision on the production service data according to the optimized decision logic and the current decision logic;
and an updating module 540, configured to update the optimization decision logic to the current decision logic when the decision result of the optimization decision logic is better than the decision result of the current decision logic.
According to the business decision logic updating device based on the decision engine and the model platform, the decision logic to be tested is tested and optimized through historical business data to obtain the optimized decision logic, primary check of the decision logic is achieved, then the optimized decision logic and the currently-implemented decision logic are used for deciding the generated business data, secondary check of the decision logic is achieved, double check is conducted on the decision logic before the decision logic is operated on line through the historical business data and the generated business data, and the rationality of the business decision logic is improved.
In one embodiment, the testing module 510 includes an obtaining unit, configured to, in response to a model definition operation, obtain a wind control decision rule and a business decision rule corresponding to the model definition operation; determining a decision logic to be tested according to the wind control decision rule and the business decision rule; and acquiring historical service data corresponding to the decision logic to be tested.
In one embodiment, the service decision logic updating device based on the decision engine and the model platform further comprises an analysis module, wherein the analysis module is used for acquiring a service to be decided and determining a current decision logic corresponding to the service to be decided; and performing decision analysis on the service to be decided according to the current decision logic to obtain a service decision result.
In one embodiment, the analysis module is further configured to perform wind control evaluation on the service to be decided according to a wind control decision rule in the current decision logic to obtain a wind control evaluation result; and performing service decision on the service to be decided according to the service decision rule and the wind control evaluation result in the current decision logic to obtain a service decision result.
In one embodiment, the decision module 530 is further configured to obtain an allocation ratio parameter between the optimization decision logic and the current decision logic; dividing the production business data into first type production business data corresponding to the optimization decision logic and second type production business data corresponding to the current decision logic according to the distribution proportion parameters; according to the optimization decision logic, making a decision on the first type of production service data to obtain a decision result of the optimization decision logic; and according to the current decision logic, making a decision on the second type of production service data to obtain a decision result of the current decision logic.
In one embodiment, the service decision logic updating device based on the decision engine and the model platform further includes a monitoring module, the monitoring module is configured to obtain data to be decided and a decision result corresponding to the current decision logic, and generate a monitoring report including the data to be decided and the decision result, and the monitoring report is configured to optimize the current decision logic.
For specific limitations of the service decision logic updating apparatus based on the decision engine and the model platform, reference may be made to the above limitations of the service decision logic updating method based on the decision engine and the model platform, and details are not repeated here. The various modules in the above described decision engine and model platform based business decision logic update apparatus may be implemented in whole or in part by software, hardware, and combinations thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as shown in fig. 6. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing business decision logic updating data based on the decision engine and the model platform. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a business decision logic update method based on a decision engine and a model platform.
Those skilled in the art will appreciate that the architecture shown in fig. 6 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, there is provided a computer device comprising a memory storing a computer program and a processor implementing the following steps when the processor executes the computer program:
obtaining decision logic to be tested and historical service data, and testing the decision logic to be tested according to the historical service data to obtain a test result;
optimizing the decision logic according to the test result and the expected value corresponding to the historical service data to obtain an optimized decision logic;
obtaining current decision logic and production service data, and respectively making a decision on the production service data according to the optimized decision logic and the current decision logic;
and when the decision result of the optimization decision logic is better than that of the current decision logic, updating the optimization decision logic to the current decision logic.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
responding to the model definition operation, and acquiring a wind control decision rule and a service decision rule corresponding to the model definition operation;
determining a decision logic to be tested according to the wind control decision rule and the business decision rule;
and acquiring historical service data corresponding to the decision logic to be tested.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
acquiring a service to be decided, and determining a current decision logic corresponding to the service to be decided;
and performing decision analysis on the service to be decided according to the current decision logic to obtain a service decision result.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
performing wind control evaluation on the service to be decided according to a wind control decision rule in the current decision logic to obtain a wind control evaluation result;
and performing service decision on the service to be decided according to the service decision rule and the wind control evaluation result in the current decision logic to obtain a service decision result.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
acquiring distribution ratio parameters of an optimization decision logic and a current decision logic;
dividing the production business data into first type production business data corresponding to the optimization decision logic and second type production business data corresponding to the current decision logic according to the distribution proportion parameters;
according to the optimization decision logic, making a decision on the first type of production service data to obtain a decision result of the optimization decision logic;
and according to the current decision logic, making a decision on the second type of production service data to obtain a decision result of the current decision logic.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
and acquiring the data to be decided and the decision result corresponding to the current decision logic, and generating a monitoring report containing the data to be decided and the decision result, wherein the monitoring report is used for optimizing the current decision logic.
According to the computer equipment for realizing the service decision logic updating method based on the decision engine and the model platform, the decision logic to be tested is tested and optimized through historical service data to obtain the optimized decision logic, the primary check of the decision logic is realized, then the optimized decision logic and the currently executed decision logic are used for deciding the generated service data, the secondary check of the decision logic is realized, the decision logic is subjected to double check before the decision logic is operated on line through the historical service data and the generated service data, and the rationality of the service decision logic is improved.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:
obtaining decision logic to be tested and historical service data, and testing the decision logic to be tested according to the historical service data to obtain a test result;
optimizing the decision logic according to the test result and the expected value corresponding to the historical service data to obtain an optimized decision logic;
obtaining current decision logic and production service data, and respectively making a decision on the production service data according to the optimized decision logic and the current decision logic;
and when the decision result of the optimization decision logic is better than that of the current decision logic, updating the optimization decision logic to the current decision logic.
In one embodiment, the computer program when executed by the processor further performs the steps of:
responding to the model definition operation, and acquiring a wind control decision rule and a service decision rule corresponding to the model definition operation;
determining a decision logic to be tested according to the wind control decision rule and the business decision rule;
and acquiring historical service data corresponding to the decision logic to be tested.
In one embodiment, the computer program when executed by the processor further performs the steps of:
acquiring a service to be decided, and determining a current decision logic corresponding to the service to be decided;
and performing decision analysis on the service to be decided according to the current decision logic to obtain a service decision result.
In one embodiment, the computer program when executed by the processor further performs the steps of:
performing wind control evaluation on the service to be decided according to a wind control decision rule in the current decision logic to obtain a wind control evaluation result;
and performing service decision on the service to be decided according to the service decision rule and the wind control evaluation result in the current decision logic to obtain a service decision result.
In one embodiment, the computer program when executed by the processor further performs the steps of:
acquiring distribution ratio parameters of an optimization decision logic and a current decision logic;
dividing the production business data into first type production business data corresponding to the optimization decision logic and second type production business data corresponding to the current decision logic according to the distribution proportion parameters;
according to the optimization decision logic, making a decision on the first type of production service data to obtain a decision result of the optimization decision logic;
and according to the current decision logic, making a decision on the second type of production service data to obtain a decision result of the current decision logic.
In one embodiment, the computer program when executed by the processor further performs the steps of:
and acquiring the data to be decided and the decision result corresponding to the current decision logic, and generating a monitoring report containing the data to be decided and the decision result, wherein the monitoring report is used for optimizing the current decision logic.
The computer-readable storage medium for implementing the service decision logic updating method based on the decision engine and the model platform tests and optimizes the decision logic to be tested through historical service data to obtain optimized decision logic, realizes primary check of the decision logic, then decides the optimized decision logic and the currently executed decision logic on generated service data to realize secondary check of the decision logic, passes through the historical service data and the generated service data, performs double check on the decision logic before the decision logic is operated on line, and improves the rationality of the service decision logic.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware related to instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above examples only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A business decision logic updating method based on a decision engine and a model platform is characterized by comprising the following steps:
obtaining decision logic to be tested and historical service data, and testing the decision logic to be tested according to the historical service data to obtain a test result;
optimizing the decision logic according to the test result and the expected value corresponding to the historical service data to obtain an optimized decision logic;
obtaining current decision logic and production service data, and respectively making a decision on the production service data according to the optimization decision logic and the current decision logic;
and when the decision result of the optimization decision logic is better than the decision result of the current decision logic, updating the optimization decision logic to the current decision logic.
2. The method of claim 1, wherein obtaining decision logic and historical traffic data to be tested comprises:
responding to model definition operation, and acquiring a wind control decision rule and a service decision rule corresponding to the model definition operation;
determining a decision logic to be tested according to the wind control decision rule and the business decision rule;
and acquiring historical service data corresponding to the decision logic to be tested.
3. The method of claim 1, wherein after updating the optimized decision logic to the current decision logic when the decision result of the optimized decision logic is better than the decision result of the current decision logic, further comprising:
acquiring a service to be decided, and determining a current decision logic corresponding to the service to be decided;
and performing decision analysis on the service to be decided according to the current decision logic to obtain a service decision result.
4. The method according to claim 3, wherein the performing decision analysis on the service to be decided according to the current decision logic to obtain a service decision result comprises:
performing wind control evaluation on the service to be decided according to the wind control decision rule in the current decision logic to obtain a wind control evaluation result;
and performing service decision on the service to be decided according to the service decision rule in the current decision logic and the wind control evaluation result to obtain a service decision result.
5. The method of claim 1, wherein obtaining the current decision logic and production business data, and wherein separately deciding the production business data according to the optimization decision logic and the current decision logic comprises:
acquiring distribution ratio parameters of the optimization decision logic and the current decision logic;
according to the distribution proportion parameter, dividing the production business data into first type production business data corresponding to the optimization decision logic and second type production business data corresponding to the current decision logic;
according to the optimization decision logic, making a decision on the first type of production service data to obtain a decision result of the optimization decision logic;
and according to the current decision logic, making a decision on the second type of production service data to obtain a decision result of the current decision logic.
6. The method of claim 1, wherein updating the optimized decision logic to be after the current decision logic when the decision result of the optimized decision logic is better than the decision result of the current decision logic further comprises:
and acquiring the data to be decided and the decision result corresponding to the current decision logic, and generating a monitoring report containing the data to be decided and the decision result, wherein the monitoring report is used for optimizing the current decision logic.
7. The method of claim 1, wherein the decision logic comprises at least one of a rule, a rule flow, a decision tree, a decision table, and a score card.
8. A business decision logic updating apparatus based on a decision engine and a model platform, the apparatus comprising:
the test module is used for acquiring decision logic to be tested and historical service data, and testing the decision logic to be tested according to the historical service data to obtain a test result;
the optimization module is used for optimizing the decision logic according to a test result and an expected value corresponding to the historical service data to obtain an optimized decision logic;
the decision module is used for acquiring the current decision logic and the production service data and respectively making a decision on the production service data according to the optimized decision logic and the current decision logic;
and the updating module is used for updating the optimization decision logic into the current decision logic when the decision result of the optimization decision logic is superior to the decision result of the current decision logic.
9. A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method of any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911075958.6A CN110929879A (en) | 2019-11-06 | 2019-11-06 | Business decision logic updating method based on decision engine and model platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911075958.6A CN110929879A (en) | 2019-11-06 | 2019-11-06 | Business decision logic updating method based on decision engine and model platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110929879A true CN110929879A (en) | 2020-03-27 |
Family
ID=69852433
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911075958.6A Pending CN110929879A (en) | 2019-11-06 | 2019-11-06 | Business decision logic updating method based on decision engine and model platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110929879A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111459843A (en) * | 2020-06-19 | 2020-07-28 | 上海冰鉴信息科技有限公司 | Decision flow testing method and device applied to wind control decision engine |
| CN111709647A (en) * | 2020-06-18 | 2020-09-25 | 辽宁振兴银行股份有限公司 | Data source dynamic management method based on policy engine control |
| CN112394922A (en) * | 2020-12-02 | 2021-02-23 | 成都新希望金融信息有限公司 | Decision configuration method, business decision method and decision engine system |
| CN112465383A (en) * | 2020-12-08 | 2021-03-09 | 深圳华制智能制造技术有限公司 | Industrial internet intelligent decision method, system, computer equipment and storage medium |
| CN113076348A (en) * | 2021-04-13 | 2021-07-06 | 上海优扬新媒信息技术有限公司 | Policy information management method, device, server and storage medium |
| CN113256275A (en) * | 2021-07-14 | 2021-08-13 | 支付宝(杭州)信息技术有限公司 | Expert system updating method, service processing method and device |
| CN113608796A (en) * | 2021-06-30 | 2021-11-05 | 北京新氧科技有限公司 | Rule engine configuration and operation method and device, electronic equipment and storage medium |
| CN113704117A (en) * | 2021-08-31 | 2021-11-26 | 北京三快在线科技有限公司 | Algorithm testing system, method and device |
| CN114168565A (en) * | 2021-12-10 | 2022-03-11 | 北京宇信科技集团股份有限公司 | Backtracking test method, device and system of business rule model and decision engine |
| CN114254909A (en) * | 2021-12-16 | 2022-03-29 | 天元大数据信用管理有限公司 | Risk management method and platform based on decision engine |
| WO2024017177A1 (en) * | 2022-07-18 | 2024-01-25 | 支付宝(杭州)信息技术有限公司 | Method and apparatus for executing service, storage medium and device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105867117A (en) * | 2016-06-20 | 2016-08-17 | 西安电子科技大学 | Energy-saving optimizing method for ore grinding grading system of concentration plant based on decision rule |
| CN108573355A (en) * | 2018-05-08 | 2018-09-25 | 阿里巴巴集团控股有限公司 | The method, apparatus and service server of operation are replaced after model modification |
| CN109063985A (en) * | 2018-07-18 | 2018-12-21 | 阿里巴巴集团控股有限公司 | A kind of Application of risk decision method and device of business |
| CN109146662A (en) * | 2018-07-16 | 2019-01-04 | 蜜小蜂智慧（北京）科技有限公司 | A kind of risk control method and device |
| CN109816221A (en) * | 2019-01-07 | 2019-05-28 | 平安科技（深圳）有限公司 | Decision of Project Risk method, apparatus, computer equipment and storage medium |
| CN110264089A (en) * | 2019-06-24 | 2019-09-20 | 浪潮软件股份有限公司 | A method of operational indicator is showed based on rich text format and is illustrated |
| CN110349015A (en) * | 2019-07-17 | 2019-10-18 | 民生科技有限责任公司 | The anti-fake system tuning operation loading method and device held up based on three pass |
-
2019
- 2019-11-06 CN CN201911075958.6A patent/CN110929879A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105867117A (en) * | 2016-06-20 | 2016-08-17 | 西安电子科技大学 | Energy-saving optimizing method for ore grinding grading system of concentration plant based on decision rule |
| CN108573355A (en) * | 2018-05-08 | 2018-09-25 | 阿里巴巴集团控股有限公司 | The method, apparatus and service server of operation are replaced after model modification |
| CN109146662A (en) * | 2018-07-16 | 2019-01-04 | 蜜小蜂智慧（北京）科技有限公司 | A kind of risk control method and device |
| CN109063985A (en) * | 2018-07-18 | 2018-12-21 | 阿里巴巴集团控股有限公司 | A kind of Application of risk decision method and device of business |
| CN109816221A (en) * | 2019-01-07 | 2019-05-28 | 平安科技（深圳）有限公司 | Decision of Project Risk method, apparatus, computer equipment and storage medium |
| CN110264089A (en) * | 2019-06-24 | 2019-09-20 | 浪潮软件股份有限公司 | A method of operational indicator is showed based on rich text format and is illustrated |
| CN110349015A (en) * | 2019-07-17 | 2019-10-18 | 民生科技有限责任公司 | The anti-fake system tuning operation loading method and device held up based on three pass |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111709647A (en) * | 2020-06-18 | 2020-09-25 | 辽宁振兴银行股份有限公司 | Data source dynamic management method based on policy engine control |
| CN111459843A (en) * | 2020-06-19 | 2020-07-28 | 上海冰鉴信息科技有限公司 | Decision flow testing method and device applied to wind control decision engine |
| CN112394922A (en) * | 2020-12-02 | 2021-02-23 | 成都新希望金融信息有限公司 | Decision configuration method, business decision method and decision engine system |
| CN112465383A (en) * | 2020-12-08 | 2021-03-09 | 深圳华制智能制造技术有限公司 | Industrial internet intelligent decision method, system, computer equipment and storage medium |
| CN113076348A (en) * | 2021-04-13 | 2021-07-06 | 上海优扬新媒信息技术有限公司 | Policy information management method, device, server and storage medium |
| CN113076348B (en) * | 2021-04-13 | 2022-12-13 | 度小满科技(北京)有限公司 | Policy information management method, device, server and storage medium |
| CN113608796A (en) * | 2021-06-30 | 2021-11-05 | 北京新氧科技有限公司 | Rule engine configuration and operation method and device, electronic equipment and storage medium |
| CN113256275B (en) * | 2021-07-14 | 2021-11-02 | 支付宝(杭州)信息技术有限公司 | Expert system updating method, service processing method and device |
| CN113256275A (en) * | 2021-07-14 | 2021-08-13 | 支付宝(杭州)信息技术有限公司 | Expert system updating method, service processing method and device |
| CN113704117A (en) * | 2021-08-31 | 2021-11-26 | 北京三快在线科技有限公司 | Algorithm testing system, method and device |
| CN114168565A (en) * | 2021-12-10 | 2022-03-11 | 北京宇信科技集团股份有限公司 | Backtracking test method, device and system of business rule model and decision engine |
| CN114254909A (en) * | 2021-12-16 | 2022-03-29 | 天元大数据信用管理有限公司 | Risk management method and platform based on decision engine |
| WO2024017177A1 (en) * | 2022-07-18 | 2024-01-25 | 支付宝(杭州)信息技术有限公司 | Method and apparatus for executing service, storage medium and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110929879A (en) | Business decision logic updating method based on decision engine and model platform | |
| CN109858737B (en) | Grading model adjustment method and device based on model deployment and computer equipment | |
| CN109636607A (en) | Business data processing method, device and computer equipment based on model deployment | |
| CN112329022A (en) | Intelligent network automobile information security risk assessment method and system | |
| CN111176990A (en) | Test data generation method and device based on data decision and computer equipment | |
| Doyen et al. | A generic framework for generalized virtual age models | |
| CN109063984B (en) | Method, apparatus, computer device and storage medium for risky travelers | |
| CN109949154A (en) | Customer information classification method, device, computer equipment and storage medium | |
| CN109615280A (en) | Employee's data processing method, device, computer equipment and storage medium | |
| CN110084606A (en) | Risk control method, device, computer equipment and storage medium | |
| CN113256408A (en) | Risk control method and system based on consumption finance and computer equipment | |
| CN113888299A (en) | Wind control decision method and device, computer equipment and storage medium | |
| CN111831817A (en) | Questionnaire generation and analysis method and device, computer equipment and readable storage medium | |
| CN115641166A (en) | Virtual resource allocation strategy creation method and system | |
| CN111737319B (en) | User cluster prediction method, device, computer equipment and storage medium | |
| CN114372867A (en) | User credit verification and evaluation method and device and computer equipment | |
| CN112927076A (en) | Securities trading risk control method and device, computer equipment and storage medium | |
| CN112529319A (en) | Grading method and device based on multi-dimensional features, computer equipment and storage medium | |
| CN110084701A (en) | Financing platform enters method, apparatus, computer equipment and storage medium | |
| CN114553726B (en) | Network security operation and maintenance method and system based on functions and resource levels | |
| CN116012123B (en) | Wind control rule engine method and system based on Rete algorithm | |
| CN113011893B (en) | Data processing method, device, computer equipment and storage medium | |
| CN113793007B (en) | Data transaction authority control method, device and equipment | |
| CN115185923B (en) | Method and system for managing meteorological observation metadata and intelligent terminal | |
| CN113434505B (en) | Transaction information attribute retrieval method, device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200327 |
|
| RJ01 | Rejection of invention patent application after publication |