CN112182831B

CN112182831B - Intelligent casting and looking industry test and evaluation sandbox

Info

Publication number: CN112182831B
Application number: CN201910757997.8A
Authority: CN
Inventors: 蔡维德; 蔡维纲
Original assignee: Qingdao Tiande Xinlian Information Technology Co ltd; Tianmin Qingdao International Sandbox Research Institute Co ltd; Beijing Tiande Technology Co ltd
Current assignee: Qingdao Tiande Xinlian Information Technology Co ltd; Tianmin Qingdao International Sandbox Research Institute Co ltd; Beijing Tiande Technology Co ltd
Priority date: 2019-08-16
Filing date: 2019-08-16
Publication date: 2021-08-17
Anticipated expiration: 2039-08-16
Also published as: CN112182831A

Abstract

Intelligent delivery industry test evaluation and evaluation sandbox method and system for testing and evaluating intelligent delivery products in a block chain sandbox manner. Test data of intelligent commissioning products, intelligent commissioning product operating software, and intelligent commissioning product evaluation software must be taken from one or more blockchains; test and evaluation results must pass a consensus or verification process, which may be part of a certain blockchain operation or independent of any blockchain operation; after consensus and/or verification, test results and evaluation results must be placed on one or more blockchain systems.

Description

Intelligent casting and looking industry test and evaluation sandbox

Technical Field

The invention relates to a method and a system for intelligent delivery and more particularly to a method and a system for testing and evaluating intelligent delivery and delivery of management in a sandbox manner.

Background

The intelligent delivery and service is also called as robot financing, which is that a virtual robot completes the original financing consultant service provided manually through an algorithm and a product based on the own financing requirement of a client.

Clearly, smart commissioning products must be tested in a trusted and standardized environment. Intelligent patronage requires credit because fraudulent intelligent patronage can cause significant economic loss to investors. Intelligent commissioning also requires standardized testing, as each intelligent commissioning product claims to be able to earn money, but these claims must be compared on an equal basis. Investment advice must perform well in a variety of markets and extensive testing is necessary. In addition, many intelligent commissioning products claim to be able to make custom-tailored investment recommendations based on different investor needs. These products must be custom-made tested to verify that their claims are sufficiently relied upon.

Sandbox (sandbox) is a computer science term that refers to an isolated and secure environment for running programs. For processes that are untrusted, destructive, or incapable of determining the intent of the process, sandboxes provide a secure environment for experimentation, testing, and evaluation.

Thus, the sandbox environment is a good framework for testing and evaluating intelligent patronage. The evaluation (testing) of trusted and standardized intelligent commissioning can be divided into three test points: the first step ensures that the input test data is approved standard data, the second step ensures that the intelligent algorithm cannot be adjusted or tampered before and after running, and the third step ensures that the output operation result of intelligent administration is real and cannot be tampered.

In the market of intelligent patronage, there are some fraud. Many fraud phenomena are rooted in three links of "test data", "test algorithm" and "test result".

In the "test data" link, there is applicable non-standard, incorrect data.

In the step of testing the algorithm, an algorithm which can be realized by external declaration exists, but another algorithm is used in real operation, or even the algorithm is realized manually. Although the operation result meets the requirement, the process does not use a real and effective algorithm. Because the algorithm program has the situation of continuous iterative updating, the requirements of anchoring time, anchoring place and the like also exist in the evaluation of the algorithm, so that the result of the algorithm test is ensured to meet the requirements. In the "test result" link, there is also a possibility that the result is falsified.

Based on these three-step test points, non-tamper-able and standardized requirements are the most important factors. Here, blockchains become a useful tool; the data of the blockchain is not changeable and the data of each node is guaranteed to be consistent. This property plays a key role in sandboxing tests. The block chain technique is well suited for intelligent commissioning system evaluation (testing). Today, intelligent commissioning of test sandboxes requires the use of blockchain techniques to provide a proper framework and consistent test methodology.

Disclosure of Invention

Aspects of the present invention relate to methods and systems for testing and evaluating smart commissioning products in a sandbox fashion. Reference will be made hereinafter to a sandbox system for intelligent commissioning product testing and evaluation. This sandbox system will be referred to simply as the "sandbox system".

According to one aspect of the invention, suitable test data may include analog (simulation) data. But the simulated data must have the same statistical properties as the real data, such as mean, variance, and/or other parameters. In one embodiment, suitable test data may be real data, or simulated data, or a mixture of real and simulated data; the simulation data needs to be statistically consistent with the real data, that is, the simulation data and the real data have the same statistical characteristics.

An intelligent commissioning provider may take his product to a sandbox system for testing and evaluation. This intelligent delivery and service provider provides: (1) test data provided by a supplier; (2) the black box or white box software (i.e. the black box or white box algorithm for intelligent delivery) of the product must be installed in a sandbox system test environment; (3) a related document about the product.

The testing and evaluation of the sandbox system should satisfy 3 conditions: (1) test data of intelligent commissioning products, intelligent commissioning product operating software, and intelligent commissioning product evaluation software must be taken from one or more blockchains; (2) test and evaluation results must pass a consensus or verification process, which may be part of a certain blockchain operation or independent of any blockchain operation; (3) after consensus and/or verification, test results and evaluation results must be placed on one or more blockchain systems.

In one embodiment, the sandbox system stores all vendor-supplied test data in one or more blockchains, and in addition, the hash value of that data is also stored in one or more blockchains. In addition, any new test data, or modifications to the test data, are also placed on one or more block chains; and the hash value of the new test data, or/and the modified hash value of the test data, is also placed on one or more blockchains.

In one embodiment, an algorithmic implementation of the intelligent commissioning of the product (software), intelligent commissioning product testing software, and intelligent commissioning product evaluation software are also stored in one or more blockchains. The algorithm implementation of the intelligent commissioning product can be a black box. The hash value of the algorithm implementation (software) of the intelligent commissioning product, the hash value of the intelligent commissioning product test software, or/and the hash value of the intelligent commissioning product evaluation software is also stored in one or more blockchains.

In one embodiment, the environment data for the algorithm to run, the time, place, input data, output results of the algorithm, and all or part of the hash values associated with the information are also stored in one or more block chains for the smart commissioning product when it is tested and evaluated.

In one embodiment, after the smart commissioning product is tested, the output results are also stored on one or more blockchains; in addition, the hash value of the output result is also placed on one or more blockchains. In one embodiment, all results are first placed on one or more blockchains before they are published or delivered by the sandbox system.

In one embodiment, the output results of the intelligent commissioning product after being evaluated are also known to be the actual operation results and stored in one or more block chains. In one embodiment, the results of the evaluation, any evaluation criteria, software for evaluation, time of evaluation, data for evaluation, etc. are all placed on one or more blockchains after blockchain consensus or verification. All or part of the hash values associated with the information are also stored in one or more blockchains.

In one embodiment, the evaluation software that evaluates the intelligent commissioning product, evaluates the time, place, input data, output results of the run, is also placed on one or more blockchains.

Drawings

The foregoing and other features, aspects and advantages of the present invention are described in detail below with reference to the drawings of various embodiments, which are intended to illustrate and not to limit the invention. The drawings include the following figures, wherein:

FIG. 1 shows a block diagram of FIG. 1 illustrating the process of testing and evaluating smart commissioning products via a sandbox blockchain platform.

Detailed Description

The invention will be further described by way of examples, without in any way limiting the scope of the invention, with reference to the accompanying drawings.

Embodiments of the present invention will now be described with reference to the drawings, wherein like reference numerals refer to like elements throughout. The terminology used in the description presented herein is not intended to be interpreted in any limited or restrictive manner, simply because it is being utilized in conjunction with a detailed description of certain specific embodiments of the invention. Furthermore, embodiments of the invention may include several novel features, no single one of which is solely responsible for its desirable attributes or which is essential to practicing the inventions herein described.

FIG. 1 illustrates a sandbox system for implementing testing and evaluation of intelligent commissioning products using a blockchain platform. In this embodiment, the intelligent patronage product is used for stock investments. In the test platform, on the left side of the figure, there are N + 2 test data sets: 2 sets of stock market test data (real data), and N sets of simulated stock market test data (simulated data).

At the center of fig. 1, a box labeled "smart commissioning product (black box)" represents certain smart commissioning black box software that acquires data from multiple test data sets and generates outputs that are put into different test models. On the right side of the figure, there are a plurality of test models, represented by test model a, test model B. In each test model, there may be multiple test results: in fig. 1 n represents the number of test results. In actual testing, the number (n) of test results for different test patterns may be different. Each intelligent commissioning product is evaluated by a plurality of different test models. And according to the test results of different test models, ranking the tested intelligent commissioning products in a sandbox system platform.

In FIG. 1, all test data sets, intelligent commissioning blackbox software and all test models, and test results are collected as evidence and stored in one or more blockchains through a blockchain platform.

Claims

1. A sandbox system for testing and evaluating intelligent products for delivery and care based on block chains is characterized in that test data of the intelligent products for delivery and care, intelligent product operation software for delivery and care and intelligent product evaluation software for delivery and care are taken from one or more block chains; test and evaluation results must pass a consensus or verification process, which may be part of a certain blockchain operation or independent of any blockchain operation; after consensus and/or verification, test results and evaluation results must be placed on one or more blockchain systems; the test data and the real data have the same statistical characteristics, and the statistical characteristics comprise mean values and/or variance; the test data is real data, simulation data or a mixture of the real data and the simulation data, and the simulation data and the real data have the same statistical characteristics; when the intelligent commissioning product is tested and evaluated, environment information of operation of an algorithm in a testing and evaluating subsystem of the intelligent commissioning product is stored, and the time, the place, the input data and the output result of the operation of the algorithm in the testing and evaluating subsystem of the intelligent commissioning product are also stored in one or more block chains; when the intelligent commissioning product is tested and evaluated, the hash value of the environment data of the operation of the algorithm in the test and evaluation subsystem of the intelligent commissioning product, the hash value of the operation time, the hash value of the operation place, the hash value of the input data and the hash value of the output result of the algorithm in the test and evaluation subsystem of the intelligent commissioning product are also stored in one or more block chains; storing the time, the place, the input data and the output result of the operation in the operation subsystem of the evaluation intelligent commissioning product on one or more block chains; the hash value is all or part of the hash value of the related information; the operation subsystem of the intelligent casting and caring product is a black box system or a white box system; and after the result is output and the result is identified, the real operation result is obtained and is stored on one or more block chains.