CN114912089A - Configuration method and system for algorithm quantity transmission calculation for algorithm source tracing - Google Patents

Abstract

A configuration method for algorithm mass transmission calculation for algorithm traceability, comprising steps: S100, the standard reference data maker logs in; S200, the standard reference data maker identity verification; S300, the standard reference data maker fills in the basic information of the target traceability algorithm information; S400, the standard reference data maker uploads the corresponding standard reference data package; S500, for each group of standard reference data in the standard reference data package, generate a standard reference data ID, and combine the three components of the standard reference data in the same group Parts are marked with the same ID; S600, the standard reference data maker configures the algorithm mass transmission software module corresponding to the standard reference data package. This disclosure discloses a complete set of methods and systems related to algorithm traceability, which lays a solid technical foundation for quantitative measurement and evaluation for online algorithm traceability.

Description

Configuration method and system for algorithmic volume transfer calculation for algorithm traceability

technical field

The present disclosure relates to the field of metrology, and in particular, to a configuration method and system for algorithmic mass transfer calculation for algorithm traceability, so as to ensure and evaluate the accuracy and reliability of software algorithms in terms of magnitude.

Background technique

Software, as an extension of the human mind, has significant advantages such as low cost, flexibility, and functional complexity. However, from the perspective of measurement, the software also has shortcomings such as being easy to be cheated and tampered with, bugs are not easy to find, and compliance with laws and regulations is poor, which also exposes some problems in the use of measuring instruments.

At present, the biggest difficulty in the field of metrology is how to ensure and evaluate the impact of software algorithms in measuring instruments on the accuracy and reliability of quantitative values. For example, if the same data is input into a program with the same function written by different programmers, the output results may be different, and it is difficult to judge the accuracy of the two software algorithms in terms of measurement requirements. Even if the output is the same, it is difficult to judge the compliance of a software algorithm with metrology regulations.

How to ensure and evaluate the accuracy and reliability of software algorithms is the focus of the global metrology field, but so far, the relevant research on the accuracy and reliability of software algorithms is still at the level of algorithm evaluation, which is a qualitative judgment. To ensure and evaluate the accuracy and reliability of software algorithms, the most important thing is to be able to trace the source of the algorithm.

SUMMARY OF THE INVENTION

In order to solve the above technical problems, the present disclosure innovatively provides a set of methods and systems related to algorithm traceability, so as to ensure and evaluate the accuracy and reliability of software algorithms.

The present disclosure discloses a configuration method for algorithm quantity transmission calculation for algorithm source tracing, comprising the following steps:

S100. Standard reference data maker login;

S200, standard reference data maker identity verification;

S300. The standard reference data maker fills in the basic information of the target traceability algorithm;

S400, the standard reference data maker uploads the corresponding standard reference data package;

S500, for each group of standard reference data in the standard reference data package, generate a standard reference data ID, and mark the three components of the standard reference data in the same group as the same ID;

S600. The standard reference data maker configures an algorithm data transmission software module corresponding to the standard reference data package.

In addition, the present disclosure also discloses a configuration system for algorithmic mass transfer calculation for algorithm traceability, including:

Login module, identity verification module, filling algorithm basic information module, uploading standard reference data package module, generating standard reference data ID module, configuring algorithm data transmission software module, among which,

The login module is used for the standard reference data maker to log in;

Authentication module for standard reference data maker authentication;

Fill in the basic information module of the algorithm, which is used by the standard reference data maker to fill in the basic information of the target traceability algorithm;

The upload standard reference data package module is used to upload the corresponding standard reference data package;

The generating standard reference data ID module is used to generate the standard reference data ID for each group of standard reference data in the standard reference data package, and mark the three constituent parts of the standard reference data in the same group as the same ID;

The algorithm quantity transmission software module is configured for the standard reference data maker to configure the algorithm quantity transmission software module corresponding to the standard reference data package.

In addition, the present disclosure also discloses a method for acquiring standard reference data, comprising the following steps:

ST100, the user of the algorithm to be traced is logged in;

ST200, user authentication of the algorithm to be traced;

ST300. The user of the algorithm to be traced fills in the algorithm traceability application information of the algorithm to be traced;

ST400. According to the algorithm source traceability application information, query the basic information of the target source traceability algorithm in the configuration system of the aforementioned algorithm volume transmission calculation, and when the algorithm source traceability application information matches the basic information of the target source traceability algorithm, generate a standard reference data packet;

ST500. The user of the algorithm to be traced obtains standard reference data from the standard reference data package.

preferably,

In ST300, the algorithm traceability application information includes: the name of the algorithm to be traced, the applicant's name and contact information, the applicant's affiliation, and the application date, etc.

preferably,

In ST500, the standard reference data includes standard reference input data.

In addition, the present disclosure also discloses a standard reference data system to implement any of the standard reference data acquisition methods, including:

Login module, identity verification module, filling in algorithm traceability application information module, generating standard reference data package module, obtaining standard reference data module, among which,

The login module is used to log in the user of the algorithm to be traced;

Authentication module, used for user authentication of the algorithm to be traced;

Fill in the algorithm traceability application information module, which is used by users of the algorithm to be traced to fill in the algorithm traceability application information of the algorithm to be traced;

A standard reference data packet generation module is used to query the basic information of the target source tracing algorithm in the configuration system of the aforementioned algorithm mass transmission calculation according to the algorithm source tracing application information, and when the algorithm source tracing application information matches the basic information of the target source tracing algorithm, generate standard reference package;

The module for obtaining standard reference data is used for the user of the algorithm to be traced to obtain standard reference data from the standard reference data package.

In addition, the present disclosure also discloses a method for obtaining an algorithm traceability result, comprising the following steps:

STE100, to be traced algorithm user login;

STE200, to be traced algorithm user authentication;

STE300. The user of the algorithm to be traced shall fill in the calculation result of the algorithm to be traced corresponding to the applied standard reference data;

STE400, query the standard reference data in the configuration system of the aforementioned algorithm for mass transmission calculation to verify the standard reference data of the application, and after verification is correct, calculate the indication error according to the calculation result of the algorithm to be traced and the corresponding standard reference data;

STE500, evaluate the measurement uncertainty of the indication error;

STE600. Based on the assessment, generate a digital/electronic certificate or digital/electronic report with the measurement uncertainty assessment as an algorithmic traceability result.

Preferably, it also includes the following steps:

STE700, the user of the algorithm to be traced obtains the digital/electronic certificate or digital/electronic report.

Preferably, STE500 further includes the following sub-steps:

STE501. Transfer the calculation result of the algorithm to be traced to the algorithm quantity transmission software module, calculate the evaluation index Y of the algorithm to be traced, and evaluate its measurement uncertainty.

In addition, the present disclosure also discloses an algorithmic mass transmission system to implement any method for obtaining the algorithmic traceability result, including:

A login module, an identity verification module, an algorithm calculation result module for filling in the algorithm to be traced, an indication error calculation module, an evaluation module, an algorithm traceability result generation module, and an algorithm traceability result acquisition module, among which,

The login module is used to log in the user of the algorithm to be traced;

Authentication module, used for user authentication of the algorithm to be traced;

Fill in the algorithm calculation result module of the algorithm to be traced, which is used for the user of the algorithm to be traced to fill in the calculation result of the algorithm to be traced corresponding to the applied standard reference data;

The display error calculation module is used for querying the standard reference data in the configuration system of the aforementioned algorithm quantity transmission calculation to verify the standard reference data of the application. After verification, according to the calculation result of the algorithm to be traced and the corresponding standard reference data, Calculate the indication error;

Evaluation module, used to evaluate the measurement uncertainty of the indication error;

an algorithm traceability result generation module, used for generating a digital/electronic certificate or a digital/electronic report based on the evaluation as the algorithm traceability result;

The algorithm traceability result obtaining module is used for the user of the algorithm to be traced to obtain the digital/electronic certificate or digital/electronic report.

To sum up, the present disclosure closely combines measurement technology with software testing technology, takes the standard reference data generated by the standard reference data maker as the highest standard of traceability, obtains the calculation result by inputting the standard reference data into the algorithm to be traced, and obtains the calculation result according to the calculation result and The standard reference data calculates the indication error, evaluates the measurement uncertainty of the indication error, and finally generates the algorithm traceability certificate (report) to complete the algorithm traceability. In this process, from the configuration method and system for algorithmic mass transfer calculation for algorithm traceability, to the acquisition method and system for standard reference data, to the acquisition method of algorithm traceability results and its algorithm mass transfer system, the present disclosure all With innovative design, it completely discloses a complete set of algorithm traceability methods and systems, aiming to lay a solid technical foundation for quantitative measurement and evaluation for the algorithm to be traced to realize online algorithm traceability.

Description of drawings

The accompanying drawings illustrate exemplary embodiments of the present disclosure and, together with the description, serve to explain the principles of the present disclosure, are included to provide a further understanding of the disclosure, and are incorporated in and constitute the present specification part of the manual.

1 is a schematic flowchart of a configuration method for algorithmic volume transfer calculation for algorithm traceability in an embodiment of the present disclosure;

2 is a schematic flowchart of a method for acquiring standard reference data in an embodiment of the present disclosure;

FIG. 3 is a schematic flowchart of a method for obtaining an algorithm traceability result according to an embodiment of the present disclosure.

Detailed ways

The present disclosure will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the related content, but not to limit the present disclosure. In addition, it should be noted that, for the convenience of description, only the parts related to the present disclosure are shown in the drawings.

It should be noted that the embodiments of the present disclosure and the features of the embodiments may be combined with each other unless there is conflict. The technical solutions of the present disclosure will be described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.

Unless otherwise stated, the illustrated exemplary embodiments/embodiments are to be understood as exemplary features providing various details of some ways in which the technical concept of the present disclosure may be implemented in practice. Therefore, unless otherwise stated, the features of various embodiments/embodiments may be additionally combined, separated, interchanged and/or rearranged without departing from the technical concept of the present disclosure.

The use of cross-hatching and/or hatching in the drawings is generally used to clarify boundaries between adjacent components. As such, unless stated, the presence or absence of cross-hatching or shading does not convey or represent any particular material, material properties, dimensions, proportions, commonalities between the illustrated components and/or any other characteristics of the components, any preferences or requirements for attributes, properties, etc. Furthermore, in the drawings, the size and relative sizes of components may be exaggerated for clarity and/or descriptive purposes. When example embodiments may be implemented differently, the specific process sequence may be performed in a different order than described. For example, two consecutively described processes may be performed substantially concurrently or in the reverse order of that described. In addition, the same reference numerals denote the same components.

When an element is referred to as being "on" or "over", "connected to" or "coupled to" another element, the element can be directly on, directly connected to, the other element Either directly coupled to the other component, or intermediate components may be present. However, when an element is referred to as being "directly on," "directly connected to," or "directly coupled to" another element, there are no intervening elements present. To this end, the term "connected" may refer to a physical connection, electrical connection, etc., with or without intervening components.

For descriptive purposes, the present disclosure may use terms such as "under", "under", "under", "under", "above", "on", "at" Spatially relative terms such as "above," "higher," and "side (eg, as in "sidewall")" to describe one element to another (other) element as shown in the figures Relationship. In addition to the orientation depicted in the figures, spatially relative terms are intended to include different orientations of the device in use, operation, and/or manufacture. For example, if the device in the figures is turned over, elements described as "below" or "beneath" other elements or features would then be oriented "above" the other elements or features. Thus, the exemplary term "under" can include both an orientation of "above" and "below." In addition, the device may be otherwise oriented (eg, rotated 90 degrees or at other orientations) and, as such, the spatially relative descriptors used herein should be interpreted accordingly.

The terminology used herein is for the purpose of describing particular embodiments and is not intended to be limiting. As used herein, the singular forms "a" and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. Furthermore, when the terms "comprising" and/or "including" and their variants are used in this specification, it is indicated that the stated features, integers, steps, operations, parts, components and/or groups thereof are present, but not excluded One or more other features, integers, steps, operations, parts, components and/or groups thereof are present or additional. Note also that, as used herein, the terms "substantially," "approximately," and other similar terms are used as terms of approximation and not as terms of degree, as they are used to explain what one of ordinary skill in the art would recognize Inherent deviations from measured, calculated and/or provided values.

In order to facilitate the further understanding of the present disclosure, firstly, the executive body involved in the present disclosure will be described. In the present disclosure, the following definitions are mainly involved in the entire algorithm traceability process:

1. The user of the algorithm to be traced refers to the party that owns the algorithm to be traced;

2. The standard reference data system refers to a system that allows standard reference data developers to upload standard reference data packages, configure algorithm mass transmission software modules, and respond to applications for traceable algorithm users and issue standard reference data; among them,

For the standard reference data, taking the laboratory test data for patient albumin in medical testing as an example, experts from the China Institute of Metrology and related industry experts are in accordance with the People's Republic of China "Measuring Law", with reference to the "American Standard Reference Data Law" 、Combined with the clinical industry standard "Indoor Quality Control of Quantitative Determination of Clinical Testing" (WS/T 641-2018) and the characteristics of patient albumin laboratory test data to formulate and generate standard reference data for this segment;

The standard reference data package includes three types of standard reference data sets. Each type of standard reference data set includes multiple sets of standard reference data to become a data set. Each set of standard reference data consists of three parts: standard reference input data. (for example, including 10 test data), standard reference output data (for example, label 0 or 1), measurement uncertainty of the set of standard reference data;

3. The software module of algorithm volume transmission refers to the module that realizes volume transmission calculation for the algorithm to be traced; among them,

The volume transmission calculation refers to calculating the two types of data sets by statistical or other mathematical methods, and finally obtaining the evaluation index Y of the algorithm to be traced and the corresponding measurement uncertainty; wherein, one of the two types of data sets is , in order to substitute the standard reference input data in the standard reference data package into the output result data set of the user to be traced algorithm, and the other type is the standard reference output data set in the corresponding standard reference data package;

4. Algorithm mass transmission system refers to a system that provides algorithm traceability functions for algorithm users to be traced.

Referring to FIG. 1 , in one embodiment, the present disclosure discloses a configuration method for algorithmic mass transfer calculation for algorithmic source tracing, including the following steps:

S100. Standard reference data maker login;

S200, standard reference data maker identity verification;

As mentioned above, standard reference data makers can be experts from the China Institute of Metrology or experts in related industries, and should be authorized by the relevant departments;

S300. The standard reference data maker fills in the basic information of the target traceability algorithm;

S400, the standard reference data maker uploads the corresponding standard reference data package;

S500, for each group of standard reference data in the standard reference data package, generate a standard reference data ID, and mark the three components of the standard reference data in the same group as the same ID;

S600. The standard reference data maker configures an algorithm data transmission software module corresponding to the standard reference data package.

In order to facilitate the understanding of the above embodiments, for example:

In the medical test, before the official release of the patient albumin test report, the quality control of the laboratory test data of the patient albumin obtained by the test is required to infer and evaluate the reliability of the test results, so as to judge whether the test report can be issued. , to discover and eliminate unreliable factors in the quality link in time;

A software developer has developed a machine learning quality control algorithm for patient albumin laboratory test data; in order to measure and evaluate the algorithm, it is necessary to apply the configuration method of the algorithm's mass transmission calculation for the specific algorithm in the subdivision field, wherein ,

The standard reference data maker logs in to the system, and after identity verification, fills in the machine learning quality control algorithm information of the patient albumin laboratory test data, including: algorithm name, standard reference data maker name and contact information, affiliated organization, and a brief description of the algorithm, etc.;

As for uploading the standard reference data package, mark the three components of the standard reference data in the same group with the same ID, such as D0001;

As for configuring the algorithm-based mass transmission software module, you can configure specific statistical or other mathematical methods for the two types of data sets as the key to measurement. The purpose is to obtain the evaluation index Y of the algorithm to be traced and the corresponding Measurement uncertainty; wherein, one of the two types of data sets is the output result data set after substituting the standard reference input data in the standard reference data package into the user's to-be-traced algorithm, and the other type is the corresponding standard reference The standard reference output dataset in the package.

In this way, this embodiment implements a configuration method for algorithmic mass transfer calculation for algorithm traceability through the above configuration method. Compared with traditional qualitative judgment, the above configuration method can ensure quantitative measurement and evaluate algorithm traceability.

In another embodiment, the present disclosure discloses a configuration system for algorithmic mass transfer calculation for algorithmic source tracing, including:

Login module, identity verification module, filling algorithm basic information module, uploading standard reference data package module, generating standard reference data ID module, configuring algorithm data transmission software module, among which,

The login module is used for the standard reference data maker to log in;

Authentication module for standard reference data maker authentication;

Fill in the basic information module of the algorithm, which is used by the standard reference data maker to fill in the basic information of the target traceability algorithm;

The upload standard reference data package module is used to upload the corresponding standard reference data package;

The generating standard reference data ID module is used to generate the standard reference data ID for each group of standard reference data in the standard reference data package, and mark the three constituent parts of the standard reference data in the same group as the same ID;

The algorithm quantity transmission software module is configured for the standard reference data maker to configure the algorithm quantity transmission software module corresponding to the standard reference data package.

Referring to FIG. 2, in another embodiment, the present disclosure discloses a method for acquiring standard reference data, including the following steps:

ST100, the user of the algorithm to be traced is logged in;

ST200, user authentication of the algorithm to be traced;

ST300. The user of the algorithm to be traced fills in the algorithm traceability application information of the algorithm to be traced;

ST400. According to the algorithm source traceability application information, query the basic information of the target source traceability algorithm in the configuration system of the aforementioned algorithm volume transmission calculation, and when the algorithm source traceability application information matches the basic information of the target source traceability algorithm, generate a standard reference data packet;

ST500. The user of the algorithm to be traced obtains standard reference data from the standard reference data package.

In another embodiment,

In ST300, the algorithm traceability application information includes: the name of the algorithm to be traced, the applicant's name and contact information, the applicant's affiliation, and the application date, etc.

In another embodiment,

In ST500, the standard reference data includes standard reference input data.

In this way, the user of the algorithm to be traced can refer to the input data according to the standard as the input of the algorithm to be traced, and test the algorithm to be traced to obtain the output of the algorithm to be traced.

It can be understood that the testing process prioritizes testing in a trusted environment, eg, the testing is entrusted to a trusted and authoritative third party for testing or supervision. Algorithm traceability can be realized by performing data processing on the output and the corresponding standard reference output data in the standard reference data package according to standard procedures; or, directly transmitting the output to the algorithm data transmission software module to calculate the evaluation index Y of the algorithm to be traced and the corresponding measurement uncertainty.

In addition, optionally, the standard reference data includes a standard reference input data set. The user of the to-be-traced algorithm substitutes the obtained standard reference input data set into the to-be-traced algorithm, and the algorithm runs to obtain the output result set; the user of the to-be-traced algorithm logs in again, and after identity verification, uploads the obtained output result set; the output result set is transmitted to the algorithm volume The software module is transmitted to calculate the evaluation index Y of the algorithm to be traced and the corresponding measurement uncertainty.

In another embodiment, the present disclosure discloses a standard reference data system to implement the above method for obtaining standard reference data, including:

Login module, identity verification module, filling in algorithm traceability application information module, generating standard reference data package module, obtaining standard reference data module, among which,

The login module is used to log in the user of the algorithm to be traced;

Authentication module, used for user authentication of the algorithm to be traced;

Fill in the algorithm traceability application information module, which is used by users of the algorithm to be traced to fill in the algorithm traceability application information of the algorithm to be traced;

A standard reference data packet generation module is used to query the basic information of the target source tracing algorithm in the configuration system of the aforementioned algorithm mass transmission calculation according to the algorithm source tracing application information, and when the algorithm source tracing application information matches the basic information of the target source tracing algorithm, generate standard reference package;

The module for obtaining standard reference data is used for the user of the algorithm to be traced to obtain standard reference data from the standard reference data package.

Referring to FIG. 3, in another embodiment, the present disclosure further discloses a method for obtaining an algorithm traceability result, including the following steps:

STE100, to be traced algorithm user login;

STE200, to be traced algorithm user authentication;

STE300. The user of the algorithm to be traced shall fill in the calculation result of the algorithm to be traced corresponding to the applied standard reference data;

STE400, query the standard reference data in the configuration system of the aforementioned algorithm for mass transmission calculation to verify the standard reference data of the application, and after verification is correct, calculate the indication error according to the calculation result of the algorithm to be traced and the corresponding standard reference data;

STE500, evaluate the measurement uncertainty of the indication error;

STE600. Based on the assessment, generate a digital/electronic certificate or digital/electronic report with the measurement uncertainty assessment as an algorithmic traceability result.

In another embodiment, it further includes the following steps:

STE700, the user of the algorithm to be traced obtains the digital/electronic certificate or digital/electronic report.

In another embodiment, STE500 further includes the following sub-steps:

STE501. Transfer the calculation result of the algorithm to be traced to the algorithm quantity transmission software module, calculate the evaluation index Y of the algorithm to be traced, and evaluate its measurement uncertainty.

In this way, when STE600 generates an algorithm traceability result, the algorithm traceability result also includes the evaluation index Y of the algorithm to be traced.

In another embodiment, the present disclosure discloses an algorithmic mass transmission system to implement the method for obtaining the above-mentioned algorithmic traceability result, including:

A login module, an identity verification module, an algorithm calculation result module for filling in the algorithm to be traced, an indication error calculation module, an evaluation module, an algorithm traceability result generation module, and an algorithm traceability result acquisition module, among which,

The login module is used to log in the user of the algorithm to be traced;

Authentication module, used for user authentication of the algorithm to be traced;

Fill in the algorithm calculation result module of the algorithm to be traced, which is used for the user of the algorithm to be traced to fill in the calculation result of the algorithm to be traced corresponding to the applied standard reference data;

The display error calculation module is used for querying the standard reference data in the configuration system of the aforementioned algorithm quantity transmission calculation to verify the standard reference data of the application. After verification, according to the calculation result of the algorithm to be traced and the corresponding standard reference data, Calculate the indication error;

Evaluation module, used to evaluate the measurement uncertainty of the indication error;

an algorithm traceability result generation module, used for generating a digital/electronic certificate or a digital/electronic report based on the evaluation as the algorithm traceability result;

The algorithm traceability result obtaining module is used for the user of the algorithm to be traced to obtain the digital/electronic certificate or digital/electronic report.

For example, for a patient albumin laboratory test data machine learning quality control algorithm described above, the final algorithm traceability result may be as follows:

The value range of the evaluation index Y is [0, 100%]. When the value of Y tends to 100%, it indicates that the output result of the algorithm to be traced is sufficiently accurate and reliable. When the Y value tends to 0, it means that the implementation process of the algorithm to be traced does not meet the requirements of laboratory test data quality control. The corresponding measurement uncertainty shows the dispersion of the Y value. In this case, the evaluation index Y of the machine learning quality control algorithm for the patient albumin laboratory test data is 71.3%, indicating that the output results of the algorithm are basically accurate and reliable, but the design of the algorithm also has some defects. For example, in this case The input vectors corresponding to different features of the machine learning algorithm should be independent of each other, but in fact, after analyzing the data features of the training set, there is a certain correlation between the input vectors, which is related to the floating mean value in the data preprocessing stage. It is related to the import order of the overall detection data when the outliers are eliminated by the algorithm, and it is recommended that the algorithm makers focus on solving this problem.

In the description of this specification, references to the terms "one embodiment/mode", "some embodiments/modes", "example", "specific example", or "some examples", etc. are intended to be combined with the description of the embodiment/mode A particular feature, structure, material, or characteristic described or exemplified is included in at least one embodiment/mode or example of the present disclosure. In this specification, schematic representations of the above terms are not necessarily directed to the same embodiment/mode or example. Furthermore, the particular features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments/means or examples. Furthermore, those skilled in the art may combine and combine the different embodiments/modes or examples described in this specification and the features of the different embodiments/modes or examples without conflicting each other.

In addition, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature delimited with "first", "second" may expressly or implicitly include at least one of that feature. In the description of the present disclosure, "plurality" means at least two, such as two, three, etc., unless expressly and specifically defined otherwise.

Those skilled in the art should understand that the above-mentioned embodiments are only for clearly illustrating the present disclosure, rather than limiting the scope of the present disclosure. For those skilled in the art, other changes or modifications may also be made on the basis of the above disclosure, and these changes or modifications are still within the scope of the present disclosure.

Claims (10)

1. A configuration method for algorithm quantity transmission calculation for algorithm traceability, comprising the steps: S100. Standard reference data maker login; S200, standard reference data maker identity verification; S300. The standard reference data maker fills in the basic information of the target traceability algorithm; S400, the standard reference data maker uploads the corresponding standard reference data package; S500, for each group of standard reference data in the standard reference data package, generate a standard reference data ID, and mark the three components of the standard reference data in the same group as the same ID; S600. The standard reference data maker configures an algorithm data transmission software module corresponding to the standard reference data package. 2. A configuration system for algorithm quantity transmission calculation for algorithm traceability, comprising: Login module, identity verification module, filling algorithm basic information module, uploading standard reference data package module, generating standard reference data ID module, configuring algorithm data transmission software module, among which, The login module is used for the standard reference data maker to log in; Authentication module for standard reference data maker authentication; Fill in the basic information module of the algorithm, which is used by the standard reference data maker to fill in the basic information of the target traceability algorithm; The upload standard reference data package module is used to upload the corresponding standard reference data package; The generating standard reference data ID module is used to generate the standard reference data ID for each group of standard reference data in the standard reference data package, and mark the three constituent parts of the standard reference data in the same group as the same ID; The algorithm quantity transmission software module is configured for the standard reference data maker to configure the algorithm quantity transmission software module corresponding to the standard reference data package. 3. A method for obtaining standard reference data, comprising the steps of: ST100, the user of the algorithm to be traced is logged in; ST200, user authentication of the algorithm to be traced; ST300. The user of the algorithm to be traced fills in the algorithm traceability application information of the algorithm to be traced; ST400. According to the algorithm source traceability application information, query the basic information of the target source traceability algorithm in the configuration system of the aforementioned algorithm volume transmission calculation, and when the algorithm source traceability application information matches the basic information of the target source traceability algorithm, generate a standard reference data packet; ST500. The user of the algorithm to be traced obtains standard reference data from the standard reference data package. 4. The method of claim 3, wherein, In ST300, the algorithm traceability application information includes: the name of the algorithm to be traced, the applicant's name and contact information, the applicant's affiliation, and the application date, etc. 5. The method of claim 3, wherein, In ST500, the standard reference data includes standard reference input data. 6. A standard reference data system, to implement the method for obtaining the standard reference data according to any one of claims 4 to 5, comprising: Login module, identity verification module, filling in algorithm traceability application information module, generating standard reference data package module, obtaining standard reference data module, among which, The login module is used to log in the user of the algorithm to be traced; Authentication module, used for user authentication of the algorithm to be traced; Fill in the algorithm traceability application information module, which is used by users of the algorithm to be traced to fill in the algorithm traceability application information of the algorithm to be traced; A standard reference data packet generation module is used to query the basic information of the target source tracing algorithm in the configuration system of the aforementioned algorithm mass transmission calculation according to the algorithm source tracing application information, and when the algorithm source tracing application information matches the basic information of the target source tracing algorithm, generate Standard reference package; The module for obtaining standard reference data is used for the user of the algorithm to be traced to obtain standard reference data from the standard reference data package. 7. A method for obtaining an algorithm traceability result, comprising the following steps: STE100, to be traced algorithm user login; STE200, to be traced algorithm user authentication; STE300. The user of the algorithm to be traced shall fill in the calculation result of the algorithm to be traced corresponding to the applied standard reference data; STE400, query the standard reference data in the configuration system of the aforementioned algorithm for mass transmission calculation to verify the standard reference data of the application, and after verification is correct, calculate the indication error according to the calculation result of the algorithm to be traced and the corresponding standard reference data; STE500, evaluate the measurement uncertainty of the indication error; STE600. Based on the assessment, generate a digital/electronic certificate or digital/electronic report with the measurement uncertainty assessment as an algorithmic traceability result. 8. The method according to claim 7, further comprising the steps of: STE700, the user of the algorithm to be traced obtains the digital/electronic certificate or digital/electronic report. 9. The method according to claim 7, STE500 further comprises the following substeps: STE501. Transfer the calculation result of the algorithm to be traced to the algorithm quantity transmission software module, calculate the evaluation index Y of the algorithm to be traced, and evaluate its measurement uncertainty. 10. An algorithmic mass transmission system, to implement the acquisition method of the algorithm traceability result of any one of claims 7 to 9, comprising: A login module, an identity verification module, an algorithm calculation result module for filling in the algorithm to be traced, an indication error calculation module, an evaluation module, an algorithm traceability result generation module, and an algorithm traceability result acquisition module, among which, The login module is used to log in the user of the algorithm to be traced; Authentication module, used for user authentication of the algorithm to be traced; Fill in the algorithm calculation result module of the algorithm to be traced, which is used for the user of the algorithm to be traced to fill in the calculation result of the algorithm to be traced corresponding to the applied standard reference data; The display error calculation module is used for querying the standard reference data in the configuration system of the aforementioned algorithm quantity transmission calculation to verify the standard reference data of the application. After verification, according to the calculation result of the algorithm to be traced and the corresponding standard reference data, Calculate the indication error; Evaluation module, used to evaluate the measurement uncertainty of the indication error; an algorithm traceability result generation module, used for generating a digital/electronic certificate or a digital/electronic report based on the evaluation as the algorithm traceability result; The algorithm traceability result obtaining module is used for the user of the algorithm to be traced to obtain the digital/electronic certificate or digital/electronic report.

Images