CN114912089A - Configuration method and system for algorithm quantity transmission calculation for algorithm source tracing - Google Patents
Configuration method and system for algorithm quantity transmission calculation for algorithm source tracing Download PDFInfo
- Publication number
- CN114912089A CN114912089A CN202210492943.5A CN202210492943A CN114912089A CN 114912089 A CN114912089 A CN 114912089A CN 202210492943 A CN202210492943 A CN 202210492943A CN 114912089 A CN114912089 A CN 114912089A
- Authority
- CN
- China
- Prior art keywords
- algorithm
- reference data
- standard reference
- module
- traced
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000004422 calculation algorithm Methods 0.000 title claims abstract description 282
- 238000004364 calculation method Methods 0.000 title claims abstract description 50
- 238000000034 method Methods 0.000 title claims abstract description 49
- 230000005540 biological transmission Effects 0.000 title claims abstract description 46
- 238000005259 measurement Methods 0.000 claims abstract description 28
- 238000011156 evaluation Methods 0.000 claims abstract description 23
- 238000012795 verification Methods 0.000 claims abstract description 14
- 239000007787 solid Substances 0.000 abstract description 2
- 102000009027 Albumins Human genes 0.000 description 8
- 108010088751 Albumins Proteins 0.000 description 8
- 238000001514 detection method Methods 0.000 description 7
- 238000003908 quality control method Methods 0.000 description 7
- 239000000463 material Substances 0.000 description 6
- 238000012360 testing method Methods 0.000 description 6
- 238000010801 machine learning Methods 0.000 description 5
- 238000007689 inspection Methods 0.000 description 3
- 238000009533 lab test Methods 0.000 description 3
- 238000012067 mathematical method Methods 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000002558 medical inspection Methods 0.000 description 2
- 239000013598 vector Substances 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000013522 software testing Methods 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/50—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
- G06F21/57—Certifying or maintaining trusted computer platforms, e.g. secure boots or power-downs, version controls, system software checks, secure updates or assessing vulnerabilities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computer Security & Cryptography (AREA)
- Quality & Reliability (AREA)
- Storage Device Security (AREA)
- Stored Programmes (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Supply And Distribution Of Alternating Current (AREA)
Abstract
A configuration method for algorithm quantity transmission calculation of algorithm source tracing comprises the following steps: s100, logging in by a standard reference data maker; s200, standard reference data maker identity verification; s300, filling basic information of a target traceability algorithm by a standard reference data maker; s400, uploading a corresponding standard reference data packet by a standard reference data maker; s500, generating a standard reference data ID for each group of standard reference data in the standard reference data packet, and marking three components of the same group of standard reference data as the same ID; s600, configuring an algorithm quantity transmission software module corresponding to the standard reference data packet by the standard reference data maker. The disclosure discloses a whole set of algorithm traceability related method and system, which lays a solid technical foundation for quantitative measurement and evaluation for online algorithm traceability.
Description
Technical Field
The disclosure relates to the field of metering, in particular to a configuration method and a configuration system for algorithm quantity transmission calculation for algorithm source tracing, so as to guarantee accuracy and reliability of software algorithm on quantity values.
Background
The software has the obvious advantages of low cost, flexibility, functional complexity and the like as the expansion of human thinking. However, from the metering point of view, the software has the defects of easy cheating and tampering, difficult Bug discovery, poor law and regulation compliance and the like, which also exposes some problems in the use of the metering device.
The biggest difficulty faced in the field of metrology at present is how to guarantee and evaluate the accurate and reliable impact of software algorithms in a metrology device on the magnitude. For example, inputting the same data into a program with the same function written by different programmers may result in different output results, making it difficult to judge the accuracy of the two software algorithms in the metering requirements. Even if the output result is the same, the compliance of the software algorithm to the metering regulation is difficult to judge.
How to guarantee and evaluate the accuracy and reliability of the software algorithm on the quantity value is the focus of attention in the global metering field, but until now, the related research on the accuracy and reliability of the software algorithm is still in the algorithm evaluation level, and belongs to qualitative judgment. The most important thing is to guarantee and evaluate the accuracy and reliability of the software algorithm in terms of magnitude, and the algorithm can be traced.
Disclosure of Invention
In order to solve the technical problems, the present disclosure innovatively provides a whole set of algorithm tracing related methods and systems thereof to ensure and evaluate accuracy and reliability of software algorithms in terms of magnitude.
The invention discloses a configuration method for algorithm quantity transmission calculation for algorithm source tracing, which comprises the following steps:
s100, logging in by a standard reference data maker;
s200, standard reference data maker identity verification;
s300, filling basic information of a target traceability algorithm by a standard reference data maker;
s400, uploading a corresponding standard reference data packet by a standard reference data maker;
s500, generating a standard reference data ID for each group of standard reference data in the standard reference data packet, and marking three components of the standard reference data in the same group as the same ID;
s600, configuring an algorithm quantity transmission software module corresponding to the standard reference data packet by the standard reference data maker.
In addition, the present disclosure also discloses a configuration system for algorithm quantity transmission calculation of algorithm tracing, including:
a login module, an identity verification module, a module for filling basic information of algorithm, a module for uploading standard reference data packet, a module for generating standard reference data ID, and a module for configuring algorithm quantity transmission software,
the login module is used for logging in by a standard reference data maker;
the identity authentication module is used for authenticating the identity of the standard reference data maker;
a filling algorithm basic information module used for filling basic information of a target traceability algorithm by a standard reference data maker;
the standard reference data packet uploading module is used for uploading the corresponding standard reference data packet;
a standard reference data ID generation module for generating a standard reference data ID for each group of standard reference data in the standard reference data packet, and marking three components of the standard reference data in the same group as the same ID;
and the configuration algorithm quantity transmission software module is used for configuring the algorithm quantity transmission software module corresponding to the standard reference data packet by the standard reference data maker.
In addition, the disclosure also discloses a method for acquiring the standard reference data, which comprises the following steps:
ST100, logging in by a user of a to-be-traced algorithm;
ST200, verifying the user identity by a to-be-traced algorithm;
ST300, filling algorithm traceability application information of the algorithm to be traceable by a user of the algorithm to be traceable;
ST400, inquiring basic information of a target traceability algorithm in the configuration system calculated by algorithm quantity transmission according to the algorithm traceability application information, and generating a standard reference data packet when the algorithm traceability application information is matched with the basic information of the target traceability algorithm;
ST500, the user of the algorithm to be traced obtains the standard reference data from the standard reference data packet.
Preferably, the first and second liquid crystal materials are,
in ST300, the algorithm tracing application information includes: the name of the algorithm to be traced, the name and contact way of the applicant, the unit to which the applicant belongs, the application date and the like.
Preferably, the first and second liquid crystal materials are,
in ST500, the standard reference data includes standard reference input data.
In addition, the present disclosure also discloses a standard reference data system to implement any one of the standard reference data acquisition methods, including:
a login module, an identity verification module, a module for filling algorithm tracing application information, a module for generating a standard reference data packet and a module for acquiring standard reference data,
the login module is used for logging in a user to be traced;
the identity authentication module is used for authenticating the identity of the user by the algorithm to be traced;
the system comprises a filling algorithm traceability application information module, a traceability algorithm module and a traceability management module, wherein the filling algorithm traceability application information module is used for filling algorithm traceability application information of a traceability algorithm to be traced by a user of the traceability algorithm to be traced;
the standard reference data packet generation module is used for inquiring basic information of the target traceability algorithm in the algorithm quantity transmission calculation configuration system according to the algorithm traceability application information and generating a standard reference data packet when the algorithm traceability application information is matched with the basic information of the target traceability algorithm;
and the standard reference data obtaining module is used for obtaining standard reference data from the standard reference data packet by the algorithm to be traced.
In addition, the present disclosure also discloses a method for obtaining the algorithm tracing result, which includes the following steps:
STE100, logging in by a user of a to-be-traced algorithm;
STE200, user identity authentication of a source-to-be-traced algorithm;
STE300, a user of the algorithm to be traced fills in a calculation result of the algorithm to be traced corresponding to the applied standard reference data;
the STE400 is used for inquiring standard reference data in a configuration system for algorithm measurement and calculation to verify the applied standard reference data, and after the standard reference data are verified to be correct, indicating value errors are calculated according to the calculation result of the algorithm to be traced and the corresponding standard reference data;
STE500, evaluating the measurement uncertainty of the indicating value error;
the STE600, based on said assessment, generates a digital/electronic certificate or a digital/electronic report with the assessment of the measurement uncertainty as a result of the algorithmic tracing.
Preferably, the method further comprises the following steps:
the STE700, the algorithm to be traced user acquires the digital/electronic certificate or the digital/electronic report.
Preferably, the STE500 further comprises the following sub-steps:
and the STE501 transmits the calculation result of the algorithm to be traced to the algorithm quantity transmission software module, calculates the evaluation index Y of the algorithm to be traced and evaluates the measurement uncertainty of the algorithm to be traced.
In addition, the present disclosure also discloses an algorithm quantity transmission system to implement any one of the methods for obtaining the algorithm tracing result, including:
a login module, an identity verification module, an algorithm calculation result module for filling in the algorithm to be traced, a value indicating error calculation module, an evaluation module, an algorithm tracing result generation module and an algorithm tracing result acquisition module, wherein,
the login module is used for logging in a user to be traced;
the identity authentication module is used for authenticating the identity of the user by the algorithm to be traced;
the algorithm calculation result filling module is used for filling calculation results of the algorithm to be traced corresponding to the applied standard reference data in the algorithm to be traced by the user;
the indicating value error calculation module is used for inquiring the standard reference data in the configuration system for the algorithm quantity transmission calculation to verify the applied standard reference data, and calculating the indicating value error according to the calculation result of the algorithm to be traced and the corresponding standard reference data after the standard reference data is verified to be correct;
the evaluation module is used for evaluating the uncertainty of the indicating value error measurement;
an algorithm traceability result generation module, configured to generate a digital/electronic certificate or a digital/electronic report as an algorithm traceability result based on the evaluation;
and the algorithm traceability result acquisition module is used for acquiring the digital/electronic certificate or the digital/electronic report by the algorithm to be traced.
In summary, the metering technology and the software testing technology are closely combined, standard reference data generated by a standard reference data maker is used as the highest standard of traceability, a calculation result is obtained by inputting the standard reference data into an algorithm to be traced, an indication error is calculated according to the calculation result and the standard reference data, measurement uncertainty evaluation is carried out on the indication error, an algorithm traceability certificate (report) is finally generated, and algorithm traceability is completed. In the process, the method and the system for configuring the algorithm quantity transmission calculation for algorithm traceability, the method and the system for acquiring the standard reference data, the method and the system for acquiring the algorithm traceability result and the algorithm quantity transmission system thereof are innovatively designed, a whole set of algorithm traceability method and system is completely disclosed, and the purpose of laying a solid technical foundation for quantitative measurement and evaluation for the algorithm to be traceable to realize online algorithm traceability is achieved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this specification, illustrate exemplary embodiments of the disclosure and together with the description serve to explain the principles of the disclosure.
FIG. 1 is a schematic flow chart diagram illustrating a configuration method for algorithm metric computation for algorithm tracing according to an embodiment of the present disclosure;
FIG. 2 is a schematic flow chart diagram illustrating a method for obtaining standard reference data according to an embodiment of the present disclosure;
fig. 3 is a schematic flowchart of a method for obtaining an algorithm tracing result according to an embodiment of the present disclosure.
Detailed Description
The present disclosure will be described in further detail with reference to the drawings and embodiments. It is to be understood that the specific embodiments described herein are for purposes of illustration only and are not to be construed as limitations of the present disclosure. It should be further noted that, for the convenience of description, only the portions relevant to the present disclosure are shown in the drawings.
It should be noted that the embodiments and features of the embodiments in the present disclosure may be combined with each other without conflict. Technical solutions of the present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
Unless otherwise indicated, the illustrated exemplary embodiments/examples are to be understood as providing exemplary features of various details of some ways in which the technical concepts of the present disclosure may be practiced. Accordingly, unless otherwise indicated, features of the various embodiments may be additionally combined, separated, interchanged, and/or rearranged without departing from the technical concept of the present disclosure.
The use of cross-hatching and/or shading in the drawings is generally used to clarify the boundaries between adjacent components. As such, unless otherwise noted, the presence or absence of cross-hatching or shading does not convey or indicate any preference or requirement for a particular material, material property, size, proportion, commonality between the illustrated components and/or any other characteristic, attribute, property, etc., of a component. Further, in the drawings, the size and relative sizes of components may be exaggerated for clarity and/or descriptive purposes. While example embodiments may be practiced differently, the specific process sequence may be performed in a different order than that described. For example, two processes described consecutively may be performed substantially simultaneously or in reverse order to that described. In addition, like reference numerals denote like parts.
When an element is referred to as being "on" or "on," "connected to" or "coupled to" another element, it can be directly on, connected or coupled to the other element or intervening elements may be present. However, when an element is referred to as being "directly on," "directly connected to" or "directly coupled to" another element, there are no intervening elements present. For purposes of this disclosure, the term "connected" may refer to physically, electrically, etc., and may or may not have intermediate components.
For descriptive purposes, the present disclosure may use spatially relative terms such as "below … …," below … …, "" below … …, "" below, "" above … …, "" above, "" … …, "" higher, "and" side (e.g., as in "side wall") to describe one component's relationship to another (other) component as illustrated in the figures. Spatially relative terms are intended to encompass different orientations of the device in use, operation, and/or manufacture in addition to the orientation depicted in the figures. For example, if the device in the figures is turned over, elements described as "below" or "beneath" other elements or features would then be oriented "above" the other elements or features. Thus, the exemplary term "below … …" can encompass both an orientation of "above" and "below". Further, the devices may be otherwise positioned (e.g., rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein interpreted accordingly.
The terminology used herein is for the purpose of describing particular embodiments and is not intended to be limiting. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Furthermore, when the terms "comprises" and/or "comprising" and variations thereof are used in this specification, the presence of stated features, integers, steps, operations, elements, components and/or groups thereof are stated but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and/or groups thereof. It is also noted that, as used herein, the terms "substantially," "about," and other similar terms are used as approximate terms and not as degree terms, and as such, are used to interpret inherent deviations in measured values, calculated values, and/or provided values that would be recognized by one of ordinary skill in the art.
In order to facilitate further understanding of the present disclosure, the execution subject involved in the present disclosure is first described, and in the present disclosure, the following definitions are mainly involved in the whole algorithm tracing process:
1. the user of the algorithm to be traced refers to the party with the algorithm to be traced;
2. the standard reference data system is a system which allows a standard reference data maker to upload a standard reference data packet and configure an algorithm quantity transmission software module and can respond to the application of a to-be-traced algorithm user and issue standard reference data; wherein,
for standard reference data, taking the detection data of the laboratory for the albumin of the patient in medical inspection as an example, the experts of the China measurement science research institute and the experts in the related industry field formulate and generate standard reference data of the subdivision field according to the measuring law of the people's republic of China, the American standard reference data law, the clinical industry standard clinical inspection quantitative determination indoor quality control (WS/T641-2018) and the detection data characteristics of the laboratory for the albumin of the patient;
the standard reference data packet comprises three types of standard reference data sets, wherein each type of standard reference data set comprises a plurality of groups of standard reference data to form a data set, and each group of standard reference data comprises three parts: standard reference input data (e.g., including 10 detection data), standard reference output data (e.g., tag 0 or 1), measurement uncertainty for the set of standard reference data;
3. the algorithm quantity transmission software module is a module for realizing quantity transmission calculation by aiming at the algorithm to be traced; wherein,
the quantity transmission calculation refers to calculating the two types of data sets through statistics or other mathematical methods to finally obtain the evaluation index Y of the algorithm to be traced and the corresponding measurement uncertainty; one of the two types of data sets is an output result data set obtained by substituting standard reference input data in a standard reference data packet into a user to-be-traced algorithm, and the other type of data set is a standard reference output data set in a corresponding standard reference data packet;
4. the algorithm quantity transmission system is a system for providing algorithm source tracing function for the algorithm user to be traced.
Referring to fig. 1, in one embodiment, the present disclosure discloses a configuration method for algorithm metric computation for algorithm tracing, comprising the following steps:
s100, logging in by a standard reference data maker;
s200, standard reference data maker identity verification;
as mentioned above, the standard reference data maker can be an expert of China metrological scientific research institute and an expert of related industry field, and should be authorized by related departments;
s300, filling basic information of a target traceability algorithm by a standard reference data maker;
s400, uploading a corresponding standard reference data packet by a standard reference data maker;
s500, generating a standard reference data ID for each group of standard reference data in the standard reference data packet, and marking three components of the standard reference data in the same group as the same ID;
s600, configuring an algorithm quantity transmission software module corresponding to the standard reference data packet by the standard reference data maker.
To facilitate understanding of the above embodiments, for example:
in medical inspection, before a patient albumin inspection report is formally released, quality control needs to be carried out on the detected patient albumin laboratory detection data so as to deduce and evaluate the reliability of the detection result, judge whether the inspection report can be sent out or not, and timely discover and eliminate unreliable factors of quality links;
a software developer develops a patient albumin laboratory test data machine learning quality control algorithm; in order to meter and evaluate the algorithm, a configuration method of the algorithm metric calculation needs to be applied to the specific algorithm of the subdivided field, wherein,
the standard reference data maker logs in the system, and fills in the machine learning quality control algorithm information of the laboratory detection data of the albumin of the patient after identity verification, and the method comprises the following steps: the method comprises the following steps of (1) simply describing an algorithm name, a standard reference data maker name and a contact way, a unit to which the standard reference data maker belongs, an algorithm and the like;
as for uploading the standard reference data packet, marking three components of the standard reference data of the same group as the same ID, such as D0001;
as for the configuration algorithm quantity transmission software module, a specific statistical or other mathematical method can be configured for the two types of data sets, and the specific statistical or other mathematical method is taken as the key of measurement, so that the evaluation index Y of the algorithm to be traced and the corresponding measurement uncertainty are obtained by the method; one of the two types of data sets is an output result data set obtained by substituting standard reference input data in a standard reference data packet into a user to-be-traced algorithm, and the other type of data set is a standard reference output data set in a corresponding standard reference data packet.
Therefore, the configuration method for algorithm quantity transmission calculation for algorithm source tracing is realized through the configuration method, and compared with the traditional qualitative judgment, the configuration method can guarantee quantitative measurement and evaluate algorithm source tracing.
In another embodiment, the present disclosure discloses a configuration system for algorithm metric computation for algorithm tracing, comprising:
a login module, an identity verification module, a module for filling basic information of algorithm, a module for uploading standard reference data packet, a module for generating standard reference data ID, and a module for configuring algorithm quantity transmission software,
the login module is used for logging in by a standard reference data maker;
the identity authentication module is used for authenticating the identity of the standard reference data maker;
the filling algorithm basic information module is used for filling basic information of a target traceability algorithm by a standard reference data maker;
the standard reference data packet uploading module is used for uploading the corresponding standard reference data packet;
a standard reference data ID generation module for generating a standard reference data ID for each group of standard reference data in the standard reference data packet, and marking three components of the standard reference data in the same group as the same ID;
and the configuration algorithm quantity transmission software module is used for configuring the algorithm quantity transmission software module corresponding to the standard reference data packet by the standard reference data maker.
Referring to fig. 2, in another embodiment, the present disclosure discloses a method for acquiring standard reference data, comprising the following steps:
ST100, logging in by a user of the algorithm to be traced;
ST200, verifying the user identity by a to-be-traced algorithm;
ST300, filling algorithm traceability application information of the algorithm to be traceable by a user of the algorithm to be traceable;
ST400, inquiring basic information of a target traceability algorithm in the configuration system calculated by algorithm quantity transmission according to the algorithm traceability application information, and generating a standard reference data packet when the algorithm traceability application information is matched with the basic information of the target traceability algorithm;
ST500, the user of the algorithm to be traced obtains the standard reference data from the standard reference data packet.
In another embodiment of the present invention, the substrate is,
in ST300, the algorithm tracing application information includes: the name of the algorithm to be traced, the name and contact way of the applicant, the unit to which the applicant belongs, the application date and the like.
In a further embodiment of the method according to the invention,
in ST500, the standard reference data includes standard reference input data.
Therefore, the user of the algorithm to be traced can reference the input data according to the standard to be used as the input of the algorithm to be traced, and test the algorithm to be traced so as to obtain the output of the algorithm to be traced.
It will be appreciated that the testing process prioritizes testing in a trusted environment, such as where the testing delegates testing or supervision from a trusted and authoritative third party. The algorithm tracing can be realized by processing the output data and the corresponding standard reference output data in the standard reference data packet according to a standard program; or directly transmitting the output to an algorithm quantity transmission software module, and calculating the evaluation index Y of the algorithm to be traced and the corresponding measurement uncertainty.
Further, optionally, the standard reference data comprises a standard reference input data set. Substituting the acquired standard reference input data set into the algorithm to be traced by the algorithm to be traced user, and operating the algorithm to obtain an output result set; logging in again by the user with the algorithm to be traced, and uploading the obtained output result set through identity authentication; and the output result set is transmitted to an algorithm quantity transmission software module, and the evaluation index Y of the algorithm to be traced and the corresponding measurement uncertainty are calculated.
In another embodiment, the present disclosure discloses a standard reference data system to implement the above standard reference data acquisition method, including:
a login module, an identity verification module, a module for filling algorithm tracing application information, a module for generating a standard reference data packet and a module for acquiring standard reference data,
the login module is used for logging in a user with the algorithm to be traced;
the identity authentication module is used for authenticating the identity of the user by the algorithm to be traced;
the system comprises a filling algorithm traceability application information module, a traceability algorithm module and a traceability management module, wherein the filling algorithm traceability application information module is used for filling algorithm traceability application information of a traceability algorithm to be traced by a user of the traceability algorithm to be traced;
the standard reference data packet generating module is used for inquiring basic information of a target traceability algorithm in the algorithm quantity transmission calculation configuration system according to the algorithm traceability application information, and generating a standard reference data packet when the algorithm traceability application information is matched with the basic information of the target traceability algorithm;
and the standard reference data obtaining module is used for obtaining standard reference data from the standard reference data packet by the algorithm to be traced.
Referring to fig. 3, in another embodiment, the present disclosure further discloses a method for obtaining a source tracing result of an algorithm, including the following steps:
STE100, logging in by a user of a to-be-traced algorithm;
STE200, user identity authentication of a source-to-be-traced algorithm;
STE300, a user of the algorithm to be traced fills in a calculation result of the algorithm to be traced corresponding to the applied standard reference data;
the STE400 is used for inquiring standard reference data in a configuration system for algorithm measurement and calculation to verify the applied standard reference data, and after the standard reference data are verified to be correct, indicating value errors are calculated according to the calculation result of the algorithm to be traced and the corresponding standard reference data;
STE500, evaluating the measurement uncertainty of the indicating value error;
the STE600, based on said assessment, generates a digital/electronic certificate or a digital/electronic report with the assessment of the measurement uncertainty as a result of the algorithmic tracing.
In another embodiment, the method further comprises the following steps:
the STE700, the user of the algorithm to be traced obtains the digital/electronic certificate or the digital/electronic report.
In another embodiment, the STE500 further comprises the following sub-steps:
and the STE501 transmits the calculation result of the algorithm to be traced to the algorithm quantity transmission software module, calculates the evaluation index Y of the algorithm to be traced and evaluates the measurement uncertainty of the algorithm to be traced.
Thus, when the STE600 generates the algorithm tracing result, the algorithm tracing result further includes an evaluation index Y of the algorithm to be traced.
In another embodiment, the present disclosure discloses an algorithm quantity transmission system for implementing the method for obtaining the algorithm tracing result, including:
a login module, an identity verification module, an algorithm calculation result module for filling in the algorithm to be traced, a value indicating error calculation module, an evaluation module, an algorithm tracing result generation module and an algorithm tracing result acquisition module, wherein,
the login module is used for logging in a user to be traced;
the identity authentication module is used for authenticating the identity of the user by the algorithm to be traced;
the algorithm calculation result filling module is used for filling calculation results of the algorithm to be traced corresponding to the applied standard reference data in the algorithm to be traced by the user;
the indicating value error calculation module is used for inquiring the standard reference data in the configuration system for the algorithm quantity transmission calculation to verify the applied standard reference data, and calculating the indicating value error according to the calculation result of the algorithm to be traced and the corresponding standard reference data after the standard reference data is verified to be correct;
the evaluation module is used for evaluating the uncertainty of the indicating value error measurement;
an algorithm traceability result generation module, configured to generate a digital/electronic certificate or a digital/electronic report as an algorithm traceability result based on the evaluation;
and the algorithm traceability result acquisition module is used for acquiring the digital/electronic certificate or the digital/electronic report by the algorithm to be traced.
For example, for one of the patient albumin laboratory test data machine learning quality control algorithms described above, the final algorithm tracing result may be as follows:
the evaluation index Y has a value range of [0, 100% ], and when the value of Y tends to 100%, the output result of the algorithm to be traced is accurate and reliable enough. When the Y value tends to 0, the implementation process of the algorithm to be traced is not in accordance with the quality control requirement of the laboratory detection data. The corresponding measurement uncertainty indicates the dispersion of the Y value. In this case, the value of the evaluation index Y of the patient albumin laboratory test data machine learning quality control algorithm is 71.3%, which indicates that the output result of the algorithm is basically accurate and reliable, but the design of the algorithm has some defects, for example, in the present case, input vectors corresponding to different characteristics of the machine learning algorithm should be mutually independent, but actually, through the analysis of the data characteristics of the training set, a certain correlation exists between the input vectors, which is related to the introduction sequence of the overall test data when the abnormal values are eliminated through a floating mean value method in the data preprocessing stage, and an algorithm maker is suggested to mainly solve the problem in this aspect.
In the description herein, reference to the description of the terms "one embodiment/mode," "some embodiments/modes," "example," "specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment/mode or example is included in at least one embodiment/mode or example of the present disclosure. In this specification, the schematic representations of the terms used above are not necessarily intended to be the same embodiment/mode or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments/modes or examples. Furthermore, the various embodiments/aspects or examples and features of the various embodiments/aspects or examples described in this specification can be combined and combined by one skilled in the art without conflicting therewith.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present disclosure, "a plurality" means at least two, e.g., two, three, etc., unless explicitly specifically limited otherwise.
It will be understood by those skilled in the art that the foregoing embodiments are merely for clarity of illustration of the disclosure and are not intended to limit the scope of the disclosure. Other variations or modifications may occur to those skilled in the art, based on the foregoing disclosure, and are still within the scope of the present disclosure.
Claims (10)
1. A configuration method for algorithm quantity transmission calculation of algorithm source tracing comprises the following steps:
s100, logging in by a standard reference data maker;
s200, standard reference data maker identity verification;
s300, filling basic information of a target traceability algorithm by a standard reference data maker;
s400, uploading a corresponding standard reference data packet by a standard reference data maker;
s500, generating a standard reference data ID for each group of standard reference data in the standard reference data packet, and marking three components of the standard reference data in the same group as the same ID;
s600, configuring an algorithm quantity transmission software module corresponding to the standard reference data packet by the standard reference data maker.
2. A configuration system for algorithm quantum computation for algorithm tracing, comprising:
a login module, an identity verification module, an algorithm basic information filling module, a standard reference data packet uploading module, a standard reference data ID generation module and an algorithm configuration quantity transmission software module, wherein,
the login module is used for logging in by a standard reference data maker;
the identity authentication module is used for authenticating the identity of the standard reference data maker;
a filling algorithm basic information module used for filling basic information of a target traceability algorithm by a standard reference data maker;
the standard reference data packet uploading module is used for uploading the corresponding standard reference data packet;
a standard reference data ID generation module for generating a standard reference data ID for each group of standard reference data in the standard reference data packet, and marking three components of the standard reference data in the same group as the same ID;
and the configuration algorithm quantity transmission software module is used for configuring the algorithm quantity transmission software module corresponding to the standard reference data packet by the standard reference data maker.
3. A method for acquiring standard reference data comprises the following steps:
ST100, logging in by a user of the algorithm to be traced;
ST200, verifying the user identity by a to-be-traced algorithm;
ST300, filling algorithm traceability application information of the algorithm to be traceable by a user of the algorithm to be traceable;
ST400, inquiring basic information of a target traceability algorithm in the configuration system calculated by algorithm quantity transmission according to the algorithm traceability application information, and generating a standard reference data packet when the algorithm traceability application information is matched with the basic information of the target traceability algorithm;
ST500, the user of the algorithm to be traced obtains the standard reference data from the standard reference data packet.
4. The method of claim 3, wherein,
in ST300, the algorithm tracing application information includes: the name of the algorithm to be traced, the name and contact way of the applicant, the unit to which the applicant belongs, the application date and the like.
5. The method of claim 3, wherein,
in ST500, the standard reference data includes standard reference input data.
6. A standard reference data system for implementing the method for acquiring standard reference data of any one of claims 4 to 5, comprising:
a login module, an identity verification module, a module for filling algorithm tracing application information, a module for generating a standard reference data packet and a module for acquiring standard reference data,
the login module is used for logging in a user with the algorithm to be traced;
the identity authentication module is used for authenticating the identity of the user by the algorithm to be traced;
the system comprises a filling algorithm traceability application information module, a traceability algorithm module and a traceability management module, wherein the filling algorithm traceability application information module is used for filling algorithm traceability application information of a traceability algorithm to be traced by a user of the traceability algorithm to be traced;
the standard reference data packet generation module is used for inquiring basic information of the target traceability algorithm in the algorithm quantity transmission calculation configuration system according to the algorithm traceability application information and generating a standard reference data packet when the algorithm traceability application information is matched with the basic information of the target traceability algorithm;
and the standard reference data obtaining module is used for obtaining standard reference data from the standard reference data packet by the algorithm to be traced.
7. A method for obtaining algorithm tracing results comprises the following steps:
STE100, logging in by a user of a to-be-traced algorithm;
STE200, user identity authentication of a source-to-be-traced algorithm;
STE300, a user of the algorithm to be traced fills in a calculation result of the algorithm to be traced corresponding to the applied standard reference data;
the STE400 is used for inquiring standard reference data in a configuration system for algorithm measurement and calculation to verify the applied standard reference data, and after the standard reference data are verified to be correct, indicating value errors are calculated according to the calculation result of the algorithm to be traced and the corresponding standard reference data;
STE500, evaluating the measurement uncertainty of the indicating value error;
the STE600, based on said assessment, generates a digital/electronic certificate or a digital/electronic report with an assessment of the uncertainty of the measurement as a result of the algorithm tracing.
8. The method of claim 7, further comprising the steps of:
the STE700, the algorithm to be traced user acquires the digital/electronic certificate or the digital/electronic report.
9. The method of claim 7, the STE500 further comprising the sub-steps of:
and the STE501 transmits the calculation result of the algorithm to be traced to the algorithm quantity transmission software module, calculates the evaluation index Y of the algorithm to be traced and evaluates the measurement uncertainty of the algorithm to be traced.
10. An algorithm measurement and transmission system for implementing the method for obtaining the algorithm tracing result according to any one of claims 7 to 9, comprising:
a login module, an identity verification module, an algorithm calculation result module for filling in the algorithm to be traced, a value indicating error calculation module, an evaluation module, an algorithm tracing result generation module and an algorithm tracing result acquisition module, wherein,
the login module is used for logging in a user to be traced;
the identity authentication module is used for authenticating the identity of the user by the algorithm to be traced;
the algorithm calculation result filling module is used for filling calculation results of the algorithm to be traced corresponding to the applied standard reference data in the algorithm to be traced by the user;
the indicating value error calculation module is used for inquiring the standard reference data in the configuration system for the algorithm quantity transmission calculation to verify the applied standard reference data, and calculating the indicating value error according to the calculation result of the algorithm to be traced and the corresponding standard reference data after the standard reference data is verified to be correct;
the evaluation module is used for evaluating the uncertainty of the indicating value error measurement;
an algorithm traceability result generation module, configured to generate a digital/electronic certificate or a digital/electronic report as an algorithm traceability result based on the evaluation;
and the algorithm traceability result acquisition module is used for acquiring the digital/electronic certificate or the digital/electronic report by the algorithm to be traced.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310291802.1A CN116305160A (en) | 2022-05-07 | 2022-05-07 | Configuration method and system for algorithm quantity transmission calculation for algorithm tracing |
| CN202210492943.5A CN114912089B (en) | 2022-05-07 | 2022-05-07 | Configuration method and system for algorithm quantity transmission calculation for algorithm tracing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210492943.5A CN114912089B (en) | 2022-05-07 | 2022-05-07 | Configuration method and system for algorithm quantity transmission calculation for algorithm tracing |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310291802.1A Division CN116305160A (en) | 2022-05-07 | 2022-05-07 | Configuration method and system for algorithm quantity transmission calculation for algorithm tracing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114912089A true CN114912089A (en) | 2022-08-16 |
| CN114912089B CN114912089B (en) | 2023-02-03 |
Family
ID=82767114
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210492943.5A Active CN114912089B (en) | 2022-05-07 | 2022-05-07 | Configuration method and system for algorithm quantity transmission calculation for algorithm tracing |
| CN202310291802.1A Pending CN116305160A (en) | 2022-05-07 | 2022-05-07 | Configuration method and system for algorithm quantity transmission calculation for algorithm tracing |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310291802.1A Pending CN116305160A (en) | 2022-05-07 | 2022-05-07 | Configuration method and system for algorithm quantity transmission calculation for algorithm tracing |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN114912089B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117953334A (en) * | 2024-03-26 | 2024-04-30 | 中国计量科学研究院 | Visual detection equipment dosage traceability metering device and method thereof |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102479351A (en) * | 2010-11-25 | 2012-05-30 | 西安计量技术研究院 | Method for intelligently managing newly established measurement standard and system thereof |
| CN106934630A (en) * | 2015-12-31 | 2017-07-07 | 济南大陆机电股份有限公司 | A kind of measurement instrument magnitude tracing method |
| CN111352998A (en) * | 2020-02-28 | 2020-06-30 | 中国计量科学研究院 | Trusted alliance block chain digital calibration certificate system and operation method thereof |
| CN111899034A (en) * | 2020-07-28 | 2020-11-06 | 安徽高山科技有限公司 | Anti-counterfeiting tracing query method for product tracing based on block chain |
| CN112036673A (en) * | 2019-05-17 | 2020-12-04 | 向友刚 | Measuring instrument quantity tracing method and measuring instrument management system |
| CN112577542A (en) * | 2019-09-27 | 2021-03-30 | 广州中测检测技术有限公司 | Measuring instrument and remote quantity transmission/tracing method thereof |
| CN114255047A (en) * | 2020-09-25 | 2022-03-29 | 续科天下(北京)科技有限公司 | Pork traceability system based on block chain technology |
| CN114253995A (en) * | 2022-03-01 | 2022-03-29 | 深圳市明源云科技有限公司 | Data tracing method, device, equipment and computer readable storage medium |
-
2022
- 2022-05-07 CN CN202210492943.5A patent/CN114912089B/en active Active
- 2022-05-07 CN CN202310291802.1A patent/CN116305160A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102479351A (en) * | 2010-11-25 | 2012-05-30 | 西安计量技术研究院 | Method for intelligently managing newly established measurement standard and system thereof |
| CN106934630A (en) * | 2015-12-31 | 2017-07-07 | 济南大陆机电股份有限公司 | A kind of measurement instrument magnitude tracing method |
| CN112036673A (en) * | 2019-05-17 | 2020-12-04 | 向友刚 | Measuring instrument quantity tracing method and measuring instrument management system |
| CN112577542A (en) * | 2019-09-27 | 2021-03-30 | 广州中测检测技术有限公司 | Measuring instrument and remote quantity transmission/tracing method thereof |
| CN111352998A (en) * | 2020-02-28 | 2020-06-30 | 中国计量科学研究院 | Trusted alliance block chain digital calibration certificate system and operation method thereof |
| CN111899034A (en) * | 2020-07-28 | 2020-11-06 | 安徽高山科技有限公司 | Anti-counterfeiting tracing query method for product tracing based on block chain |
| CN114255047A (en) * | 2020-09-25 | 2022-03-29 | 续科天下(北京)科技有限公司 | Pork traceability system based on block chain technology |
| CN114253995A (en) * | 2022-03-01 | 2022-03-29 | 深圳市明源云科技有限公司 | Data tracing method, device, equipment and computer readable storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 张琳: ""基于MVC模式的计量院管理系统设计"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117953334A (en) * | 2024-03-26 | 2024-04-30 | 中国计量科学研究院 | Visual detection equipment dosage traceability metering device and method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114912089B (en) | 2023-02-03 |
| CN116305160A (en) | 2023-06-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Westgard | Managing quality vs. measuring uncertainty in the medical laboratory | |
| Theodorsson | Uncertainty in measurement and total error: tools for coping with diagnostic uncertainty | |
| CN113049873B (en) | Current sensor, current measuring device, system, apparatus, and storage medium | |
| CN114912089B (en) | Configuration method and system for algorithm quantity transmission calculation for algorithm tracing | |
| CN113176529B (en) | Magnetic gradiometer correction method, magnetic gradiometer correction device and storage medium | |
| WO2020233516A1 (en) | Measuring instrument mass transfer/traceability method and measuring instrument management system | |
| CN109444340A (en) | Flammable gas alarm automatic calibrator and its operating method based on image recognition | |
| CN109375142A (en) | Mutual-inductor tester calibration method and system based on kaiser window FFT filtering | |
| CN114580214B (en) | Intelligent steam flowmeter checking and testing system and method based on Internet of things | |
| CN112923967B (en) | Instrument calibration system supporting rapid assessment of instrument calibration uncertainty | |
| CN111739274B (en) | Instrument management system, management platform, industrial instrument and method | |
| CN116186976A (en) | Verification method and verification system for accuracy of data collected by equipment platform sensor | |
| CN114884657B (en) | Whole-course online automatic execution algorithm tracing method and system | |
| Flores et al. | Robust bootstrapped Mandel's h and k statistics for outlier detection in interlaboratory studies | |
| CN110967446B (en) | Parameter targeting method and device, storage medium and electronic equipment | |
| CN112161647A (en) | Measuring instrument, measuring transmission/tracing method thereof, measuring instrument management system and method | |
| CN112577542A (en) | Measuring instrument and remote quantity transmission/tracing method thereof | |
| CN209311427U (en) | Flammable gas alarm automatic calibrator based on image recognition | |
| CN114397698A (en) | Double-coordinate system precision unifying method and system suitable for seismic physical simulation | |
| Fenton | Software measurement: why a formal approach? | |
| CN106125646B (en) | A kind of data collecting system of flue-cured tobacco controller | |
| Ferri | Uncertainty in Measurement | |
| US20080181121A1 (en) | Self-Describing Device Interconnections | |
| KR20240014123A (en) | Apparatus and method for assisting sexually transmitted infections testing based on artificial intelligence and rapid diagnostic kit convergence | |
| KR20240014122A (en) | Apparatus and method for colorectal cancer screening using fecal occult blood test based on artificial intelligence and rapid diagnosis kit convergence |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |