CN114884657B - Whole-course online automatic execution algorithm tracing method and system - Google Patents
Whole-course online automatic execution algorithm tracing method and system Download PDFInfo
- Publication number
- CN114884657B CN114884657B CN202210493524.3A CN202210493524A CN114884657B CN 114884657 B CN114884657 B CN 114884657B CN 202210493524 A CN202210493524 A CN 202210493524A CN 114884657 B CN114884657 B CN 114884657B
- Authority
- CN
- China
- Prior art keywords
- algorithm
- traced
- server
- software
- tracing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004422 calculation algorithm Methods 0.000 title claims abstract description 230
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000012795 verification Methods 0.000 claims abstract description 65
- 238000004891 communication Methods 0.000 claims abstract description 19
- 230000007246 mechanism Effects 0.000 claims abstract description 9
- 238000004364 calculation method Methods 0.000 claims description 33
- 238000005259 measurement Methods 0.000 claims description 23
- 230000003993 interaction Effects 0.000 claims description 18
- 230000008569 process Effects 0.000 claims description 17
- 238000011156 evaluation Methods 0.000 claims description 15
- 238000005516 engineering process Methods 0.000 abstract description 4
- 238000013522 software testing Methods 0.000 abstract description 2
- 230000005540 biological transmission Effects 0.000 description 8
- 238000004519 manufacturing process Methods 0.000 description 7
- 239000000463 material Substances 0.000 description 4
- 238000012067 mathematical method Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/08—Key distribution or management, e.g. generation, sharing or updating, of cryptographic keys or passwords
- H04L9/0816—Key establishment, i.e. cryptographic processes or cryptographic protocols whereby a shared secret becomes available to two or more parties, for subsequent use
- H04L9/0819—Key transport or distribution, i.e. key establishment techniques where one party creates or otherwise obtains a secret value, and securely transfers it to the other(s)
- H04L9/083—Key transport or distribution, i.e. key establishment techniques where one party creates or otherwise obtains a secret value, and securely transfers it to the other(s) involving central third party, e.g. key distribution center [KDC] or trusted third party [TTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/0823—Network architectures or network communication protocols for network security for authentication of entities using certificates
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/12—Applying verification of the received information
- H04L63/126—Applying verification of the received information the source of the received data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/32—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials
- H04L9/3263—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials involving certificates, e.g. public key certificate [PKC] or attribute certificate [AC]; Public key infrastructure [PKI] arrangements
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Stored Programmes (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The method tightly combines a metering technology and a software testing technology, performs CA authentication on algorithm software to be traced to form an authentication digital certificate, verifies the validity of the certificate by a CA server, generates identity verification information of the algorithm tracing server, establishes a communication mechanism between the algorithm software to be traced and the algorithm tracing server, and further realizes automatic algorithm tracing based on the system.
Description
Technical Field
The disclosure relates to the field of metering, and in particular relates to an algorithm tracing method for automatic execution on a whole course to ensure and evaluate accuracy and reliability of a software algorithm in magnitude.
Background
The software is used for expanding human thinking, and has the remarkable advantages of low cost, flexibility, functional complexity and the like. However, from the metering perspective, the software also has the defects of easy cheating and tampering, difficult Bug discovery, poor compliance of laws and regulations and the like, and the software also exposes some problems in the use of metering devices.
The biggest difficulty faced in the metering field at present is how to guarantee and evaluate the influence of a software algorithm in a metering device on the accuracy and reliability of the value. For example, inputting the same data into functionally identical programs written by different programmers may differ in the output results, making it difficult to determine the accuracy of both software algorithms in terms of metering requirements. Even if the output results are the same, it is difficult to judge compliance of the software algorithm with the metering regulations.
How to guarantee and evaluate the accuracy and reliability of the software algorithm in magnitude is the focus of attention in the field of global metering, but until the present, the related research on the accuracy and reliability of the software algorithm is still in the algorithm evaluation level, and belongs to qualitative judgment.
In view of this, it is highly necessary for those skilled in the art to study how to automate quantitative metering and evaluation software in a trusted environment so that the magnitude is accurate and reliable and traceability of the algorithm can be achieved.
Disclosure of Invention
In order to solve the technical problems, the present disclosure provides an algorithm traceability method and system for automatic execution on the whole course in an innovative manner, so as to automatically and quantitatively measure and evaluate software in a trusted environment.
The disclosure discloses an algorithm tracing method for automatic execution on a whole course, which comprises the following steps:
s100, communication is established between algorithm software to be traced and a CA server, interaction is carried out, and in the interaction process, the CA server verifies the validity of a digital certificate, wherein the digital certificate is signed to the algorithm software to be traced by the CA server in advance;
s200, after passing verification, the CA server generates identity verification information for the algorithm to be traced, and if the algorithm does not pass the verification, the CA server performs software initialization of the algorithm to be traced so as to issue a digital certificate to the algorithm to be traced and generate the identity verification information; the authentication information is ATMS authentication information and is used for authentication of an algorithm traceability service;
s300, establishing communication and interaction between algorithm software to be traced and an algorithm tracing server, and in the interaction process, carrying out identity verification on the algorithm tracing server to be traced so as to verify whether ATMS identity verification information is effective;
s400, after verification, the algorithm software to be traced submits a tracing application to an algorithm tracing server, and after the algorithm tracing server passes the application, input data and a calculation result of the algorithm software to be traced are automatically submitted to the algorithm tracing server;
s500, an algorithm tracing server generates algorithm standards according to the tracing application;
s600, based on the algorithm standard, the algorithm tracing server calculates an algorithm standard output result according to the input data submitted by the algorithm software to be traced;
s700, calculating an indication error between the calculation result of the algorithm software to be traced and the algorithm standard output result according to the algorithm software to be traced;
s800, the algorithm traceability server further evaluates measurement uncertainty of the indication error;
s900, based on the assessment, the algorithm tracing server generates a digital/electronic certificate or a digital/electronic report with the measurement uncertainty assessment as an algorithm tracing result.
Preferably, the method further comprises the following steps:
and S1000, the algorithm tracing server transmits the algorithm tracing result to the algorithm software to be traced so that the algorithm software to be traced can acquire the digital/electronic certificate or the digital/electronic report.
In addition, the disclosure discloses an algorithm traceability system for whole-course on-line automatic execution, so as to implement the method, which comprises the following steps:
the system comprises a CA server side, a to-be-traced algorithm software side and an algorithm tracing server side, wherein,
the CA server is used for verifying the validity of the digital certificate, wherein the digital certificate is signed to algorithm software to be traced in advance by the CA server; and, in addition, the method comprises the steps of,
after passing the verification, the CA server is used for generating identity verification information for the algorithm to be traced, and if the identity verification information does not pass the verification, the CA server is used for initializing the algorithm software to be traced so as to issue a digital certificate to the algorithm software to be traced and generate the identity verification information; the authentication information is ATMS authentication information and is used for authentication of an algorithm traceability service;
the method comprises the steps that communication is established between algorithm software to be traced and an algorithm tracing server, and interaction is carried out, wherein in the interaction process, the algorithm tracing server carries out identity verification on the algorithm software to be traced so as to verify whether ATMS identity verification information is effective;
the algorithm software to be traced is used for submitting a tracing application to the algorithm tracing server after verification, and automatically submitting input data and calculation results of the algorithm software to be traced after the algorithm tracing server passes the application;
the algorithm traceability server is used for:
generating algorithm standards according to the traceability application;
based on the algorithm standard, calculating an algorithm standard output result according to the input data submitted by the algorithm software to be traced;
according to the calculation result of the algorithm software to be traced and the algorithm standard output result, the algorithm tracing server calculates the indication error between the calculation result and the algorithm standard output result;
further assessing the measurement uncertainty of the indication error; the method comprises the steps of,
based on the evaluation, a digital/electronic certificate or digital/electronic report with a measurement uncertainty rating is generated as an algorithmic traceability result.
Preferably, the method comprises the steps of,
the algorithm tracing server is further used for:
and transmitting the algorithm tracing result to the algorithm software to be traced so that the algorithm software to be traced can acquire the digital/electronic certificate or the digital/electronic report.
In summary, the present disclosure tightly combines a metering technology and a software testing technology, performs CA authentication on algorithm software to be traced to form an authentication digital certificate, verifies the validity of the certificate by a CA server, generates authentication information of the algorithm tracing server, establishes a communication mechanism between the algorithm software to be traced and the algorithm tracing server, and further enables the algorithm software to be traced to realize automatic algorithm tracing based on the system.
Drawings
The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this specification, illustrate exemplary embodiments of the disclosure and together with the description serve to explain the principles of the disclosure.
FIG. 1 is a flow diagram of an algorithm tracing method in one embodiment of the disclosure;
fig. 2 is a schematic diagram of a configuration flow of algorithm criteria in one embodiment of the present disclosure.
Detailed Description
The present disclosure is described in further detail below with reference to the drawings and the embodiments. It is to be understood that the specific embodiments described herein are merely illustrative of the relevant content and not limiting of the present disclosure. It should be further noted that, for convenience of description, only a portion relevant to the present disclosure is shown in the drawings.
In addition, embodiments of the present disclosure and features of the embodiments may be combined with each other without conflict. The technical aspects of the present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
Unless otherwise indicated, the exemplary implementations/embodiments shown are to be understood as providing exemplary features of various details of some ways in which the technical concepts of the present disclosure may be practiced. Thus, unless otherwise indicated, features of the various implementations/embodiments may be additionally combined, separated, interchanged, and/or rearranged without departing from the technical concepts of the present disclosure.
The use of cross-hatching and/or shading in the drawings is typically used to clarify the boundaries between adjacent components. As such, the presence or absence of cross-hatching or shading does not convey or represent any preference or requirement for a particular material, material property, dimension, proportion, commonality between illustrated components, and/or any other characteristic, attribute, property, etc. of a component, unless indicated. In addition, in the drawings, the size and relative sizes of elements may be exaggerated for clarity and/or descriptive purposes. While the exemplary embodiments may be variously implemented, the specific process sequences may be performed in a different order than that described. For example, two consecutively described processes may be performed substantially simultaneously or in reverse order from that described. Moreover, like reference numerals designate like parts.
When an element is referred to as being "on" or "over", "connected to" or "coupled to" another element, it can be directly on, connected or coupled to the other element or intervening elements may be present. However, when an element is referred to as being "directly on," "directly connected to," or "directly coupled to" another element, there are no intervening elements present. For this reason, the term "connected" may refer to physical connections, electrical connections, and the like, with or without intermediate components.
For descriptive purposes, the present disclosure may use spatially relative terms such as "under … …," under … …, "" under … …, "" lower, "" above … …, "" upper, "" above … …, "" higher "and" side (e.g., as in "sidewall"), etc., to describe one component's relationship to another (other) component as illustrated in the figures. In addition to the orientations depicted in the drawings, the spatially relative terms are intended to encompass different orientations of the device in use, operation, and/or manufacture. For example, if the device in the figures is turned over, elements described as "under" or "beneath" other elements or features would then be oriented "over" the other elements or features. Thus, the exemplary term "below" … … can include both "above" and "below" orientations. Furthermore, the device may be otherwise positioned (e.g., rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein interpreted accordingly.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Furthermore, when the terms "comprises" and/or "comprising," and variations thereof, are used in the present specification, the presence of stated features, integers, steps, operations, elements, components, and/or groups thereof is described, but the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof is not precluded. It is also noted that, as used herein, the terms "substantially," "about," and other similar terms are used as approximation terms and not as degree terms, and as such, are used to explain the inherent deviations of measured, calculated, and/or provided values that would be recognized by one of ordinary skill in the art.
For facilitating further understanding of the present disclosure, first, description will be made of an execution body related to the present disclosure, and in the present disclosure, the following execution bodies are mainly related to the whole algorithm tracing process:
1. the algorithm tracing server (Algorithm Traceability Master Service, ATMS) is a server which allows an algorithm standard maker to upload algorithm standards and configure an algorithm quantity transmission software module (provide algorithm quantity transmission calculation service) and can respond to an application of algorithm software to be traced;
2. CA (Certificate Authority) server means an authoritative CA mechanism for providing certification for algorithm software to be traced, which issues an authoritative certification certificate with legal effect to an applicant according to the application of the applicant (for example, in the present disclosure, the applicant is the algorithm software to be traced), the certificate contains the signature of the root certificate of the authoritative CA mechanism, the validity of the certification certificate can be verified through the verification service provided by the CA mechanism, and if the verification is passed, the certificate is proved to have legal effect. Meanwhile, the authentication certificate contains a public key which can be used for verifying the electronic signature of the applicant, and the electronic signature can be proved to have legal effect after verification, so that the electronic signature is legally protected, and the signing party cannot repudiate the signed content;
3. the to-be-traced algorithm software refers to a party having to-be-traced algorithm and capable of performing related calculation of the to-be-traced algorithm.
In one embodiment, referring to fig. 1, the disclosure discloses an algorithm tracing method for whole-course on-line automatic execution, which comprises the following steps:
s100, communication is established between algorithm software to be traced and a CA server, interaction is carried out, and in the interaction process, the CA server verifies the validity of a digital certificate, wherein the digital certificate is signed to the algorithm software to be traced by the CA server in advance;
the CA server can be understood to check whether the authentication certificate of the algorithm software to be traced exists or not, and reapply the digital certificate for authentication to the authority CA mechanism if the authentication certificate does not exist; if so, verifying whether the digital certificate is available; if the certificate is not available, it is necessary to regenerate the public-private key pair and reapply the certificate to the authority CA. The CA mechanism and the CA server can be the same CA server, and the CA mechanism can also issue a digital certificate through a separate server;
s200, after passing verification, the CA server generates identity verification information for the algorithm to be traced, and if the algorithm does not pass the verification, the CA server performs software initialization of the algorithm to be traced so as to issue a digital certificate to the algorithm to be traced and generate the identity verification information; the authentication information is ATMS authentication information and is used for authentication of an algorithm traceability service;
it can be understood that the certificate carries a signature of the root certificate of the CA server, the validity of the digital certificate can be verified through the CA server, a specific verification mode can be preset, the disclosure is not particularly limited, and if the certificate passes verification, the certificate has legal efficacy; if not, the CA server performs the initialization of the algorithm software to be traced to issue a digital certificate to the CA server and generate identity verification information;
s300, establishing communication and interaction between algorithm software to be traced and an algorithm tracing server, and in the interaction process, carrying out identity verification on the algorithm tracing server to be traced so as to verify whether ATMS identity verification information is effective;
s400, after verification, the algorithm software to be traced submits a tracing application to an algorithm tracing server, and after the algorithm tracing server passes the application, input data and a calculation result of the algorithm software to be traced are automatically submitted to the algorithm tracing server;
s500, an algorithm tracing server generates algorithm standards according to the tracing application;
s600, based on the algorithm standard, the algorithm tracing server calculates an algorithm standard output result according to the input data submitted by the algorithm software to be traced;
s700, calculating an indication error between the calculation result of the algorithm software to be traced and the algorithm standard output result according to the algorithm software to be traced;
s800, the algorithm traceability server further evaluates measurement uncertainty of the indication error;
s900, based on the assessment, the algorithm tracing server generates a digital/electronic certificate or a digital/electronic report with the measurement uncertainty assessment as an algorithm tracing result.
It can be appreciated that the algorithm software to be traced can be of various known software types, such as Win 32-bit software, win 64-bit software, linux application software, CS architecture software, BS architecture software, running software in a physical machine environment, running software in a virtual machine environment, cross-platform container class software, and the like. When the tracing algorithm software has a network communication function, the tracing algorithm software can directly establish communication and interact with a CA server or an algorithm tracing server; when the algorithm software to be traced does not have a network communication function, the algorithm software to be traced can establish communication and interact with the CA server or the algorithm tracing server through other software.
Whether the communication between the algorithm software and the algorithm traceability server is directly or indirectly realized, the algorithm traceability server identity verification information is generated by the algorithm software to be traced after verification is passed, and preparation is obviously made for establishing communication connection between the algorithm traceability server and the algorithm traceability server; communication connection is established between algorithm software to be traced and an algorithm tracing server, and the two parties can automatically communicate without human intervention;
after the identity verification is passed, the algorithm software to be traced inputs the input data into the algorithm to be traced to obtain a calculation result, submits the input data and the calculation result, and applies for tracing the algorithm; it should be noted that, the input data is provided to the algorithm tracing server by the algorithm software to be traced according to the specification requirement preset by the algorithm standard maker, wherein the calculation time of the algorithm to be traced is required to be performed within the validity period of identity verification, the validity period can be defined in advance, and the disclosure is not limited in detail. In addition, in the embodiment, the priority is given to the algorithm tracing server not to relate to the algorithm calculation of the algorithm software to be traced, and the related calculation is completed by the algorithm software to be traced; however, it can be understood that after the to-be-traced algorithm software passes through the ATMS verification, the self-executed software can be cloned into the algorithm tracing server so as to enable the algorithm tracing server to perform trusted operation, and the algorithm tracing server needs to have an operating environment for operating the to-be-traced algorithm software, which is of course beneficial to further ensuring the trusted operation. After receiving the application submitted by the algorithm software to be traced, the algorithm tracing server generates corresponding algorithm standards aiming at the algorithm information to be traced, inputs the received input data into the generated algorithm standards, calculates corresponding output results, and then calculates the indication error between the calculation results and the algorithm standard output results according to the algorithm calculation results to be traced.
It is apparent that the present disclosure has the following advantages:
on one hand, the method is different from an algorithm evaluation method in that the method quantitatively evaluates the accuracy and reliability of an algorithm calculation result in a tracing mode;
on the other hand, based on the algorithm tracing method, the method can realize full-course on-line automation and one-key tracing, greatly reduce or even stop human intervention, and improve the effectiveness, accuracy and reliability of algorithm tracing.
In another embodiment, the method further comprises the steps of:
and S1000, the algorithm tracing server transmits the algorithm tracing result to the algorithm software to be traced so that the algorithm software to be traced can acquire the digital/electronic certificate or the digital/electronic report.
In addition, it should be noted that,
in S500, before the algorithm tracing server generates the algorithm standard according to the tracing application:
the algorithm standard maker fills in basic information of an algorithm on an algorithm tracing server and configures an algorithm quantity transmission software module, wherein the module comprises algorithm standards and corresponding standard calculation used in the algorithm tracing process;
the algorithm quantity transmission software module is a module for realizing quantity transmission calculation for a to-be-traced algorithm; wherein,,
the quantitative transmission calculation means that two types of data sets are calculated through a statistical or other mathematical method, and finally an evaluation index Y of a to-be-traced algorithm and corresponding measurement uncertainty are obtained; one class of the two classes of data sets is a result data set calculated by algorithm software to be traced, and the other class of the two classes of data sets is an output result data set of an algorithm standard calculated according to the input data submitted by the algorithm software to be traced.
Referring to fig. 2, the overall process from the algorithm formulator logging in, to authentication, to filling in the basic information of the algorithm, and to configuring the algorithm metering software module is illustrated.
For purposes of metering and evaluating, the methods disclosed in this disclosure are applied to a specific algorithm in some subdivision domain, where,
the algorithm standard maker logs in the system, fills in the basic information of the algorithm through identity verification, and comprises the following steps: algorithm standard names, algorithm standard types, algorithm standard formulator names and contact ways, units, algorithm simple descriptions and the like; it can be understood that the algorithm standard maker can be an expert of China national institute of metrology, an expert of related industries, and the like, and is authorized by related departments;
as for the configuration of the algorithm quantity transmission software module, specific statistical or other mathematical methods can be configured for the two types of data sets, and the specific statistical or other mathematical methods are used as keys of the algorithm standard for metering, so that the evaluation index Y of the algorithm software to be traced and the corresponding measurement uncertainty can be obtained through the method; one class of the two classes of data sets is a result data set calculated by algorithm software to be traced, and the other class of the two classes of data sets is an output result data set of an algorithm standard calculated according to the input data submitted by the algorithm software to be traced.
Further, the present disclosure makes more detailed explanation about the algorithm criteria:
definition of algorithm criteria:
with a determined magnitude and associated measurement uncertainty, a reference object is implemented that is defined by the same given quantity as the homogeneous algorithm.
Algorithm tracing examples with algorithm standards as tracing standards:
in the field of coordinate measurement, three-coordinate measuring machines can rapidly and accurately evaluate dimensional data, providing operators with useful information about the status of the production process. The working principle is as follows: the operator places the measured object in the measuring space of the three-coordinate machine, the probe measures the coordinate position of each measuring point on the measured object, then the space coordinate values of the measuring points are transmitted to the software module of the three-coordinate machine, the coordinate fitting is realized by processing the coordinate data by the related software algorithm, and finally the geometric dimension, shape and position of the measured object are given.
The basic geometric element fitting is an important function to be realized by a three-coordinate machine software module in coordinate measurement, and the accuracy and reliability of the fitting of the coordinate data by a software algorithm directly influence the judgment of the size and shape of the measured object. If the measured size and shape are not accurate enough, it would be catastrophic to the manufacturing plant and therefore it would be necessary to trace the algorithm to the software algorithm used for the fitting. The fitting of the software algorithm mainly comprises the fitting of basic geometric elements such as three-dimensional straight lines, planes, three-dimensional circles, spheres, cylinders, cones and the like.
The following examples will take the coordinate fitting algorithm software of the three-dimensional straight line in space as an example to develop the algorithm tracing.
1 tracing reference standard adopts algorithm standard
How to make: and (3) parameterizing the space straight line by analyzing the theoretical characteristics of the three-dimensional space straight line, defining the distance from the space coordinate to the straight line, and establishing a model algorithm by enabling the sum of the distances from all coordinate points to the straight line to be minimum. Wherein the minimized fitting is realized by adopting a least square method, a singular value decomposition method and other mathematical methods. The input data of the algorithm standard is a space three-dimensional coordinate point set, and the output data is 6 elements, namely one point (x 0 ，y 0 ，z 0 ) And the direction cosine (a, b, c) of the straight line at that point.
Who formulated by: the algorithm standard is formulated by expert study of China national institute of metrology and authorized by related departments.
Accuracy: algorithm standard with standard measurement uncertainty of 1.5 μm
Input data specification requires: meanwhile, in order to facilitate the algorithm tracing, relevant experts of the China research institute of metrology research have researched and formulated the input data specification requirements for the algorithm tracing of the example.
2 traceability process
The reference standard of the algorithm tracing is an algorithm standard, and the tracing process is as follows:
1) After CA authentication and ATMS identity verification are passed through the to-be-traced algorithm software developed by a certain manufacturer and used for space three-dimensional straight line fitting, input data meeting the requirements and the calculation result of the to-be-traced algorithm corresponding to the input data are submitted according to the input data standard requirements preset by an algorithm standard maker;
2) And the algorithm tracing server receives input data and calculation results of the algorithm software to be traced according to the application of the algorithm software to be traced, and generates algorithm standards for the algorithm software to be traced. Meanwhile, the algorithm tracing server inputs the received input data into an algorithm standard, and a corresponding calculation result is obtained through calculation;
3) The two types of calculation results are transmitted to an algorithm quantity transmission software module in an algorithm tracing server, and data processing is carried out by software to obtain an algorithm evaluation value Y and corresponding measurement uncertainty thereof;
4) Based on the evaluation result, the algorithm tracing server generates a digital/electronic certificate or a digital/electronic report with measurement uncertainty evaluation as an algorithm tracing result;
5) The algorithm tracing server transmits an algorithm tracing result to algorithm software to be traced, and the algorithm software to be traced acquires a digital/electronic certificate or a digital/electronic report with measurement uncertainty evaluation.
3 tracing results
The algorithm tracing result of the algorithm software to be traced for space three-dimensional straight line fitting developed by a certain manufacturing factory is as follows:
1) The algorithm evaluation value Y of the algorithm software to be traced is 95.2%, and the corresponding relative standard measurement uncertainty is 3.52%;
2) The algorithm tracing result shows that the algorithm software to be traced can realize a better fitting function, and the fitting result meets the production and manufacturing requirements.
In addition, in another embodiment, the disclosure discloses an algorithm tracing system for automatic execution on a whole course line, so as to implement the method, which comprises the following steps:
the system comprises a CA server side, a to-be-traced algorithm software side and an algorithm tracing server side, wherein,
the CA server is used for verifying the validity of the digital certificate, wherein the digital certificate is signed to algorithm software to be traced in advance by the CA server; and, in addition, the method comprises the steps of,
after passing the verification, the CA server is used for generating identity verification information for the algorithm to be traced, and if the identity verification information does not pass the verification, the CA server is used for initializing the algorithm software to be traced so as to issue a digital certificate to the algorithm software to be traced and generate the identity verification information; the authentication information is ATMS authentication information and is used for authentication of an algorithm traceability service;
the method comprises the steps that communication is established between algorithm software to be traced and an algorithm tracing server, and interaction is carried out, wherein in the interaction process, the algorithm tracing server carries out identity verification on the algorithm software to be traced so as to verify whether ATMS identity verification information is effective;
the algorithm software to be traced is used for submitting a tracing application to the algorithm tracing server after verification, and automatically submitting input data and calculation results of the algorithm software to be traced after the algorithm tracing server passes the application;
the algorithm traceability server is used for:
generating algorithm standards according to the traceability application;
based on the algorithm standard, calculating an algorithm standard output result according to the input data submitted by the algorithm software to be traced;
according to the calculation result of the algorithm software to be traced and the algorithm standard output result, the algorithm tracing server calculates the indication error between the calculation result and the algorithm standard output result;
further assessing the measurement uncertainty of the indication error; the method comprises the steps of,
based on the evaluation, a digital/electronic certificate or digital/electronic report with a measurement uncertainty rating is generated as an algorithmic traceability result.
In a further embodiment of the present invention,
the algorithm tracing server is further used for:
and transmitting the algorithm tracing result to the algorithm software to be traced so that the algorithm software to be traced can acquire the digital/electronic certificate or the digital/electronic report.
For example, some final algorithm trace-out result may be as follows:
the value range of the evaluation index Y is [0,100% ], and when the value of Y tends to 100%, the output result of the algorithm to be traced is accurate and reliable enough. When the Y value tends to 0, the implementation process of the algorithm to be traced is not in accordance with the production requirement. The corresponding measurement uncertainty then accounts for the dispersion of the Y values.
In the description of the present specification, reference to the terms "one embodiment/manner," "some embodiments/manner," "example," "specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment/manner or example is included in at least one embodiment/manner or example of the present disclosure. In this specification, the schematic representations of the above terms are not necessarily for the same embodiment/manner or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments/modes or examples. Furthermore, the various embodiments/modes or examples described in this specification and the features of the various embodiments/modes or examples can be combined and combined by persons skilled in the art without contradiction.
Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In the description of the present disclosure, the meaning of "a plurality" is at least two, such as two, three, etc., unless explicitly specified otherwise.
It will be appreciated by those skilled in the art that the above-described embodiments are merely for clarity of illustration of the disclosure, and are not intended to limit the scope of the disclosure. Other variations or modifications will be apparent to persons skilled in the art from the foregoing disclosure, and such variations or modifications are intended to be within the scope of the present disclosure.
Claims (4)
1. An algorithm tracing method for whole-course on-line automatic execution is characterized in that,
the method comprises the steps of performing CA authentication on algorithm software to be traced to form an authentication digital certificate, verifying the validity of the certificate by a CA server, generating identity verification information of an algorithm tracing server, establishing a communication mechanism between the algorithm software to be traced and the algorithm tracing server, and further enabling the algorithm software to be traced to realize automatic algorithm tracing;
the method comprises the following steps:
s100, communication is established between algorithm software to be traced and a CA server, interaction is carried out, and in the interaction process, the CA server verifies the validity of a digital certificate, wherein the digital certificate is signed to the algorithm software to be traced by the CA server in advance;
s200, after passing the verification, the CA server generates identity verification information for the algorithm software to be traced, and if the algorithm software to be traced does not pass the verification, the CA server initializes the algorithm software to be traced so as to issue a digital certificate to the algorithm software to be traced and generate the identity verification information; the identity verification information is the identity verification information of the algorithm tracing server and is used for identity verification of the algorithm tracing service;
s300, communication and interaction are established between algorithm software to be traced and an algorithm tracing server, and in the interaction process, the algorithm tracing server performs identity verification on the algorithm software to be traced so as to verify whether identity verification information of the algorithm tracing server is effective;
s400, after verification, the algorithm software to be traced submits a tracing application to an algorithm tracing server, and after the algorithm tracing server passes the application, input data and a calculation result of the algorithm software to be traced are automatically submitted to the algorithm tracing server;
s500, an algorithm tracing server generates algorithm standards according to the tracing application;
s600, based on the algorithm standard, the algorithm tracing server calculates an algorithm standard output result according to the input data submitted by the algorithm software to be traced;
s700, calculating an indication error between the calculation result of the algorithm software to be traced and the algorithm standard output result according to the algorithm software to be traced;
s800, the algorithm traceability server further evaluates measurement uncertainty of the indication error;
and S900, based on the evaluation, the algorithm tracing server generates a digital certificate or a digital report with the measurement uncertainty evaluation as an algorithm tracing result.
2. The method of claim 1, further comprising the step of:
and S1000, the algorithm tracing server transmits the algorithm tracing result to the algorithm software to be traced so that the algorithm software to be traced can acquire the digital certificate or the digital report.
3. An algorithm traceability system for automated execution on-line throughout the journey to implement the method of any of claims 1 to 2, comprising:
the system comprises a CA server side, a to-be-traced algorithm software side and an algorithm tracing server side, wherein,
the CA server is used for verifying the validity of the digital certificate, wherein the digital certificate is signed to algorithm software to be traced in advance by the CA server; and, in addition, the method comprises the steps of,
after passing the verification, the CA server is used for generating identity verification information for the algorithm software to be traced, and if the algorithm software to be traced does not pass the verification, the CA server is used for initializing the algorithm software to be traced so as to issue a digital certificate to the algorithm software to be traced and generate the identity verification information; the identity verification information is the identity verification information of the algorithm tracing server and is used for identity verification of the algorithm tracing service;
the method comprises the steps that communication is established between algorithm software to be traced and an algorithm tracing server, interaction is carried out, and in the interaction process, the algorithm tracing server carries out identity verification on the algorithm software to be traced so as to verify whether identity verification information of the algorithm tracing server is effective;
the algorithm software to be traced is used for submitting a tracing application to the algorithm tracing server after verification, and automatically submitting input data and calculation results of the algorithm software to be traced after the algorithm tracing server passes the application;
the algorithm traceability server is used for:
generating algorithm standards according to the traceability application;
based on the algorithm standard, calculating an algorithm standard output result according to the input data submitted by the algorithm software to be traced;
according to the calculation result of the algorithm software to be traced and the algorithm standard output result, the algorithm tracing server calculates the indication error between the calculation result and the algorithm standard output result;
further assessing the measurement uncertainty of the indication error; the method comprises the steps of,
based on the evaluation, a digital certificate or digital report with a measurement uncertainty rating is generated as an algorithmic traceability result.
4. The system of claim 3, wherein,
the algorithm tracing server is further used for:
and transmitting the algorithm tracing result to the algorithm software to be traced so that the algorithm software to be traced can acquire the digital certificate or the digital report.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210493524.3A CN114884657B (en) | 2022-05-07 | 2022-05-07 | Whole-course online automatic execution algorithm tracing method and system |
| CN202310739059.1A CN116707790A (en) | 2022-05-07 | 2022-05-07 | Whole-course online automatic execution algorithm tracing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210493524.3A CN114884657B (en) | 2022-05-07 | 2022-05-07 | Whole-course online automatic execution algorithm tracing method and system |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310739059.1A Division CN116707790A (en) | 2022-05-07 | 2022-05-07 | Whole-course online automatic execution algorithm tracing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114884657A CN114884657A (en) | 2022-08-09 |
| CN114884657B true CN114884657B (en) | 2023-05-02 |
Family
ID=82674514
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310739059.1A Pending CN116707790A (en) | 2022-05-07 | 2022-05-07 | Whole-course online automatic execution algorithm tracing method and system |
| CN202210493524.3A Active CN114884657B (en) | 2022-05-07 | 2022-05-07 | Whole-course online automatic execution algorithm tracing method and system |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310739059.1A Pending CN116707790A (en) | 2022-05-07 | 2022-05-07 | Whole-course online automatic execution algorithm tracing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN116707790A (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111181946A (en) * | 2019-12-24 | 2020-05-19 | 浙江大学 | Credible traceability system and method based on block chain and Internet of things |
| WO2020233516A1 (en) * | 2019-05-17 | 2020-11-26 | Xiang Yougang | Measuring instrument mass transfer/traceability method and measuring instrument management system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109522683B (en) * | 2018-09-26 | 2022-11-01 | 百度在线网络技术（北京）有限公司 | Software tracing method, system, computer equipment and storage medium |
| CN111641615A (en) * | 2020-05-20 | 2020-09-08 | 深圳市今天国际物流技术股份有限公司 | Distributed identity authentication method and system based on certificate |
| CN114386061A (en) * | 2021-12-21 | 2022-04-22 | 中汽创智科技有限公司 | Method, device and equipment for tracing magnitude and storage medium |
-
2022
- 2022-05-07 CN CN202310739059.1A patent/CN116707790A/en active Pending
- 2022-05-07 CN CN202210493524.3A patent/CN114884657B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020233516A1 (en) * | 2019-05-17 | 2020-11-26 | Xiang Yougang | Measuring instrument mass transfer/traceability method and measuring instrument management system |
| CN111181946A (en) * | 2019-12-24 | 2020-05-19 | 浙江大学 | Credible traceability system and method based on block chain and Internet of things |
Non-Patent Citations (1)
| Title |
|---|
| 计量器具软件测评体系研究;崔伟群;;中国计量(第05期);68-69 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114884657A (en) | 2022-08-09 |
| CN116707790A (en) | 2023-09-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109460947B (en) | Highway engineering process inspection reporting system based on BIM + GIS technology | |
| CN111274671A (en) | Precise repairing and assembling method for complex product assembling process based on digital twinning and operation system thereof | |
| CN102467684A (en) | System and method for evaluating comprehensive performance based on improved radar chart | |
| CN108427093A (en) | A kind of calibrating and measuring system and method for watt-hour meter automatic verification device | |
| CN104198922B (en) | Frequency selection method in early fault diagnosis of analog circuit | |
| CN114884657B (en) | Whole-course online automatic execution algorithm tracing method and system | |
| Helmecke et al. | Numerical measurement uncertainty determination for dimensional measurements of microparts with CT | |
| CN112036673A (en) | Measuring instrument quantity tracing method and measuring instrument management system | |
| US20080059126A1 (en) | System and method for measuring straightness of a line built based on point cloud | |
| CN114111706A (en) | Leveling method integrating interior and exterior industry and quality inspection and data acquisition system | |
| CN114241266A (en) | Processing method and system for intelligent early warning of optical cable | |
| CN104615928A (en) | Metrological verification method and system and server | |
| CN114912089B (en) | Configuration method and system for algorithm quantity transmission calculation for algorithm tracing | |
| CN109375142A (en) | Mutual-inductor tester calibration method and system based on kaiser window FFT filtering | |
| CN109547960A (en) | A kind of intelligent detecting method and system | |
| Yin et al. | Measuring software test verification for complex workpieces based on virtual gear measuring instrument | |
| CN111739274B (en) | Instrument management system, management platform, industrial instrument and method | |
| CN105387826A (en) | method and apparatus for quantifying dimensional variations and process capability | |
| CN111060050B (en) | Method for comprehensively verifying detection software of three-coordinate measuring machine | |
| Butler et al. | A methodology for testing classes of approximation and optimization software | |
| Lind et al. | Evaluating a digital twin concept for an automatic up-to-date factory layout setup | |
| CN113362456A (en) | Measuring instrument construction method and system based on digital twinning technology | |
| CN206322000U (en) | A kind of silencing cotton filling test fail-safe system | |
| JP3764856B2 (en) | Method for evaluating the shape failure of the surface to be measured | |
| Summerhays et al. | Application of simulation software to coordinate measurement uncertainty evaluation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |