CN103698489B - The verification method of test data and device - Google Patents
The verification method of test data and device Download PDFInfo
- Publication number
- CN103698489B CN103698489B CN201310746049.7A CN201310746049A CN103698489B CN 103698489 B CN103698489 B CN 103698489B CN 201310746049 A CN201310746049 A CN 201310746049A CN 103698489 B CN103698489 B CN 103698489B
- Authority
- CN
- China
- Prior art keywords
- data
- test
- test result
- result
- current
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 515
- 238000012795 verification Methods 0.000 title claims abstract description 68
- 238000000034 method Methods 0.000 title claims abstract description 60
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims abstract description 154
- 230000002159 abnormal effect Effects 0.000 claims abstract description 87
- 238000003908 quality control method Methods 0.000 claims abstract description 87
- 238000001514 detection method Methods 0.000 claims abstract description 57
- 238000011084 recovery Methods 0.000 claims description 72
- 238000009825 accumulation Methods 0.000 claims description 2
- 238000007689 inspection Methods 0.000 claims description 2
- 238000012544 monitoring process Methods 0.000 abstract description 23
- 239000012452 mother liquor Substances 0.000 description 18
- 238000004364 calculation method Methods 0.000 description 6
- 238000012421 spiking Methods 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 230000000737 periodic effect Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 125000004122 cyclic group Chemical group 0.000 description 2
- 238000013100 final test Methods 0.000 description 2
- 238000007667 floating Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000013524 data verification Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000011076 safety test Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
Landscapes
- Testing Resistance To Weather, Investigating Materials By Mechanical Methods (AREA)
Abstract
The invention discloses a kind of verification method and device of test data.Wherein, the method comprises: obtain water quality data and carry out detecting the test result obtained; When current test result exceedes default standard value, determine to carry out emergent Quality Control test or abnormal Quality Control test to current test result, obtain the first the result; When current test result does not exceed default standard value, data exception detection is carried out to current test result, if current test result is abnormal data, then abnormal Quality Control test is carried out to current test result, obtain the second the result, if current test result is not abnormal data, then conventional Quality Control test is carried out to current test result, obtain the 3rd the result; At the first the result or the second the result or the 3rd the result in setting range, then the test result of water quality data is effective result.By the present invention, the data that can realize can monitoring environment supervision instrument carry out distinguishing validity.
Description
Technical Field
The invention relates to the field of water quality monitoring, in particular to a method and a device for verifying test data.
Background
At present, the online environment monitoring in China starts late, and is at the second monitoring level (automatic online and unattended monitoring is realized), but whether the data is effective or not is not judged. At present, the existing water quality on-line monitoring system can only simply start an instrument to test according to a period, and the data quality is basically not guaranteed. Specifically, in the prior art, sampling and analysis are mainly performed manually, and a large amount of resources (human resources, financial resources, material resources, and time) are required.
At present, no effective solution is provided for the problem that whether the water quality detection result monitored by an environment monitoring instrument is effective or not in the related art.
Disclosure of Invention
In view of the problem that it is not possible to determine whether the water quality detection result monitored by the environmental monitoring instrument is valid in the related art, an effective solution has not been proposed yet, and therefore, the main object of the present invention is to provide a method and an apparatus for verifying test data to solve the above problem.
In order to achieve the above object, according to an aspect of the present invention, there is provided a verification method of test data, the method including: according to the test cycle, the water quality data is subjected to cyclic detection to obtain a test result, wherein the test result comprises: historical test results and current test results obtained by detection in the current test period; determining to perform emergency quality control test or abnormal quality control test on the water quality data according to the current standard exceeding times under the condition that the current test result exceeds a preset standard value to obtain a first verification result; performing data anomaly detection on the current test result under the condition that the current test result does not exceed a preset standard value, performing an anomaly quality control test on the water quality data to obtain a second verification result if the current test result is abnormal data, and performing a conventional quality control test on the water quality data to obtain a third verification result if the current test result is not abnormal data; and if the first verification result, the second verification result or the third verification result is within the set range, the current test result of the water quality data is an effective result.
In order to achieve the above object, according to another aspect of the present invention, there is provided a verification apparatus of test data, the apparatus including: the test module is used for carrying out cycle detection on the water quality data according to the test period to obtain a test result, and the test result comprises: historical test results and current test results obtained by detection in the current test period; the first verification module is used for determining to carry out emergency quality control test or abnormal quality control test on the water quality data according to the current standard exceeding times under the condition that the current test result exceeds a preset standard value to obtain a first verification result; the second verification module is used for performing data anomaly detection on the current test result under the condition that the current test result does not exceed a preset standard value, performing an abnormal quality control test on the water quality data to obtain a second verification result if the current test result is abnormal data, and performing a conventional quality control test on the water quality data to obtain a third verification result if the current test result is not abnormal data; and the determining module is used for determining that the current test result of the water quality data is a valid result when the first verification result, the second verification result or the third verification result is within a set range.
According to the invention, the water quality data is subjected to cyclic detection according to the test period to obtain the test result, and the test result comprises the following steps: historical test results and current test results obtained by detection in the current test period; determining to perform emergency quality control test or abnormal quality control test on the water quality data according to the current standard exceeding times under the condition that the current test result exceeds a preset standard value to obtain a first verification result; performing data anomaly detection on the current test result under the condition that the current test result does not exceed a preset standard value, performing an anomaly quality control test on the water quality data to obtain a second verification result if the current test result is abnormal data, and performing a conventional quality control test on the water quality data to obtain a third verification result if the current test result is not abnormal data; when the first verification result, the second verification result or the third verification result is within a set range, the current test result of the water quality data is an effective result, the problem that whether the water quality detection result monitored by the environment monitoring instrument is effective or not can not be determined in the related art is solved, and the effect of judging the effectiveness of the data monitored by the environment monitoring instrument can be further achieved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
FIG. 1 is a schematic structural diagram of a verification apparatus for test data according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method of validating test data according to an embodiment of the invention; and
fig. 3 is a detailed flowchart of a verification method of test data according to an embodiment of the present invention.
Detailed Description
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present invention will be described in detail below with reference to the embodiments with reference to the attached drawings.
Before describing further details of embodiments of the present invention, one suitable computing architecture that may be used to implement the principles of the present invention will be described with reference to FIG. 1. In the following description, embodiments of the invention are described with reference to acts and symbolic representations of operations that are performed by one or more computers, unless indicated otherwise. As such, it will be understood that such acts and operations, which are at times referred to as being computer-executed, include the manipulation by the processing unit of the computer of electrical signals representing data in a structured form. This manipulation transforms the data or maintains it at locations in the computer's memory system, which reconfigures or otherwise alters the operation of the computer in a manner well understood by those skilled in the art. The data structures that maintain the data are physical locations of the memory that have particular properties defined by the format of the data. However, while the invention is described in the foregoing context, it is not meant to be limiting, as those of skill in the art will appreciate that various aspects of the acts and operations described hereinafter may also be implemented in hardware.
Turning to the drawings, wherein like reference numerals refer to like elements, the principles of the present invention are illustrated as being implemented in a suitable computing environment. The following description is based on illustrated embodiments of the invention and should not be taken as limiting the invention with regard to alternative embodiments that are not explicitly described herein.
FIG. 1 shows a schematic diagram of one example computer architecture that may be used for these devices. For purposes of description, the architecture depicted is only one example of a suitable environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should the computing system be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in FIG. 1.
The principles of the present invention are operational with numerous other general purpose or special purpose computing or communications environments or configurations. Examples of well known computing systems, environments, and configurations that may be suitable for use with the invention include, but are not limited to, personal computers, servers, multiprocessor systems, microprocessor-based systems, minicomputers, mainframe computers, and distributed computing environments that include any of the above systems or devices.
In its most basic configuration, fig. 1 is a schematic structural diagram of a verification apparatus for test data according to an embodiment of the present invention. As shown in fig. 1, the verification apparatus of test data may include: a test module 101, a first verification module 103, a second verification module 105, and a determination module 107.
Wherein, test module 101 is used for carrying out cycle detection to quality of water data according to the test cycle, obtains the test result, and the test result includes: historical test results and current test results obtained by detection in the current test period; the first verification module 103 is configured to determine to perform an emergency quality control test or an abnormal quality control test on the water quality data according to the current standard-exceeding times to obtain a first verification result when the current test result exceeds a preset standard value; the second verification module 105 is configured to perform data anomaly detection on the current test result under the condition that the current test result does not exceed a preset standard value, perform an abnormal quality control test on the water quality data to obtain a second verification result if the current test result is abnormal data, and perform a conventional quality control test on the water quality data to obtain a third verification result if the current test result is not abnormal data; and the determining module 107 is configured to determine that the current test result of the water quality data is a valid result when the first verification result, the second verification result, or the third verification result is within the set range.
In the above embodiments of the present application, the test period refers to that the system performs a water sample analysis test according to a set time period, for example, a water sample analysis can be performed on water quality data once in 4 hours.
The abnormal data refers to: the comparison of the currently detected test result data and one or more previous test result data, which float over a certain value, indicates that the current test result is abnormal data. For example, the current test result is compared with the data of the previous test result, and if the upper and lower floating rate exceeds 30%, the current data is determined as abnormal data; or the current test data exceeds a set threshold (often referred to as an over-standard) and the previous test data does not exceed the threshold, the current data is also considered abnormal data.
The superscalar data means: and if the current test result exceeds a preset standard value, determining that the current test result is standard exceeding data, namely, if the current test result data obtained by the current detection exceeds the set standard value, marking that the current test result is standard exceeding. Preferably, if the test results of two current continuous water sample tests exceed the set standard value, the system determines that the current test result is definitely the overproof data.
The embodiment of the application realizes that the system automatically carries out verification control when the current test result has the two situations.
Specific verification controls may include: when the current test result is judged to be abnormal data, the system can test according to a set quality control flow, the quality control flow is a combination of one or more of parallel sample test, standard sample test and added standard recovery test, and after the quality control test is finished, the system returns to a normal periodic test. If the current test result is judged to be standard exceeding data, the system can immediately perform a standard sample test, if the standard sample test is within an allowable error range, the data tested by the instrument can be determined to be accurate, namely the data are real and exceed the standard, otherwise, the instrument is proved to be problematic, and the data of the tested water sample cannot be proved to be accurate.
According to the embodiment of the application, the abnormal quality control test, the conventional quality control test or the emergency quality control test are automatically performed on the abnormal data and the standard exceeding data, and specifically, the parallel sample test, the standard adding recovery test and the like can be performed to confirm whether the data of the currently detected test result is really abnormal, standard exceeding or caused by the reason of the instrument, so that the truth and the effectiveness of the test result are ensured.
Therefore, the invention further tests and processes the abnormal data and the standard exceeding data through the existing online equipment, judges whether the data is abnormal or standard exceeding under the condition of not influencing normal test, and further realizes the judgment of the effectiveness of the data measured by the instrument. Finally, the corresponding control flow is started, and the manpower, material resources, financial resources and time are saved in all aspects. Therefore, the problem that whether the water quality detection result monitored by the environment monitoring instrument is effective or not can not be determined in the related technology is solved, and the effect of judging the effectiveness of the data monitored by the environment monitoring instrument is further achieved.
Preferably, the first verification module in the above embodiment of the present application may include: the accumulation module is used for accumulating 1 to the overproof times recorded by the system to obtain the current overproof times under the condition that the current test result exceeds a preset standard value; the first detection module is used for detecting whether the current exceeding times exceeds a first threshold value; the emergency quality control testing module is used for carrying out emergency quality control testing on the water quality data under the condition that the current exceeding times exceeds a first threshold; and the abnormal quality control testing module is used for performing abnormal quality control testing on the water quality data under the condition that the current exceeding times does not exceed the first threshold.
Preferably, in the above device embodiment of the present application, the scheme for performing the emergency quality control test on the current test result may include the following embodiments: performing any one or more of the following tests on the current test result: parallel sample testing, standard sample checking testing and standard adding recovery testing; after the standard adding recovery test is carried out on the current test result, if the obtained standard adding recovery rate is within a preset range, the result of carrying out the parallel sample test on the current test result is valid data, otherwise, the test result is invalid data.
Specifically, the embodiment of the emergency quality control process in the above embodiment of the present application is as follows: under the condition that the exceeding times are more than a certain number, for example, after the exceeding times are more than 2 times, the system is started to be in an emergency mode, so that historical test results obtained by circularly detecting the water quality data are read, standard sample quality control tests and/or standard adding recovery tests are carried out on all the historical test results according to the set times, for example, the standard sample tests are carried out on water samples after 6 water quality tests are carried out, and/or the standard adding recovery tests are carried out on the water samples after 5 water quality tests are carried out. The quality control test does not change the working flow of the system, namely, the abnormal test or the conventional mode is not switched.
The standard sample test is realized in the following manner: the method is characterized in that a sample with known concentration is tested, the obtained sample test result and the known historical test result are subjected to error calculation, and generally, the error range of +/-10% indicates that the instrument is unproblematic, namely, the current test result of the water sample made by the instrument is correct.
The implementation of the spiking recovery test is as follows: adding mother liquor with certain concentration and volume into the pure water sample with the current test result, uniformly mixing, and then testing, wherein the obtained test result (mixed sample value) and the test result of the pure water sample calculate the standard recovery rate through a formula, generally the standard recovery rate is between 80% and 120%, and the result of the water sample with the current test is correct, and the formula is as follows: spiked recovery = (mixed sample-water sample) × water sample volume/(mother liquor concentration × mother liquor volume) × 100%.
Preferably, in the above embodiment of the present application, in a scheme of performing data anomaly detection on a current test result, the apparatus may further include: the second detection module is used for detecting whether the overproof times recorded by the system are null or not; the data anomaly detection module is used for clearing the recorded exceeding times under the condition that the recorded exceeding times are empty, and carrying out data anomaly detection on the current test result; and under the condition that the recorded exceeding times are not empty, carrying out data anomaly detection on the current test result.
Preferably, the data anomaly detection module in the above embodiment of the present application may include: the comparison module is used for carrying out error comparison on the current test result and a preset number of safety test results; the first determining module is used for determining that the current test result is abnormal data and determining that the current test result is abnormal data under the condition that the error value between the current test result and the preset number of historical test results exceeds a second threshold value; and the second determining module is used for determining that the current test result is not abnormal data under the condition that the error value of the current test result and the preset number of historical test results does not exceed a second threshold value.
Preferably, in the above embodiment of the present application, in the process of executing the second verification module 105, the following scheme may be executed in a scheme of performing the abnormal quality control test on the current test result: performing any one or more of the following tests on the current test result: parallel sample testing, standard sample checking testing and standard adding recovery testing; after the standard adding recovery test is carried out on the current test result, if the obtained standard adding recovery rate is within a preset range, the result of carrying out the parallel sample test on the current test result is valid data, otherwise, the test result is invalid data.
Specifically, the abnormal quality control process in the above embodiment of the present application is as follows: and when the current test result is determined to be abnormal data, performing at least one parallel sample test on the water quality data of the water sample, and optionally performing a standard sample test and a standard adding recovery test, and returning to the conventional test after the abnormal quality control process is completed.
The parallel sample test is realized by the following steps: and (4) testing the same water sample for multiple times, and averaging multiple results to serve as a final test result. The water sample obtained from the current test result is independently subjected to a plurality of water sample tests, and the obtained plurality of test results are averaged, so that a parallel sample test result is obtained.
At the moment, the abnormal quality control process adopts standard sample test and standard adding recovery test to test the current water sample, so as to determine whether the parallel sample test result is valid data.
Specifically, the standard sample test is implemented as follows: the method is characterized in that a sample with known concentration is tested, the obtained sample test result and the known historical test result are subjected to error calculation, and generally, the error range of +/-10% indicates that the instrument is unproblematic, namely, the current test result of the water sample made by the instrument is correct.
The implementation of the spiking recovery test is as follows: adding mother liquor with certain concentration and volume into the pure water sample with the current test result, uniformly mixing, and then testing, wherein the obtained test result (mixed sample value) and the test result of the pure water sample calculate the standard recovery rate through a formula, generally the standard recovery rate is between 80% and 120%, and the result of the water sample with the current test is correct, and the formula is as follows: spiked recovery = (mixed sample-water sample) × water sample volume/(mother liquor concentration × mother liquor volume) × 100%.
Preferably, in the above embodiment of the present application, in the process of executing the second verification module 105, the following scheme may be executed in a scheme of performing a conventional quality control test on a current test result: performing any one or more of the following tests on the current test result: parallel sample testing, standard sample checking testing and standard adding recovery testing; after the standard adding recovery test is carried out on the current test result, if the obtained standard adding recovery rate is within a preset range, the result of carrying out the parallel sample test on the current test result is valid data, otherwise, the test result is invalid data.
Specifically, the conventional quality control process implementation in the above embodiment of the present application is as follows: in the normal periodic test process, if the current test result is determined to be non-abnormal data, the quality control test is performed on the historical test results of a preset number of times, for example, the test results of water samples within one day are collected, wherein a standard sample test is performed on the water samples after 6 water quality tests are performed every time, and/or a standard adding recovery test is performed on the water samples after 5 water quality tests are performed every time. The quality control test does not change the working flow of the system, namely, the abnormal test or the conventional mode is not switched.
The standard sample test is realized in the following manner: the method is characterized in that a sample with known concentration is tested, the obtained sample test result and the known historical test result are subjected to error calculation, and generally, the error range of +/-10% indicates that the instrument is unproblematic, namely, the current test result of the water sample made by the instrument is correct.
The implementation of the spiking recovery test is as follows: adding mother liquor with certain concentration and volume into the pure water sample with the current test result, uniformly mixing, and then testing, wherein the obtained test result (mixed sample value) and the test result of the pure water sample calculate the standard recovery rate through a formula, generally the standard recovery rate is between 80% and 120%, and the result of the water sample with the current test is correct, and the formula is as follows: spiked recovery = (mixed sample-water sample) × water sample volume/(mother liquor concentration × mother liquor volume) × 100%.
For example, the following description will be made in detail by taking the current test result exceeding the standard as an example: the method can judge whether the error of the current test result and the previous test result or results exceeds more than 30%, if so, the method can carry out any combination of parallel sample test (for multiple times), standard sample test (for multiple times) and standard recovery test according to the set flow, if the standard sample test result is in the artificially set error range (considering the performance of the instrument, the error range of each instrument can be judged and set manually), and if the standard recovery rate is 80% to 120%, the current parallel sample data is valid data, otherwise, the data tested by the instrument is not accurate any more, and the tested data is invalid.
The above process also provides the steps of judging whether the current test result exceeds the set standard, if the current test result exceeds the set standard, carrying out any combination of parallel sample test, standard sample test and standard adding recovery test, judging the error range of the parallel sample data, the standard sample test and the standard adding recovery rate, wherein the judgment condition is the same as the previous point, if the data is confirmed to be the standard exceeding data, starting continuous monitoring (increasing the monitoring frequency) immediately, and enabling the system to enter an emergency state.
In summary, the above embodiments of the present application provide an effectiveness determination apparatus when a detection result is abnormal data or standard exceeding data, and specifically, a processing manner after determining whether the abnormal data and the standard exceeding data are real and determining that the data of the test result is standard exceeding is adopted to start continuous monitoring.
FIG. 2 is a flow chart of a method of validating test data according to an embodiment of the invention; fig. 3 is a detailed flowchart of a verification method of test data according to an embodiment of the present invention.
As shown in fig. 2, the method comprises the following steps:
step S10, performing cycle detection on the water quality data according to the test period to obtain a test result, wherein the test result comprises: historical test results and current test results obtained by detection in the current test period.
And step S30, determining to perform emergency quality control test or abnormal quality control test on the water quality data according to the current standard exceeding times under the condition that the current test result exceeds a preset standard value, and obtaining a first verification result.
And step S50, performing data anomaly detection on the current test result under the condition that the current test result does not exceed a preset standard value, performing an anomaly quality control test on the water quality data to obtain a second verification result if the current test result is abnormal data, and performing a conventional quality control test on the water quality data to obtain a third verification result if the current test result is not abnormal data.
And step S70, if the first verification result, the second verification result or the third verification result is within the set range, the current test result of the water quality data is a valid result.
In the above embodiments of the present application, the test period refers to that the system performs a water sample analysis test according to a set time period, for example, a water sample analysis can be performed on water quality data once in 4 hours.
The abnormal data refers to: the comparison of the currently detected test result data and one or more previous test result data, which float over a certain value, indicates that the current test result is abnormal data. For example, the current test result is compared with the data of the previous test result, and if the upper and lower floating rate exceeds 30%, the current data is determined as abnormal data; or the current test data exceeds a set threshold (often referred to as an over-standard) and the previous test data does not exceed the threshold, the current data is also considered abnormal data.
The superscalar data means: and if the current test result exceeds a preset standard value, determining that the current test result is standard exceeding data, namely, if the current test result data obtained by the current detection exceeds the set standard value, marking that the current test result is standard exceeding. Preferably, if the test results of two current continuous water sample tests exceed the set standard value, the system determines that the current test result is definitely the overproof data.
The embodiment of the application realizes that the system automatically carries out verification control when the current test result has the two situations.
Specific verification controls may include: when the current test result is judged to be abnormal data, the system can test according to a set quality control flow, the quality control flow is a combination of one or more of parallel sample test, standard sample test and added standard recovery test, and after the quality control test is finished, the system returns to a normal periodic test. If the current test result is judged to be standard exceeding data, the system can immediately perform a standard sample test, if the standard sample test is within an allowable error range, the data tested by the instrument can be determined to be accurate, namely the data are real and exceed the standard, otherwise, the instrument is proved to be problematic, and the data of the tested water sample cannot be proved to be accurate.
According to the embodiment of the application, the abnormal quality control test, the conventional quality control test or the emergency quality control test are automatically performed on the abnormal data and the standard exceeding data, and specifically, the parallel sample test, the standard adding recovery test and the like can be performed to confirm whether the data of the currently detected test result is really abnormal, standard exceeding or caused by the reason of the instrument, so that the truth and the effectiveness of the test result are ensured.
Preferably, when the current test result is judged to be the superscalar data, the system changes the test period, and the test period can be shortened, for example. Previously 4 hours for a test period, now 1 hour or less (set according to field practice), so-called encryption monitoring. The above-described manner of changing the test period may be performed together with the panic mode.
Therefore, the invention further tests and processes the abnormal data and the standard exceeding data through the existing online equipment, judges whether the data is abnormal or standard exceeding under the condition of not influencing normal test, and further realizes the judgment of the effectiveness of the data measured by the instrument. Finally, the corresponding control flow is started, and the manpower, material resources, financial resources and time are saved in all aspects. Therefore, the problem that whether the water quality detection result monitored by the environment monitoring instrument is effective or not can not be determined in the related technology is solved, and the effect of judging the effectiveness of the data monitored by the environment monitoring instrument is further achieved.
The following describes the water quality data testing process in detail with respect to the above embodiments of the present application.
In the above method embodiment of the present application, as shown in fig. 3, when the current test result exceeds the preset standard value, step S30 determines to perform an emergency quality control test or an abnormal quality control test on the water quality data according to the current number of times exceeding the standard, and obtaining the first verification result may include the following steps:
and S301, accumulating 1 for the overproof times recorded by the system to obtain the current overproof times under the condition that the current test result exceeds a preset standard value.
Step S302, detecting whether the current exceeding times exceeds a first threshold value; when the current number of times of exceeding exceeds the first threshold, the process proceeds to step S303, and when the current number of times of exceeding does not exceed the first threshold, the process proceeds to step S304.
Specifically, the first threshold in this step may be 2 times. And when the exceeding times exceed 2 times, sending the short message and entering an emergency mode. The emergency mode here is to enter step S303.
And step S303, performing emergency quality control test on the water quality data.
And step S304, performing an abnormal quality control test on the water quality data.
Preferably, in the above embodiment of the present application, the step of performing the emergency quality control test on the water quality data in step S303 may include the following embodiments: extracting water quality data to perform cycle detection to obtain a historical test result; performing any one or more of the following tests on historical test results of the water quality data: a standard sample checking test and a standard adding recovery test; after the benchmarking recovery test is carried out on the historical test result, if the obtained benchmarking recovery rate is within a first preset range, the current test result is valid data, and if not, the current test result is invalid data; after the historical test results are subjected to the standard sample checking test, if the error value of each historical test result and the sample test result is within a second preset range, the current test result is valid data, and if not, the current test result is invalid data.
Specifically, the embodiment of the emergency quality control process in the above embodiment of the present application is as follows: under the condition that the exceeding times are more than a certain number, for example, after the exceeding times are more than 2 times, the system is started to be in an emergency mode, after the historical test results obtained by circularly detecting the water quality data are read, the quality control test is carried out on all the historical test results according to the set times, for example, the standard sample test is carried out on the water sample after 6 water quality tests are carried out, and/or the standard adding recovery test is carried out on the water sample after 5 water quality tests are carried out. The quality control test does not change the working flow of the system, namely, the abnormal test or the conventional mode is not switched.
The standard sample test is realized in the following manner: the method is characterized in that a sample with known concentration is tested, the obtained sample test result and the known historical test result are subjected to error calculation, and generally, the error range of +/-10% indicates that the instrument is unproblematic, namely, the current test result of the water sample made by the instrument is correct.
The implementation of the spiking recovery test is as follows: adding mother liquor with certain concentration and volume into the pure water sample with the current test result, uniformly mixing, and then testing, wherein the obtained test result (mixed sample value) and the test result of the pure water sample calculate the standard recovery rate through a formula, generally the standard recovery rate is between 80% and 120%, and the result of the water sample with the current test is correct, and the formula is as follows: spiked recovery = (mixed sample-water sample) × water sample volume/(mother liquor concentration × mother liquor volume) × 100%.
In the above embodiment of the present application, as shown in fig. 3, in the execution process of step S50, before performing data anomaly detection on the current test result, the method may further include the following steps:
step S401, detecting whether the overproof times recorded by the system are null or not; wherein, when the recorded exceeding times is empty, step S502 is executed, and when the recorded exceeding times is not empty, step S503 is executed.
And S402, clearing the recorded exceeding times, and performing data anomaly detection on the current test result.
Step S403, directly performing data anomaly detection on the current test result.
Preferably, in the foregoing embodiment of the present application, as shown in fig. 3, the step of performing data anomaly detection on the current test result may include the following implementation steps:
in step S501, the current test result is error-compared with a predetermined number of historical test results to determine whether the current test result is abnormal data.
In step S502, when the error value between the current test result and the predetermined number of historical test results exceeds the second threshold, the current test result is determined to be abnormal data.
In step S503, in the case that the error value between the current test result and the predetermined number of histories does not exceed the second threshold, it is determined that the current test result is not abnormal data.
Preferably, in the foregoing embodiment of the present application, in the process of executing step S50, the following scheme may be executed in the step of performing the abnormal quality control test on the water quality data: performing a combination of any one or more of the following tests on the water quality data: parallel sample testing, standard sample checking testing and standard adding recovery testing; after the water quality data is subjected to the standard adding recovery test, if the obtained standard adding recovery rate is within a third preset range, the result of the parallel sample test on the current test result is valid data, and if not, the current test result is invalid data; after the standard sample inspection test is carried out on the water quality data, if the error value of the current test result and the sample test result is within a fourth preset range, the result of carrying out the parallel sample test on the current test result is valid data, and if not, the current test result is invalid data.
Specifically, the abnormal quality control process in the above embodiment of the present application is as follows: and when the current test result is determined to be abnormal data, performing at least one parallel sample test on the water quality data of the water sample, and optionally performing a standard sample test and a standard adding recovery test, and returning to the conventional test after the abnormal quality control process is completed.
The parallel sample test is realized by the following steps: and (4) testing the same water sample for multiple times, and averaging multiple results to serve as a final test result. That is, the average value of a plurality of historical test results (for example, the first three normal test results of the water sample) corresponding to the water sample obtained as the current test result is obtained, so as to obtain the parallel sample test result.
At the moment, the abnormal quality control process adopts standard sample test and standard adding recovery test to test the current water sample, so as to determine whether the parallel sample test result is valid data.
Specifically, the standard sample test is implemented as follows: the method is characterized in that a sample with known concentration is tested, the obtained sample test result and the known historical test result are subjected to error calculation, and generally, the error range of +/-10% indicates that the instrument is unproblematic, namely, the current test result of the water sample made by the instrument is correct.
The implementation of the spiking recovery test is as follows: adding mother liquor with certain concentration and volume into the pure water sample with the current test result, uniformly mixing, and then testing, wherein the obtained test result (mixed sample value) and the test result of the pure water sample calculate the standard recovery rate through a formula, generally the standard recovery rate is between 80% and 120%, and the result of the water sample with the current test is correct, and the formula is as follows: spiked recovery = (mixed sample-water sample) × water sample volume/(mother liquor concentration × mother liquor volume) × 100%.
Preferably, in the above embodiment of the present application, in the process of executing step S50, the following scheme may be executed in the step of performing the conventional quality control test on the water quality data: within a preset time, extracting a preset number of historical test results obtained by carrying out limited-time circulation detection on water quality data; performing any one or combination of the following tests on a predetermined number of historical test results of the water quality data: a standard sample checking test and a standard adding recovery test; after the predetermined number of historical test results are subjected to the benchmarking recovery test, if the obtained benchmarking recovery rate is within a fifth predetermined range, the current test result is valid data, and otherwise, the current test result is invalid data; after the standard sample checking test is carried out on the historical test results of the preset quantity, if the error value of each test result and the sample test result is within a sixth preset range, the current test result is valid data, and if not, the current test result is invalid data.
Specifically, the conventional quality control process implementation in the above embodiment of the present application is as follows: in the normal periodic test process, if the current test result is determined to be non-abnormal data, the quality control test is performed on the historical test results of a preset number of times, for example, the test results of water samples within one day are collected, wherein a standard sample test is performed on the water samples after 6 water quality tests are performed every time, and/or a standard adding recovery test is performed on the water samples after 5 water quality tests are performed every time. The quality control test does not change the working flow of the system, namely, the abnormal test or the conventional mode is not switched.
The standard sample test is realized in the following manner: the method is characterized in that a sample with known concentration is tested, the obtained sample test result and the known historical test result are subjected to error calculation, and generally, the error range of +/-10% indicates that the instrument is unproblematic, namely, the current test result of the water sample made by the instrument is correct.
The implementation of the spiking recovery test is as follows: adding mother liquor with certain concentration and volume into the pure water sample with the current test result, uniformly mixing, and then testing, wherein the obtained test result (mixed sample value) and the test result of the pure water sample calculate the standard recovery rate through a formula, generally the standard recovery rate is between 80% and 120%, and the result of the water sample with the current test is correct, and the formula is as follows: spiked recovery = (mixed sample-water sample) × water sample volume/(mother liquor concentration × mother liquor volume) × 100%.
In summary, the above embodiments of the present application provide a method for determining validity when a detection result is abnormal data or standard exceeding data, and specifically, a processing manner after determining whether abnormal data and standard exceeding data are real and determining data of the test result is standard exceeding is adopted to start continuous monitoring. At the completion of the normal cycle test:
specifically, as shown in fig. 3, the following description will be made in detail by taking the standard exceeding of the current test result as an example: the method can judge whether the error of the current test result and the previous test result or results exceeds more than 30%, if so, the method can carry out any combination of parallel sample test (for multiple times), standard sample test (for multiple times) and standard recovery test according to the set flow, if the standard sample test result is in the artificially set error range (considering the performance of the instrument, the error range of each instrument can be judged and set manually), and if the standard recovery rate is 80% to 120%, the current parallel sample data is valid data, otherwise, the data tested by the instrument is not accurate any more, and the tested data is invalid.
As shown in fig. 3, it is determined whether the current test result exceeds the set standard, if so, any combination of the parallel sample test, the standard sample test and the standard recovery test is performed, and the error range of the parallel sample data, the standard sample test and the standard recovery rate are determined, the determination condition is the same as the previous point, if the data is determined to be the standard data, the continuous monitoring is started immediately (the monitoring frequency is increased), and the system enters the emergency state.
It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than presented herein.
From the above description, it can be seen that the present invention achieves the following technical effects: the problem that whether the water quality detection result monitored by the environment monitoring instrument is effective or not can not be determined in the related technology is solved, and the effect of judging the effectiveness of the data monitored by the environment monitoring instrument is achieved.
From the above description of the embodiments, it is clear to those skilled in the art that the present application can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present application may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments of the present application.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The application is operational with numerous general purpose or special purpose computing system environments or configurations. For example: personal computers, server computers, hand-held or portable devices, tablet-type devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and they may alternatively be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, or fabricated separately as individual integrated circuit modules, or fabricated as a single integrated circuit module from multiple modules or steps. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (11)
1. A method for validating test data, comprising:
according to the test period, carrying out cycle detection on the water quality data to obtain a test result, wherein the test result comprises: historical test results and current test results obtained by detection in the current test period;
determining to perform emergency quality control test or abnormal quality control test on the water quality data according to the current standard exceeding times under the condition that the current test result exceeds a preset standard value to obtain a first verification result;
performing data anomaly detection on the current test result under the condition that the current test result does not exceed a preset standard value, performing an anomaly quality control test on the water quality data to obtain a second verification result if the current test result is abnormal data, and performing a conventional quality control test on the water quality data to obtain a third verification result if the current test result is not the abnormal data;
and if the first verification result, the second verification result or the third verification result is within a set range, the current test result of the water quality data is a valid result.
2. The method as claimed in claim 1, wherein when the current test result exceeds a preset standard value, determining to perform an emergency quality control test or an abnormal quality control test on the water quality data according to the current number of times exceeding the standard, and the step of obtaining a first verification result comprises:
under the condition that the current test result exceeds a preset standard value, accumulating 1 for the overproof times recorded by the system to obtain the current overproof times;
detecting whether the current exceeding times exceeds a first threshold value; wherein,
performing emergency quality control test on the water quality data under the condition that the current exceeding times exceed the first threshold;
and under the condition that the current exceeding times do not exceed the first threshold, performing an abnormal quality control test on the water quality data.
3. The method of claim 2, wherein the step of performing an emergency quality control test on the water quality data comprises:
extracting the water quality data to perform the cycle detection to obtain the historical test result;
performing any one or combination of the following tests on the historical test results of the water quality data: a standard sample checking test and a standard adding recovery test;
after the benchmarking recovery test is carried out on the historical test result, if the obtained benchmarking recovery rate is within a first preset range, the current test result is valid data, and if not, the current test result is invalid data; after the standard sample checking test is carried out on the historical test results, if the error value of each historical test result and the sample test result is within a second preset range, the current test result is valid data, and if not, the current test result is invalid data.
4. The method of claim 1, wherein prior to performing data anomaly detection on the current test result, the method further comprises:
detecting whether the overproof times recorded by the system are null or not; wherein,
clearing the recorded exceeding times under the condition that the recorded exceeding times are empty, and performing data anomaly detection on the current test result;
and under the condition that the recorded exceeding times are not empty, directly carrying out data anomaly detection on the current test result.
5. The method of claim 4, wherein the step of performing data anomaly detection on the current test result comprises:
comparing the current test result with a predetermined number of historical test results for errors;
determining that the current test result is the abnormal data when an error value between the current test result and the predetermined number of historical test results exceeds a second threshold;
in the event that the error value of the current test result from the predetermined number of histories does not exceed the second threshold, then it is determined that the current test result is not the abnormal data.
6. The method of claim 5, wherein the step of performing an abnormal quality control test on the water quality data comprises:
performing a combination of any one or more of the following tests on the water quality data: parallel sample testing, standard sample checking testing and standard adding recovery testing;
after the water quality data is subjected to the standard adding recovery test, if the obtained standard adding recovery rate is within a third preset range, the result of the parallel sample test on the current test result is valid data, and if not, the current test result is invalid data; after the standard sample inspection test is carried out on the water quality data, if the error value of the current test result and the sample test result is within a fourth preset range, the result of carrying out the parallel sample test on the current test result is valid data, otherwise, the current test result is invalid data.
7. The method of claim 5, wherein the step of performing a routine quality control test on the water quality data comprises:
extracting a preset number of historical test results obtained by carrying out limited-time circulation detection on the water quality data within preset time;
performing any one or combination of the following tests on the predetermined number of historical test results of the water quality data: a standard sample checking test and a standard adding recovery test;
after the predetermined number of historical test results are subjected to the benchmarking recovery test, if the obtained benchmarking recovery rate is within a fifth predetermined range, the current test result is valid data, and otherwise, the current test result is invalid data; after the standard sample checking test is carried out on the historical test results of the preset number, if the error value of each test result and the sample test result is within a sixth preset range, the current test result is valid data, and if not, the current test result is invalid data.
8. An apparatus for verifying test data, comprising:
the test module is used for carrying out cycle detection on the water quality data according to the test period to obtain a test result, and the test result comprises: historical test results and current test results obtained by detection in the current test period;
the first verification module is used for determining to carry out emergency quality control test or abnormal quality control test on the water quality data according to the current standard exceeding times under the condition that the current test result exceeds a preset standard value to obtain a first verification result;
the second verification module is used for performing data anomaly detection on the current test result under the condition that the current test result does not exceed a preset standard value, performing an abnormal quality control test on the water quality data to obtain a second verification result if the current test result is abnormal data, and performing a conventional quality control test on the water quality data to obtain a third verification result if the current test result is not the abnormal data;
and the determining module is used for determining that the current test result of the water quality data is an effective result when the first verification result, the second verification result or the third verification result is within a set range.
9. The apparatus of claim 8, wherein the first authentication module comprises:
the accumulation module is used for accumulating 1 to the overproof times recorded by the system to obtain the current overproof times under the condition that the current test result exceeds a preset standard value;
the first detection module is used for detecting whether the current exceeding times exceeds a first threshold value;
the emergency quality control testing module is used for carrying out emergency quality control testing on the water quality data under the condition that the current exceeding times exceeds the first threshold;
and the abnormal quality control testing module is used for performing abnormal quality control testing on the water quality data under the condition that the current exceeding times does not exceed the first threshold.
10. The apparatus of claim 8, further comprising:
the second detection module is used for detecting whether the overproof times recorded by the system are null or not;
the data anomaly detection module is used for clearing the recorded exceeding times under the condition that the recorded exceeding times are empty, and carrying out data anomaly detection on the current test result; and under the condition that the recorded exceeding times are not empty, performing data anomaly detection on the current test result.
11. The apparatus of claim 10, wherein the data anomaly detection module comprises:
the comparison module is used for carrying out error comparison on the current test result and a preset number of historical test results;
a first sub-determination module, configured to determine that the current test result is the abnormal data when an error value between the current test result and the predetermined number of historical test results exceeds a second threshold;
a second sub-determination module for determining that the current test result is not the abnormal data if the error value between the current test result and the predetermined number of historical test results does not exceed the second threshold.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310746049.7A CN103698489B (en) | 2013-12-30 | 2013-12-30 | The verification method of test data and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310746049.7A CN103698489B (en) | 2013-12-30 | 2013-12-30 | The verification method of test data and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103698489A CN103698489A (en) | 2014-04-02 |
| CN103698489B true CN103698489B (en) | 2015-07-29 |
Family
ID=50360088
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310746049.7A Active CN103698489B (en) | 2013-12-30 | 2013-12-30 | The verification method of test data and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103698489B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104980962B (en) * | 2014-04-03 | 2019-04-30 | 中国移动通信集团设计院有限公司 | A kind of determination method and device in field testing period |
| CN104978971B (en) * | 2014-04-08 | 2019-04-05 | 科大讯飞股份有限公司 | A kind of method and system for evaluating spoken language |
| CN104090951A (en) * | 2014-07-04 | 2014-10-08 | 李阳 | Abnormal data processing method |
| CN104237468B (en) * | 2014-09-24 | 2016-03-30 | 石家庄尚维信息技术有限公司 | A kind of monitoring method for monitoring of environmental checkout equipment accuracy |
| CN106485387A (en) * | 2015-09-01 | 2017-03-08 | 北大方正集团有限公司 | Semiconductor process flow control method and device |
| CN105675834B (en) * | 2015-12-31 | 2018-07-13 | 聚光科技(杭州)股份有限公司 | The quality control method and device of water quality monitoring system |
| CN107462285A (en) * | 2017-09-18 | 2017-12-12 | 北京奥博泰科技有限公司 | Environmental monitoring system and method |
| CN108957018A (en) * | 2018-05-19 | 2018-12-07 | 贾晓轻 | A kind of automatic biochemistry analyzer |
| CN108982890A (en) * | 2018-06-29 | 2018-12-11 | 西安思坦科技有限公司 | The automatic quality control system of water quality and function compounding method, data checking method |
| CN110161205A (en) * | 2019-06-14 | 2019-08-23 | 山东省城市供排水水质监测中心 | A kind of monitoring water quality on line tele-control system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102122265A (en) * | 2011-03-03 | 2011-07-13 | 中国工商银行股份有限公司 | System and method for verifying computer software test results |
| CN102236740A (en) * | 2010-04-26 | 2011-11-09 | 上海申丰检测有限公司 | Water quality detection and evaluation service method for drinking water |
| CN102348125A (en) * | 2010-07-30 | 2012-02-08 | 上海炬力集成电路设计有限公司 | Video data reception system verification method and apparatus thereof |
| CN103020642A (en) * | 2012-10-08 | 2013-04-03 | 江苏省环境监测中心 | Water environment monitoring and quality-control data analysis method |
| CN103186467A (en) * | 2011-12-31 | 2013-07-03 | 北京新媒传信科技有限公司 | Method and device for verifying data correctness |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3743001B2 (en) * | 1999-09-17 | 2006-02-08 | オムロン株式会社 | Abnormality determination method and apparatus |
| KR20120077046A (en) * | 2010-12-30 | 2012-07-10 | 주식회사 정림 | Method for verifying reliability using a means of noticing an error in usn water-quality monitoring system |
-
2013
- 2013-12-30 CN CN201310746049.7A patent/CN103698489B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102236740A (en) * | 2010-04-26 | 2011-11-09 | 上海申丰检测有限公司 | Water quality detection and evaluation service method for drinking water |
| CN102348125A (en) * | 2010-07-30 | 2012-02-08 | 上海炬力集成电路设计有限公司 | Video data reception system verification method and apparatus thereof |
| CN102122265A (en) * | 2011-03-03 | 2011-07-13 | 中国工商银行股份有限公司 | System and method for verifying computer software test results |
| CN103186467A (en) * | 2011-12-31 | 2013-07-03 | 北京新媒传信科技有限公司 | Method and device for verifying data correctness |
| CN103020642A (en) * | 2012-10-08 | 2013-04-03 | 江苏省环境监测中心 | Water environment monitoring and quality-control data analysis method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103698489A (en) | 2014-04-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103698489B (en) | The verification method of test data and device | |
| CN103728429B (en) | On-line water quality monitoring method and Monitoring systems | |
| CN108900319B (en) | Fault detection method and device | |
| CN104375912B (en) | The measuring method and device of mobile terminal interim card | |
| KR101043299B1 (en) | Method, system and computer readable recording medium for detecting exploit code | |
| CN110769452B (en) | Base station longitude and latitude anomaly identification method, system, server and storage medium | |
| CN103810063B (en) | Computer testing system and method | |
| US10581665B2 (en) | Content-aware anomaly detection and diagnosis | |
| CN111063048A (en) | Method and device for processing equipment inspection information and electronic equipment | |
| KR101953558B1 (en) | Apparatus and Method for Fault Management of Smart Devices | |
| CN108872780A (en) | Charge livewire work detection, system and the terminal device reconnoitred | |
| CN111698128A (en) | Internet of things network quality detection method and device, computer equipment and storage medium | |
| CN114691521A (en) | Software testing platform based on artificial intelligence | |
| CN103743878A (en) | Water quality monitoring data processing method and device | |
| CN106776248A (en) | A kind of method and apparatus of data processing | |
| CN111654405B (en) | Method, device, equipment and storage medium for fault node of communication link | |
| CN111047160B (en) | Pollution cause analysis method and device, readable storage medium and electronic equipment | |
| CN117691733A (en) | Assessment method and device for information security protection of power distribution automation system | |
| Zhang et al. | Development of a system for collecting loop-detector event data for individual vehicles | |
| WO2016063816A1 (en) | Device and method for detecting abnormality pre-indications in a computer system | |
| CN106709251B (en) | A kind of appraisal procedure and device | |
| CN103680070B (en) | Based on the shift in position recognition methods of the earthquake pre-warning monitor of acceleration transducer | |
| CN116189389A (en) | Landslide monitoring data processing method, landslide monitoring data processing system, computer and storage medium | |
| CN103746871A (en) | Data validity detection device and detection method | |
| CN102591734A (en) | Method and device for detecting reset type of system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |