CN112986169A - Ultraviolet spectrum pollutant classification detection method based on sampling contourlet transformation - Google Patents

Ultraviolet spectrum pollutant classification detection method based on sampling contourlet transformation Download PDF

Info

Publication number
CN112986169A
CN112986169A CN202110267079.4A CN202110267079A CN112986169A CN 112986169 A CN112986169 A CN 112986169A CN 202110267079 A CN202110267079 A CN 202110267079A CN 112986169 A CN112986169 A CN 112986169A
Authority
CN
China
Prior art keywords
pollutant
spectrum
sample
matrix
test sample
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110267079.4A
Other languages
Chinese (zh)
Inventor
赖一行
杨浩
张嘉维
李文涛
钟楚圆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong New Generation Industrial Internet Innovation Technology Co ltd
Original Assignee
Guangdong New Generation Industrial Internet Innovation Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong New Generation Industrial Internet Innovation Technology Co ltd filed Critical Guangdong New Generation Industrial Internet Innovation Technology Co ltd
Priority to CN202110267079.4A priority Critical patent/CN112986169A/en
Publication of CN112986169A publication Critical patent/CN112986169A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/31Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
    • G01N21/33Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using ultraviolet light

Abstract

The invention discloses an ultraviolet spectrum pollutant classification detection method based on sampling contourlet transformation, which comprises the following steps: firstly, measuring known pollutants; step two, establishing a classification model; step three, obtaining a sample; step four, concentration measurement; step five, detecting the spectrum; step six, data processing; step seven, establishing a concentration model; step eight, classified detection; step nine, concentration determination; the invention not only detects and classifies the pollutants contained in the sample through the classification model, but also obtains the concentration of the pollutants according to the absorbance of ultraviolet rays by utilizing the concentration model, thereby being beneficial to improving the practicability of the invention, rapidly distinguishing the pollutant types through a spectrum direct contrast analysis method and being beneficial to improving the working efficiency.

Description

Ultraviolet spectrum pollutant classification detection method based on sampling contourlet transformation
Technical Field
The invention relates to the technical field of water quality monitoring, in particular to an ultraviolet spectrum pollutant classification detection method based on sampling contourlet transformation.
Background
Ultraviolet spectroscopy, also known as ultraviolet and visible spectroscopy, abbreviated as UV, is one of the most widely used methods for determining molecular structures in organic chemistry.
The application range of the ultraviolet spectrum is very wide, along with the continuous progress of modern science and technology, the ultraviolet spectrum pollutant classification detection method also has application in water quality detection, the pollutant classification detection in water on the market generally adopts a wet chemistry method, secondary pollution is very easy to cause, thereby the ultraviolet spectrum pollutant classification detection method based on sampling contourlet transform is produced, however, the classification detection method on the market is easily influenced by stray light in a detection sample in the detection process, the detection result is interfered, the detection error is increased, the pollution type in the sample is detected singly during detection, the concentration of the pollutant cannot be judged, the practicability is lower, time and labor are wasted in the classification detection process, and the efficiency of classification detection is greatly reduced.
Disclosure of Invention
The invention aims to provide a method for classifying and detecting ultraviolet spectrum pollutants based on sampling contourlet transformation, so as to solve the problems in the background technology.
In order to solve the technical problems, the invention provides the following technical scheme: an ultraviolet spectrum pollutant classification detection method based on sampling profile wave conversion comprises the following steps: firstly, measuring known pollutants; step two, establishing a classification model; step three, obtaining a sample; step four, concentration measurement; step five, detecting the spectrum; step six, data processing; step seven, establishing a concentration model; step eight, classified detection; step nine, concentration determination;
in the first step, firstly, a UV spectrometer is used for detecting and analyzing a standard water sample containing a single pollutant to obtain the spectral characteristics of the standard pollutant, and a spectral matrix of the standard pollutant is established as a reference;
in the second step, the spectrum matrix of the standard pollutant obtained in the first step is brought into a support vector machine, and a classification model is obtained through continuous iterative learning of data;
in the third step, a plurality of unknown pollutants to be detected are obtained as samples;
in the fourth step, the unknown pollutant sample in the third step is divided into an experimental sample and a test sample according to the proportion of 7: 3, the COD value of the experimental sample is measured by using a potassium dichromate titration method, and a data matrix of the COD value of the experimental sample is generated;
in the fifth step, the experimental sample and the test sample in the fourth step are respectively measured by using a UV spectrometer to obtain the spectral characteristics of the unknown pollutants, and the spectral matrix of the experimental sample and the spectral matrix of the test sample are respectively established;
in the sixth step, the spectrum matrix of the experimental sample and the spectrum matrix of the test sample obtained in the fifth step are respectively subjected to smoothing treatment, derivative treatment and SNV treatment, and the obtained spectrum matrix is reserved after the treatment is finished;
in the seventh step, the spectrum matrix of the experimental sample processed in the sixth step is used as a training set, the spectrum matrix of the test sample is used as a test set, and the training set and the data matrix of the COD value of the experimental sample measured in the third step are respectively subjected to iterative computation by using a computer to obtain a concentration model;
in the eighth step, the spectrum matrix of the test sample obtained in the fifth step is substituted into the classification model obtained in the second step, so that the pollutant types in the test sample are obtained;
and in the ninth step, substituting the spectrum matrix of the test sample obtained in the fifth step into the concentration model obtained in the seventh step to obtain the pollutant concentration data of the test sample.
According to the technical scheme, in the sixth step, the algorithm of the smoothing processing is a moving average method or a Savitzky-Go-lay convolution smoothing method.
According to the above technical solution, in the sixth step, the derivative processing is one of a first derivative and a second derivative.
According to the above technical solution, in the sixth step, the SNV processing formula is: where is the average of the ith sample, m is the number of wavelength points of the ultraviolet spectral curve, and i is the number of samples.
According to the technical scheme, in the seventh step, the COD value is used as the concentration index of the organic pollutants.
According to the above technical solution, in the seventh step, an algorithm of iterative computation is partial least squares PLS.
According to the above technical solution, in the eighth step, the classification method of the classification model is a spectral direct contrast analysis method, that is, a spectral matrix of the test sample and a reference matrix of a single pollutant are linearly correlated, a fitting straight line is used as a standard, and if the standard is more than 0.99, the single pollutant is present in the test sample.
Compared with the prior art, the invention has the following beneficial effects:
1. according to the method, the sample data is subjected to smoothing processing, derivative processing and SNV processing, so that the interference of noise and scattering in the sample is greatly reduced, the phenomena of superposition and interference among spectrums are reduced, the definition of the spectrums is improved, and the error of classification measurement is reduced.
2. The invention not only detects and classifies the pollutants contained in the sample through the classification model, but also obtains the concentration of the pollutants according to the absorbance of ultraviolet rays by using the concentration model, thereby being beneficial to improving the practicability of the invention.
3. The invention rapidly distinguishes the pollutant types by a spectral direct comparison analysis method, is favorable for improving the working efficiency, and is favorable for improving the accuracy by adopting the fitted straight line for comparison.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
FIG. 1 is a flow chart of the method of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, the present invention provides a technical solution: an ultraviolet spectrum pollutant classification detection method based on sampling profile wave conversion comprises the following steps: firstly, measuring known pollutants; step two, establishing a classification model; step three, obtaining a sample; step four, concentration measurement; step five, detecting the spectrum; step six, data processing; step seven, establishing a concentration model; step eight, classified detection; step nine, concentration determination;
in the first step, firstly, a UV spectrometer is used for detecting and analyzing a standard water sample containing a single pollutant to obtain the spectral characteristics of the standard pollutant, and a spectral matrix of the standard pollutant is established as a reference;
in the second step, the spectrum matrix of the standard pollutant obtained in the first step is brought into a support vector machine, and a classification model is obtained through continuous iterative learning of data;
in the third step, a plurality of unknown pollutants to be detected are obtained as samples;
in the fourth step, the unknown pollutant sample in the third step is divided into an experimental sample and a test sample according to the proportion of 7: 3, the COD value of the experimental sample is measured by using a potassium dichromate titration method, and a data matrix of the COD value of the experimental sample is generated;
in the fifth step, the experimental sample and the test sample in the fourth step are respectively measured by using a UV spectrometer to obtain the spectral characteristics of the unknown pollutants, and the spectral matrix of the experimental sample and the spectral matrix of the test sample are respectively established;
in the sixth step, the spectrum matrix of the experimental sample and the spectrum matrix of the test sample obtained in the fifth step are respectively subjected to smoothing treatment, derivative treatment and SNV treatment, the treatment is standby after the treatment is finished, the algorithm of the smoothing treatment is a moving average method or a Savitzky-Go-lay convolution smoothing method, the derivative treatment is one of a first derivative or a second derivative, and the formula of the SNV treatment is as follows: wherein, the average value of the ith sample is shown, m is the number of wavelength points of the ultraviolet spectrum curve, and i is the number of samples;
in the seventh step, the spectrum matrix of the experimental sample processed in the sixth step is used as a training set, the spectrum matrix of the test sample is used as a test set, the training set and the data matrix of the COD value of the experimental sample measured in the third step are respectively subjected to iterative computation by using a computer, and the iterative computation algorithm is Partial Least Squares (PLS), so as to obtain a concentration model, and the COD value is used as the concentration index of the organic pollutants;
in the eighth step, the spectrum matrix of the test sample obtained in the fifth step is substituted into the classification model obtained in the second step, so as to obtain the pollutant types in the test sample, and the classification method of the classification model is a spectrum direct contrast analysis method, namely, the spectrum matrix of the test sample is linearly related to a reference matrix of a single pollutant, a fitting straight line is used as a standard, and if the number of the fitting straight line is more than 0.99, the single pollutant is contained in the test sample;
and in the ninth step, substituting the spectrum matrix of the test sample obtained in the fifth step into the concentration model obtained in the seventh step to obtain the pollutant concentration data of the test sample.
Based on the above, the method has the advantages that the noise of the data is reduced by smoothing the sample data, the superposition and the interference of the spectrum are reduced by derivative processing, the definition of the spectrum is improved by SNV processing, the error of classification detection is favorably reduced, the pollutants are favorably classified and the concentration of the pollutants is favorably calculated respectively by a classification model and a concentration model, the practicability is favorably improved, and the classification is favorably realized by using a spectrum direct contrast analysis method in the classification process, so that the working efficiency is favorably improved.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that changes may be made in the embodiments and/or equivalents thereof without departing from the spirit and scope of the invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (7)

1. An ultraviolet spectrum pollutant classification detection method based on sampling profile wave conversion comprises the following steps: firstly, measuring known pollutants; step two, establishing a classification model; step three, obtaining a sample; step four, concentration measurement; step five, detecting the spectrum; step six, data processing; step seven, establishing a concentration model; step eight, classified detection; step nine, concentration determination; the method is characterized in that:
in the first step, firstly, a UV spectrometer is used for detecting and analyzing a standard water sample containing a single pollutant to obtain the spectral characteristics of the standard pollutant, and a spectral matrix of the standard pollutant is established as a reference;
in the second step, the spectrum matrix of the standard pollutant obtained in the first step is brought into a support vector machine, and a classification model is obtained through continuous iterative learning of data;
in the third step, a plurality of unknown pollutants to be detected are obtained as samples;
in the fourth step, the unknown pollutant sample in the third step is divided into an experimental sample and a test sample according to the proportion of 7: 3, the COD value of the experimental sample is measured by using a potassium dichromate titration method, and a data matrix of the COD value of the experimental sample is generated;
in the fifth step, the experimental sample and the test sample in the fourth step are respectively measured by using a UV spectrometer to obtain the spectral characteristics of the unknown pollutants, and the spectral matrix of the experimental sample and the spectral matrix of the test sample are respectively established;
in the sixth step, the spectrum matrix of the experimental sample and the spectrum matrix of the test sample obtained in the fifth step are respectively subjected to smoothing treatment, derivative treatment and SNV treatment, and the obtained spectrum matrix is reserved after the treatment is finished;
in the seventh step, the spectrum matrix of the experimental sample processed in the sixth step is used as a training set, the spectrum matrix of the test sample is used as a test set, and the training set and the data matrix of the COD value of the experimental sample measured in the third step are respectively subjected to iterative computation by using a computer to obtain a concentration model;
in the eighth step, the spectrum matrix of the test sample obtained in the fifth step is substituted into the classification model obtained in the second step, so that the pollutant types in the test sample are obtained;
and in the ninth step, substituting the spectrum matrix of the test sample obtained in the fifth step into the concentration model obtained in the seventh step to obtain the pollutant concentration data of the test sample.
2. The ultraviolet spectrum pollutant classification detection method based on sampling profile wave conversion as claimed in claim 1, characterized in that: in the sixth step, the algorithm of the smoothing processing is a moving average method or a Savitzky-Go-lay convolution smoothing method.
3. The ultraviolet spectrum pollutant classification detection method based on sampling profile wave conversion as claimed in claim 1, characterized in that: in the sixth step, the derivative processing is one of a first derivative and a second derivative.
4. The ultraviolet spectrum pollutant classification detection method based on sampling profile wave conversion as claimed in claim 1, characterized in that: in the sixth step, the formula of the SNV processing is as follows: where is the average of the ith sample, m is the number of wavelength points of the ultraviolet spectral curve, and i is the number of samples.
5. The ultraviolet spectrum pollutant classification detection method based on sampling profile wave conversion as claimed in claim 1, characterized in that: and in the seventh step, the COD value is used as the concentration index of the organic pollutants.
6. The ultraviolet spectrum pollutant classification detection method based on sampling profile wave conversion as claimed in claim 1, characterized in that: in the seventh step, the algorithm of iterative computation is partial least squares PLS.
7. The ultraviolet spectrum pollutant classification detection method based on sampling profile wave conversion as claimed in claim 1, characterized in that: in the step eight, the classification method of the classification model is a spectral direct contrast analysis method, that is, the spectral matrix of the test sample and the reference matrix of the single pollutant are linearly correlated, a fitting straight line is used as a standard, and if the standard is more than 0.99, the single pollutant is contained in the test sample.
CN202110267079.4A 2021-03-11 2021-03-11 Ultraviolet spectrum pollutant classification detection method based on sampling contourlet transformation Pending CN112986169A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110267079.4A CN112986169A (en) 2021-03-11 2021-03-11 Ultraviolet spectrum pollutant classification detection method based on sampling contourlet transformation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110267079.4A CN112986169A (en) 2021-03-11 2021-03-11 Ultraviolet spectrum pollutant classification detection method based on sampling contourlet transformation

Publications (1)

Publication Number Publication Date
CN112986169A true CN112986169A (en) 2021-06-18

Family

ID=76335080

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110267079.4A Pending CN112986169A (en) 2021-03-11 2021-03-11 Ultraviolet spectrum pollutant classification detection method based on sampling contourlet transformation

Country Status (1)

Country Link
CN (1) CN112986169A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103267739A (en) * 2013-05-07 2013-08-28 浙江大学 Aquaculture wastewater organic matter concentration measurement method based on spectrum technology
CN103712939A (en) * 2013-12-30 2014-04-09 张显超 Pollutant concentration fitting method based on ultraviolet-visible spectrum
CN103776789A (en) * 2014-02-26 2014-05-07 张显超 Unknown pollutant early-warning method based on ultraviolet-visible spectrum
CN107122733A (en) * 2017-04-25 2017-09-01 西安电子科技大学 Hyperspectral image classification method based on NSCT and SAE
CN107169471A (en) * 2017-06-07 2017-09-15 深圳市创艺工业技术有限公司 A kind of fingerprint recognition system based on image co-registration
CN107316013A (en) * 2017-06-14 2017-11-03 西安电子科技大学 Hyperspectral image classification method with DCNN is converted based on NSCT
CN110702648A (en) * 2019-09-09 2020-01-17 浙江大学 Fluorescent spectrum pollutant classification method based on non-subsampled contourlet transformation

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103267739A (en) * 2013-05-07 2013-08-28 浙江大学 Aquaculture wastewater organic matter concentration measurement method based on spectrum technology
CN103712939A (en) * 2013-12-30 2014-04-09 张显超 Pollutant concentration fitting method based on ultraviolet-visible spectrum
CN103776789A (en) * 2014-02-26 2014-05-07 张显超 Unknown pollutant early-warning method based on ultraviolet-visible spectrum
CN107122733A (en) * 2017-04-25 2017-09-01 西安电子科技大学 Hyperspectral image classification method based on NSCT and SAE
CN107169471A (en) * 2017-06-07 2017-09-15 深圳市创艺工业技术有限公司 A kind of fingerprint recognition system based on image co-registration
CN107316013A (en) * 2017-06-14 2017-11-03 西安电子科技大学 Hyperspectral image classification method with DCNN is converted based on NSCT
CN110702648A (en) * 2019-09-09 2020-01-17 浙江大学 Fluorescent spectrum pollutant classification method based on non-subsampled contourlet transformation

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
吴元清 等: "水体有机污染物浓度检测中的紫外光谱分析方法", 《光谱学与光谱分析》 *
黄平捷 等: "基于SPA和多分类SVM的紫外-可见光光谱饮用水有机污染物判别方法研究", 《光谱学与光谱分析》 *

Similar Documents

Publication Publication Date Title
CN111239071B (en) Method for detecting concentration of nitrate in seawater by spectrometry
CN108108889A (en) A kind of water monitoring data on-line processing method and device
CN109187392B (en) Zinc liquid trace metal ion concentration prediction method based on partition modeling
CN106918567B (en) A kind of method and apparatus measuring trace metal ion concentration
CN110108658B (en) Infrared spectrum identification method and system for polluted gas
CN110749565A (en) Method for rapidly identifying storage years of Pu' er tea
CN111198165A (en) Method for measuring water quality parameters based on spectral data standardization
CN102072767A (en) Wavelength similarity consensus regression-based infrared spectrum quantitative analysis method and device
CN115221927A (en) Ultraviolet-visible spectrum dissolved organic carbon detection method
CN112504983A (en) Nitrate concentration prediction method based on turbidity chromaticity compensation
CN113686811A (en) Spectral data processing method based on double sensors
CN110231328B (en) Raman spectrum quantitative analysis method based on half-peak height distance method
Yao et al. Moving-window bis-correlation coefficients method for visible and near-infrared spectral discriminant analysis with applications
CN110887798B (en) Nonlinear full-spectrum water turbidity quantitative analysis method based on extreme random tree
CN115810403B (en) Method for evaluating water pollution based on environmental characteristic information
CN112986169A (en) Ultraviolet spectrum pollutant classification detection method based on sampling contourlet transformation
CN116380869A (en) Raman spectrum denoising method based on self-adaptive sparse decomposition
CN111141809A (en) Soil nutrient ion content detection method based on non-contact type conductivity signal
CN112858208A (en) Biomass potassium content measurement and modeling method based on infrared spectrum principal component and neural network
CN114062306B (en) Near infrared spectrum data segmentation preprocessing method
CN115656063A (en) Target pollutant content analysis method and device based on hyperspectral data
Aguilera et al. PLS and PCR methods in the assessment of coastal water quality
CN107941745A (en) Method based near infrared spectrum differential staining orange
CN215493143U (en) System for multispectral combines PLS-DA to distinguish plant leaf color nuance
CN111562226B (en) Method and system for analyzing total nitrogen and total phosphorus in seawater based on characteristic peak area of absorption spectrum

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210618

RJ01 Rejection of invention patent application after publication