CN111272679B - High-resolution-based remote sensing reflectivity product generation system and method - Google Patents
High-resolution-based remote sensing reflectivity product generation system and method Download PDFInfo
- Publication number
- CN111272679B CN111272679B CN202010087767.8A CN202010087767A CN111272679B CN 111272679 B CN111272679 B CN 111272679B CN 202010087767 A CN202010087767 A CN 202010087767A CN 111272679 B CN111272679 B CN 111272679B
- Authority
- CN
- China
- Prior art keywords
- data
- module
- remote sensing
- reflectivity
- sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
- G01N21/31—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/9032—Query formulation
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N2021/1793—Remote sensing
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Pathology (AREA)
- Computational Linguistics (AREA)
- Biochemistry (AREA)
- Immunology (AREA)
- Analytical Chemistry (AREA)
- Mathematical Physics (AREA)
- Chemical & Material Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Other Investigation Or Analysis Of Materials By Electrical Means (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
Abstract
The invention discloses a generation system and a method of a remote sensing reflectivity product based on high resolution, wherein the generation system comprises a reading module, a processing module and a processing module, wherein the reading module is used for reading the content of a data file of a high resolution spectrometer; the retrieval module is used for carrying out retrieval analysis on the content read by the reading module and extracting all measurement time for carrying out measurement on the water area site; the setting module is used for setting the value of the reflectivity of the air-water interface of the water area site corresponding to each measurement time; the processing module is used for carrying out automatic traversal processing on sensor data screening, data integrity checking and remote sensing reflectivity calculation on all the measurement time extracted by the retrieval module to obtain remote sensing reflectivity data; the storage module is used for storing the remote sensing reflectivity data obtained by the processing module; and the browsing module is used for displaying the remote sensing reflectivity data stored by the storage module. The remote sensing reflectivity product generation system solves the problems of errors, omission and overlong generation time period of data products caused by manual processing of a spectrometer user.
Description
Technical Field
The invention relates to the technical field of water body apparent optical characteristic measurement, in particular to a system and a method for generating a remote sensing reflectivity product based on high resolution.
Background
The three elements of water color of the water body comprise chlorophyll, inorganic suspended matters and organic yellow matters, and the three elements have important roles in primary productivity prediction of the ocean, marine ecological environment monitoring, marine dynamics research, marine fishery development and management service. The remote sensing reflectivity spectrum distribution of the water meter is important data for inverting three factors of water color of a water body in a certain area.
The remote sensing reflectivity spectral distribution of the water meter in a certain area cannot be measured directly, and the measurement site is calculated by adopting the above-water spectral measurement method by the data recorded by the water surface upstream radiance sensor, the sky downstream radiance sensor and the water surface downstream irradiance sensor carried by the high-resolution spectrometer. Because all measurement data can only be stored in a storage medium in the instrument when the spectrometer works in the water area on site, when the instrument stops working, all measurement data are exported to a text file encoded in an ASCII mode, and the file not only contains the spectrum data of the three sensors, but also contains the inclination posture and pressure data of the instrument corresponding to each measurement. Because the data of different measuring time and different sensors are stored in one file, in order to distinguish the data of different measuring time and different sensors, the file contains character information, namely data head information, used for data description, wherein the text size of the data measured at one time by each measuring site is 1937 lines, and the file records hundreds or even thousands of measured data of a plurality of measuring sites and is a text file containing hundreds of thousands or even millions of lines. Fig. 1 shows measurement data of a water surface uplink radiance sensor measured at a certain time, and the data head and the data total 298 are listed for saving space only part of the data.
In the prior art, a user needs to manually find three sensor data of the time of measurement in a measurement data file by searching a time string corresponding to the time of measurement, then summarizing the three sensor data into one file, manually inputting a mathematical expression by using software with a calculation function to calculate the remote sensing reflectivity, and storing a calculation result in a storage medium for water color three-element inversion. The manual processing mode is easy to miss data and process errors, and in order to ensure the quality of the data products, the consistency of processing results of more than three people is needed to be judged, so that the prior art not only seriously consumes precious scientific research manpower, but also has long data product generation time period, and can not meet the rapid requirement of water color business on remote sensing reflectivity data. There are therefore drawbacks to the prior art that require improvement.
Disclosure of Invention
The invention provides a system and a method for generating a remote sensing reflectivity product based on high resolution, which solve the problems of errors and omission of data products and overlong generation time period in the prior art.
The invention is realized by adopting the following technical scheme:
a high resolution based remote sensing reflectivity product generation system comprising:
the reading module is used for reading the content of the high-resolution spectrometer data file;
the retrieval module is used for carrying out retrieval analysis on the content read by the reading module and extracting all measurement time for carrying out measurement on the water area site;
the setting module is used for setting the value of the reflectivity of the air-water interface of the water area site corresponding to each measurement time;
the processing module is used for carrying out automatic traversal processing on sensor data screening, data integrity checking and remote sensing reflectivity calculation on all the measurement time extracted by the retrieval module to obtain remote sensing reflectivity data;
the storage module is used for storing the remote sensing reflectivity data obtained by the processing module;
and the browsing module is used for displaying the remote sensing reflectivity data stored by the storage module.
Further, the regular expression of the measurement time in the retrieval module is:
[0-9]{4}\-[0-9]{2}\-[0-9]{2}\s[0-9]{2}:[0-9]{2}:[0-9]{2}。
further, the retrieval module includes:
and the measuring time storage module is used for storing all the measuring times extracted in the retrieval module and the row positions thereof.
Further, the setting modes in the setting module comprise three different air-water interface reflectivity setting modes of uniform setting, individual setting, uniform and individual mixed setting;
the setting module further includes:
and the air-water interface reflectivity database module is used for storing the numerical value of the air-water interface reflectivity set by the setting module.
Further, the processing module includes:
and the keyword library module is used for storing keywords used for screening the sensor data.
Further, keywords used for sensor data screening processing in the keyword library module comprise a data start mark keyword, a data end mark keyword, a calibration spectrum keyword and a sensor keyword; the sensor keywords comprise a water surface uplink radiance sensor keyword, a sky downlink radiance sensor keyword and a water surface downlink irradiance sensor keyword.
Further, the processing module includes:
the calibration spectrum retrieval module is used for retrieving keywords of the calibration spectrum from the content of the measurement data file read by the reading module according to the measurement time;
the sensor type judging module is used for judging that the obtained data belongs to any one of a water surface uplink radiance sensor, a sky downlink radiance sensor and a water surface downlink irradiance sensor according to the sensor keywords;
the data judging module is used for determining whether a data start mark keyword exists in each row of characters;
and the data reading module is used for reading the data.
Further, the mathematical expression of the remote sensing reflectivity data obtained in the processing module is:
Rrs(λi)＝(Lsw-Lsky*r)/Es
wherein Rrs (λi) represents the remote sensing reflectivity of the water body at the wavelength λi; lsw represents measurement data of the water surface uplink radiance sensor at λi; lsky represents the measurement data of the sky downlink radiance sensor at lambdaj; es represents the measured data of the irradiance sensor at λi; r represents the gas-water interface reflectivity value corresponding to the measurement time taken from the gas-water interface reflectivity database.
Correspondingly, the method for generating the remote sensing reflectivity product based on the high resolution is also provided, and is characterized by comprising the following steps:
s1, reading the content of a high-resolution spectrometer data file;
s2, searching and analyzing the read data file content, and extracting all measurement time for measuring in a water area site;
s3, setting a value of the reflectivity of the air-water interface of the water area site corresponding to each measurement time;
s4, performing automatic traversal processing of sensor data screening, data integrity checking and remote sensing reflectivity calculation on all measurement time to obtain remote sensing reflectivity data;
s5, storing the obtained remote sensing reflectivity data;
s6, displaying the stored remote sensing reflectivity data.
Further, the step S2 further includes:
storing all the extracted measurement time and the row position of the extracted measurement time;
the step S3 further includes:
storing the set air-water interface reflectivity value;
the step S4 further includes:
and storing keywords used for screening the sensor data.
The beneficial effects of the invention are as follows:
1. according to the invention, the reading module reads the measured data of the spectrometer, the searching module extracts the measured time from the read content, and the processing module automatically traverses the data processing technology of sensor data screening and remote sensing reflectivity calculation according to the measured time, so that data errors and omission caused by manual data processing are avoided, and the stability and reliability of the quality of a data product are ensured.
2. According to the invention, the retrieval module automatically extracts the measurement time according to the time regular expression, the processing module automatically traverses the measurement time to generate the remote sensing reflectivity product, the work which can be completed after the spectrometer user manually processes the data for tens of hours is shortened to be completed in tens of seconds, the generation time period of the remote sensing reflectivity product is obviously shortened, and the efficiency and the automation degree of generating the remote sensing reflectivity product are improved.
3. The three setting modes provided by the setting module not only meet the water body characteristics of different measuring stations, but also meet the requirements of users on quick parameter setting, and the working efficiency of remote sensing reflectivity products generated by the users of the spectrometer is effectively improved.
4. The storage module automatically files and saves the remote sensing reflectances corresponding to different measurement times by taking the measurement time as a file name without manual intervention of a user, thereby further improving the working efficiency of generating the remote sensing reflectivity product and being convenient for the user to quickly find the required data product according to the measurement time.
5. The processing module performs integrity check on the data retrieved by the measurement time through the data integrity check module, further perfects the generation system and method of the remote sensing reflectivity product, and is convenient for a spectrometer user to quickly locate and remove the fault of the instrument.
Drawings
FIG. 1 is a schematic diagram of measurement data of a water surface uplink radiance sensor measured at a certain time provided by the background art;
FIG. 2 is a diagram of a system for generating a high resolution-based remote sensing reflectivity product according to an embodiment;
FIG. 3 is a flow chart of a system for generating a high resolution-based remote sensing reflectivity product according to the first embodiment;
FIG. 4 is a diagram of a 5-line character stack according to the first embodiment;
FIG. 5 is a schematic diagram of partial data of a remote sensing reflectivity product for a certain measurement time according to the first embodiment;
fig. 6 is a schematic diagram of a visual result of a remote sensing reflectivity product according to the first embodiment.
Detailed Description
Other advantages and effects of the present invention will become apparent to those skilled in the art from the present disclosure, when the following detailed description of the present invention is given by way of specific examples. The invention may be practiced or carried out in other embodiments that depart from the specific details, and the details of the present description may be modified or varied from the spirit and scope of the present invention. It should be noted that the following embodiments and features in the embodiments may be combined with each other without conflict.
The invention aims at overcoming the defects of the prior art and provides a system and a method for generating a remote sensing reflectivity product based on high resolution.
Example 1
The present embodiment provides a generation system of a remote sensing reflectivity product based on high resolution, as shown in fig. 2-6, including:
a reading module 11 for reading the content of the high resolution spectrometer data file;
the retrieval module 12 is used for carrying out retrieval analysis on the content read by the reading module and extracting all measurement time for carrying out measurement on the water area site;
the setting module 13 is used for setting the value of the reflectivity of the air-water interface of the water area corresponding to each measurement time;
the processing module 14 is used for performing automatic traversal processing of sensor data screening, data integrity checking and remote sensing reflectivity calculation on all the measurement time extracted by the retrieval module to obtain remote sensing reflectivity data;
the storage module 15 is used for storing the remote sensing reflectivity data obtained by the processing module;
the browsing module 16 is configured to display the remote sensing reflectivity data stored in the storage module.
In the reading module 11, the high resolution spectrometer data file content is read.
The high-resolution spectrometer data file is a text file, and after the file is read into a computer memory, each sensor data after analysis contains three types of information, namely characters, data and separators; the characters are used for explaining data information such as a sensor, measuring time, type, data initial identification and the like to which the data belong; the data are acquisition and measurement results of the sensor on site; the separator comprises a space, a carriage return and a line feed, and is used for dividing data and character information; all three types of information are encoded in the american standard code for information interchange ASCII.
In the embodiment, the content of the data file is read in, and whether the data file is a spectrometer data file is judged according to whether the data file contains one-time complete measurement data, if so, the read content is sent to a retrieval module; if not, prompting the data information of the non-spectrometer file, avoiding the manual operation of searching and checking whether the data file is the spectrometer file line by line in the text file by a user in the prior art, enabling the system to have the function of automatically judging whether the data file is the spectrometer file, and improving the automation degree of screening the spectrometer file.
In the retrieval module 12, the content read by the reading module is retrieved and analyzed, and all the measurement time in the water area is extracted;
in this embodiment, the method for retrieving the measurement time uses a regular expression:
"[0-9] {4} - [0-9] {2}" is automatically retrieved and identified.
In the embodiment, the retrieval method avoids product data omission which may occur when a spectrometer user searches the text file manually in the prior art.
Wherein, the retrieval module includes: and the measuring time storage module is used for storing all the measuring times extracted in the retrieval module and the row positions thereof.
In the setting module 13, a value of the reflectivity of the air-water interface of the water area corresponding to each measurement time is set;
in this embodiment, the setting mode of the setting module includes three different modes of uniform setting, individual setting, uniform and individual mixed setting for setting the reflectivity of the air-water interface of the measurement site.
The unified setting mode is that the reflectivity of the air-water interface of all the measuring stations is the same value.
The individual setting mode is that the values of the reflectivity of the air-water interface of each measuring station are different, the individual setting mode is needed to be set respectively, the setting method is that a user selects the measuring time, and then the appointed value is input aiming at the time.
The unified and individual mixed setting modes are that most of the same gas-water interface reflectivity values are set by adopting unified values, and few different setting modes are adopted by adopting individual setting modes, and the setting methods are as described in the previous individual setting.
The three setting modes not only meet the water body characteristics of different measuring sites, but also meet the requirements of users on quick parameter setting, and effectively improve the working efficiency of remote sensing reflectivity products generated by the users of the spectrometer.
In this embodiment, the setting module includes a gas-water interface reflectivity database module, configured to store the value of the gas-water interface reflectivity set by the setting module.
In the processing module 14, the sensor data screening, the data integrity checking and the automatic traversal processing of the remote sensing reflectivity calculation are performed on all the measurement time extracted by the retrieval module, so as to obtain the remote sensing reflectivity data.
The processing module 14 includes a keyword library module for storing keywords used for sensor data screening.
Keywords used to screen the sensor data include calibration spectral keywords: SPECTRUM, CALIBRATED; sensor keywords: the method comprises the steps of including a water surface uplink irradiance sensor keyword SAM_854D, a sky downlink irradiance sensor keyword SAM_8536 and a water surface downlink irradiance sensor keyword SAMIP_50D3; a DATA start flag keyword [ DATA ], a DATA END flag keyword [ END ].
The processing module 14 in this embodiment further includes: the system comprises a calibration spectrum retrieval module, a sensor type discrimination module, a data reading module and a data integrity checking module.
And the calibration spectrum retrieval module retrieves the calibration spectrum keywords in the content of the measurement data file read by the reading module according to the measurement time, and adopts a 5-line character first-in-first-out stack retrieval method, as shown in figure 4. The specific method comprises the following steps: sequentially taking out a certain measuring time from the measuring time storage module, searching the measuring time in the measuring data file together as processing time and a keyword CALIBRATED, SPECTRUM, initializing and establishing a stack for storing 5 lines of character information of the file, reading in the 5 lines of character information from a line position corresponding to the measuring time, putting the 5 lines of character information into the stack, and firstly reading the 5 lines of character information at the bottom of the stack, wherein the steps are as follows: the first row is stored at the bottom, and is respectively a second row, a third row, a fourth row and a fifth row in turn upwards, then judging whether the first row contains a keyword of SPECTRUM, judging whether the second row contains a keyword of CALIBRATED, judging whether the fifth row contains a measurement time in processing, if one of the keywords in the three rows is missing, discarding data of the bottom of the stack, namely the first row, placing the first row into the first row, placing the second row into the third row, placing the fourth row into the third row, placing the fifth row into the fourth row, then reading in a new row from a measurement data file to refresh the content of the fifth row, continuously judging whether the first row, the second row and the fifth row respectively contain SPECTRUM, CALIBRATED and the keywords in processing time, and continuously repeating the operation until the first row contains SPECTRUM and the second row contains the CALIBRATED and the fifth row contains the specified measurement time, and starting to enter the sensor type judging process.
In this embodiment, compared with the method for searching for calibration spectrum data by comparing and judging manually line by line according to measurement time and key words SPECTRUM, CALIBRATED in the prior art, the method for searching for 5-line character first-in first-out stack mode of the calibration spectrum searching module not only ensures that data corresponding to each measurement time cannot be missed, but also makes the data searching method more concise and efficient, and improves the data screening speed.
And the sensor type judging module is used for judging that the obtained data belongs to any one of a water surface uplink radiation brightness sensor, a sky downlink radiation brightness sensor and a water surface downlink radiation brightness sensor according to the sensor keywords.
And continuously reading in 1 row of information from the data file, judging whether one of keywords SAM_854D, SAM _8536 and SAMIP_50D3 is contained in the row, if the operation is not continuously repeated until one of the keywords is contained, determining the data to be read out as sensor data corresponding to the keyword, and juxtaposing a sensor data finding mark of 1 in the processing measurement time, otherwise, 0, and entering a data judging process.
In this embodiment, the sensor type discriminating module not only determines the home sensor of the data to be read out, but also records whether there is a loss of data, and is ready for the integrity check of the data.
And the data judging module is used for determining whether the data start mark keyword exists in each row of characters.
And continuously reading in 1 row of information from the DATA file, judging whether the row contains the [ DATA ] keyword, and if the row does not contain the [ DATA ] keyword, repeating the operation until the read row contains the [ DATA ] keyword, skipping one row, and entering a DATA reading process.
And the data reading module is used for reading the data.
And continuously reading 1 row of information from the data file in a character mode, judging whether the row has a data END mark keyword [ END ], if not, repositioning a file pointer to the row head of the row according to the row data information, and re-reading the row in a text data mode, wherein the wavelength and the corresponding radiance or irradiance data are respectively read. And continuously circularly reading in the next row, and also judging whether the [ END ] keywords exist or not, and if the [ END ] keywords are not positioned to the first row, reading in wavelength and radiance or irradiance data. And until one row of circularly read-in information contains [ END ] keywords, all sensor data corresponding to the keywords found by the sensor type judging module for processing the measuring time are read out.
In this embodiment, compared with the prior art in which the spectrometer user manually searches data from the data file row by row and copies and pastes, the data discrimination and data reading module avoids data omission and errors possibly caused by manual operation, and ensures the stability and reliability of the quality of the data product.
Repeating the processes of the calibration spectrum retrieval module, the sensor type discrimination module, the data discrimination module and the data reading module for 2 times, continuously searching the measurement data of the other two sensors, and entering the data integrity checking module for processing after the completion.
And the data integrity checking module is used for checking whether the data of the corresponding water surface uplink irradiance sensor, the sky downlink irradiance sensor and the water surface downlink irradiance sensor are complete or not.
The data of the water surface uplink irradiance sensor, the sky downlink irradiance sensor and the water surface downlink irradiance sensor at a certain measurement time are incomplete if one of the data is missing, namely one or more than one of the marks is found out to be 0 in the three sensor data of the processing measurement time, the remote sensing reflectivity cannot be generated by the measurement data, and the system gives the type and the reason of the missing sensor data and files and stores the data into a result file of the measurement. If the three sensor data finding marks in the processing measurement time are all 1, the three sensor data are all found, and the remote sensing reflectivity calculation process is entered.
In this embodiment, the data integrity checking module automatically analyzes whether the sensor data corresponding to all the measurement times are complete, and provides the user with the sensor type of the data missing, so that the user can quickly locate the fault of the instrument and remove the fault.
In the processing module 14, the mathematical expression for remote sensing reflectance calculation is:
Rrs(λi)＝(Lsw-Lsky*r)/Es
wherein Rrs (λi) represents the remote sensing reflectivity of the water body at the wavelength λi; lsw represents measurement data of the water surface uplink radiance sensor at λi; lsky represents the measurement data of the sky downlink radiance sensor at lambdaj; es represents the measured data of the irradiance sensor at λi; r represents the gas-water interface reflectivity value corresponding to the measurement time taken from the gas-water interface reflectivity database.
In this embodiment, the processing module 14 completes the automatic traversal process control of the sensor data screening, data integrity check, remote sensing reflectance calculation for each measurement time in the measurement time lexicon. Compared with the prior art, the processing module replaces the operations of manually screening data and inputting remote sensing reflectivity mathematical expression by a user, realizes continuous and uninterrupted processing of data in each measurement time, has high automation degree, not only improves the generation speed of data products, but also shortens the time of remote sensing reflectivity products which can be completed in tens of hours to tens of seconds, simultaneously avoids the possibility of missing certain measurement data and data product errors in the prior art, and ensures the stability and reliability of the quality of the data products.
The storage module 15 is configured to store the remote sensing reflectivity data obtained by the processing module.
And storing the obtained remote sensing reflectivity data into a folder designated by a user.
And (3) automatically archiving and storing the remote sensing reflectivity obtained by calculating the measurement time of each time to a folder designated by a user by taking the measurement time as a file name, storing the data in an ASCII (integrated circuit code for information) mode, and simultaneously recording the reflectivity of a gas-water interface corresponding to the measurement time so as to be convenient for the user to refer. The remote sensing reflectivity data can be browsed by any text editing program, and fig. 5 shows the remote sensing reflectivity product generated by a certain measurement time, and only part of the data is listed for saving space.
In this embodiment, the storage module 15 has a function of automatically archiving and storing the file name by using the measurement time to the folder designated by the user, and compared with the prior art, the module ensures that archiving and storing of the data product is automatically completed without user intervention, not only improves the working efficiency of generating the remote sensing reflectivity product, but also reserves the measurement time information by using the measurement time as the file name, so that the user can quickly find the required data product according to the measurement time.
In the browsing module 16, the remote sensing reflectivity data stored in the storage module is displayed.
For the remote sensing reflectivity products after archiving and storing, the remote sensing reflectivity of the water body is provided for a user to browse the measuring time by selecting the measuring time, and the user can browse the spectral distribution of the remote sensing reflectivity products in a text mode and also can browse the spectral distribution of the remote sensing reflectivity products in a graphic mode. Fig. 6 is a visual result of the remote sensing reflectivity product obtained by the measurement corresponding to fig. 5.
In this embodiment, the browsing module 16 provides the user with browsing all measured product data in both graphics and characters, as compared to text characters in the prior art.
The benefit obtained by this embodiment takes the processing of the high-resolution spectrometer data file containing 240 measurements as an example, the spectrometer user manually screens the data of the water surface uplink radiance sensor, the sky downlink radiance sensor and the water surface downlink irradiance sensor from the file, then manually inputs the mathematical expression to calculate the remote sensing reflectivity and files and stores, the time required for processing the measured data once is calculated to be 5 minutes through practice, thus the processing of the measured data for 240 times is completed, the processing time required for the manual uninterrupted operation is 20 hours, the system of this embodiment is adopted for processing, the Intel Core (TM) i7-7700 CPU@3.6GHz processor and the 8G memory are used, the processing of the measured data for 240 times is completed only for 45 seconds, the time period for generating the remote sensing reflectivity product is obviously shortened, and the quick requirement for developing the water color service is satisfied. In order to ensure the quality of data products, the prior art needs to judge through consistency of three or more processing results, at least two other people are required to respectively carry out the same manual data processing work for twenty hours, the three people have consistent processing results and end the work, the three people have inconsistent processing results, and more time is required to find out reasons of errors, so that the prior art severely consumes human resources. The invention avoids data errors and omission caused by manual data processing, ensures the stability and reliability of the quality of the remote sensing reflectivity product, and therefore, the consistency of the processing results of multiple persons is not needed to test the quality of the product, thereby saving a great deal of scientific research manpower. Obviously: the more time data is measured in the data file, the more processing time is saved, and the more remarkable the obtained technical effect is.
In a word, the invention has the technical effects of quick parameter setting, convenience for a user to quickly find out a required product, quick positioning of instrument faults, stable and reliable data product quality, short remote sensing reflectivity product generation time period, meeting of quick development requirements of water color service products and saving of precious scientific research manpower.
Example two
The embodiment provides a method for generating a remote sensing reflectivity product based on high resolution, which comprises the following steps:
s11, reading the content of a high-resolution spectrometer data file;
s12, searching and analyzing the read data file content, and extracting all measurement time for measuring in different water areas on site;
s13, setting a value of the reflectivity of the air-water interface of the water area site corresponding to each measurement time;
s14, performing data screening, data integrity checking and automatic traversal processing of remote sensing reflectivity calculation on all measurement time to obtain remote sensing reflectivity data;
s15, storing the obtained remote sensing reflectivity data;
s16, displaying the stored remote sensing reflectivity data.
Further, the step S12 further includes:
storing all the extracted measurement time and the row position of the extracted measurement time;
the step S13 further includes:
storing the set air-water interface reflectivity value;
the step S14 includes:
storing keywords used in sensor data screening processing;
the step S15 further includes:
and (3) automatically archiving and storing the remote sensing reflectivity corresponding to each measurement time by taking the measurement time as a file name.
It should be noted that, the method for generating the remote sensing reflectivity product based on high resolution with high speed and no error in the present embodiment is similar to the embodiment, and will not be described herein.
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
Claims (5)
1. A high resolution remote sensing reflectivity product based generation system, comprising:
the reading module is used for reading the content of the high-resolution spectrometer data file;
the retrieval module is used for carrying out retrieval analysis on the content read by the reading module and extracting all measurement time for carrying out measurement on the water area site; the retrieval module comprises a measurement time storage module, and a regular expression for storing all the measurement times extracted in the retrieval module and the measurement times in the row position retrieval module where the measurement times are positioned is as follows: [0-9] {4} - [0-9] {2};
the setting module is used for setting the value of the reflectivity of the air-water interface of the water area site corresponding to each measurement time; the setting modes in the setting module comprise three different air-water interface reflectivity setting modes of uniform setting, individual setting and uniform and individual mixed setting; the setting module further includes: the gas-water interface reflectivity database module is used for storing the value of the gas-water interface reflectivity set by the setting module;
the processing module is used for carrying out automatic traversal processing on sensor data screening, data integrity checking and remote sensing reflectivity calculation on all the measurement time extracted by the retrieval module to obtain remote sensing reflectivity data; the processing module comprises a keyword library module for storing keywords used for screening the sensor data; the mathematical expression of the remote sensing reflectivity data obtained in the processing module is as follows:
Rrs(λi)＝(Lsw-Lsky*r)/Es
wherein Rrs (λi) represents the remote sensing reflectivity of the water body at the wavelength λi; lsw represents measurement data of the water surface uplink radiance sensor at λi; lsky represents the measurement data of the sky downlink radiance sensor at lambdaj; es represents the measured data of the irradiance sensor at λi; r represents the gas-water interface reflectivity value corresponding to the measurement time taken out from the gas-water interface reflectivity database;
the storage module is used for storing the remote sensing reflectivity data obtained by the processing module;
and the browsing module is used for displaying the remote sensing reflectivity data stored by the storage module.
2. The system for generating a high-resolution remote sensing reflectivity product according to claim 1, wherein the keywords used for sensor data screening in the keyword library module include a data start flag keyword, a data end flag keyword, a calibration spectrum keyword and a sensor keyword; the sensor keywords comprise a water surface uplink radiance sensor keyword, a sky downlink radiance sensor keyword and a water surface downlink irradiance sensor keyword.
3. The high resolution remote sensing reflectivity product generation system of claim 2, wherein the processing module includes:
the calibration spectrum retrieval module is used for retrieving keywords of the calibration spectrum from the content of the measurement data file read by the reading module according to the measurement time;
the sensor type judging module is used for judging that the obtained data belongs to any one of a water surface uplink radiance sensor, a sky downlink radiance sensor and a water surface downlink irradiance sensor according to the sensor keywords;
the data judging module is used for determining whether a data start mark keyword exists in each row of characters;
and the data reading module is used for reading the data.
4. The method for generating the remote sensing reflectivity product based on the high resolution is characterized by comprising the following steps of:
s1, reading the content of a high-resolution spectrometer data file;
s2, searching and analyzing the read data file content, and extracting all measurement time for measuring in a water area site; the regular expression for measuring time is:
[0-9]{4}\-[0-9]{2}\-[0-9]{2}\s[0-9]{2}:[0-9]{2}:[0-9]{2}；
s3, setting a value of the reflectivity of the air-water interface of the water area site corresponding to each measurement time; the setting modes comprise three different air-water interface reflectivity setting modes of uniform setting, individual setting, uniform and individual mixed setting;
s4, performing automatic traversal processing of sensor data screening, data integrity checking and remote sensing reflectivity calculation on all measurement time to obtain remote sensing reflectivity data; the mathematical expression of the obtained remote sensing reflectivity data is as follows:
Rrs(λi)＝(Lsw-Lsky*r)/Es
wherein Rrs (λi) represents the remote sensing reflectivity of the water body at the wavelength λi; lsw represents measurement data of the water surface uplink radiance sensor at λi; lsky represents the measurement data of the sky downlink radiance sensor at lambdaj; es represents the measured data of the irradiance sensor at λi; r represents the gas-water interface reflectivity value corresponding to the measurement time taken out from the gas-water interface reflectivity database;
s5, storing the obtained remote sensing reflectivity data;
s6, displaying the stored remote sensing reflectivity data.
5. The method of claim 4, wherein step S2 further comprises:
storing all the extracted measurement time and the row position of the extracted measurement time;
step S3 further includes:
storing the set air-water interface reflectivity value;
step S4 further includes:
and storing keywords used for screening the sensor data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010087767.8A CN111272679B (en) | 2020-02-11 | 2020-02-11 | High-resolution-based remote sensing reflectivity product generation system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010087767.8A CN111272679B (en) | 2020-02-11 | 2020-02-11 | High-resolution-based remote sensing reflectivity product generation system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111272679A CN111272679A (en) | 2020-06-12 |
| CN111272679B true CN111272679B (en) | 2023-07-28 |
Family
ID=70997008
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010087767.8A Active CN111272679B (en) | 2020-02-11 | 2020-02-11 | High-resolution-based remote sensing reflectivity product generation system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111272679B (en) |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1297825C (en) * | 2003-09-05 | 2007-01-31 | 中国科学院上海技术物理研究所 | Synchronous colelcting and processing system for culture wave spectrum and poly culture information |
| CN103092979B (en) * | 2013-01-31 | 2016-01-27 | 中国科学院对地观测与数字地球科学中心 | The disposal route of remotely-sensed data retrieval natural language |
| CN103198115B (en) * | 2013-03-29 | 2016-12-28 | 中国科学院对地观测与数字地球科学中心 | A kind of Target scalar data processing equipment |
| CN108917854A (en) * | 2018-09-04 | 2018-11-30 | 中国科学院南海海洋研究所 | A kind of measuring method and equipment for walking boat for ocean color |
| CN109283144A (en) * | 2018-10-26 | 2019-01-29 | 浙江省水利河口研究院 | The strong long remote sensing calculation method for lasting variation of tidal height muddiness river mouth suspension bed sediment |
| CN109374581B (en) * | 2018-11-22 | 2021-08-10 | 浙江海洋大学 | Water color monitoring device based on spectrum monitoring system SAS |
-
2020
- 2020-02-11 CN CN202010087767.8A patent/CN111272679B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN111272679A (en) | 2020-06-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210019287A1 (en) | Systems and methods for populating a structured database based on an image representation of a data table | |
| CN106845579B (en) | Informationized control method and control system for improving product quality inspection correctness | |
| CN102662930B (en) | Corpus tagging method and corpus tagging device | |
| CN111459799B (en) | Software defect detection model establishing and detecting method and system based on Github | |
| US20110270858A1 (en) | File type recognition analysis method and system | |
| CN110378206B (en) | Intelligent image examination system and method | |
| CN1806501B (en) | Marine phytoplankton automatic distinguishing method and apparatus | |
| CN116363125B (en) | Deep learning-based battery module appearance defect detection method and system | |
| EP2575060A2 (en) | Associative memory visual evaluation tool | |
| CN110275938B (en) | Knowledge extraction method and system based on unstructured document | |
| CN111272679B (en) | High-resolution-based remote sensing reflectivity product generation system and method | |
| CN114264648A (en) | Water quality detection test paper identification method and system | |
| CN117114013B (en) | Semantic annotation method and device based on small sample | |
| TWI301203B (en) | Test point pitch analyzing method for logic circuit | |
| CN114637845B (en) | Model testing method, device, equipment and storage medium | |
| CN116010663B (en) | TMT project map analysis and data analysis method and system | |
| CN110968677B (en) | Text addressing method and device, medium and electronic equipment | |
| CN114118008B (en) | Data comparison system and method based on BS framework | |
| CN112818247B (en) | Method for analyzing product heat according to keywords | |
| CN114490397A (en) | End cloud cooperative code defect detection method and system based on ensemble learning | |
| Chen et al. | Development and evaluation of a character social network relationship map tool in an ancient book digital humanities research platform | |
| TWI384362B (en) | Method of viewing test log file and computer program product using the method | |
| KR20230007023A (en) | Intelligent ideation system and method | |
| WO2023084518A1 (en) | Method, system and computer program product for management and review of product consumer medicine information | |
| CN111986749A (en) | Digital pathological image retrieval system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |