CN115049754A - Method and device for generating infrared thermodynamic diagram on orbit based on satellite - Google Patents
Method and device for generating infrared thermodynamic diagram on orbit based on satellite Download PDFInfo
- Publication number
- CN115049754A CN115049754A CN202210977596.5A CN202210977596A CN115049754A CN 115049754 A CN115049754 A CN 115049754A CN 202210977596 A CN202210977596 A CN 202210977596A CN 115049754 A CN115049754 A CN 115049754A
- Authority
- CN
- China
- Prior art keywords
- value
- satellite
- image
- pixel
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 238000010586 diagram Methods 0.000 title claims abstract description 44
- 238000013139 quantization Methods 0.000 claims abstract description 4
- 238000012545 processing Methods 0.000 claims description 19
- 230000002159 abnormal effect Effects 0.000 claims description 18
- 230000005855 radiation Effects 0.000 claims description 17
- 238000012937 correction Methods 0.000 claims description 13
- 230000003595 spectral effect Effects 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 11
- 238000005316 response function Methods 0.000 claims description 10
- 238000004364 calculation method Methods 0.000 claims description 8
- 239000012634 fragment Substances 0.000 claims description 8
- 239000000126 substance Substances 0.000 claims description 8
- 230000006870 function Effects 0.000 claims description 7
- 210000001747 pupil Anatomy 0.000 claims description 7
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 7
- 230000005457 Black-body radiation Effects 0.000 claims description 6
- 230000011218 segmentation Effects 0.000 claims description 3
- 238000012549 training Methods 0.000 claims description 3
- 238000003709 image segmentation Methods 0.000 claims description 2
- 230000004044 response Effects 0.000 claims description 2
- 230000005856 abnormality Effects 0.000 claims 1
- 239000003595 mist Substances 0.000 description 8
- 238000004422 calculation algorithm Methods 0.000 description 5
- 238000013135 deep learning Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000013439 planning Methods 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- CCEKAJIANROZEO-UHFFFAOYSA-N sulfluramid Chemical group CCNS(=O)(=O)C(F)(F)C(F)(F)C(F)(F)C(F)(F)C(F)(F)C(F)(F)C(F)(F)C(F)(F)F CCEKAJIANROZEO-UHFFFAOYSA-N 0.000 description 2
- 238000002834 transmittance Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
- 238000012384 transportation and delivery Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/80—Geometric correction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/13—Satellite images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10032—Satellite or aerial image; Remote sensing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A30/00—Adapting or protecting infrastructure or their operation
- Y02A30/60—Planning or developing urban green infrastructure
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Astronomy & Astrophysics (AREA)
- Remote Sensing (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Photometry And Measurement Of Optical Pulse Characteristics (AREA)
- Image Processing (AREA)
Abstract
The embodiment of the application discloses a method and a device for generating an infrared thermodynamic diagram on orbit on a satellite. The method is applied to an in-orbit satellite, and comprises the following steps: acquiring a thermal infrared remote sensing image, wherein the infrared wavelength of the infrared remote sensing image is 3-14 mu m; converting the digital quantization DN value of each pixel in the thermal infrared remote sensing image into a radiance value of each pixel; calculating a brightness temperature value corresponding to the radiance value of each pixel; and generating a thermodynamic diagram of the thermal infrared remote sensing image according to the brightness temperature value corresponding to each pixel.
Description
Technical Field
The embodiment of the application relates to the field of image processing, in particular to a method and a device for generating an infrared thermodynamic diagram on the basis of on-board satellite orbit.
Background
With the expansion and development of cities, the monitoring of urban thermal environment becomes a research hotspot in recent years. The urban thermodynamic diagram can reflect the thermal environment condition of the current city in time and space, and provides data support for monitoring urban pollution, researching urban heat island effect, urban planning development, intelligent management and the like. There are two main ways to monitor the urban thermal environment at present, one is: the method is based on an observation mode of a ground station, the data precision is high, but the global observation data is difficult to obtain due to the limited number of the ground observation stations, and a large-area cannot be covered; secondly, the following steps: when a satellite passes through a ground observation station, the satellite remote sensing image based on the satellite-borne thermal infrared sensor transmits a shot satellite image to the ground, a thermodynamic diagram is generated through a temperature inversion algorithm and is calculated and analyzed, and the whole city can be monitored through the method.
Because the satellite images have the characteristics of large coverage and strong timeliness, the generation of the thermal diagram currently mainly uses the satellite remote sensing images, and the inversion of the Surface Temperature (LST) is carried out by combining the atmospheric data observed by the ground station. The traditional thermodynamic diagram generation needs to go through the following steps: (1) a satellite obtains a remote sensing image and transmits data to the ground; (2) the DN value is converted into the radiance through the radiation correction; (3) performing geometric correction on the image; (4) calculating the brightness temperature according to the radiance value; (5) calculating the atmospheric transmittance according to the water vapor content of the atmosphere and the like, and performing atmospheric correction on the image; (6) inversion is performed on the LST in combination with the radiance to ground mass ratio. Finally, drawing a graph and analyzing the data.
The method has high inversion accuracy, but has complex ground procedures, large manual workload and low efficiency, and can not count and monitor the abnormal temperature of cities and surrounding areas in real time due to the large difficulty in acquiring the water vapor content in the atmosphere.
Disclosure of Invention
In order to solve any technical problem, the embodiment of the application provides a method and a device for generating an infrared thermodynamic diagram on the basis of on-board satellite orbit.
To achieve the purpose of the embodiments of the present application, the embodiments of the present application provide a method for generating an infrared thermodynamic diagram based on-satellite on-orbit, which is applied to an on-orbit satellite, and the method includes:
acquiring a thermal infrared remote sensing image of a target area, wherein the infrared wavelength of the infrared remote sensing image is 3-14 mu m;
converting the digital quantization DN value of each pixel in the thermal infrared remote sensing image into a radiance value of each pixel;
calculating a brightness temperature value corresponding to the radiance value of each pixel;
and generating a thermodynamic diagram of the thermal infrared remote sensing image according to the brightness temperature value corresponding to each pixel.
A storage medium having a computer program stored therein, wherein the computer program is arranged to perform the method as described above when executed.
An apparatus for on-board on-satellite-based generation of an infrared thermodynamic diagram, comprising a memory having a computer program stored therein and a processor arranged to execute the computer program to perform the method as described above.
One of the above technical solutions has the following advantages or beneficial effects:
the brightness temperature is directly used to show the relative relation of temperature difference, the required calculated amount is smaller, the working efficiency is higher, the urban and surrounding temperature data information can be conveniently and quickly acquired, the purpose of generating the infrared thermodynamic diagram on orbit is achieved, the thermodynamic diagram can be quickly generated on orbit to monitor the urban temperature change, the working efficiency is improved, and compared with the prior art that satellite images are transmitted to a ground station for data processing, the problems of complex operation processing method, large manual workload and lower efficiency are solved.
The method and the device improve the accuracy of image processing based on cloud and fog discrimination and cloud mask extraction on the satellite; meanwhile, according to the obtained new sample image, the on-orbit continuous iteration updating model is realized; the method has the advantages that the target calibration coefficient of the on-orbit on the satellite is determined in real time by utilizing the two calibration coefficients and the shooting date, so that the accuracy of the target calibration coefficient is ensured, and meanwhile, the working efficiency is improved; in addition, the workload of the ground station can be effectively reduced by extracting the abnormal temperature area based on the thermodynamic diagram.
Additional features and advantages of the embodiments of the application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the embodiments of the application. The objectives and other advantages of the embodiments of the application may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
The accompanying drawings are included to provide a further understanding of the embodiments of the present application and are incorporated in and constitute a part of this specification, illustrate embodiments of the present application and together with the examples of the embodiments of the present application do not constitute a limitation of the embodiments of the present application.
Fig. 1 is a flowchart of a method for generating an infrared thermodynamic diagram based on-board satellite orbit provided by the present application;
FIG. 2 is another flow chart of a method for on-board on-satellite in-orbit generation of an infrared thermodynamic diagram as provided herein;
fig. 3 is a flowchart of a management method of a cloud and fog discrimination model based on deep learning according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application more apparent, the embodiments of the present application will be described in detail below with reference to the accompanying drawings. It should be noted that, in the embodiments of the present application, features in the embodiments and the examples may be arbitrarily combined with each other without conflict.
Fig. 1 is a flowchart of a method for generating an infrared thermodynamic diagram based on-board satellite provided by the present application. As shown in fig. 1, the method is applied to an in-orbit satellite, and comprises the following steps:
in one exemplary embodiment, a satellite-borne thermal infrared sensor can be used to obtain a thermal infrared remote sensing image of a preset area, wherein the infrared wavelength can be 3-14 μm.
the method of converting the DN value into the radiance value in the related art is applicable to this step, and is not described herein again.
103, calculating a brightness temperature value corresponding to the radiance value of each pixel;
in the related technology, the image needs to be transmitted to a ground station, and the ground station performs inversion to obtain accurate ground surface temperature, so that the generation of a thermodynamic diagram is realized. In contrast, in the embodiment of the application, the brightness temperature value of the pixel is directly used to show the relative relationship of the temperature difference between different areas, so that the accurate earth surface temperature is obtained without inversion, the urban and ambient temperature data information is conveniently and rapidly acquired, the working efficiency is improved, and the problems of complex processing method, large manual workload and low efficiency in the related technology are solved.
104, generating a thermodynamic diagram of the thermal infrared remote sensing image according to the brightness temperature value corresponding to each pixel;
compared with the thermodynamic diagram generated by accurately representing the temperature in the related art, the temperature difference generation method and the temperature difference generation device have the advantages that the relative relation between the temperatures is represented by the brightness temperature value of the pixel, the temperature difference of different areas is represented by the relative relation between the temperatures, the required calculation amount is smaller, and the work efficiency is higher.
According to the method provided by the embodiment of the application, the brightness temperature is directly used for showing the relative relation of the temperature difference, the city and surrounding temperature data information can be conveniently and quickly acquired, the purpose of generating the infrared thermodynamic diagram on the rail is achieved, the thermodynamic diagram can be quickly generated on the rail to monitor the temperature change of the city, and the working efficiency is improved.
Fig. 2 is another flowchart of a method for generating an infrared thermodynamic diagram based on-satellite orbit according to an embodiment of the present application. As shown in fig. 2, the method comprises the steps of:
specifically, cloud and fog recognition is carried out on the thermal infrared remote sensing image to obtain a target image with cloud and fog; and carrying out cloud and fog segmentation processing on the target image with the cloud and fog to generate a mask corresponding to the target image.
By generating a corresponding mask for the target image, interference of the highlighted DN value in the cloud area on subsequent DN value processing can be avoided.
and performing relative radiation correction on the region with cloud and fog in the thermal infrared remote sensing image by using the mask, so that the influence of the cloud and fog image on the thermal infrared remote sensing image in the processing process is reduced.
204, performing geometric correction on the target image after the relative radiation correction based on a global elevation model stored on the satellite;
the embodiments of geometric correction in the related art are all applicable to the present application and are not described herein again.
And step 205, converting the DN value of each pixel into the radiance value of each pixel according to the scaling coefficient.
And step 206, calculating a corresponding brightness temperature value according to the radiance value of each pixel element to generate a thermodynamic diagram.
wherein step 207 is an optional operation.
And step 208, transmitting the generated thermodynamic diagram and the image data of the temperature abnormal area to the ground station in the visible arc section of the ground station.
In the process of implementing task planning by the agile imaging satellite and the ground operation control system thereof, the visible arc segment of the target in a certain time period or a plurality of orbit circles needs to be calculated and forecasted according to target characteristic input provided by a user.
The method provided by the embodiment of the application realizes the on-orbit rapid processing of the thermal infrared remote sensing image by using on-satellite hardware resources, generates the urban thermodynamic diagram by using the bright temperature value obtained by on-orbit preprocessing and inversion, and simultaneously provides the method for rapidly downloading the temperature abnormal area information. The problem that ground processing timeliness of the current satellite-borne thermal infrared remote sensing image generated thermodynamic diagram is low is solved, and meanwhile abnormal temperature conditions of cities and surrounding areas can be rapidly counted and monitored.
The method is not only suitable for investigating the heat radiation characteristics of general objects on the earth surface (such as urban heat islands), but also suitable for other high-temperature target identification sensitive scenes (forest fires, active volcano identification and the like).
The method provided by the embodiments of the present application is explained as follows:
fig. 3 is a flowchart of a management method of a cloud and fog discrimination model based on deep learning according to an embodiment of the present application, and as shown in fig. 3, steps 301 to 307 are all on-satellite on-orbit real-time processing, and the specific steps are as follows:
302, performing cloud and mist distinguishing calculation based on an initial cloud and mist distinguishing model in real time on orbit on an image shot by a satellite, and outputting two classification calculation results based on cloud and non-cloud and mist;
step 303, extracting a cloud layer shielding region in the cloud image, wherein the extracting operation can be used for extracting a region meeting the condition based on a preset cloud segmentation algorithm;
the cloud and fog discrimination model obtained by deep learning algorithm training is transplanted to a satellite-borne hardware platform, cloud discrimination and cloud mask processing are performed on the obtained thermal infrared remote sensing image, new cloud samples can be injected to the satellite-borne hardware platform through a ground station for on-orbit learning, and algorithm precision is continuously improved. The satellite-borne hardware platform includes, but is not limited to, a GPU (graphics Processing Unit), an FPGA (Field Programmable Gate Array), and an NPU (Natural Processing Unit).
305, downloading a cloud and fog discrimination result on the satellite and a cloud mask to a ground station;
the ground station can be used for judging cloud and fog identification precision by combining with a satellite remote sensing image, modifying an area with the judgment precision smaller than a preset threshold value, and taking a modification result as a sample image to be annotated with a satellite;
and 307, iteratively updating the cloud and fog discrimination model according to the received sample image.
Based on the process, the cloud and mist discrimination result obtained through the cloud and mist identification model on the satellite is downloaded to the ground station, the sample image is determined by screening the cloud and mist discrimination result through the ground station, the cloud and mist discrimination model stored on the satellite is updated based on the sample image, and the accuracy of the discrimination algorithm can be improved.
In an exemplary embodiment, the converting the digital quantized DN value of each pixel in the thermal infrared remote sensing image into a radiance value of each pixel includes:
acquiring a target gain value and a target offset value corresponding to the current date;
and multiplying the DN value of each pixel by the target gain value, and adding the DN value of each pixel with the target offset value to obtain the radiance value of each pixel.
The target gain value and the target offset value corresponding to the current date are obtained based on the gain value and the offset value determined by the two on-orbit calibrations, and the specific implementation mode is as follows:
step 401, determine a first date of an on-track scaling operation prior to a current date
And a second date of the on-track calibration operation after the current date
；
Step 402, determining a first date
On-track calibration of operating gain values
And an offset value
And, a second date
On-track calibration of operating gain values
And an offset value
；
The specific determination method is as follows:
and when the satellite passes through the border, synchronously acquiring the surface temperature of the water body, the surface radiation brightness of the water body and the meteorological parameters above the water body. And (4) calculating the radiance at the entrance pupil of the satellite according to the formula (1).
Wherein the content of the first and second substances,
is a function of the wavelength of the light,
is the radiance at the satellite entrance pupil; t is s Is the surface temperature;
is a waveIs long as
Surface emissivity of the earth;
is a wavelength
At temperature T of black body s The lower radiance can be calculated according to the Planck function;
is a wavelength
The atmospheric transmittance in the observation direction of the satellite sensor;
and
the radiation intensities of the atmosphere up and down, respectively.
Calculating to obtain satellite equivalent radiance by adopting an equation (2) according to the satellite entrance pupil radiance and the spectral response function, wherein the method comprises the following steps:
wherein the content of the first and second substances,
is the equivalent radiance value of the satellite entrance pupil,
as a function of the spectral response of the satellite.
And (4) obtaining a Gain value Gain and an offset value offset by the formula (3) according to the DN value of the water body pixel and the satellite equivalent radiance.
And step 403, obtaining a target gain value and a target offset value corresponding to the current date according to the gain value and the offset value corresponding to the on-track calibration operation of the first date and the second date.
And (5) determining a target scaling factor used by the current date by adopting the formula (4).
Wherein the content of the first and second substances,
、
and
sequentially showing a first date, a second date and a current date,
、
、
Sequentially showing a gain value corresponding to the first date, a gain value corresponding to the second date and a gain value corresponding to the current date;
、
、
the offset value corresponding to the first date, the offset value corresponding to the second date, and the offset value corresponding to the current date are sequentially shown.
After the target scaling coefficient is obtained, the DN value is converted into an equivalent radiance value by adopting an equation (6), so that the equivalent radiance value is ensured:
the target calibration coefficient determined by the method is higher in accuracy, and the target calibration coefficient is used for calculating the equivalent radiance value, so that the accuracy of a calculation result is guaranteed.
How to calculate the brightness temperature value corresponding to the radiance value of each pixel is described below, which includes:
acquiring the sum of values corresponding to the spectral response function of the wavelength under different value-taking conditions;
obtaining a radiance value corresponding to the central wavelength of each pixel according to the sum of the values and the satellite equivalent radiance value of each pixel;
and calculating a brightness temperature value corresponding to the blackbody radiation brightness value of the central wavelength.
Because the central wavelength cannot accurately represent the whole thermal infrared wavelength range, values of the spectral response function under at least two wavelength values can be selected for calculation, so that the accuracy of the obtained radiance value is ensured.
Further, the radiance value is obtained by using the following formula (7):
wherein the content of the first and second substances,
is the center wavelength of the light emitted by the light source,
in order to radiate the brightness value of the light,
is a value of the spectral response function,
for the global emissivity map stored on the satellite,
at a temperature T and a center wavelength of
The value of the radiance at the time of the illumination,
as wavelength in the spectral response function
The minimum value of (a) is determined,
as wavelength in the spectral response function
Is measured.
The main purpose of the on-track thermodynamic diagram generation is to quickly monitor a temperature abnormal area, the surface temperature does not need to be accurately represented, and only the relative condition of the surface temperature needs to be reflected, so that the atmospheric effect can be ignored, and the Planck function simplified by the equation (1) is adopted to obtain the brightness temperature value.
Calculating a brightness temperature value by using a simplified Planck equation based on a global emissivity map stored on the satellite, and specifically referring to formula (8):
wherein, C 1 Is a first radiation constant, C 2 Is the second radiation constant.
Wherein, C 1 Can take the value of 1.191x10 -5 mW·sr -1 ·cm -4 ，C 2 The value of (A) may be 1.438833cm K.
The computational complexity for determining the brightness value based on the radiance value is significantly reduced due to the neglect of atmospheric effects.
Optionally, after obtaining the thermodynamic diagram, determining a target region indicating that the temperature is abnormal in the thermodynamic diagram, where the specific implementation manner is as follows:
performing image segmentation on the thermodynamic diagram to obtain at least two image fragments;
performing the following operations for each image slice, including:
calculating pixel values corresponding to all pixels in the image fragment to obtain the maximum value and the average value of the pixels of the image fragment;
if the maximum value of the image elements in the image fragment is at least two times higher than the average value, marking the image elements, and determining the area where the marked image elements are located as a temperature abnormal area only when the marked image elements are connected and the number of the marked image elements is larger than a preset number threshold;
recording the central coordinates of the temperature abnormal area;
cutting according to a preset range by taking the central coordinate as a center to obtain a target area;
and carrying out binarization processing on the cut target area according to abnormity and non-abnormity to obtain the coordinate information of the central point of the temperature abnormal area.
Specifically, performing N × N windowing calculation on the generated thermodynamic diagram, wherein N is an integer; counting the maximum value and the average value in the window; when the maximum value in the window is more than 3 times higher than the average value, marking the pixel, and only when the marked pixels are connected and the number of the pixels is more than N/2, considering the pixels as a temperature abnormal area, recording the central coordinate of the area, and cutting the pixels according to a certain rectangular range by taking the central coordinate as the center to obtain a target area; and carrying out binarization processing on the cut target area according to abnormity and non-abnormity to obtain the coordinate information of the central point of the abnormal temperature area.
In summary, the embodiment of the present application provides a scheme for generating a thermodynamic diagram on a satellite, where the scheme uses a brightness temperature value of a pixel to represent a relative relationship of surface temperatures, so as to effectively reduce ground procedures and manual workload, and improve monitoring timeliness and frequency.
In addition, the accuracy of image processing is improved based on cloud and mist discrimination and cloud mask extraction on the satellite; meanwhile, according to the obtained new sample image, the on-orbit continuous iteration updating model is realized; the method has the advantages that the target calibration coefficient of the on-orbit on the satellite is determined in real time by utilizing the two calibration coefficients and the shooting date, so that the accuracy of the target calibration coefficient is ensured, and meanwhile, the working efficiency is improved; in addition, the workload of the ground station can be effectively reduced by extracting the abnormal temperature area based on the thermodynamic diagram.
The method is not only suitable for investigating the heat radiation characteristics of general objects on the ground (such as urban heat islands), but also suitable for other high-temperature target recognition sensitive scenes (forest fires, live volcano recognition and the like).
An embodiment of the present application provides a storage medium, in which a computer program is stored, wherein the computer program is configured to perform the method described in any one of the above when the computer program runs.
The present application provides an apparatus for generating an infrared thermodynamic diagram on orbit on a satellite, including a memory and a processor, where the memory stores a computer program, and the processor is configured to execute the computer program to perform the method described in any one of the above.
It will be understood by those of ordinary skill in the art that all or some of the steps of the methods, systems, functional modules/units in the devices disclosed above may be implemented as software, firmware, hardware, or suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed by several physical components in cooperation. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as is well known to those of ordinary skill in the art. Computer storage media includes, but is not limited to, RAM (Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash Memory or other Memory technology, CD-ROM (Compact Disc Read-Only Memory), Digital Versatile Discs (DVD) or other optical Disc storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as known to those skilled in the art.
Claims (10)
1. A method for generating an infrared thermodynamic diagram based on-orbit satellite on a satellite, which is applied to real-time processing on in-orbit satellite hardware to generate the infrared thermodynamic diagram, and comprises the following steps:
acquiring a thermal infrared remote sensing image of a target area, wherein the infrared wavelength of the infrared remote sensing image is 3-14 mu m;
converting the digital quantization DN value of each pixel in the thermal infrared remote sensing image into a radiance value of each pixel;
calculating a brightness temperature value corresponding to the radiance value of each pixel;
and generating a thermodynamic diagram of the thermal infrared remote sensing image according to the brightness temperature value corresponding to each pixel.
2. The method of claim 1, wherein prior to converting the digitally quantized DN value for each pixel in the thermal infrared remote sensing image to a radiance value for each pixel, the method further comprises:
carrying out cloud and fog recognition on the thermal infrared remote sensing image to obtain a target image with cloud and fog;
carrying out cloud and fog segmentation processing on the target image with cloud and fog to generate a mask corresponding to the target image;
performing relative radiation correction on the target image by using the mask;
performing geometric correction on the target image after the relative radiation correction based on a global elevation model stored on the satellite;
and after the relative radiation correction and the geometric correction are finished, converting the digital quantization DN value into a radiation brightness value.
3. The method of claim 2, wherein:
carrying out cloud and fog recognition on the thermal infrared remote sensing image by utilizing a cloud and fog discrimination model prestored on the satellite, wherein the cloud and fog discrimination model is obtained by training according to a sample image sent by a ground station;
after the mask corresponding to the target image is generated, the method further includes:
downloading the processing result of the cloud and fog discrimination model on the satellite and the cloud mask to the ground station;
receiving a sample image fed back by a ground station, wherein the ground station can be combined with a satellite remote sensing image to judge cloud and fog identification precision, modify an area with the judgment precision smaller than a preset threshold value, and annotate a satellite on the modified result serving as the sample image;
and according to the received sample image, carrying out iterative update on the cloud and fog discrimination model.
4. The method of claim 1, wherein converting the digitally quantized DN value of each pixel in the thermal infrared remote sensing image into a radiance value of each pixel comprises:
acquiring a target gain value and a target offset value corresponding to the current date;
and multiplying the DN value of each pixel by the target gain value, and adding the DN value of each pixel with the target offset value to obtain the radiance value of each pixel.
5. The method of claim 4, wherein obtaining the target gain value and the target offset value corresponding to the current date comprises:
determining a first date of an on-track scaling operation prior to a current date
And a second date of the on-track calibration operation after the current date
；
Determining a first date
On-track calibration of operating gain values
And offset value
And, a second date
On-track calibration of operating gain values
And an offset value
；
Obtaining a target gain value and a target offset value corresponding to the current date according to the gain value and the offset value corresponding to the on-orbit scaling operation of the first date and the second date;
wherein, gain value and offset value corresponding to each on-orbit calibration operation are obtained by the following method, including:
calculating equivalent radiance of satellite
The method comprises the following steps:
wherein the content of the first and second substances,
is the radiance at the satellite entrance pupil;
according to DN value of water body pixel and satellite equivalent radiance
Calculating Gain and offset;
wherein the content of the first and second substances,
is the equivalent radiance value of the satellite entrance pupil,
as a function of the spectral response of the satellite.
6. The method of claim 5, wherein the target gain value and the target offset value corresponding to the current date are obtained according to the gain value and the offset value corresponding to the on-track scaling operation of the first date and the second date, and the calculation expression is as follows:
wherein the content of the first and second substances,
、
and
sequentially showing a first date, a second date and a current date,
、
、
Sequentially showing a gain value corresponding to the first date, a gain value corresponding to the second date and a target gain value corresponding to the current date;
、
、
the offset value corresponding to the first date, the offset value corresponding to the second date, and the target offset value corresponding to the current date are sequentially expressed.
7. The method of claim 1, wherein calculating a brightness temperature value corresponding to a radiance value of each pixel element comprises:
acquiring the sum of values corresponding to the spectral response function of the wavelength under different value-taking conditions;
obtaining a blackbody radiation brightness value corresponding to the central wavelength of each pixel according to the sum of the values and the satellite equivalent radiation brightness value of each pixel;
calculating a brightness temperature value corresponding to the blackbody radiation brightness value of the central wavelength;
wherein, the calculation expression of the blackbody radiation brightness value is as follows:
wherein the content of the first and second substances,
is the center wavelength of the light emitted by the light source,
is the radiance value of the satellite's entrance pupil,
is the value of the spectral response function,
for the global emissivity map stored on the satellite,
at a temperature T and a center wavelength of
The value of the black body radiation luminance at the time,
as wavelength in the spectral response function
The minimum value of (a) is determined,
as wavelength in the spectral response function
Is measured.
8. The method according to claim 1, wherein calculating the brightness temperature value corresponding to the blackbody radiation brightness value of the center wavelength using the following computational expression comprises:
wherein, C 1 Is a first radiation constant, C 2 Is the second radiation constant.
9. The method of claim 1, wherein after generating the thermodynamic diagram of the thermal infrared remote sensing image according to the brightness temperature value corresponding to each pixel, the method further comprises:
judging the area indicating the temperature abnormality in the thermodynamic diagram, comprising:
performing image segmentation on the thermodynamic diagram to obtain at least two image fragments;
performing the following operations for each image slice, including:
calculating pixel values corresponding to all pixels in the image fragment to obtain the maximum value and the average value of the pixels of the image fragment;
if the maximum value of the image elements in the image fragment is at least two times higher than the average value, marking the image elements, and determining the area where the marked image elements are located as a temperature abnormal area only when the marked image elements are connected and the number of the marked image elements is larger than a preset number threshold;
recording the central coordinates of the temperature abnormal area;
cutting according to a preset range by taking the central coordinate as a center to obtain a target area;
and carrying out binarization processing on the cut target area according to abnormity and non-abnormity to obtain the coordinate information of the central point of the temperature abnormal area.
10. An apparatus for on-board on-satellite in-orbit generation of an infrared thermodynamic diagram, comprising a memory and a processor, wherein the memory has stored therein a computer program, the processor being arranged to execute the computer program to perform the method of any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210977596.5A CN115049754B (en) | 2022-08-16 | 2022-08-16 | Method and device for generating infrared thermodynamic diagram on orbit based on satellite |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210977596.5A CN115049754B (en) | 2022-08-16 | 2022-08-16 | Method and device for generating infrared thermodynamic diagram on orbit based on satellite |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115049754A true CN115049754A (en) | 2022-09-13 |
| CN115049754B CN115049754B (en) | 2023-01-10 |
Family
ID=83166762
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210977596.5A Active CN115049754B (en) | 2022-08-16 | 2022-08-16 | Method and device for generating infrared thermodynamic diagram on orbit based on satellite |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115049754B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104748857A (en) * | 2015-03-05 | 2015-07-01 | 北京师范大学 | Method and system for inverting urban surface temperatures |
| CN107356969A (en) * | 2017-09-06 | 2017-11-17 | 四川易利数字城市科技有限公司 | A kind of seismic precursor analysis method based on satellite thermal infrared data and GIS |
| CN111323129A (en) * | 2020-03-25 | 2020-06-23 | 长光卫星技术有限公司 | Earth surface temperature inversion method based on broadband thermal infrared image |
| CN112304890A (en) * | 2020-11-27 | 2021-02-02 | 重庆商勤科技有限公司 | Method and system for monitoring ozone concentration by airborne spectrum remote sensing |
| CN113776671A (en) * | 2021-08-11 | 2021-12-10 | 吉林大学 | Day and night remote sensing image short wave infrared volcano temperature-emissivity joint inversion method |
| CN113970376A (en) * | 2021-09-07 | 2022-01-25 | 中国科学院空天信息创新研究院 | Satellite infrared load calibration method based on ocean area reanalysis data |
-
2022
- 2022-08-16 CN CN202210977596.5A patent/CN115049754B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104748857A (en) * | 2015-03-05 | 2015-07-01 | 北京师范大学 | Method and system for inverting urban surface temperatures |
| CN107356969A (en) * | 2017-09-06 | 2017-11-17 | 四川易利数字城市科技有限公司 | A kind of seismic precursor analysis method based on satellite thermal infrared data and GIS |
| CN111323129A (en) * | 2020-03-25 | 2020-06-23 | 长光卫星技术有限公司 | Earth surface temperature inversion method based on broadband thermal infrared image |
| CN112304890A (en) * | 2020-11-27 | 2021-02-02 | 重庆商勤科技有限公司 | Method and system for monitoring ozone concentration by airborne spectrum remote sensing |
| CN113776671A (en) * | 2021-08-11 | 2021-12-10 | 吉林大学 | Day and night remote sensing image short wave infrared volcano temperature-emissivity joint inversion method |
| CN113970376A (en) * | 2021-09-07 | 2022-01-25 | 中国科学院空天信息创新研究院 | Satellite infrared load calibration method based on ocean area reanalysis data |
Non-Patent Citations (7)
| Title |
|---|
| SITI NOR AFZAN BUYADI 等: "Impact of Land Use Changes on the Surface Temperature Distribution of Area Surrounding the National Botanic Garden, Shah Alam", 《PROCEDIA - SOCIAL AND BEHAVIORAL SCIENCES》 * |
| 唐曦 等: "基于遥感的上海城市热岛效应与植被的关系研究", 《华东师范大学学报(自然科学版)》 * |
| 庄伟 等: "一种检测煤田地表热异常的新方法", 《中国煤田地质》 * |
| 张兆明 等: "Landsat 5 TM数据辐射定标", 《科技导报》 * |
| 李艳彬 等: "基于ETM+数据的石家庄热岛效应研究", 《城市地理》 * |
| 肖达: "北京市城市热环境的多时间尺度分析研究", 《中国优秀硕士学位论文全文数据库 基础科学辑》 * |
| 贾萌娜 等: "火星表面亮温的时空变化特征分析", 《遥感学报》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115049754B (en) | 2023-01-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9990705B2 (en) | Atmospheric compensation in satellite imagery | |
| Frantz et al. | An operational radiometric landsat preprocessing framework for large-area time series applications | |
| Su et al. | Next-generation angular distribution models for top-of-atmosphere radiative flux calculation from CERES instruments: Validation | |
| US20230026811A1 (en) | System and method for removing haze from remote sensing images | |
| JP7334879B2 (en) | Correlating Thermal Satellite Image Data to Generate High Spatial Resolution Heatmaps | |
| Xue et al. | Shortwave radiation calculation for forest plots using airborne LiDAR data and computer graphics | |
| Corradini et al. | Retrieval of SO 2 from thermal infrared satellite measurements: correction procedures for the effects of volcanic ash | |
| CN109946235A (en) | The multi layer cloud inversion method of wind and cloud 4A meteorological satellite Multichannel Scan Imagery Radiometer | |
| US9383478B2 (en) | System and method for atmospheric parameter enhancement | |
| CN113970376B (en) | Satellite infrared load calibration method based on marine region re-analysis data | |
| Kuhnell et al. | Mapping woody vegetation cover over the state of Queensland using Landsat TM imagery | |
| Forster et al. | Toward cloud tomography from space using MISR and MODIS: Locating the “veiled core” in opaque convective clouds | |
| Chapman et al. | Potential applications of thermal fisheye imagery in urban environments | |
| Mazzotti et al. | Spatially continuous characterization of forest canopy structure and subcanopy irradiance derived from handheld radiometer surveys | |
| CN114663786A (en) | Forest stand radiation flux calculation method based on point cloud data and computer graphics | |
| CN115049754B (en) | Method and device for generating infrared thermodynamic diagram on orbit based on satellite | |
| CN113256493A (en) | Thermal infrared remote sensing image reconstruction method and device | |
| US11922687B2 (en) | Information processing apparatus, information processing method, and program | |
| US20240044783A1 (en) | Generating high-resolution concentration maps for atmospheric gases using geography-informed machine learning | |
| KR20190136850A (en) | Method for mitigation of topographic effect in infrared images taken from geostationary orbit imaging system and Apparatus Thereof | |
| Valdelomar et al. | Comparison of two different techniques to determine the cloud cover from all-sky imagery | |
| Tuttle et al. | Horizontal electric fields from flow of auroral O+(2 P) ions at sub-second temporal resolution | |
| Grimming | Uncooled Microbolometer Imaging Systems for Machine Vision | |
| KR20200075881A (en) | Satellite image analysis model generation method and system for calculating solar radiation using artificial neural network technique | |
| CN116380811B (en) | Cloud detection method based on oxygen absorption band |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |