CN115988334B - Self-correcting digital camera mobile remote sensing system and method - Google Patents

Self-correcting digital camera mobile remote sensing system and method Download PDF

Info

Publication number
CN115988334B
CN115988334B CN202310260914.0A CN202310260914A CN115988334B CN 115988334 B CN115988334 B CN 115988334B CN 202310260914 A CN202310260914 A CN 202310260914A CN 115988334 B CN115988334 B CN 115988334B
Authority
CN
China
Prior art keywords
image
corrected
remote sensing
color
color space
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310260914.0A
Other languages
Chinese (zh)
Other versions
CN115988334A (en
Inventor
杜咏馨
喻智华
雷雨
郝杰
王海龙
王保国
颜廷文
张振华
林玉水
叶协欢
龚星平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangxi Beiwei Space Information Technology Co ltd
Original Assignee
Jiangxi Beiwei Space Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangxi Beiwei Space Information Technology Co ltd filed Critical Jiangxi Beiwei Space Information Technology Co ltd
Priority to CN202310260914.0A priority Critical patent/CN115988334B/en
Publication of CN115988334A publication Critical patent/CN115988334A/en
Application granted granted Critical
Publication of CN115988334B publication Critical patent/CN115988334B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02EREDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
    • Y02E10/00Energy generation through renewable energy sources
    • Y02E10/50Photovoltaic [PV] energy

Landscapes

  • Image Processing (AREA)

Abstract

The application provides a self-correcting digital camera mobile remote sensing system and a method, which are applied to the technical field of image data processing, wherein the method comprises the following steps: acquiring an image to be corrected; establishing a remote sensing camera response model, and obtaining an output value of the corrected image pixel according to the sunlight spectrum power distribution and the atmospheric layer radiation spectrum distribution; performing remote sensing automatic classification on the image to be corrected, and selecting a remote sensing digital image of a preset area according to the classification of the image to be corrected; performing color space conversion aiming at the classification result, converting the image to be corrected from an RGB color space to an LMS color space, and performing offset elimination on the image to be corrected by converting the image to be corrected from the LMS color space to a logarithmic LMS color space; performing linear model brightness and color correction on the corresponding types; converting the corrected image into an RGB color space and outputting a corrected image; the color self-correction of the image is realized, and the quality of the color remote sensing image is improved rapidly and effectively.

Description

Self-correcting digital camera mobile remote sensing system and method
Technical Field
The present disclosure relates to the field of image data processing technologies, and in particular, to a self-correcting digital camera mobile remote sensing system and method.
Background
At present, remote sensing has become a main means of large-area real-time geosynchronous observation, but besides the influence of sun, atmospheric conditions and satellite parameters, seasonal variation of vegetation features also can cause color and brightness differences between different remote sensing images. These differences not only have a great influence on the subsequent image classification and change detection, but also have difficulty in remote sensing image stitching. The true color remote sensing image is synthesized by red, green and blue wave bands, the color of the shot object is displayed as faithfully as possible, and the true color remote sensing image provides more information than the gray level image, but the image shot by the current camera has the following problems:
(1) The depth information acquired by the camera has a certain error due to the limitation of imaging conditions and the interference of external environment, and the quality of the image is affected;
(2) When the acquired image is corrected, manual operation is needed, the efficiency is low, the use is limited under the condition of strict requirement on the correction time, and automatic correction cannot be realized.
Reference patent application number CN202010298041.9 discloses a single-camera polar line correction method and device, the specific contents of which are: collecting flat plate images projected with speckles at different distances by using a camera and a speckle projector which face the same direction and have unchanged relative positions, and obtaining a first plane speckle image and a second plane speckle image; matching the first plane speckle image and the second plane speckle image through an image matching algorithm to obtain sub-pixel matching points; obtaining a mapping matrix between the two physical coordinates according to the physical coordinates of the sub-pixel matching points corresponding to the first plane speckle image and the physical coordinates corresponding to the second plane speckle image; obtaining a direction vector of the projector center in a camera reference system according to the mapping matrix; adjusting the coordinate axis direction of a camera reference system to align the horizontal axis direction with the direction vector, and updating the imaging matrix of the camera; and mapping the target scene image through the imaging matrix to obtain an epipolar corrected image.
The prior art obtains corrected images through technologies such as an image matching algorithm, an imaging matrix and the like, but a correction method is not applicable to a dual-camera system, errors exist in the correction process, and correction of color images is not considered, so that a self-correction digital camera mobile remote sensing system and a self-correction digital camera mobile remote sensing method are provided.
Disclosure of Invention
The present application provides a self-correcting digital camera mobile remote sensing system and method, which aims to solve the problems that errors exist in the correction process and the correction of color images is not considered.
In order to achieve the above purpose, the present application provides the following technical solutions:
the application provides a self-correcting digital camera mobile remote sensing method, which comprises the following steps:
s1: acquiring an image to be corrected, and identifying an error area of the image to be corrected to obtain an error point;
s2: establishing a remote sensing camera response model, and obtaining an output value of the corrected image pixel according to the sunlight spectrum power distribution and the atmospheric layer radiation spectrum distribution, wherein the model is as follows:
Figure SMS_4
the method comprises the steps of carrying out a first treatment on the surface of the Wherein when->
Figure SMS_6
The unit function indicates that the camera response model is linear, and the unit function is a function subjected to A/D conversion of the remote sensing camera>
Figure SMS_10
Is a monotonic function increasing nonlinear function and indicates that the camera response model is nonlinear, +.>
Figure SMS_1
For the spectral power distribution of the incident light, +.>
Figure SMS_5
Is light ofWavelength of spectral color, < >>
Figure SMS_8
The sensitivity of the red, green and blue spectrum of the camera, noise is noise, and k is the constant of exposure time; when the solar spectral power distribution and the atmospheric radiation spectral distribution are uniformly distributed in space, the model is: />
Figure SMS_11
The method comprises the steps of carrying out a first treatment on the surface of the Wherein the method comprises the steps of
Figure SMS_2
For irradiance of sunlight>
Figure SMS_7
For the transmissivity of the atmosphere in the direction of the remote sensing camera, < ->
Figure SMS_9
H is the elevation of the remote sensing camera, which is the depression angle and azimuth angle +.>
Figure SMS_12
Layer emittance for atmospheric path, k is a constant of exposure time, +.>
Figure SMS_3
For light sensitivity, noise is noise;
s3: the method comprises the steps of implementing remote sensing automatic classification on an image to be corrected, selecting a remote sensing digital image of a preset area according to the classification of the image to be corrected, acquiring a characteristic formulation classification system of the remote sensing digital image, establishing supervision classification in the classification system, training the characteristic, classifying pixels with the same characteristic by adopting a clustering method if the characteristic is not in the supervision classification, and measuring the characteristic;
s4: performing color space conversion aiming at the classification result, converting the image to be corrected from RGB color space to LMS color space, performing offset elimination on the image to be corrected by converting the LMS color space to logarithmic LMS color space, and finally converting the image to be corrected from logarithmic LMS color space to LMS color space
Figure SMS_13
A color space;
performing linear model brightness and color correction on the corresponding types, and respectively calculating
Figure SMS_14
The mean and variance of each type in the image to be corrected after the color space transformation are as follows:
Figure SMS_15
the method comprises the steps of carrying out a first treatment on the surface of the Wherein->
Figure SMS_16
For the image to be corrected i is the i-th type,/->
Figure SMS_17
Type i for the image to be corrected>
Figure SMS_18
Pixel values after color space conversion, < >>
Figure SMS_19
The pixel value of the i type image after correction;
s5: and converting the corrected image into an RGB color space after correction, and outputting a corrected image.
Further, the step of obtaining the image to be corrected, and identifying the error area of the image to be corrected to obtain the error point includes:
and automatically removing the stripe noise of the image to be corrected, wherein the formula is as follows:
Figure SMS_20
the method comprises the steps of carrying out a first treatment on the surface of the Wherein->
Figure SMS_21
For the input gray values, M is the average value of gray values of all pixel numbers in the image to be corrected, D is the standard deviation of gray values of all pixel numbers in the image to be corrected, < >>
Figure SMS_22
For the average value of the gray values of the pixel numbers on each scanning line, and (2)>
Figure SMS_23
Standard deviation of pixel number gray values on each scanning line; if the ith row is a stripe and all pixels on the stripe are zero-order gray values, the +.>
Figure SMS_24
And->
Figure SMS_25
Also zero value, calculated +.>
Figure SMS_26
The gray value of the (i) line is equal to the average value M of the gray values of all the pixels in the image to be corrected, namely, the calculated gray values of all the pixels in the (i) line are equal, and the (i) line is judged to be a strip, so that automatic noise removal is needed.
Further, after S2, the method includes:
and carrying out geometric fine correction on the image to be corrected, establishing original image coordinates and transformed coordinates, calculating corresponding original coordinates through the central position of each transformed image pixel, judging that the pixel point of the transformed coordinates is not in the center of the original image pixel when the pixel point of the transformed coordinates is not in the original image coordinate system, calculating coordinates in the original image corresponding to each point in the geometric corrected image obtained after correction, calculating according to line point by point in the calculation process, and carrying out next line calculation after each line is ended.
Further, the process of performing geometric fine correction on the image to be corrected includes establishing a corresponding relationship between an original image and a geometric correction image, where the formula is as follows:
Figure SMS_27
the method comprises the steps of carrying out a first treatment on the surface of the Wherein x and y are original image coordinates, u and v are transformed image coordinates, and are integers, < >>
Figure SMS_28
Respectively are provided withThe abscissa of 6 known corresponding points.
Further, the step of color correction is as follows:
storing a reflection spectrum distribution set of the color card in a database, and calculating tristimulus values according to the spectrum reflectivity of the color card to obtain a color true value; calculating a remote sensing value of the spectral reflectivity of a preset color card by using the camera response model; and mapping the 3 color components of the image to be corrected onto the 3 color components of the color chart, describing the characteristics of the remote sensing camera by using a linear model to obtain a corrected color image, and carrying out color correction again when the spectrum of the light source and the atmospheric parameters change.
Further, after S4, the method includes:
eliminating standard deviations of various types of images to be corrected, calculating standard deviations of various pixels on corresponding types to obtain distance weight parameters, and multiplying the reverse normalized distance weight parameters by correction values of various types by using a reverse normalization weight method to obtain final pixel values of corresponding pixels.
Further, the clustering method classifies pixels with the same characteristics by adopting a K-means clustering method, and supposedly classifies an image to be corrected into m types, calculates the gravity center of each type and takes the gravity center as an initial center of the m types; in each iteration, any sample is assigned to the corresponding type.
The application also provides a self-correcting digital camera mobile remote sensing system, comprising:
the acquisition module is used for: acquiring an image to be corrected, and identifying an error area of the image to be corrected to obtain an error point;
and (3) a building module: establishing a remote sensing camera response model, and obtaining an output value of the corrected image pixel according to the sunlight spectrum power distribution and the atmospheric layer radiation spectrum distribution, wherein the model is as follows:
Figure SMS_31
the method comprises the steps of carrying out a first treatment on the surface of the Wherein when->
Figure SMS_34
Indicating camera as unit functionThe response model is linear, and the unit function is a function subjected to A/D conversion of the remote sensing camera,/->
Figure SMS_38
Is a monotonic function increasing nonlinear function and indicates that the camera response model is nonlinear, +.>
Figure SMS_32
For the spectral power distribution of the incident light, +.>
Figure SMS_35
Is the wavelength of the spectral color,
Figure SMS_37
the sensitivity of the red, green and blue spectrum of the camera, noise is noise, and k is the constant of exposure time; when the solar spectral power distribution and the atmospheric radiation spectral distribution are uniformly distributed in space, the model is:
Figure SMS_40
the method comprises the steps of carrying out a first treatment on the surface of the Wherein->
Figure SMS_29
For irradiance of sunlight>
Figure SMS_33
For the transmissivity of the atmosphere in the direction of the remote sensing camera, < ->
Figure SMS_36
H is the elevation of the remote sensing camera, which is the depression angle and azimuth angle +.>
Figure SMS_39
Layer emittance for atmospheric path, k is a constant of exposure time, +.>
Figure SMS_30
For light sensitivity, noise is noise.
And a classification module: the method comprises the steps of implementing remote sensing automatic classification on an image to be corrected, selecting a remote sensing digital image of a preset area according to the classification of the image to be corrected, acquiring a characteristic formulation classification system of the remote sensing digital image, establishing supervision classification in the classification system, training the characteristic, classifying pixels with the same characteristic by adopting a clustering method if the characteristic is not in the supervision classification, and measuring the characteristic;
and a correction module: performing color space conversion aiming at the classification result, converting the image to be corrected from RGB color space to LMS color space, performing offset elimination on the image to be corrected by converting the LMS color space to logarithmic LMS color space, and finally converting the image to be corrected from logarithmic LMS color space to LMS color space
Figure SMS_41
A color space;
performing linear model brightness and color correction on the corresponding types, and respectively calculating
Figure SMS_42
The mean and variance of each type in the image to be corrected after the color space transformation are as follows:
Figure SMS_43
the method comprises the steps of carrying out a first treatment on the surface of the Wherein->
Figure SMS_44
For the image to be corrected i is the i-th type,/->
Figure SMS_45
Type i for the image to be corrected>
Figure SMS_46
Pixel values after color space conversion, < >>
Figure SMS_47
The pixel value of the i type image after correction;
and an output module: and converting the corrected image into an RGB color space after correction, and outputting a corrected image.
The application provides a self-correcting digital camera mobile remote sensing system and a self-correcting digital camera mobile remote sensing method, which have the following beneficial effects:
(1) According to the invention, a reflection spectrum distribution set of the color card is stored in a database, and a tristimulus value is calculated according to the spectrum reflectivity of the color card, so that a color true value is obtained; calculating a remote sensing value of the spectral reflectivity of a preset color card by using a camera response model; mapping 3 color components of an image to be corrected onto 3 color components of a color chart, describing the characteristics of a remote sensing camera by using a linear model to obtain a corrected color image, wherein the color correction method can change a color correction matrix along with the change of conditions, and has the advantages of good flexibility and high correction efficiency;
(2) The invention comprehensively uses the technical means such as a remote sensing camera response model, an iterative optimization algorithm and the like, solves the problem that the depth information acquired by the camera has a certain error, prevents the limitation of imaging conditions and the interference of external environment, has stronger universality and practicability, ensures the image correction precision, saves the cost and can meet the self-correction requirement of various remote sensing cameras;
(3) The invention classifies the images to be corrected according to the number of peaks in the histogram, adopts an unsupervised classification algorithm, firstly selects a plurality of samples as clustering centers, gathers the rest samples towards each center according to a minimum distance criterion, thereby obtaining initial clustering, and carries out color space conversion after obtaining a classification result of the images to be corrected, thereby realizing the self-correction of the colors of the images, rapidly and effectively improving the quality of the color remote sensing images, ensuring uniform brightness and clear details.
Drawings
FIG. 1 is a schematic flow chart of a self-correcting digital camera mobile remote sensing method according to an embodiment of the present application;
fig. 2 is a block diagram of a self-correcting digital camera mobile remote sensing system according to an embodiment of the present application.
The implementation, functional features and advantages of the present application will be further described with reference to the accompanying drawings in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
Referring to fig. 1, a flow chart of a self-correcting digital camera mobile remote sensing method is provided;
the self-correcting digital camera mobile remote sensing method provided by the application comprises the following steps:
s1: acquiring an image to be corrected, and identifying an error area of the image to be corrected to obtain an error point; and automatically removing the stripe noise of the image to be corrected, wherein the formula is as follows:
Figure SMS_48
the method comprises the steps of carrying out a first treatment on the surface of the Wherein->
Figure SMS_49
For the input gray values, M is the average value of gray values of all pixel numbers in the image to be corrected, D is the standard deviation of gray values of all pixel numbers in the image to be corrected, < >>
Figure SMS_50
For the average value of the gray values of the pixel numbers on each scanning line, and (2)>
Figure SMS_51
Standard deviation of pixel number gray values on each scanning line; if the ith row is a stripe and all pixels on the stripe are zero-order gray values, the +.>
Figure SMS_52
And->
Figure SMS_53
Also zero value, calculated +.>
Figure SMS_54
The gray value of the (i) line is equal to the average value M of the gray values of all the pixels in the image to be corrected, namely, the calculated gray values of all the pixels in the (i) line are equal, and the (i) line is judged to be a strip, so that automatic noise removal is needed.
In this step, since the remote sensing image is easily affected by the atmosphere during imaging, different atmospheric conditions may affect the brightness and color distribution of the image, thereby resulting in subsequent correction deviation; when imaging, the scanning line is dropped due to the fault on a certain scanning line of the detection system, no information is usually generated at this time, only one black line is displayed on the image, and segmented black lines sometimes appear, which are called stripe noise.
S2: establishing a remote sensing camera response model, and obtaining an output value of the corrected image pixel according to the sunlight spectrum power distribution and the atmospheric layer radiation spectrum distribution, wherein the model is as follows:
Figure SMS_56
the method comprises the steps of carrying out a first treatment on the surface of the Wherein when->
Figure SMS_60
The unit function indicates that the camera response model is linear, and the unit function is a function subjected to A/D conversion of the remote sensing camera>
Figure SMS_63
Is a monotonic function increasing nonlinear function and indicates that the camera response model is nonlinear, +.>
Figure SMS_57
For the spectral power distribution of the incident light, +.>
Figure SMS_61
Wavelength of spectral color, < >>
Figure SMS_64
The sensitivity of the red, green and blue spectrum of the camera, noise is noise, and k is the constant of exposure time; when the solar spectral power distribution and the atmospheric radiation spectral distribution are uniformly distributed in space, the model is: />
Figure SMS_66
The method comprises the steps of carrying out a first treatment on the surface of the Wherein the method comprises the steps of
Figure SMS_55
For irradiance of sunlight>
Figure SMS_59
For the transmissivity of the atmosphere in the direction of the remote sensing camera, < ->
Figure SMS_62
H is the elevation of the remote sensing camera, which is the depression angle and azimuth angle +.>
Figure SMS_65
Layer emittance for atmospheric path, k is a constant of exposure time, +.>
Figure SMS_58
For light sensitivity, noise is noise; and carrying out geometric fine correction on the image to be corrected, establishing original image coordinates and transformed coordinates, calculating corresponding original coordinates through the central position of each transformed image pixel, judging that the pixel point of the transformed coordinates is not in the center of the original image pixel when the pixel point of the transformed coordinates is not in the original image coordinate system, calculating coordinates in the original image corresponding to each point in the geometric corrected image obtained after correction, calculating according to line point by point in the calculation process, and carrying out next line calculation after each line is ended.
In the step, in the remote sensing process, sunlight consisting of direct sunlight through the atmosphere and scattered light of sky irradiates on a ground object together, is reflected back to the atmosphere by the ground object, and finally reaches a remote sensing camera; the method comprises the steps of carrying out geometric fine correction on an image to be corrected, wherein the image before correction is formed by equidistant pixel points with regular rows and columns, but actually, due to certain geometric distortion, the ground distances corresponding to the pixel points in the image are not equal, the corrected image is formed by equidistant grid points, and the ground is used as a standard, so that the image meets the uniform distribution of certain projection, the final purpose of correction is to determine the row and column values of the corrected image, and then find the brightness value of each pixel in a new image; the geometric fine correction resampling method comprises the following steps: establishing a relation between original image coordinates (x, y) and transformed image coordinates (u, v), and calculating original image coordinate points (x, y) through the central position (u represents the number of rows and v represents the number of columns, and are integers) of each transformed image pixel; analysis shows that the pixel points of the integer (u, v) are generally not located on the integer (x, y) points in the original image coordinate system, namely are not located at the centers of the pixels of the original image, the positions (x, y) in the original image corresponding to each point in the corrected image are calculated, the calculation is carried out point by point according to lines, and the next line calculation is carried out after each line is ended until the whole image is ended.
S3: and carrying out remote sensing automatic classification on the image to be corrected, selecting a remote sensing digital image of a preset area according to the classification of the image to be corrected, acquiring the characteristics of the remote sensing digital image to formulate a classification system, establishing supervision classification in the classification system, training the characteristics, classifying pixels with the same characteristics by adopting a clustering method if the characteristics are not in the supervision classification, and measuring the characteristics.
In the step, classifying the image to be corrected according to the number of peaks in the histogram, adopting an unsupervised classification algorithm, firstly selecting a plurality of samples as clustering centers, aggregating the rest samples towards each center according to a minimum distance criterion, thus obtaining an initial cluster, judging whether the initial cluster result meets the requirements, if not, splitting and merging the clustering set to obtain a new cluster center, determining the clustering center through iterative operation of sample mean values, judging whether the clustering result meets the requirements, and repeating the iteration until the clustering division operation is completed.
S4: performing color space conversion aiming at the classification result, converting the image to be corrected from RGB color space to LMS color space, performing offset elimination on the image to be corrected by converting the LMS color space to logarithmic LMS color space, and finally converting the image to be corrected from logarithmic LMS color space to LMS color space
Figure SMS_67
A color space;
will correspond to the type lineCorrection of brightness and color of the sexual model, respectively, calculation of
Figure SMS_68
The mean and variance of each type in the image to be corrected after the color space transformation are as follows:
Figure SMS_69
the method comprises the steps of carrying out a first treatment on the surface of the Wherein->
Figure SMS_70
For the image to be corrected, i is the i-th type,
Figure SMS_71
type i for the image to be corrected>
Figure SMS_72
Pixel values after color space conversion, < >>
Figure SMS_73
The pixel value of the i type image after correction; the color correction step is as follows: storing a reflection spectrum distribution set of the color card in a database, and calculating tristimulus values according to the spectrum reflectivity of the color card to obtain a color true value; calculating a remote sensing value of the spectral reflectivity of a preset color card by using the camera response model; mapping the 3 color components of the image to be corrected onto the 3 color components of a color chart, describing the characteristics of the remote sensing camera by using a linear model to obtain a corrected color image, and carrying out color correction again when the spectrum of the light source and the atmospheric parameters change; eliminating standard deviations of various types of images to be corrected, calculating standard deviations of various pixels on corresponding types to obtain distance weight parameters, and multiplying the reverse normalized distance weight parameters by correction values of various types by using a reverse normalization weight method to obtain final pixel values of corresponding pixels.
In this step, from the image to be corrected, the RGB color space is converted to the LMS color space, and the conversion formula is:
Figure SMS_74
after the image is converted into the LMS color space, the statistical distribution of the converted image data has great deviation, and the LMS color space can be converted into the logarithmic LMS space to be eliminated, wherein the conversion formula is as follows:
Figure SMS_75
finally, the image is converted from the logarithmic LMS color space to the following conversion formula
Figure SMS_76
Color space, the conversion formula is:
Figure SMS_77
s5: and converting the corrected image into an RGB color space after correction, and outputting a corrected image.
Referring to fig. 2, the present invention further provides a self-correcting digital camera mobile remote sensing system, comprising:
the acquisition module is used for: acquiring an image to be corrected, and identifying an error area of the image to be corrected to obtain an error point;
and (3) a building module: establishing a remote sensing camera response model, and obtaining an output value of the corrected image pixel according to the sunlight spectrum power distribution and the atmospheric layer radiation spectrum distribution, wherein the model is as follows:
Figure SMS_79
the method comprises the steps of carrying out a first treatment on the surface of the Wherein when->
Figure SMS_83
The unit function indicates that the camera response model is linear, and the unit function is a function subjected to A/D conversion of the remote sensing camera>
Figure SMS_86
Is a monotonic function increasing nonlinear function and indicates that the camera response model is nonlinear, +.>
Figure SMS_81
For the spectral power distribution of the incident light, +.>
Figure SMS_84
Is the wavelength of the spectral color,
Figure SMS_87
the sensitivity of the red, green and blue spectrum of the camera, noise is noise, and k is the constant of exposure time; when the solar spectral power distribution and the atmospheric radiation spectral distribution are uniformly distributed in space, the model is:
Figure SMS_89
the method comprises the steps of carrying out a first treatment on the surface of the Wherein->
Figure SMS_78
For the irradiance of sunlight, the light is irradiated,
Figure SMS_82
for the transmissivity of the atmosphere in the direction of the remote sensing camera, < ->
Figure SMS_85
H is the elevation of the remote sensing camera, which is the depression angle and azimuth angle +.>
Figure SMS_88
Layer emittance for atmospheric path, k is a constant of exposure time, +.>
Figure SMS_80
For light sensitivity, noise is noise;
and a classification module: the method comprises the steps of implementing remote sensing automatic classification on an image to be corrected, selecting a remote sensing digital image of a preset area according to the classification of the image to be corrected, acquiring a characteristic formulation classification system of the remote sensing digital image, establishing supervision classification in the classification system, training the characteristic, classifying pixels with the same characteristic by adopting a clustering method if the characteristic is not in the supervision classification, and measuring the characteristic;
and a correction module: performing color space conversion on the classification result, and converting the image to be corrected from RGB color space to LMS color spacePerforming offset cancellation on an image to be corrected by converting an LMS color space into a logarithmic LMS color space, and finally converting the image to be corrected from the logarithmic LMS color space into
Figure SMS_90
A color space;
performing linear model brightness and color correction on the corresponding types, and respectively calculating
Figure SMS_91
The mean and variance of each type in the image to be corrected after the color space transformation are as follows:
Figure SMS_92
the method comprises the steps of carrying out a first treatment on the surface of the Wherein->
Figure SMS_93
For the image to be corrected i is the i-th type,/->
Figure SMS_94
Type i for the image to be corrected>
Figure SMS_95
Pixel values after color space conversion, < >>
Figure SMS_96
The pixel value of the i type image after correction;
and an output module: and converting the corrected image into an RGB color space after correction, and outputting a corrected image.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, apparatus, article, or method that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, apparatus, article, or method. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, apparatus, article or method that comprises the element.
The foregoing description is only of the preferred embodiments of the present application and is not intended to limit the scope of the claims, and all equivalent structures or equivalent processes using the descriptions and drawings of the present application, or direct or indirect application in other related technical fields are included in the scope of the claims of the present application.
Although embodiments of the present application have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made therein without departing from the principles and spirit of the application, the scope of which is defined in the appended claims and their equivalents.

Claims (7)

1. A method for self-correcting digital camera mobile remote sensing, comprising:
s1: acquiring an image to be corrected, and identifying an error area of the image to be corrected to obtain an error point;
s2: establishing a remote sensing camera response model, and obtaining an output value of the image pixel to be corrected according to the sunlight spectrum power distribution and the atmospheric layer radiation spectrum distribution, wherein the model is as follows:
Figure QLYQS_1
wherein when F is a unit function indicating that the camera response model is linear, the unit function is a function after A/D conversion of the remote sensing camera, F is a monotonic function increasing nonlinear function indicating that the camera response model is nonlinear, I (m, n, lambda) is spectral power distribution of incident light, lambda is wavelength of spectral color, D i (m, n, λ), i=1, 2,3 is the red, green, blue spectral sensitivity of the camera, noise is noise, k is a constant of exposure time, respectively; when the solar spectral power distribution and the atmospheric radiation spectral distribution are uniformly distributed in space, the model is:
Figure QLYQS_2
where E (lambda) is the solar irradiance,
Figure QLYQS_3
for the transmissivity of the atmosphere in the direction of the remote sensing camera, θ +.>
Figure QLYQS_4
For the depression and azimuth angle, h is the elevation of the remote sensing camera, P (λ) is the layer radiance of the atmospheric path, k is the constant of the exposure time, D i (lambda) is the light sensitivity, noise is the noise;
s3: the method comprises the steps of implementing remote sensing automatic classification on an image to be corrected, selecting a remote sensing digital image of a preset area according to the classification of the image to be corrected, acquiring a characteristic formulation classification system of the remote sensing digital image, establishing supervision classification in the classification system, training the characteristic, classifying pixels with the same characteristic by adopting a clustering method if the characteristic is not in the supervision classification, and measuring the characteristic;
s4: performing color space conversion aiming at the classification result, converting the image to be corrected from an RGB color space to an LMS color space, performing offset elimination on the image to be corrected by converting the LMS color space to a logarithmic LMS color space, and finally converting the image to be corrected from the logarithmic LMS color space to an lalpha beta color space;
performing linear model brightness and color correction on the corresponding types, and calculating the mean value and variance of each type in the image to be corrected after lalpha beta color space conversion, wherein the formula is as follows:
Y i (p)′=Y i (p)-μ i1
wherein mu i1 For the image to be corrected, i is the i-th type, Y i (p) pixel values after conversion of the ith type lαβ color space of the image to be corrected, Y i (p)' is the corrected i-th type image element value;
the color correction step is as follows:
storing a reflection spectrum distribution set of the color card in a database, and calculating tristimulus values according to the spectrum reflectivity of the color card to obtain a color true value; calculating a remote sensing value of the spectral reflectivity of a preset color card by using the camera response model; mapping the 3 color components of the image to be corrected onto the 3 color components of a color chart, describing the characteristics of the remote sensing camera by using a linear model to obtain a corrected color image, and carrying out color correction again when the spectrum of the light source and the atmospheric parameters change;
s5: and converting the corrected image into an RGB color space after correction, and outputting a corrected image.
2. The method for mobile remote sensing of a self-correcting digital camera according to claim 1, wherein the step of obtaining the image to be corrected, and identifying the error area of the image to be corrected, and obtaining the error point comprises:
and automatically removing the stripe noise of the image to be corrected, wherein the formula is as follows:
Figure QLYQS_5
wherein g ij For the input gray values, M is the average value of the gray values of all pixel numbers in the image to be corrected, D is the standard deviation of the gray values of all pixel numbers in the image to be corrected, M i For the average value of the gray values of the pixel numbers on each scanning line, d i Standard deviation of pixel number gray values on each scanning line; if the ith row is a stripe and all pixels on the stripe are zero-order gray values, m is calculated i And d i Also zero value, calculated G ij The gray value of the (i) line is equal to the average value M of the gray values of all the pixels in the image to be corrected, namely, the calculated gray values of all the pixels in the (i) line are equal, and the (i) line is judged to be a strip, so that automatic noise removal is needed.
3. A method of self-correcting digital camera mobile telemetry as claimed in claim 1, wherein after S2, comprising:
and carrying out geometric fine correction on the image to be corrected, establishing original image coordinates and transformed coordinates, calculating corresponding original coordinates through the central position of each transformed image pixel, judging that the pixel point of the transformed coordinates is not in the center of the original image pixel when the pixel point of the transformed coordinates is not in the original image coordinate system, calculating coordinates in the original image corresponding to each point in the geometric corrected image obtained after correction, calculating according to line point by point in the calculation process, and carrying out next line calculation after each line is ended.
4. A method for mobile remote sensing of a self-correcting digital camera according to claim 3, wherein said performing a geometric fine correction on said image to be corrected comprises establishing a correspondence between an original image and a geometric corrected image, wherein the formula is:
x=a 00 +a 10 u+a 01 v+a 11 uv+a 20 u 2 +a 02 v 2
y=b 00 +b 10 u+b 01 v+b 11 uv+b 20 u 2 +b 02 v 2
wherein x, y are original image coordinates, u, v are transformed image coordinates, and are integers, and a, b are respectively the horizontal and vertical coordinates of 6 known corresponding points.
5. A method of self-correcting digital camera mobile telemetry as claimed in claim 1, wherein after S4, comprising:
eliminating standard deviations of various types of images to be corrected, calculating standard deviations of various pixels on corresponding types to obtain distance weight parameters, and multiplying the reverse normalized distance weight parameters by correction values of various types by using a reverse normalization weight method to obtain final pixel values of corresponding pixels.
6. The method for mobile remote sensing of a self-correcting digital camera according to claim 1, wherein the clustering method is to classify pixels with the same characteristics by using a K-means clustering method, and the image to be corrected is assumed to be divided into m types, and the center of gravity of each type is calculated and is taken as the initial center of the m types; in each iteration, any sample is assigned to the corresponding type.
7. A self-correcting digital camera mobile remote sensing system, comprising:
the acquisition module is used for: acquiring an image to be corrected, and identifying an error area of the image to be corrected to obtain an error point;
and (3) a building module: establishing a remote sensing camera response model, and obtaining an output value of the image pixel to be corrected according to the sunlight spectrum power distribution and the atmospheric layer radiation spectrum distribution, wherein the model is as follows:
Figure QLYQS_6
wherein when F is a unit function indicating that the camera response model is linear, the unit function is a function after A/D conversion of the remote sensing camera, F is a monotonic function increasing nonlinear function indicating that the camera response model is nonlinear, I (m, n, lambda) is spectral power distribution of incident light, lambda is wavelength of spectral color, D i (m, n, λ), i=1, 2,3 is the red, green, blue spectral sensitivity of the camera, noise is noise, k is a constant of exposure time, respectively; when the solar spectral power distribution and the atmospheric radiation spectral distribution are uniformly distributed in space, the model is:
Figure QLYQS_7
where E (lambda) is the solar irradiance,
Figure QLYQS_8
for the transmissivity of the atmosphere in the direction of the remote sensing camera, θ +.>
Figure QLYQS_9
Is the depression angle and azimuth angle, h is the height of the remote sensing camera, and P (lambda) is the atmosphereLayer emittance of course, k is a constant of exposure time, D i (lambda) is the light sensitivity, noise is the noise;
and a classification module: the method comprises the steps of implementing remote sensing automatic classification on an image to be corrected, selecting a remote sensing digital image of a preset area according to the classification of the image to be corrected, acquiring a characteristic formulation classification system of the remote sensing digital image, establishing supervision classification in the classification system, training the characteristic, classifying pixels with the same characteristic by adopting a clustering method if the characteristic is not in the supervision classification, and measuring the characteristic;
and a correction module: performing color space conversion aiming at the classification result, converting the image to be corrected from an RGB color space to an LMS color space, performing offset elimination on the image to be corrected by converting the LMS color space to a logarithmic LMS color space, and finally converting the image to be corrected from the logarithmic LMS color space to an lalpha beta color space;
performing linear model brightness and color correction on the corresponding types, and respectively calculating the mean value and variance of each type in the image to be corrected after the lalpha beta color space conversion, wherein the formula is as follows:
Y i (p)′=Y i (p)-μ i1
wherein mu i1 For the image to be corrected, i is the i-th type, Y i (p) pixel values after conversion of the ith type lαβ color space of the image to be corrected, Y i (p)' is the corrected i-th type image element value;
the color correction step is as follows:
storing a reflection spectrum distribution set of the color card in a database, and calculating tristimulus values according to the spectrum reflectivity of the color card to obtain a color true value; calculating a remote sensing value of the spectral reflectivity of a preset color card by using the camera response model; mapping the 3 color components of the image to be corrected onto the 3 color components of a color chart, describing the characteristics of the remote sensing camera by using a linear model to obtain a corrected color image, and carrying out color correction again when the spectrum of the light source and the atmospheric parameters change;
and an output module: and converting the corrected image into an RGB color space after correction, and outputting a corrected image.
CN202310260914.0A 2023-03-17 2023-03-17 Self-correcting digital camera mobile remote sensing system and method Active CN115988334B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310260914.0A CN115988334B (en) 2023-03-17 2023-03-17 Self-correcting digital camera mobile remote sensing system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310260914.0A CN115988334B (en) 2023-03-17 2023-03-17 Self-correcting digital camera mobile remote sensing system and method

Publications (2)

Publication Number Publication Date
CN115988334A CN115988334A (en) 2023-04-18
CN115988334B true CN115988334B (en) 2023-06-13

Family

ID=85970828

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310260914.0A Active CN115988334B (en) 2023-03-17 2023-03-17 Self-correcting digital camera mobile remote sensing system and method

Country Status (1)

Country Link
CN (1) CN115988334B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117788351B (en) * 2024-02-27 2024-05-03 杨凌职业技术学院 Agricultural remote sensing image correction method and system

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111047539A (en) * 2019-12-27 2020-04-21 上海工程技术大学 Fabric image color calibration algorithm based on spectral reflectivity reconstruction

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009010983A (en) * 1996-02-26 2009-01-15 Richard A Holub Method of associating different image display devices, color error detection method, and color measurement device
ATE279075T1 (en) * 2000-01-12 2004-10-15 Univ East Anglia COLOR SIGNAL PROCESSING
US9552518B2 (en) * 2000-07-31 2017-01-24 The United States Of America, As Represented By The Secretary Of The Navy Method of out-of-band correction for multispectral remote sensing
CN102466520B (en) * 2010-11-11 2014-12-17 香港纺织及成衣研发中心 Multispectral imaging color measurement system and imaging signal processing method thereof
JP7023490B2 (en) * 2017-10-20 2022-02-22 株式会社朋栄 High-precision color correction processing method and high-precision color correction processing device
CN109671038B (en) * 2018-12-27 2023-04-28 哈尔滨工业大学 Relative radiation correction method based on pseudo-invariant feature point classification layering
CN115457325A (en) * 2022-09-16 2022-12-09 自然资源部第二海洋研究所 Object and spectrum rule oriented multi-spectral remote sensing image unsupervised classification method

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111047539A (en) * 2019-12-27 2020-04-21 上海工程技术大学 Fabric image color calibration algorithm based on spectral reflectivity reconstruction

Also Published As

Publication number Publication date
CN115988334A (en) 2023-04-18

Similar Documents

Publication Publication Date Title
CN107644416B (en) Real-time dynamic cloud cover inversion method based on foundation cloud picture
CN111553922B (en) Automatic cloud detection method for satellite remote sensing image
CN115988334B (en) Self-correcting digital camera mobile remote sensing system and method
CN109974854B (en) Radiation correction method for frame-type FPI (field programmable Gate array) hyperspectral image
CN113533256B (en) Method, device and equipment for determining spectral reflectivity
CN108765433A (en) One kind is for carrying high-precision leafy area measurement method
CN112529807B (en) Relative radiation correction method and device for satellite image
CN111145351B (en) Minnarert terrain correction model optimization method considering ground feature types
CN110110131B (en) Airplane cable support identification and parameter acquisition method based on deep learning and binocular stereo vision
CN111798509B (en) Method for measuring leaf area index based on hemispherical image method
CN111932452B (en) Infrared image convolution neural network super-resolution method based on visible image enhancement
CN113409379A (en) Method, device and equipment for determining spectral reflectivity
CN116452461A (en) Remote sensing data processing method and device, electronic equipment and storage medium
CN115015258A (en) Crop growth and soil moisture association determination method and related device
CN108291742A (en) Calibrate the heliostat of thermoelectricity solar power plant
CN110738693A (en) ground-based imaging radar multi-angle image registration method
CN108917722B (en) Vegetation coverage degree calculation method and device
CN110765631A (en) Effective imaging pixel-based small target judgment method for infrared radiation characteristic measurement
US12026915B2 (en) Enhanced measurement of photosynthetically active radiation (PAR) and image conversion therefor
CN115546266B (en) Multi-strip airborne laser point cloud registration method based on local normal correlation
CN111179423B (en) Three-dimensional infrared image generation method based on two-dimensional infrared image
CN113029977B (en) Automatic cross radiometric calibration method for wide-field-angle multispectral sensor
CN111595781A (en) Curved surface fitting ground hyperspectral image reflectivity correction method
CN113469899B (en) Optical remote sensing satellite relative radiation correction method based on radiation energy reconstruction
CN113570523A (en) Method for automatic generation and extrapolation of relative radiation correction coefficients for optical images

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant