Disclosure of Invention
The invention aims to provide a remote sensing image ground feature recognition method based on a graph convolution neural network according to a remote sensing satellite imaging technology, based on different remote sensing image training data sets, firstly, ground feature type feature maps in the training data sets are extracted to form feature description sets of all ground feature types, then, a deep convolution neural network is adopted to learn and fuse all the feature maps of all the types in the remote sensing image ground feature description sets, feature descriptions of nodes, edges and the like of the ground feature types are obtained, then, the graph convolution neural network is adopted to carry out node classification model training on the fused graph features, remote sensing image classification model parameters are determined, and finally, accurate recognition of unmarked image ground features is achieved.
In order to achieve the purpose, the invention provides the following technical scheme: a remote sensing image ground object identification method based on a graph convolution neural network comprises the following steps:
step 1: taking a scene remote sensing image, respectively carrying out relevant preprocessing operations including geometric correction, atmospheric correction and image enhancement, converting the color remote sensing image into a gray image or a CIELAB color space under XY coordinates, carrying out simple linear iterative clustering on the gray image or the CIELAB color space, initializing seed points, and generating compact and approximately uniform superpixels;
step 2: based on the generated super-pixel remote sensing image map, creating nodes and edges of the map, and extracting texture features and color features of the image to be used as a map input feature matrix;
and step 3: making labels by combining most voting mechanisms of ensemble learning, if a certain ground object is marked with more than half of the votes, predicting the superpixels as the ground object categories, and if not, rejecting the marks to further form a label data set of the map;
and 4, step 4: automatically extracting the high-resolution remote sensing image characteristic map by using a deep convolutional neural network to obtain node and edge input data about the image map and form a characteristic description set about the remote sensing image;
and 5: training a convolutional neural network model based on a remote sensing image feature description set to obtain an image ground object classification model and classify a test sample.
As a preferred technical solution of the present invention, in the steps 1 to 4, a feature description set of the feature type of the remote sensing image is extracted, and in the step 5, a feature classification model based on a convolution neural network is proposed.
The invention has the beneficial effects that: according to the method, a remote sensing image ground feature class feature description set is constructed by utilizing super-pixel segmentation and most voting mechanisms, approximate portraits of the remote sensing image ground feature class are obtained, and meanwhile, the data size constructed by the same image map is reduced in a large scale, so that the method is beneficial to processing the remote sensing image ground feature classification problem under a large data sample; and finally, training a convolutional neural network through the fused characteristic diagram set so as to achieve the purpose of accurately distinguishing the ground feature types. The invention is very beneficial to the research on the aspects of remote sensing natural disaster monitoring, land coverage type discrimination, urban planning, ecological environment change monitoring and the like.
Detailed Description
The following detailed description of the preferred embodiments of the present invention, taken in conjunction with the accompanying drawings, will make the advantages and features of the invention more readily understood by those skilled in the art, and thus will more clearly and distinctly define the scope of the invention.
Example (b): referring to fig. 1-2, the present invention provides a technical solution: a remote sensing image ground object identification method based on a graph convolution neural network comprises the following steps:
step 1: taking a scene remote sensing image, respectively carrying out relevant preprocessing operations including geometric correction, atmospheric correction and image enhancement, converting the color remote sensing image into a gray image or a CIELAB color space under XY coordinates, carrying out simple linear iterative clustering on the gray image or the CIELAB color space, initializing seed points, and generating compact and approximately uniform superpixels;
step 2: based on the generated super-pixel remote sensing image map, creating nodes and edges of the map, and extracting texture features and color features of the image to be used as a map input feature matrix;
and step 3: making labels by combining most voting mechanisms of ensemble learning, if a certain ground object is marked with more than half of the votes, predicting the superpixels as the ground object categories, and if not, rejecting the marks to further form a label data set of the map;
and 4, step 4: automatically extracting the high-resolution remote sensing image characteristic map by using a deep convolutional neural network to obtain node and edge input data about the image map and form a characteristic description set about the remote sensing image;
and 5: training a convolutional neural network model based on a remote sensing image feature description set to obtain an image ground object classification model and classify a test sample.
In the steps 1-4, a feature description set of the ground feature types of the remote sensing images is extracted, and in the step 5, a ground feature classification model based on a graph convolution neural network is provided.
For convenience of description, terms specific to the present invention are first defined as follows:
the remote sensing image ground object category feature description set comprises:
the feature description set of the remote sensing image ground object category refers to the following steps: based on the feature maps of the map nodes and edges extracted by the depth convolution network, the map feature maps of different ground feature types are extracted from a block image divided by a super pixel to form a remote sensing image ground feature type feature description set based on the maps so as to approximately describe the category information of the image.
The specific method comprises the following steps:
step 1: forming a remote sensing image characteristic description set;
taking a scene remote sensing image to respectively carry out relevant preprocessing operations including geometric correction, atmospheric correction, image enhancement and the like, supposing that the remote sensing image is divided into M blocks, processing the remote sensing image block by block, leading in corresponding real ground object labels of the image together, converting a color image into a gray image under XY coordinates, carrying out simple linear iterative clustering on the gray image, initializing seed points (clustering centers), and uniformly distributing the seed points in the image according to the set number of superpixels; then constructing a distance measurement standard for a feature vector formed by a gray image, carrying out a local clustering process on block image pixels to generate compact and approximately uniform N superpixels, then creating nodes and edges of a map for the generated superpixels, setting a local binary pattern for an image, comparing the superpixels with adjacent superpixels, and storing the result as a binary number to form texture features as features of map input; then, label making is carried out by combining most voting mechanisms, if the number of the ground object marked tickets exceeds half, the super pixel is predicted to be the ground object type, otherwise, marking is refused, and therefore, the remote sensing image ground object identification problem is modeled into a classification problem;
step 2: the process of automatically extracting the remote sensing image feature map set by the deep convolutional neural network comprises the following steps: the feature atlas formation of convolutional neural network automatic extraction assuming K common ground categories can be expressed as
Wherein
Wherein, k is more than or equal to 1 and less than or equal to M to represent the k block remote sensing image, N (k is more than or equal to 1 and less than or equal to N) represents the nth super pixel, and X is CNN (·) to represent the execution of the deep convolution neural network;
and step 3: the remote sensing image surface feature identification and classification process based on the graph convolution neural network comprises the following steps: according to the feature map automatically extracted by the fully-connected convolutional neural network, assuming that the ground object categories are totally K in number, the ground object identification process can be composed of the following steps;
step 3.1: remote sensing image surface feature class characteristic atlas set generated by step 2

K is more than or equal to 1 and less than or equal to M, a fused feature map is generated by connection, a graph convolution neural network is trained, a leave-one-out method is adopted to execute a cross validation process, training parameters theta of a ground feature classification model of the graph convolution neural network are obtained, the number of layers of the graph convolution neural network is 2, an adaptive attention mechanism layer is added behind the graph convolution neural network, each node in the graph can be distributed with different weights according to the features of adjacent nodes, a LOSS function is NLL _ LOSS, log _ softmax function activation is carried out on input parameters, an optimization method Adam optimization function of adaptive learning rate is selected as the optimization function, and the first order of gradient is utilized for optimizationMoment estimation and second moment estimation dynamic adjustment learning rate;
step 3.2: performing a graph convolution operation without an attention mechanism layer on the adaptive feature description set extracted by the graph convolution neural network added with the attention mechanism and the attention feature weight thereof, performing normalization processing, and finally determining the category of each node according to a classification model, wherein the formula description is OpreGCN (-), wherein OpreRepresenting the class to which the output belongs, GCN (-) representing the operation of executing graph convolution neural network;
and 3.3, performing precision operation on the output result and the real ground object type, solving corresponding measurement parameters such as Kappa coefficient, overall precision, confusion matrix and the like, and further judging the model classification effect.
According to the method, a remote sensing image ground feature class feature description set is constructed by utilizing super-pixel segmentation and most voting mechanisms, approximate portraits of the remote sensing image ground feature class are obtained, and meanwhile, the data size constructed by the same image map is reduced in a large scale, so that the method is beneficial to processing the remote sensing image ground feature classification problem under a large data sample; and finally, training a convolutional neural network through the fused characteristic diagram set so as to achieve the purpose of accurately distinguishing the ground feature types. The invention is very beneficial to the research on the aspects of remote sensing natural disaster monitoring, land coverage type discrimination, urban planning, ecological environment change monitoring and the like.
The above examples only show some embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention.