CN112070037B - Road extraction method, device, medium and equipment based on remote sensing image - Google Patents

Road extraction method, device, medium and equipment based on remote sensing image Download PDF

Info

Publication number
CN112070037B
CN112070037B CN202010953874.4A CN202010953874A CN112070037B CN 112070037 B CN112070037 B CN 112070037B CN 202010953874 A CN202010953874 A CN 202010953874A CN 112070037 B CN112070037 B CN 112070037B
Authority
CN
China
Prior art keywords
remote sensing
road
image
distance
sensing image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010953874.4A
Other languages
Chinese (zh)
Other versions
CN112070037A (en
Inventor
陈若男
彭玲
刘玉菲
吕蓓茹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aerospace Information Research Institute of CAS
Original Assignee
Aerospace Information Research Institute of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aerospace Information Research Institute of CAS filed Critical Aerospace Information Research Institute of CAS
Priority to CN202010953874.4A priority Critical patent/CN112070037B/en
Publication of CN112070037A publication Critical patent/CN112070037A/en
Application granted granted Critical
Publication of CN112070037B publication Critical patent/CN112070037B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes
    • G06V20/182Network patterns, e.g. roads or rivers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2415Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Multimedia (AREA)
  • Probability & Statistics with Applications (AREA)
  • Image Analysis (AREA)

Abstract

Provided are a method, device, medium and equipment for extracting a road based on a remote sensing image. The method comprises the following steps: drawing a road in the remote sensing image, and converting the road into a two-classification image; dividing the remote sensing image and the binary image to manufacture a remote sensing image sample and a binary image sample; carrying out edge symbol distance transformation on the binary image samples to obtain edge symbol distance image samples corresponding to the binary image samples one to one; training a road extraction model by using the corresponding remote sensing image sample, the binary image sample and the edge symbol distance image sample; and carrying out road extraction on the remote sensing image by using the trained road extraction model. When the road is extracted, the road continuity performance is obviously improved, and most of the shielding problems can be overcome.

Description

基于遥感影像的道路提取方法、装置、介质及设备Road extraction method, device, medium and equipment based on remote sensing image

技术领域technical field

本发明涉及属于信息技术领域,尤其涉及基于遥感影像的道路提取方法、装置、介质及设备。The invention belongs to the field of information technology, and in particular, relates to a road extraction method, device, medium and equipment based on remote sensing images.

背景技术Background technique

道路信息是最重要的地理信息元素之一,在自动驾驶、灾害应急响应等方面应用中发挥着重要作用。随着遥感技术的发展和深度学习技术的成熟,基于cnn的高时空分辨率的遥感图像道路提取算法层出不穷,允许对道路进行大规模监测。故而遥感影像数据迅速成为路网自动提取的重要数据源,从遥感图像中自动提取道路的算法研究已成为焦点。Road information is one of the most important geographic information elements and plays an important role in applications such as autonomous driving and disaster emergency response. With the development of remote sensing technology and the maturity of deep learning technology, road extraction algorithms from remote sensing images with high temporal and spatial resolution based on CNN emerge in an endless stream, allowing large-scale monitoring of roads. Therefore, remote sensing image data has quickly become an important data source for automatic extraction of road networks, and the research on algorithms for automatic extraction of roads from remote sensing images has become the focus.

但目前的研究主要集中在城市地区的道路提取,由于偏远地区的道路往往狭窄、宽度多变、存在严重树冠、阴影遮挡等问题,这些针对城市地区的道路提取算法在偏远地区往往效果差强人意,尤其是道路不连续性和破碎的问题会很严重。However, the current research mainly focuses on road extraction in urban areas. Because roads in remote areas are often narrow, variable in width, and have serious tree canopy, shadow occlusion and other problems, these road extraction algorithms for urban areas are often unsatisfactory in remote areas, especially The problem of road discontinuity and fragmentation can be serious.

发明内容SUMMARY OF THE INVENTION

本发明旨在解决上面描述的问题。具体地,本发明提供一种基于遥感影像的道路提取方法、装置、介质及设备。The present invention aims to solve the problems described above. Specifically, the present invention provides a method, device, medium and device for road extraction based on remote sensing images.

根据本文的第一方面,提供一种基于遥感影像的道路提取方法,包括:According to the first aspect of this paper, a road extraction method based on remote sensing images is provided, including:

对遥感影像中的道路进行绘制,并转换为二分类图像;Draw roads in remote sensing images and convert them into binary images;

对遥感影像及二分类图像进行分割,制作遥感影像样本和二分类图像样本,遥感影像样本与二分类图像样本一一对应;Segment remote sensing images and binary images to produce remote sensing image samples and binary image samples, and remote sensing image samples and binary image samples correspond one-to-one;

对二分类图像样本进行边缘符号距离变换,得到与二分类图像样本一一对应的边缘符号距离图像样本;Perform edge symbol distance transformation on the two-class image samples to obtain edge-symbol distance image samples corresponding to the two-class image samples one-to-one;

使用对应的遥感影像样本、二分类图像样本、边缘符号距离图像样本训练道路提取模型;Use the corresponding remote sensing image samples, binary image samples, and edge symbol distance image samples to train the road extraction model;

使用训练后的道路提取模型对遥感影像进行道路提取。Use the trained road extraction model to extract roads from remote sensing images.

对二分类图像样本进行边缘符号距离变换包括:Performing edge signed distance transformation on binary image samples includes:

确定所述二分类图像样本中的每一像素点到位于道路边缘上的最近点的距离Di,基于Di确定全部像素点的边缘符号距离。Determine the distance D i from each pixel point in the binary image sample to the closest point located on the road edge, and determine the edge symbol distance of all pixel points based on D i .

Figure BDA0002677947010000021
其中,xi为像素点位置,xj为道路边缘上与xi最近的像素点位置,ED为欧几里得距离。
Figure BDA0002677947010000021
Among them, x i is the pixel position, x j is the pixel position closest to x i on the edge of the road, and ED is the Euclidean distance.

基于Di确定全部像素点的边缘符号距离包括:Determining the edge sign distance of all pixels based on D i includes:

边缘符号距离为BSDi,则

Figure BDA0002677947010000022
其中,Htanh为HardTanh函数,α为比例系数,F为前景区域,B分别背景区域。The edge signed distance is BSD i , then
Figure BDA0002677947010000022
Among them, Htanh is the HardTanh function, α is the scale coefficient, F is the foreground area, and B is the background area.

道路提取模型包括ResNet框架,距离回归任务分支,分类任务分支。The road extraction model includes the ResNet framework, the distance regression task branch, and the classification task branch.

使用对应的遥感影像样本、二分类图像样本、边缘符号距离图像样本训练道路提取模型包括:Using the corresponding remote sensing image samples, binary image samples, and edge symbol distance image samples to train the road extraction model includes:

将遥感影像样本输入ResNet框架,获取遥感影像特征图;Input remote sensing image samples into the ResNet framework to obtain remote sensing image feature maps;

将遥感影像特征图输入距离回归任务分支,距离回归任务分支输出结果与边缘符号距离图像样本通过第一损失函数计算第一Loss;The remote sensing image feature map is input into the distance regression task branch, and the output result of the distance regression task branch and the edge symbol distance image sample are used to calculate the first Loss through the first loss function;

将距离回归任务分支中获得的浅层特征和深层特征输入分类任务分支,分类任务分支输出结果与二分类图像样本通过第二损失函数计算第二Loss。The shallow features and deep features obtained in the distance regression task branch are input into the classification task branch, and the output result of the classification task branch and the binary image sample are calculated by the second loss function through the second loss function.

基于遥感影像的道路提取方法,还包括:The road extraction method based on remote sensing images also includes:

基于第一Loss和第二Loss,确定最终Loss,使用最终Loss训练道路提取模型。Based on the first Loss and the second Loss, the final Loss is determined, and the road extraction model is trained using the final Loss.

根据本文的另一方面,提供一种基于遥感影像的道路提取装置,包括:According to another aspect of this article, a road extraction device based on remote sensing images is provided, comprising:

二分类图像制作模块,用于对遥感影像中的道路进行绘制,并转换为二分类图像;The two-class image production module is used to draw the road in the remote sensing image and convert it into a two-class image;

样本制作模块,用于对遥感影像及二分类图像进行分割,制作遥感影像样本和二分类图像样本,遥感影像样本与二分类图像样本一一对应;The sample making module is used to segment the remote sensing image and the two-class image, and produce the remote sensing image sample and the two-class image sample, and the remote-sensing image sample and the two-class image sample are in one-to-one correspondence;

边缘符号距离变换模块,用于对二分类图像样本进行边缘符号距离变换,得到与二分类图像样本一一对应的边缘符号距离图像样本;The edge symbol distance transformation module is used to perform edge symbol distance transformation on the two-class image samples, and obtain the edge symbol distance image samples corresponding to the two-class image samples one-to-one;

模型训练模块,用于使用对应的遥感影像样本、二分类图像样本、边缘符号距离图像样本训练道路提取模型;The model training module is used to train the road extraction model using the corresponding remote sensing image samples, binary image samples, and edge symbol distance image samples;

道路提取模块,用于使用训练后的道路提取模型对遥感影像进行道路提取。The road extraction module is used to extract roads from remote sensing images using the trained road extraction model.

根据本文的另一方面,提供一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被执行时实现基于遥感影像的道路提取方法的步骤。According to another aspect of this document, there is provided a computer-readable storage medium on which a computer program is stored, and when the computer program is executed, implements the steps of a road extraction method based on a remote sensing image.

根据本文的另一方面,提供一种计算机设备,包括处理器、存储器和存储于所述存储器上的计算机程序,处理器执行所述计算机程序时实现基于遥感影像的道路提取方法的步骤。According to another aspect of this document, a computer device is provided, comprising a processor, a memory, and a computer program stored on the memory, and the processor implements the steps of a road extraction method based on remote sensing images when the processor executes the computer program.

本发明通过对遥感影像的二分类图像进行边缘符号距离变换,获取边缘符号距离图像样本,并使用遥感影像样本、二分类图像样本、边缘符号距离图像样本对多分枝道路提取模型进行训练。边缘符号距离图像中的实值距离信息可以促进模型更好地识别道路边界,并通过学习到边界的距离特征来更好的进行道路像素分类,而不是仅限于光谱特征学习,以达到修正形状畸形或破碎道路的目的。The present invention obtains edge symbol distance image samples by performing edge symbol distance transformation on binary images of remote sensing images, and uses remote sensing image samples, binary classification image samples, and edge symbol distance image samples to train a multi-branch road extraction model. The real-valued distance information in the edge symbol distance image can promote the model to better identify the road boundary, and better classify the road pixels by learning the distance features of the boundary, rather than limited to the spectral feature learning, to correct the shape deformity Or break the purpose of the road.

参照附图来阅读对于示例性实施例的以下描述,本发明的其他特性特征和优点将变得清晰。Other characteristic features and advantages of the present invention will become apparent upon reading the following description of exemplary embodiments with reference to the accompanying drawings.

附图说明Description of drawings

并入到说明书中并且构成说明书的一部分的附图示出了本发明的实施例,并且与描述一起用于解释本发明的原理。在这些附图中,类似的附图标记用于表示类似的要素。下面描述中的附图是本发明的一些实施例,而不是全部实施例。对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,可以根据这些附图获得其他的附图。The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention. In the figures, like reference numerals are used to refer to like elements. The drawings in the following description are some, but not all, embodiments of the invention. For those of ordinary skill in the art, other drawings can be obtained from these drawings without creative effort.

图1为根据一示例性实施例示出的基于遥感影像的道路提取方法的流程图。FIG. 1 is a flowchart of a road extraction method based on remote sensing images according to an exemplary embodiment.

图2为根据一示例性实施例示出的遥感影像示意图。FIG. 2 is a schematic diagram of a remote sensing image according to an exemplary embodiment.

图3为根据一示例性实施例示出的二分类图像示意图。FIG. 3 is a schematic diagram of a two-category image according to an exemplary embodiment.

图4为根据一示例性实施例示出的边缘符号距离图像示意图。FIG. 4 is a schematic diagram of an edge symbol distance image according to an exemplary embodiment.

图5为根据一示例性实施例示出的道路提取模型示意图。FIG. 5 is a schematic diagram of a road extraction model according to an exemplary embodiment.

图6为根据一示例性实施例示出的道路提取模型的预测结果示意图。FIG. 6 is a schematic diagram illustrating a prediction result of a road extraction model according to an exemplary embodiment.

图7为根据一示例性实施例示出的基于遥感影像的道路提取装置的框图。FIG. 7 is a block diagram of an apparatus for extracting roads based on remote sensing images according to an exemplary embodiment.

图8是根据一示例性实施例示出的一种用于基于遥感影像的道路提取的计算机设备的框图。FIG. 8 is a block diagram of a computer device for road extraction based on remote sensing images, according to an exemplary embodiment.

具体实施方式Detailed ways

为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互任意组合。In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention. It should be noted that, the embodiments in the present application and the features in the embodiments may be arbitrarily combined with each other if there is no conflict.

图1是根据一示例性实施例示出的基于遥感影像的道路提取方法的流程图。参考图1,基于遥感影像的道路提取方法,包括:FIG. 1 is a flowchart of a method for extracting roads based on remote sensing images according to an exemplary embodiment. Referring to Figure 1, the road extraction method based on remote sensing images includes:

步骤S11:对遥感影像中的道路进行绘制,并转换为二分类图像;Step S11: draw the road in the remote sensing image and convert it into a binary image;

步骤S12:对遥感影像及二分类图像进行分割,制作遥感影像样本和二分类图像样本,遥感影像样本与二分类图像样本一一对应;Step S12 : segment the remote sensing image and the second-class image, and create the remote-sensing image sample and the second-class image sample, and the remote-sensing image sample and the second-class image sample are in one-to-one correspondence;

步骤S13:对二分类图像样本进行边缘符号距离变换,得到与二分类图像样本一一对应的边缘符号距离图像样本;Step S13: performing edge symbol distance transformation on the two-category image samples to obtain edge symbol distance image samples corresponding to the two-category image samples one-to-one;

步骤S14:使用对应的遥感影像样本、二分类图像样本、边缘符号距离图像样本训练道路提取模型;Step S14: using corresponding remote sensing image samples, two-class image samples, and edge symbol distance image samples to train a road extraction model;

步骤S15:使用训练后的道路提取模型对遥感影像进行道路提取。Step S15: Use the trained road extraction model to extract roads from the remote sensing images.

在步骤S11中,对遥感影像中的道路对象进行绘制,可以选择绘制工具如Arcgis、labelme等。以Arcgis为例,在遥感影像图中新建一个面图层要素,并赋予与原遥感影像相同的地理坐标系,然后通过编辑工具,人工目视解译对遥感影像中的道路进行勾绘,选择适当的缩放比例,沿着边缘像素进行绘制,最终生成shapefile格式的矢量文件。而后,将矢量图转换为栅格图,获得二值化的栅格影像,也就是二分类图像,二分类图像中0为背景,1为道路。In step S11, the road objects in the remote sensing image are drawn, and drawing tools such as ArcGIS, labelme, etc. can be selected. Taking ArcGIS as an example, create a new polygon layer element in the remote sensing image, and assign the same geographic coordinate system as the original remote sensing image, and then use the editing tool to manually interpret the road in the remote sensing image to delineate, select Appropriate scaling, drawing along edge pixels, and finally generating a vector file in shapefile format. Then, the vector image is converted into a raster image to obtain a binarized raster image, that is, a binary image. In the binary image, 0 is the background and 1 is the road.

在步骤S12中,设置样本分割规则,包括单个样本的尺寸大小和相邻样本之间的重叠占比两个方面。根据设置好的样本分割规则,对遥感影像和二分类图像进行分割,可以得到多个分割后的遥感影像图像样本,和同样多个二分类图像样本,作为后续道路提取模型的训练样本。In step S12, a sample segmentation rule is set, including the size of a single sample and the overlap ratio between adjacent samples. According to the set sample segmentation rules, the remote sensing image and the binary image are segmented, and multiple segmented remote sensing image image samples and the same multiple binary image samples can be obtained as the training samples of the subsequent road extraction model.

在步骤S13中,对二分类图像样本进行边缘符号距离变换,得到与二分类图像样本一一对应的边缘符号距离图像样本。当仅使用二分类图像对模型进行训练时,深度分类模型确定一个像素是属于道路类别还是非道路类别,会忽视道路像素之间的高度空间分布特征相关性,使得道路提取结果往往将被遮挡的部分像素归为非道路,导致道路破碎不连续的问题。In step S13, edge-symbol distance transformation is performed on the two-class image samples to obtain edge-symbol distance image samples corresponding to the two-class image samples one-to-one. When only two-class images are used to train the model, the deep classification model determines whether a pixel belongs to the road category or the non-road category, ignoring the high spatial distribution feature correlation between road pixels, so that the road extraction results will often be occluded. Some pixels are classified as non-roads, leading to the problem of road fragmentation and discontinuity.

因此本文引入边缘符号距离,在一实施例中,对二分类图像样本进行边缘符号距离变换包括:Therefore, the edge symbol distance is introduced in this paper. In one embodiment, performing edge symbol distance transformation on the binary image sample includes:

确定所述二分类图像样本中的每一像素点到位于道路边缘上的最近点的距离Di,基于Di确定全部像素点的边缘符号距离。Determine the distance D i from each pixel point in the binary image sample to the closest point located on the road edge, and determine the edge symbol distance of all pixel points based on D i .

受到符号距离变换SDT的启发,给定一个像素点位置xi,其符号距离值SDTi为:Inspired by the signed distance transformation SDT, given a pixel position x i , its signed distance value SDT i is:

Figure BDA0002677947010000051
Figure BDA0002677947010000051

式中,ED为欧几里得距离,F和B分别为前景区域和背景区域。符号距离值SDTi表示一个像素点到其最接近的不同类别像素点的距离。where ED is the Euclidean distance, and F and B are the foreground and background regions, respectively. The signed distance value SDT i represents the distance from a pixel to its closest pixel of different categories.

由此,对于给定的像素点到位于道路边缘上的最近像素点的距离,可以定义为Di

Figure BDA0002677947010000061
其中,xi为像素点位置,xj为道路边缘上与xi最近的像素点位置,ED为欧几里得距离。Thus, the distance from a given pixel to the nearest pixel on the edge of the road can be defined as D i ,
Figure BDA0002677947010000061
Among them, x i is the pixel position, x j is the pixel position closest to x i on the edge of the road, and ED is the Euclidean distance.

边缘符号距离BSDi

Figure BDA0002677947010000062
其中,Htanh为HardTanh函数,α为比例系数,F为前景区域,B分别背景区域。由于在二分类图像上进行计算,前景区域为道路,背景区域为非道路。edge sign distance BSD i ,
Figure BDA0002677947010000062
Among them, Htanh is the HardTanh function, α is the scale coefficient, F is the foreground area, and B is the background area. Since the calculation is performed on a binary image, the foreground area is a road, and the background area is a non-road.

在上式中,将距离Di通过对数映射实现缩放,使得边缘符号距离对距离变化的敏感度随着像素点与道路边缘距离的增大而降低,达到将关注度集中在道路边缘及相邻区域,对距离道路边缘很远的背景区域的关注度弱化。然后,使用HardTanh函数和比例系数α将距离值归一化到[-1,1],加快模型的训练速度的同时,进一步削弱对远离道路的背景像素的关注,从而过滤掉一些噪声。赋予道路像素的边缘符号距离为正,非道路像素边缘符号距离为负,而道路边界像素的边缘符号距离值为零,这将有效地帮助模型更好地区分道路和非道路。图2为根据一示例性实施例示出的遥感影像示意图。图3为根据一示例性实施例示出的二分类图像示意图。图4为根据一示例性实施例示出的边缘符号距离图像示意图。可见,遥感影像示意图,二分类图像,边缘符号距离图像具有一一对应的关系。In the above formula, the distance D i is scaled by logarithmic mapping, so that the sensitivity of the edge symbol distance to the distance change decreases with the increase of the distance between the pixel point and the road edge, so that the attention can be concentrated on the road edge and the relative distance. Neighboring regions, the attention to background regions far away from the road edge is weakened. Then, the distance value is normalized to [-1, 1] using the HardTanh function and the scale coefficient α, which speeds up the training speed of the model and further weakens the focus on background pixels far away from the road, thereby filtering out some noise. The edge sign distance assigned to road pixels is positive, non-road pixels edge sign distance is negative, and the edge sign distance value of road boundary pixels is zero, which will effectively help the model to better distinguish between roads and non-roads. FIG. 2 is a schematic diagram of a remote sensing image according to an exemplary embodiment. FIG. 3 is a schematic diagram of a two-category image according to an exemplary embodiment. FIG. 4 is a schematic diagram of an edge symbol distance image according to an exemplary embodiment. It can be seen that the schematic diagram of the remote sensing image, the two-class image, and the edge symbol distance image have a one-to-one correspondence.

在步骤S14中,使用对应的遥感影像样本、二分类图像样本、边缘符号距离图像样本训练道路提取模型。将步骤S11至步骤S13中制作好的遥感影像、二分类图像、边缘符号距离图像作为训练样本,对道路提取模型进行训练。In step S14, a road extraction model is trained using the corresponding remote sensing image samples, binary classification image samples, and edge symbol distance image samples. The road extraction model is trained by using the remote sensing images, two-class images, and edge symbol distance images prepared in steps S11 to S13 as training samples.

在一实施例中,道路提取模型包括ResNet框架,距离回归任务分支,分类任务分支。In one embodiment, the road extraction model includes a ResNet framework, a distance regression task branch, and a classification task branch.

图5为根据一示例性实施例示出的道路提取模型示意图。参考图5,图中51为ResNet框架,52为距离回归任务分支,53为分类任务分支。FIG. 5 is a schematic diagram of a road extraction model according to an exemplary embodiment. Referring to Figure 5, 51 in the figure is the ResNet framework, 52 is the distance regression task branch, and 53 is the classification task branch.

使用对应的遥感影像样本、二分类图像样本、边缘符号距离图像样本训练道路提取模型包括:Using the corresponding remote sensing image samples, binary image samples, and edge symbol distance image samples to train the road extraction model includes:

将遥感影像样本输入ResNet框架,获取遥感影像特征图;Input remote sensing image samples into the ResNet framework to obtain remote sensing image feature maps;

将遥感影像特征图输入距离回归任务分支,距离回归任务分支输出结果与边缘符号距离图像样本通过第一损失函数计算第一Loss;The remote sensing image feature map is input into the distance regression task branch, and the output result of the distance regression task branch and the edge symbol distance image sample are used to calculate the first Loss through the first loss function;

将距离回归任务分支中获得的浅层特征和深层特征输入分类任务分支,分类任务分支输出结果与二分类图像样本通过第二损失函数计算第二Loss。The shallow features and deep features obtained in the distance regression task branch are input into the classification task branch, and the output result of the classification task branch and the binary image sample are calculated by the second loss function through the second loss function.

基于第一Loss和第二Loss,确定最终Loss,使用最终Loss训练道路提取模型。Based on the first Loss and the second Loss, the final Loss is determined, and the road extraction model is trained using the final Loss.

下面结合图5,对道路提取模型进行说明。The road extraction model will be described below with reference to FIG. 5 .

在本实施例中,选取ResNet框架为主干网,考虑到森林交界道路通常宽度较小,像素较少,模型需要保持输入图像的高频细节。为此,将ResNet框架最后两个残差块的stride改为1,可以得到输入图像的1/8大小的特征图。此外,使用扩张卷积来扩大卷积层的感受野,使空间上下文信息更丰富。将遥感影像样本(图中5c)输入ResNet框架,然后将获得的遥感影像特征图传入52(距离回归任务分支)。In this embodiment, the ResNet framework is selected as the backbone network. Considering that the forest border road is usually small in width and has few pixels, the model needs to maintain the high-frequency details of the input image. To this end, changing the stride of the last two residual blocks of the ResNet framework to 1 can obtain a feature map of 1/8 size of the input image. In addition, dilated convolutions are used to expand the receptive field of convolutional layers, making the spatial context information richer. Input the remote sensing image sample (5c in the figure) into the ResNet framework, and then pass the obtained remote sensing image feature map into 52 (distance regression task branch).

在距离回归任务分支中,首先采用3*3的卷积层(Conv)对主干网生成的遥感影像特征图进行降维。然后,采用批处理归一化层(BN),将每批输入的分布归一化为标准正态分布,以减少内部协变量偏移量,加速学习过程,最后采用Tanh作为激活函数,生成浅层特征图。然后将浅层特征图依次经过1*1卷积层(Conv)和激活函数Tanh操作,生成深层特征图,得到低分辨率的距离值预测结果。Tanh函数用于将距离值限制在[-1,1]范围内,从而保持与边缘符号距离变换得到样本(图中5a)标记值范围一致。然后进行上采样,得到与遥感影像样本(图中5c)一样尺寸的边缘符号距离预测结果(Outputs-A)。在距离回归任务分支中以边缘符号距离图像样本作为真值,采用L1损失函数计算第一Loss(图中Loss-1)。In the distance regression task branch, firstly, a 3*3 convolutional layer (Conv) is used to reduce the dimension of the remote sensing image feature map generated by the backbone network. Then, a batch normalization layer (BN) is used to normalize the distribution of each batch of inputs to a standard normal distribution to reduce the internal covariate offset and speed up the learning process, and finally use Tanh as the activation function to generate shallow Layer feature map. Then, the shallow feature map is sequentially operated by a 1*1 convolution layer (Conv) and the activation function Tanh to generate a deep feature map, and a low-resolution distance value prediction result is obtained. The Tanh function is used to limit the distance value to the range of [-1, 1], so as to keep the label value range of the sample (5a in the figure) consistent with the edge symbol distance transformation. Then perform up-sampling to obtain the edge symbol distance prediction result (Outputs-A) of the same size as the remote sensing image sample (5c in the figure). In the distance regression task branch, the edge-signed distance image samples are used as the ground truth, and the L1 loss function is used to calculate the first Loss (Loss-1 in the figure).

对于分类任务分支(图中53)中,直接将从距离回归任务分支中获得浅层特征和深层特征进行连接操作,输入分类任务分支,将距离回归任务分支中生成的浅层特征图和深层特征图在距离回归任务和二分类任务这两个分支之间共享,以实现距离特征和语义特征的融合。然后输入3*3卷积层、批处理归一化层和ReLU激活层以生成语义特征图。再通过1*1卷积层得到分类概率图。对分类概率图进行上采样,得到与遥感影像样本一样尺寸的分类预测结果(Outputs-B)。分类任务分支中,以二分值图像样本(图中5b)作为真值,采用交叉熵损失函数计算第二Loss(图中Loss-2)。For the classification task branch (53 in the figure), connect the shallow features and deep features directly from the distance regression task branch, input the classification task branch, and combine the shallow feature map and deep feature generated in the distance regression task branch. The graph is shared between the two branches, distance regression task and binary classification task, to achieve the fusion of distance features and semantic features. Then input 3*3 convolutional layers, batch normalization layers and ReLU activation layers to generate semantic feature maps. Then, the classification probability map is obtained through the 1*1 convolutional layer. The classification probability map is up-sampled to obtain the classification prediction results (Outputs-B) of the same size as the remote sensing image samples. In the classification task branch, the binary image sample (5b in the figure) is used as the true value, and the cross-entropy loss function is used to calculate the second Loss (Loss-2 in the figure).

如上所述,该模型采用了多任务训练策略,回归任务分支采用L1损失函数,第一Loss为:

Figure BDA0002677947010000081
其中,N表示像素的总个数,BSDgt i,表示像素i的真值,BSDi为预测的边缘符号距离值。分类任务分支采用交叉熵损失函数,第二Loss为:
Figure BDA0002677947010000082
其中N表示像素的总个数,yi表示真值的类别,pi表示预测值的类别。As mentioned above, the model adopts a multi-task training strategy, and the regression task branch adopts the L1 loss function. The first Loss is:
Figure BDA0002677947010000081
Among them, N represents the total number of pixels, BSD gt i represents the true value of pixel i, and BSD i represents the predicted edge symbol distance value. The classification task branch adopts the cross entropy loss function, and the second Loss is:
Figure BDA0002677947010000082
where N represents the total number of pixels, yi represents the category of the true value, and p i represents the category of the predicted value.

多任务的最终Loss计算为:Lfinal=Lbsd+λ×LclsThe final Loss of multitasking is calculated as: L final =L bsd +λ×L cls .

其中,其中λ是一个超参数,用于平衡两种类型的损失之间的量级差异,也可用于控制分类和回归任务的侧重比例。where λ is a hyperparameter that balances the magnitude difference between the two types of losses and can also be used to control the weighting ratio for classification and regression tasks.

使用最终Loss对道路提取模型进行训练,直至收敛,并在对模型进行验证后,将道路提取模型用于道路的提取。The road extraction model is trained using the final Loss until convergence, and after the model is validated, the road extraction model is used for road extraction.

从整体上看,距离回归任务分支可以看作是对分类任务分支起到中间监督作用。Overall, the distance regression task branch can be seen as an intermediate supervision for the classification task branch.

由以上描述,本文通过对遥感影像的二分类图像进行边缘符号距离变换,获取边缘符号距离图像样本,并使用遥感影像样本、二分类图像样本、边缘符号距离图像样本对多分枝道路提取模型进行训练。边缘符号距离图像中的实值距离信息可以促进模型更好地识别道路边界,并通过学习到边界的距离特征来更好的进行道路像素分类,而不是仅限于光谱特征学习,以达到修正形状畸形或破碎道路的目的。From the above description, this paper obtains edge symbol distance image samples by performing edge symbol distance transformation on binary images of remote sensing images, and uses remote sensing image samples, binary image samples, and edge symbol distance image samples to train the multi-branch road extraction model. . The real-valued distance information in the edge symbol distance image can promote the model to better identify the road boundary, and better classify the road pixels by learning the distance features of the boundary, rather than limited to the spectral feature learning, to correct the shape deformity Or break the purpose of the road.

图6是根据一示例性实施例示出的道路提取模型的预测结果示意图。61为遥感影像,62为道路的真值,63为仅使用二分类进行预测的结果,64为使用边缘符号距离预测的结果。参考图6,本文提供的基于遥感影像的道路提取方法,在道路提取模型中引入距离回归任务作监督,在提取道路时,对道路连续性性能改善明显,能够克服大部分的遮挡问题。Fig. 6 is a schematic diagram showing a prediction result of a road extraction model according to an exemplary embodiment. 61 is the remote sensing image, 62 is the ground truth of the road, 63 is the prediction result using only binary classification, and 64 is the prediction result using edge sign distance. Referring to Figure 6, the road extraction method based on remote sensing images provided in this paper introduces the distance regression task into the road extraction model for supervision. When extracting roads, the road continuity performance is significantly improved, and most of the occlusion problems can be overcome.

图7为根据一示例性实施例示出的基于遥感影像的道路提取装置的框图。参考图7,基于遥感影像的道路提取装置包括:二分类图像制作模块701,样本制作模块702,边缘符号距离变换模块703,模型训练模块704,道路提取模块705。FIG. 7 is a block diagram of an apparatus for extracting roads based on remote sensing images according to an exemplary embodiment. Referring to FIG. 7 , a road extraction device based on remote sensing images includes: a two-class image production module 701 , a sample production module 702 , an edge symbol distance transformation module 703 , a model training module 704 , and a road extraction module 705 .

该二分类图像制作模块701被配置为用于对遥感影像中的道路进行绘制,并转换为二分类图像。The two-class image making module 701 is configured to draw the road in the remote sensing image and convert it into a two-class image.

该样本制作模块702被配置为用于对所述遥感影像及所述二分类图像进行分割,制作遥感影像样本和二分类图像样本,所述遥感影像样本与所述二分类图像样本一一对应。The sample making module 702 is configured to segment the remote sensing image and the two-class image, and create a remote-sensing image sample and a two-class image sample, and the remote-sensing image sample corresponds to the two-class image sample one-to-one.

该边缘符号距离变换模块703被配置为用于对所述二分类图像样本进行边缘符号距离变换,得到与所述二分类图像样本一一对应的边缘符号距离图像样本。The edge symbol distance transformation module 703 is configured to perform edge symbol distance transformation on the two-class image samples to obtain edge symbol distance image samples one-to-one corresponding to the two-class image samples.

该模型训练模块704被配置为用于使用对应的所述遥感影像样本、所述二分类图像样本、所述边缘符号距离图像样本训练道路提取模型。The model training module 704 is configured to train a road extraction model using the corresponding remote sensing image samples, the binary image samples, and the edge symbol distance image samples.

该道路提取模块705被配置为用于使用训练后的道路提取模型对遥感影像进行道路提取。The road extraction module 705 is configured to perform road extraction from the remote sensing image using the trained road extraction model.

图8是根据一示例性实施例示出的一种用于基于遥感影像的道路提取的计算机设备800的框图。例如,计算机设备800可以被提供为一服务器。参照图8,计算机设备800包括处理器801,处理器的个数可以根据需要设置为一个或者多个。计算机设备800还包括存储器802,用于存储可由处理器801的执行的指令,例如应用程序。存储器的个数可以根据需要设置一个或者多个。其存储的应用程序可以为一个或者多个。处理器801被配置为执行指令,以执行基于遥感影像的道路提取的方法,包括:FIG. 8 is a block diagram of a computer device 800 for road extraction based on remote sensing images, according to an exemplary embodiment. For example, computer device 800 may be provided as a server. Referring to FIG. 8 , the computer device 800 includes a processor 801, and the number of the processors can be set to one or more as required. Computer device 800 also includes memory 802 for storing instructions executable by processor 801, such as application programs. The number of memories can be set to one or more as required. It can store one or more applications. The processor 801 is configured to execute instructions to perform a method for road extraction based on remote sensing images, including:

对遥感影像中的道路进行绘制,并转换为二分类图像;Draw roads in remote sensing images and convert them into binary images;

对所述遥感影像及所述二分类图像进行分割,制作遥感影像样本和二分类图像样本,所述遥感影像样本与所述二分类图像样本一一对应;Segmenting the remote sensing image and the second-class image to create a remote-sensing image sample and a second-class image sample, where the remote-sensing image sample corresponds to the second-class image sample one-to-one;

对所述二分类图像样本进行边缘符号距离变换,得到与所述二分类图像样本一一对应的边缘符号距离图像样本;Performing edge symbol distance transformation on the two-class image samples to obtain edge symbol distance image samples corresponding to the two-class image samples one-to-one;

使用对应的所述遥感影像样本、所述二分类图像样本、所述边缘符号距离图像样本训练道路提取模型;Using the corresponding remote sensing image samples, the two-class image samples, and the edge symbol distance image samples to train a road extraction model;

使用训练后的道路提取模型对遥感影像进行道路提取。Use the trained road extraction model to extract roads from remote sensing images.

本领域技术人员应明白,本文的实施例可提供为方法、装置(设备)、或计算机程序产品。因此,本文可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本文可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质上实施的计算机程序产品的形式。计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质,包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质等。此外,本领域普通技术人员公知的是,通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据,并且可包括任何信息递送介质。As will be appreciated by those skilled in the art, the embodiments herein may be provided as a method, an apparatus (apparatus), or a computer program product. Accordingly, this document may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this document may take the form of a computer program product embodied on one or more computer-usable storage media having computer-usable program code embodied therein. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data , including but not limited to RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, magnetic tape, magnetic disk storage or other magnetic storage devices, or may be used for Any other medium that stores desired information and can be accessed by a computer, etc. In addition, communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and can include any information delivery media, as is well known to those of ordinary skill in the art .

本文是参照根据本文实施例的方法、装置(设备)和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。Described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (apparatus) and computer program products according to embodiments herein. It will be understood that each flow and/or block in the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.

这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The means implements the functions specified in one or more of the flowcharts and/or one or more blocks of the block diagrams

这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.

在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括……”限定的要素,并不排除在包括所述要素的物品或者设备中还存在另外的相同要素。As used herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that an article or device comprising a list of elements includes not only those elements, but also others not expressly listed elements, or elements inherent to the article or equipment. Without further limitation, an element defined by the phrase "comprising" does not preclude the presence of additional identical elements in the article or device comprising said element.

尽管已描述了本文的优选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例作出另外的变更和修改。所以,所附权利要求意欲解释为包括优选实施例以及落入本文范围的所有变更和修改。While the preferred embodiments have been described herein, additional changes and modifications to these embodiments may occur to those skilled in the art once the basic inventive concepts are known. Therefore, the appended claims are intended to be construed to include the preferred embodiment and all changes and modifications that fall within the scope of this document.

显然,本领域的技术人员可以对本文进行各种改动和变型而不脱离本文的精神和范围。这样,倘若本文的这些修改和变型属于本文权利要求及其等同技术的范围之内,则本文的意图也包含这些改动和变型在内。It will be apparent to those skilled in the art that various modifications and variations can be made in this document without departing from the spirit and scope of this document. Thus, provided that such modifications and variations herein come within the scope of the claims herein and their equivalents, it is intended that such modifications and variations are also included herein.

Claims (7)

1. The road extraction method based on the remote sensing image is characterized by comprising the following steps:
drawing a road in the remote sensing image, and converting the road into a two-classification image;
dividing the remote sensing image and the two classified images to manufacture a remote sensing image sample and two classified image samples, wherein the remote sensing image sample corresponds to the two classified image samples one to one;
performing edge symbol distance conversion on the two classified image samples to obtain edge symbol distance image samples corresponding to the two classified image samples one to one;
training a road extraction model by using the corresponding remote sensing image sample, the two classification image samples and the edge symbol distance image sample;
carrying out road extraction on the remote sensing image by using the trained road extraction model;
the performing edge-symbol distance transformation on the two classified image samples comprises:
determining a distance D from each pixel point in the two classified image samples to a closest point located on a road edge i Based on D i Determining the edge symbol distance of all pixel points;
Figure FDA0003765093330000011
wherein x is i Is the pixel location, x j On the road edge with x i ED is the Euclidean distance at the position of the nearest pixel point;
the base is based on D i Determining the edge symbol distances of all the pixel points comprises:
edge symbol distance BSD i Then, then
Figure FDA0003765093330000012
Wherein Htanh is a HardTanh function, alpha is a proportionality coefficient, F is a foreground area, and B is a background area.
2. The method for extracting a road based on remote sensing images as claimed in claim 1, wherein the road extraction model comprises a ResNet frame, a distance regression task branch and a classification task branch.
3. The method of claim 2, wherein the training of the road extraction model using the corresponding remote-sensing image samples, the two-class image samples and the edge sign distance image samples comprises:
inputting the remote sensing image sample into a ResNet frame to obtain a remote sensing image characteristic diagram;
inputting the remote sensing image feature map into the distance regression task branch, and calculating a first Loss through a first Loss function between the output result of the distance regression task branch and the edge symbol distance image sample;
and inputting the shallow feature and the deep feature obtained from the distance regression task branch into the classification task branch, and calculating a second Loss through a second Loss function by using the output result of the classification task branch and the binary image sample.
4. The method for extracting a road based on a remote sensing image as claimed in claim 3, further comprising:
and determining a final Loss based on the first Loss and the second Loss, and training the road extraction model by using the final Loss.
5. Road extraction element based on remote sensing image, its characterized in that includes:
the second classification image making module is used for drawing the road in the remote sensing image and converting the road into a second classification image;
the sample manufacturing module is used for segmenting the remote sensing image and the two classified images to manufacture a remote sensing image sample and two classified image samples, and the remote sensing image sample corresponds to the two classified image samples one by one;
the edge symbol distance conversion module is used for carrying out edge symbol distance conversion on the binary image samples to obtain edge symbol distance image samples which correspond to the binary image samples one to one;
the model training module is used for training a road extraction model by using the corresponding remote sensing image sample, the two classification image samples and the edge symbol distance image sample;
the road extraction module is used for extracting the road of the remote sensing image by using the trained road extraction model;
the performing edge-symbol distance transform on the two classified image samples comprises:
determining a distance D from each pixel point in the two classified image samples to a closest point located on a road edge i Based on D i Determining the edge symbol distance of all pixel points;
Figure FDA0003765093330000021
wherein x is i Is the pixel location, x j On the road edge with x i ED is the Euclidean distance at the position of the nearest pixel point;
the base is based on D i Determining the edge symbol distances of all the pixel points comprises:
edge symbol distance BSD i Then, then
Figure FDA0003765093330000022
Wherein Htanh is a HardTanh function, alpha is a proportionality coefficient, F is a foreground area, and B is a background area.
6. A computer-readable storage medium, on which a computer program is stored, characterized in that the computer program, when executed, implements the steps of the method according to any one of claims 1-4.
7. A computer arrangement comprising a processor, a memory and a computer program stored on the memory, characterized in that the processor, when executing the computer program, carries out the steps of the method according to any of claims 1-4.
CN202010953874.4A 2020-09-11 2020-09-11 Road extraction method, device, medium and equipment based on remote sensing image Active CN112070037B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010953874.4A CN112070037B (en) 2020-09-11 2020-09-11 Road extraction method, device, medium and equipment based on remote sensing image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010953874.4A CN112070037B (en) 2020-09-11 2020-09-11 Road extraction method, device, medium and equipment based on remote sensing image

Publications (2)

Publication Number Publication Date
CN112070037A CN112070037A (en) 2020-12-11
CN112070037B true CN112070037B (en) 2022-09-30

Family

ID=73697025

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010953874.4A Active CN112070037B (en) 2020-09-11 2020-09-11 Road extraction method, device, medium and equipment based on remote sensing image

Country Status (1)

Country Link
CN (1) CN112070037B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113139975B (en) * 2021-04-19 2023-11-17 国交空间信息技术(北京)有限公司 Road feature-based pavement segmentation method and device
CN113361371B (en) * 2021-06-02 2023-09-22 北京百度网讯科技有限公司 Road extraction method, device, equipment and storage medium
CN115641512B (en) * 2022-12-26 2023-04-07 成都国星宇航科技股份有限公司 Satellite remote sensing image road identification method, device, equipment and medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101126812A (en) * 2007-09-27 2008-02-20 武汉大学 Segmentation, Classification and Change Detection Integrated Method for High Resolution Remote Sensing Imagery
CN109800736A (en) * 2019-02-01 2019-05-24 东北大学 A kind of method for extracting roads based on remote sensing image and deep learning

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101126812A (en) * 2007-09-27 2008-02-20 武汉大学 Segmentation, Classification and Change Detection Integrated Method for High Resolution Remote Sensing Imagery
CN109800736A (en) * 2019-02-01 2019-05-24 东北大学 A kind of method for extracting roads based on remote sensing image and deep learning

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Distance transform regression for spatially-aware deep semantic segmentation;Nicolas Audebert 等;《Computer Vision and Image Understanding》;20190906;全文 *
Improved Anchor-Free Instance Segmentation for Building Extraction from High-Resolution Remote Sensing Images;Tong Wu 等;《remote sensing》;20200908;全文 *
结合卷积受限玻尔兹曼机的CV图像分割模型;李晓慧 等;《激光与光电子学进展》;20200828;全文 *

Also Published As

Publication number Publication date
CN112070037A (en) 2020-12-11

Similar Documents

Publication Publication Date Title
CN111079649B (en) Remote sensing image ground feature classification method based on lightweight semantic segmentation network
CN108304835B (en) character detection method and device
CN112070037B (en) Road extraction method, device, medium and equipment based on remote sensing image
CN105184763B (en) Image processing method and device
CN110647829A (en) Bill text recognition method and system
CN110929665B (en) Natural scene curve text detection method
CN110598609A (en) Weak supervision target detection method based on significance guidance
CN108121986A (en) Object detection method and device, computer installation and computer readable storage medium
CN111738262A (en) Target detection model training method, target detection model training device, target detection model detection device, target detection equipment and storage medium
US20240037750A1 (en) Generating improved panoptic segmented digital images based on panoptic segmentation neural networks that utilize exemplar unknown object classes
CN113516116B (en) Text detection method, system and medium suitable for complex natural scene
CN110781744A (en) A small-scale pedestrian detection method based on multi-level feature fusion
CN115331245B (en) Table structure identification method based on image instance segmentation
CN112232346A (en) Semantic segmentation model training method and device, and image semantic segmentation method and device
CN111932577B (en) Text detection method, electronic device and computer readable medium
CN115273032A (en) Traffic sign recognition method, apparatus, device and medium
CN110852327A (en) Image processing method, device, electronic device and storage medium
CN116311310A (en) Universal form identification method and device combining semantic segmentation and sequence prediction
CN116266387A (en) YOLOV4 image recognition algorithm and system based on reparameterized residual structure and coordinate attention mechanism
CN108805884A (en) A kind of mosaic area's detection method, device and equipment
WO2023246912A1 (en) Image character structured output method and apparatus, and electronic device and storage medium
CN114937148A (en) Small target feature enhanced image segmentation method and system
CN111931572B (en) Target detection method for remote sensing image
WO2023207535A1 (en) Pseudo label box generation method and apparatus, and electronic device
CN114283431B (en) Text detection method based on differentiable binarization

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant