WO2023116359A1 - 绿色、蓝色和灰色基础设施分类方法、装置、系统与介质 - Google Patents
绿色、蓝色和灰色基础设施分类方法、装置、系统与介质 Download PDFInfo
- Publication number
- WO2023116359A1 WO2023116359A1 PCT/CN2022/134944 CN2022134944W WO2023116359A1 WO 2023116359 A1 WO2023116359 A1 WO 2023116359A1 CN 2022134944 W CN2022134944 W CN 2022134944W WO 2023116359 A1 WO2023116359 A1 WO 2023116359A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- green
- gray
- blue
- infrastructure
- grid
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/56—Extraction of image or video features relating to colour
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/17—Terrestrial scenes taken from planes or by drones
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/194—Terrestrial scenes using hyperspectral data, i.e. more or other wavelengths than RGB
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A30/00—Adapting or protecting infrastructure or their operation
- Y02A30/60—Planning or developing urban green infrastructure
Definitions
- the present invention relates to the technical field of image processing, in particular to a green, blue and gray infrastructure classification method, device, system and medium.
- the infrastructure in the city usually includes water bodies, trees, grasslands, bare land, buildings, roads, etc., and there are great differences in the utilization performance of rainwater by different infrastructures. Therefore, relevant urban planners need to assist the city in planning and construction according to the rainwater utilization performance of different types of infrastructure, but the existing methods for classifying urban infrastructure generally have problems of low accuracy and efficiency. How to improve the accuracy and efficiency of green, blue and gray infrastructure classification is an urgent problem to be solved.
- the main purpose of the present invention is to propose a green, blue and gray infrastructure classification method, device, system and medium, aiming at solving the problem of how to improve the accuracy and efficiency of green, blue and gray infrastructure classification.
- the present invention provides a green, blue and gray infrastructure classification method
- the green, blue and gray infrastructure classification method includes the following steps:
- a sample file is obtained based on the color orthophoto, and green, blue, and gray infrastructure classification results corresponding to the target area are obtained according to the target light band image set and the sample file.
- the step of obtaining the target light band image set and the color orthomap includes:
- the sample file includes a training sample and a verification sample
- the step of obtaining the sample file based on the color orthomap includes:
- the grid image in the color grid orthomap is offset to obtain the verification sample.
- the step of obtaining the green, blue and gray infrastructure classification results corresponding to the target area includes:
- the step of determining green, blue and gray infrastructure classification results includes:
- the green, blue, and gray infrastructure pre-classification results are determined as the green, blue, and gray infrastructure classification results
- preset processing is performed on the grid image and the target light band image set to obtain an optimal grid image and an optimal target light Band images are collected, and a step is performed: overlapping the grid image and the color orthomap to obtain a color grid orthomap.
- the step of performing preset processing on the grid image and the target light band image set to obtain the optimal grid image and the optimal target light band image set includes:
- a sample file is obtained based on the color grid orthomap, and according to the target light band image set and the sample file, the green, blue and gray infrastructure classification results corresponding to the target area are obtained After the step, the green, blue and gray infrastructure classification method also includes:
- a classification map corresponding to the target area is generated, and according to the classification map, rainwater utilization analysis data corresponding to the target area is provided.
- the present invention also provides a green, blue and gray infrastructure classification device, the green, blue and gray infrastructure classification device includes:
- An acquisition module configured to acquire a multispectral photo corresponding to the target area, and obtain a set of target light band images and a color orthographic map based on the multispectral photo;
- the classification module is configured to obtain a sample file based on the color orthophoto, and obtain green, blue and gray infrastructure classification results corresponding to the target area according to the target light band image set and the sample file.
- the acquisition module also includes a two-dimensional reconstruction module, and the two-dimensional reconstruction module is used for:
- the classification module also includes a generation module, and the generation module is used for:
- the grid image in the color grid orthomap is offset to obtain the verification sample.
- classification module is also used for:
- classification module is also used for:
- the green, blue, and gray infrastructure pre-classification results are determined as the green, blue, and gray infrastructure classification results
- preset processing is performed on the grid image and the target light band image set to obtain an optimal grid image and an optimal target light Band images are collected, and a step is performed: overlapping the grid image and the color orthomap to obtain a color grid orthomap.
- classification module also includes an optimization module, and the optimization module is used for:
- classification module also includes an analysis module, and the analysis module is used for:
- a classification map corresponding to the target area is generated, and according to the classification map, rainwater utilization analysis data corresponding to the target area is provided.
- the present invention also provides a green, blue and gray infrastructure classification system
- the green, blue and gray infrastructure classification system includes: a memory, a processor and stored in the memory and a green, blue and gray infrastructure classification program operable on said processor, said green, blue and gray infrastructure classification program being executed by said processor to implement green, blue and gray as described above Steps in an infrastructure taxonomy approach.
- the present invention also provides a medium, the medium is a computer-readable storage medium, and the computer-readable storage medium stores green, blue and gray infrastructure classification programs, and the green, blue and gray infrastructure classification programs are stored on the computer-readable storage medium.
- the blue and gray infrastructure classification program is executed by the processor, the steps of the above green, blue and gray infrastructure classification method are implemented.
- the green, blue and gray infrastructure classification method proposed by the present invention obtains the multi-spectral photos corresponding to the target area, and based on the multi-spectral photos, obtains a target light band image set and a color orthomap; based on the color ortho , to obtain a sample file, and according to the target light band image set and the sample file, obtain the green, blue, and gray infrastructure classification results corresponding to the target area.
- the present invention obtains a set of target light band images and a color orthomap, and combines the sample files obtained based on the color orthomap and the set of target light band images to obtain the green and blue colors corresponding to the target area. and gray infrastructure classification results, improving the accuracy and efficiency of green, blue and gray infrastructure classification.
- Fig. 1 is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present invention
- Fig. 2 is a schematic flow chart of the first embodiment of the green, blue and gray infrastructure classification method of the present invention
- FIG. 1 is a schematic diagram of the equipment structure of the hardware operating environment involved in the solution of the embodiment of the present invention.
- the device in this embodiment of the present invention may be a PC or a server device.
- the device may include: a processor 1001 , such as a CPU, a network interface 1004 , a user interface 1003 , a memory 1005 , and a communication bus 1002 .
- the communication bus 1002 is used to realize connection and communication between these components.
- the user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.
- the network interface 1004 may include a standard wired interface and a wireless interface (such as a WI-FI interface).
- the memory 1005 can be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory.
- the memory 1005 may also be a storage device independent of the aforementioned processor 1001 .
- FIG. 1 does not constitute a limitation to the device, and may include more or less components than shown in the figure, or combine some components, or arrange different components.
- the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and green, blue, and gray infrastructure classification programs.
- the operating system is a program that manages and controls portable green, blue and gray infrastructure classification equipment and software resources, supports network communication modules, user interface modules, green, blue and gray infrastructure classification programs, and other programs or software Running; the network communication module is used to manage and control the network interface 1004; the user interface module is used to manage and control the user interface 1003.
- the green, blue and gray infrastructure classification device calls the green, blue and gray infrastructure classification program stored in the memory 1005 through the processor 1001 , and perform operations in each embodiment of the following green, blue and gray infrastructure classification methods.
- FIG. 2 is a schematic flowchart of the first embodiment of the green, blue and gray infrastructure classification method of the present invention, and the method includes:
- Step S10 obtaining the multispectral photo corresponding to the target area, and based on the multispectral photo, obtaining a target light band image set and a color orthographic map;
- step S20 a sample file is obtained based on the color orthophoto, and green, blue, and gray infrastructure classification results corresponding to the target area are obtained according to the target light band image set and the sample file.
- the green, blue and gray infrastructure classification method of this embodiment is applied to the green, blue and gray infrastructure classification equipment of urban planning agencies, and the green, blue and gray infrastructure classification equipment can be terminals or PC equipment, for description
- the green, blue, and gray infrastructure classification equipment is used as an example to describe; the green, blue, and gray infrastructure classification equipment obtains the multispectral photos corresponding to the target area, and performs two-dimensional reconstruction operations on the multispectral photos, and according to After two-dimensional reconstruction of multi-spectral photos and preset resolutions, a collection of target light band images and color orthomaps are obtained; green, blue and gray infrastructure classification equipment generates grid images according to preset grid spacing, and Overlay the grid image and the color orthomap to obtain the color grid orthomap; the green, blue and gray infrastructure classification equipment recognizes the grid point attributes corresponding to each grid point in the color grid orthomap, and according to The grid point attribute obtains the training sample, and then offsets the grid image in the color grid orthophoto map to obtain the verification sample; the green, blue and gray infrastructure classification equipment classifies
- sample files include training samples and verification samples; the types of infrastructure have been set by relevant R&D personnel into seven categories, including water bodies, trees and shrubs, grasslands, green roofs, bare land, buildings, and roads, among which water bodies are blue Trees and shrubs, grasslands, green roofs, and bare land are green infrastructure, and buildings and roads are gray infrastructure.
- the green, blue and gray infrastructure classification method of this embodiment obtains the multispectral photos corresponding to the target area, and based on the multispectral photos, obtains the target light band image set and the color orthomap; based on the color orthomap, the sample files, and according to the target light band image collection and sample files, the green, blue and gray infrastructure classification results corresponding to the target area are obtained.
- the present invention obtains a target light band image set and a color orthomap, and combines the sample files obtained based on the color orthomap and the target light band image set to obtain the green and blue colors corresponding to the target area. and gray infrastructure classification results, improving the accuracy and efficiency of green, blue and gray infrastructure classification.
- Step S10 obtaining the multispectral photo corresponding to the target area, and based on the multispectral photo, obtaining a target light band image set and a color orthographic map;
- the green, blue and gray infrastructure classification equipment uses a drone with the function of taking multi-spectral photos to shoot the target area under suitable weather conditions to obtain multi-spectral photos corresponding to the target area, And based on the multi-spectral photos, a collection of target light band images and color orthographs are obtained; for example, relevant researchers determine the target area to be studied according to the actual situation, and fly to the distance target by a drone with the function of taking multi-spectral photos.
- the ground of the area is above the preset height, and the target area is photographed, and the multispectral photos corresponding to the target area taken by the drone are sent to the green, blue, and gray infrastructure classification equipment, and the green, blue, and gray bases
- the facility classification equipment obtains the multispectral photos corresponding to the target area, based on the multispectral photos, the target light band image set and the color orthomap corresponding to the target area are obtained.
- the multispectral photos refer to the Photographs, sometimes with only 3 bands (such as a color image), but sometimes contain many more bands, even hundreds, each band being a grayscale image that represents the The brightness of the scene obtained by the sensitivity, in the multispectral photo, each pixel is related to a numerical string of pixels in different bands, that is, a vector;
- the target light band image collection includes: blue light band images, green light band images, Red light band images, red edge light band images, near-infrared light band images, NDVI images and DSM images, among which, NDVI images are images for detecting vegetation growth status, vegetation coverage and eliminating some radiation errors, etc.
- DSM Digital Surface Model , Digital Surface Model
- DSM image refers to the digital surface model image;
- the color orthophoto map refers to the color image of the target area taken by the drone from above top view.
- step S10 includes:
- Step a performing a two-dimensional reconstruction operation on the multi-spectral photo, and obtaining a target light band image set and a color orthographic map based on the multi-spectral photo after the two-dimensional reconstruction operation and a preset resolution.
- the green, blue, and gray infrastructure classification devices perform two-dimensional reconstruction operations on the obtained multispectral photos corresponding to the target area, and obtain the target A collection of light band images and color orthographic maps, where the preset resolution can be 6cm, 6.5cm, 8cm or 10cm, etc.
- relevant researchers set the preset resolution to 6cm, green, blue and gray infrastructure
- the classification equipment inputs the multi-spectral photos corresponding to the target area into DJI Terra or similar image stitching software, performs two-dimensional reconstruction operations on the multi-spectral photos, and obtains blue-light band images, green-light band images, and red-light band images with a resolution of 6cm. images, red-edge light band images, near-infrared light band images, NDVI images, DSM images and color orthomaps.
- step S20 a sample file is obtained based on the color orthophoto, and green, blue, and gray infrastructure classification results corresponding to the target area are obtained according to the target light band image set and the sample file.
- the green, blue and gray infrastructure classification equipment is based on the color orthomap
- the sample file is obtained through eCognition software and Arc GIS software, and the blue light band image and the green light band image are selected from the target light band image collection.
- Image, red band image, red edge band image, near-infrared band image, NDVI image, DSM image, one or more images are combined, and combined with the sample file, the green, blue and gray corresponding to the target area are obtained Infrastructure classification results.
- eCognition is an intelligent image analysis software, which adopts an object-oriented information extraction method and can make full use of object information (color tone, shape, texture, level) and inter-class information (comparison with adjacent objects, child objects, and parent objects). relevant features) for analysis
- Arc GIS software is a software that can be used to collect, organize, manage, analyze, communicate and publish geographic information
- sample files include training samples and verification samples.
- step S20 also includes:
- Step b generating a grid image according to a preset grid spacing, and overlapping the grid image with the colored orthomap to obtain a colored grid orthomap;
- the green, blue and gray infrastructure classification equipment generates a grid image through the eCognition software according to the preset grid spacing, and overlaps the grid image with the color orthomap corresponding to the target area to obtain a color grid grid orthophoto; for example, relevant researchers set the sampling interval to 11.6 meters based on experience, and based on the corresponding size of the grid image to be generated, the sampling interval is proportionally reduced to obtain the preset grid spacing, green, blue and
- the gray infrastructure classification equipment generates a grid image through the eCognition software according to the preset grid spacing, and overlays the grid image on the surface of the color orthomap, so that the grid image and the color orthomap overlap to obtain a color grid orthophoto It can be understood that the grid image is overlaid on the surface of the color orthomap to obtain the color grid orthomap, the surface of the color grid orthomap has a grid, and each grid point on the grid will correspond to the color Different infrastructure on grid orthomaps.
- Step c identifying the grid point attribute corresponding to each grid point in the color grid orthophoto, and obtaining the training sample according to the grid point attribute;
- the grid point corresponding to each grid point corresponding to the grid in the color grid orthomap is analyzed by Arc GIS software. Attributes are identified, and training samples are obtained according to the grid point attributes corresponding to each grid point; it can be understood that a grid point refers to the intersection point formed by the intersection of two line segments in the grid, and each grid point in the color grid orthograph The points will correspond to different infrastructures on the color grid orthophoto map.
- the grid point attribute is the type of infrastructure corresponding to the grid point. There are seven types of green roofs, bare land, buildings, and roads, among which water bodies are blue infrastructures, trees and shrubs, grasslands, green roofs, and bare lands are green infrastructures, and buildings and roads are gray infrastructures.
- Step d offsetting the grid image in the color grid orthophoto map to obtain the verification sample.
- the green, blue, and gray infrastructure classification devices offset the grids in the color grid orthophoto, specifically, the overall grid can be moved up, down, left, right, Offset in the upper left, upper right, etc., so that the grid point attribute corresponding to each grid point in the grid is different from the grid point attribute corresponding to each grid point in the training sample, and then the verification sample is obtained, for example: green, blue
- the colored and gray infrastructure classification equipment shifts the grid in the color grid orthophoto downward by a preset grid spacing, and identifies the grid attribute corresponding to each grid point after the offset, and then obtains the corresponding verification
- the sample optionally, can offset the entire grid in the color grid orthophoto map in multiple directions, so as to obtain multiple verification samples.
- Step e performing segmentation operation on the set of target optical band images according to spectral similarity to obtain shape objects, and calculating green , blue and gray infrastructure pre-classification results;
- the green, blue and gray infrastructure classification equipment performs segmentation operations on the target light band image set through eCognition software, according to the blue light band image, green light band image, red light band image, Based on the numerical similarity of the red-edge light band images, near-infrared light band images, NDVI images, and DSM images, the shape objects are segmented, and the grid point attributes in the training samples in the sample file are assigned to each shape object, and then randomly Algorithms such as forest, fuzzy classification and Bayesian algorithm, calculate the attribute value of other shape objects without attributes, and obtain the green, blue and gray infrastructure pre-classification results;
- Algorithms such as forest, fuzzy classification and Bayesian algorithm
- Step f Perform accuracy evaluation on the green, blue and gray infrastructure pre-classification results based on the verification sample in the sample file, obtain the accuracy evaluation result, and determine the green and blue infrastructure based on the accuracy evaluation result. and gray infrastructure classification results.
- the green, blue and gray infrastructure classification equipment evaluates the accuracy of the green, blue and gray infrastructure pre-classification results based on the grid point attributes corresponding to each grid point in the verification sample in the sample file, and obtains Accuracy evaluation results, and based on the accuracy evaluation results, determine green, blue and gray infrastructure classification results.
- the step of determining green, blue and gray infrastructure classification results includes:
- Step f1 comparing the accuracy evaluation result with the preset accuracy to obtain the comparison result
- the green, blue and gray infrastructure classification equipment compares the accuracy evaluation results with the preset accuracy to obtain the comparison results.
- the relevant researchers set the preset accuracy to 0.8 according to the actual situation.
- the accuracy evaluation result of the green, blue, and gray infrastructure pre-classification results obtained by the green and gray infrastructure classification equipment is 0.7, and the comparison result obtained by comparing the accuracy evaluation result with the preset accuracy is that the accuracy evaluation result is less than the preset accuracy. If the accuracy evaluation result of the green, blue, and gray infrastructure pre-classification results obtained by the green, blue, and gray infrastructure classification equipment is 0.85, the comparison result obtained by comparing the accuracy evaluation result with the preset accuracy is that the accuracy evaluation result is not good. Less than the preset precision.
- Step f2 if the comparison result is that the accuracy evaluation result is not less than the preset accuracy, then determine the green, blue and gray infrastructure pre-classification result as the green, blue and gray infrastructure classification result;
- the green, blue and gray infrastructure pre-classification results are determined as green, blue and gray Infrastructure classification results, and use the green, blue and gray infrastructure classification results to provide stormwater utilization analysis data corresponding to the target area.
- Step f3 if the comparison result is that the accuracy evaluation result is less than the preset accuracy, perform preset processing on the grid image and the target optical band image set to obtain the optimal grid image and the optimal
- the optimal target light band images are collected, and a step is performed: overlapping the grid image and the color orthomap to obtain a color grid orthomap.
- this step if the comparison result of the green, blue and gray infrastructure classification equipment is that the accuracy evaluation result is less than the preset accuracy, preset processing is performed on the grid image and the target light band image set to obtain the optimal grid
- the image and the optimal target light band image are collected, and the grid image is overlapped with the color orthomap to obtain the color grid orthomap and subsequent steps, until the obtained green, blue and gray infrastructure pre-classification results correspond to The precision is no less than the preset precision.
- step of performing preset processing on the grid image and the target light band image set to obtain the optimal grid image and the optimal target light band image set includes:
- the green, blue and gray infrastructure classification devices perform scaling operations on the grid spacing corresponding to the grid image to obtain a first preset number of grid images, and respectively Perform the first preset operation on each grid image to obtain the optimal grid image, such as: green, blue and gray infrastructure classification equipment can perform grid spacing corresponding to the grid image according to the preset grid spacing Scaling operation to obtain the first preset number of grid images, optionally, green, blue and gray infrastructure classification devices correspond to the grid images on the basis of the preset grid spacing according to the instructions of relevant researchers The grid spacing is increased or decreased, and the grid spacing is increased or decreased once, and the corresponding grid image is obtained, and finally the first preset number of grid images is obtained and then stopped.
- green, blue and gray infrastructure classification devices perform scaling operations on the grid spacing corresponding to the grid image to obtain a first preset number of grid images, and respectively Perform the first preset operation on each grid image to obtain the optimal grid image, such as: green, blue and gray infrastructure classification equipment can perform grid spacing corresponding to the grid image according to the preset grid spacing Scaling
- the green, blue and gray infrastructure classification equipment can intelligently set the first preset number, and intelligently increase or decrease the grid spacing corresponding to the grid image on the basis of the preset grid spacing. Zoom out to end up with a grid image of the first preset amount.
- the green, blue and gray infrastructure classification devices After obtaining the first preset number of grid images, the green, blue and gray infrastructure classification devices perform a first preset operation on each grid image, that is, perform a combination of grid images and The color orthomaps are overlapped to obtain the color grid orthomaps and the subsequent steps, and the accuracy evaluation results corresponding to the green, blue and gray infrastructure pre-classification results corresponding to each grid image are obtained, and then each The accuracy evaluation result corresponding to the grid image is compared with the preset accuracy, and the grid image corresponding to the accuracy evaluation result not less than the preset accuracy is selected, and the grid image corresponding to the accuracy evaluation result not less than the preset accuracy is selected.
- the grid image with the largest grid spacing is selected as the optimal grid image.
- the green, blue, and gray infrastructure classification devices perform addition and subtraction operations on the target light band images in the target light band image set to obtain a second preset number of target light band image sets, based on the optimal network
- the second preset operation is performed on each target light band image set for each grid image, so as to obtain the optimal target light band image set.
- green, blue and gray infrastructure classification equipment performs increase and decrease operations on target light band images in the target light band image set to obtain a second preset number of target light band image sets, optionally, green, blue
- the color and gray infrastructure classification equipment increases or decreases the target light band images in the target light band image set according to the instructions of the relevant researchers, and finally obtains the second preset number of target light band image sets and then stops.
- the green, blue and gray infrastructure classification equipment can intelligently set the second preset number, and intelligently increase or decrease the target light band images in the target light band image collection, and finally obtain the second preset number.
- the target light band image collection may include: blue light band images, green light band images, NDVI images, and DSM images, may include blue light band images, green light band images, red light band images, NDVI images, and DSM images. It may include blue-light band images, green-light band images, red-light band images, near-infrared light band images, NDVI images, DSM images, etc.
- the green, blue and gray infrastructure classification equipment obtains training samples and verification samples based on the optimal grid image and the color orthomap corresponding to the target area, and respectively performs The second preset operation, that is, to perform a segmentation operation on each target light band image set in the second preset number of target light band image sets to obtain a shape object, and according to the training samples and shape objects in the sample file , calculate the green, blue and gray infrastructure pre-classification results and the subsequent steps to obtain the accuracy evaluation results corresponding to the green, blue and gray infrastructure pre-classification results corresponding to each target light band image set, and in the accuracy
- the target light band image set with the highest accuracy evaluation is selected from each target light band image set whose evaluation result is not less than the preset precision, and is used as the optimal target light band image set.
- the green, blue and gray infrastructure classification equipment obtains the multispectral photos corresponding to the target area, and performs two-dimensional reconstruction operations on the multispectral photos, and according to the two-dimensional Reconstruct the multi-spectral photos and preset resolutions to obtain the target light band image collection and color orthomap; the green, blue and gray infrastructure classification equipment generates grid images according to the preset grid spacing, and the grid The image is overlaid with the color orthomap to obtain the color grid orthomap; the green, blue and gray infrastructure classification equipment recognizes the grid point attribute corresponding to each grid point in the color grid orthomap, and according to the grid point attribute Obtain the training sample, and then offset the grid image in the color grid orthophoto to obtain the verification sample; the green, blue and gray infrastructure classification equipment performs segmentation operation on the target light band image set to obtain the shape object, And according to the grid point attributes and shape objects in the training samples in the sample file, the green, blue and gray infrastructure pre-classification results are calculated, and then based on the
- the difference between the second embodiment of the green, blue and gray infrastructure classification method and the first embodiment of the green, blue and gray infrastructure classification method is that after step S20, the green, blue and gray infrastructure classification method also includes:
- Step g Generate a classification map corresponding to the target area according to the green, blue and gray infrastructure classification results, and provide rainwater utilization analysis data corresponding to the target area according to the classification map.
- the green, blue and gray infrastructure classification equipment is based on the grid images corresponding to the preset grid spacing and the blue light band image, the green light band image, the red light band image, the red edge light band image, the near
- the green, blue and gray infrastructure classification results obtained from the target light band image set composed of infrared light band images, NDVI images, and DSM images or the green, blue and gray infrastructure classification results to generate a classification map corresponding to the target area.
- the classification map includes: water bodies, trees and shrubs, grasslands, green roofs, bare land, buildings, roads, these seven types of infrastructure types in target areas, and according to The classification map provides the rainwater utilization analysis data corresponding to the target area.
- the green, blue and gray infrastructure classification device in this embodiment generates a classification map corresponding to the target region according to the finally obtained green, blue and gray infrastructure classification results of the target region, and the classification map includes: water bodies, trees and According to the classification map, provide the rainwater utilization analysis data corresponding to the target area, so that the green, blue and gray infrastructure classification results can be Provide data for stormwater utilization analysis in the target area.
- Green, blue and gray infrastructure classification devices of the present invention include:
- An acquisition module configured to acquire a multispectral photo corresponding to the target area, and obtain a set of target light band images and a color orthographic map based on the multispectral photo;
- the classification module is configured to obtain a sample file based on the color orthophoto, and obtain green, blue and gray infrastructure classification results corresponding to the target area according to the target light band image set and the sample file. Further, the acquisition module also includes a two-dimensional reconstruction module, and the two-dimensional reconstruction module is used for:
- the classification module also includes a generation module, and the generation module is used for:
- the grid image in the color grid orthomap is offset to obtain the verification sample.
- classification module is also used for:
- classification module is also used for:
- the green, blue, and gray infrastructure pre-classification results are determined as the green, blue, and gray infrastructure classification results
- preset processing is performed on the grid image and the target light band image set to obtain an optimal grid image and an optimal target light Band images are collected, and a step is performed: overlapping the grid image and the color orthomap to obtain a color grid orthomap.
- classification module also includes an optimization module, and the optimization module is used for:
- classification module also includes an analysis module, and the analysis module is used for:
- a classification map corresponding to the target area is generated, and according to the classification map, rainwater utilization analysis data corresponding to the target area is provided.
- the invention also provides a medium.
- the medium of the present invention is a computer-readable storage medium, and green, blue and gray infrastructure classification programs are stored on the computer-readable storage medium.
- green, blue and gray infrastructure classification programs are executed by a processor, the above-mentioned steps in the green, blue and gray infrastructure taxonomy.
- the method implemented when the green, blue and gray infrastructure classification program running on the processor is executed can refer to the various embodiments of the green, blue and gray infrastructure classification method of the present invention, which will not be repeated here. .
- the term “comprises”, “comprises” or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or system comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or system. Without further limitations, an element defined by the phrase “comprising a " does not preclude the presence of additional identical elements in the process, method, article or system comprising that element.
- the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation.
- the technical solution of the present invention can be embodied in the form of a software product in essence or the part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM) , magnetic disk, optical disk), including several instructions to enable a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in various embodiments of the present invention.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Remote Sensing (AREA)
- Computing Systems (AREA)
- Databases & Information Systems (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Image Processing (AREA)
- Image Analysis (AREA)
Abstract
Description
Claims (10)
- 一种绿色、蓝色和灰色基础设施分类方法,其特征在于,所述绿色、蓝色和灰色基础设施分类方法包括如下步骤:获取目标区域对应的多光谱照片,并基于所述多光谱照片,得到目标光波段图像集合以及彩色正射图;基于所述彩色正射图,得到样本文件,并根据所述目标光波段图像集合和所述样本文件,得到所述目标区域对应的绿色、蓝色和灰色基础设施分类结果。
- 如权利要求1所述的绿色、蓝色和灰色基础设施分类方法,其特征在于,所述基于所述多光谱照片,得到目标光波段图像集合以及彩色正射图的步骤包括:对所述多光谱照片进行二维重建操作,并根据经过所述二维重建操作的多光谱照片以及预设分辨率,得到目标光波段图像集合以及彩色正射图。
- 如权利要求1所述的绿色、蓝色和灰色基础设施分类方法,其特征在于,所述样本文件包括训练样本和验证样本,所述基于所述彩色正射图,得到样本文件的步骤包括:根据预设网格间距,生成网格图像,并将所述网格图像与所述彩色正射图进行重叠,得到彩色网格正射图;识别所述彩色网格正射图中每个格点对应的格点属性,并根据所述格点属性得到所述训练样本;将所述彩色网格正射图中的网格图像进行偏移,以得到所述验证样本。
- 如权利要求3所述的绿色、蓝色和灰色基础设施分类方法,其特征在于,所述根据所述目标光波段图像集合和所述样本文件,得到所述目标区域对应的绿色、蓝色和灰色基础设施分类结果的步骤包括:依据光谱相似性对所述目标光波段图像集合进行分割操作,得到形状对象,并根据所述样本文件中的所述训练样本和对应的所述形状对象光波段图像数值,计算得到绿色、蓝色和灰色基础设施预分类结果;基于所述样本文件中的所述验证样本对所述绿色、蓝色和灰色基础设施预分类结果进行精度评价,得到精度评价结果,并基于所述精度评价结果,确定绿色、蓝色和灰色基础设施分类结果。
- 如权利要求4中所述的绿色、蓝色和灰色基础设施分类方法,其特征在于,所述基于所述精度评价结果,确定绿色、蓝色和灰色基础设施分类结果的步骤包括:将所述精度评价结果与预设精度进行对比,得到对比结果;若所述对比结果为所述精度评价结果不小于所述预设精度,则将所述绿色、蓝色和灰 色基础设施预分类结果确定为绿色、蓝色和灰色基础设施分类结果;若所述对比结果为所述精度评价结果小于所述预设精度,则对所述网格图像以及所述目标光波段图像集合进行预设处理,以得到最优网格图像和最优目标光波段图像集合,并执行步骤:将所述网格图像与所述彩色正射图进行重叠,得到彩色网格正射图。
- 如权利要求5所述的绿色、蓝色和灰色基础设施分类方法,其特征在于,所述对所述网格图像以及所述目标光波段图像集合进行预设处理,以得到最优网格图像和最优目标光波段图像集合的步骤包括:对所述网格图像对应的网格间距进行缩放操作,以得到第一预设数量的网格图像,并分别对每个网格图像进行第一预设操作,以得到最优网格图像;对所述目标光波段图像集合中的目标光波段图像进行增减操作,以得到第二预设数量的目标光波段图像集合,基于所述最优网格图像分别对每个目标光波段图像集合进行第二预设操作,以得到最优目标光波段图像集合。
- 如权利要求1所述的绿色、蓝色和灰色基础设施分类方法,其特征在于,所述基于所述彩色正射图,得到样本文件,并根据所述目标光波段图像集合和所述样本文件,得到所述目标区域对应的绿色、蓝色和灰色基础设施分类结果的步骤之后,所述绿色、蓝色和灰色基础设施分类方法还包括:根据所述绿色、蓝色和灰色基础设施分类结果,生成所述目标区域对应的分类地图,并根据所述分类地图,提供所述目标区域对应的雨水利用分析数据。
- 一种绿色、蓝色和灰色基础设施分类装置,其特征在于,所述绿色、蓝色和灰色基础设施分类装置包括:获取模块,用于获取目标区域对应的多光谱照片,并基于所述多光谱照片,得到目标光波段图像集合以及彩色正射图;分类模块,用于基于所述彩色正射图,得到样本文件,并根据所述目标光波段图像集合和所述样本文件,得到所述目标区域对应的绿色、蓝色和灰色基础设施分类结果。
- 一种绿色、蓝色和灰色基础设施分类系统,其特征在于,所述绿色、蓝色和灰色基础设施分类系统包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的绿色、蓝色和灰色基础设施分类程序,所述绿色、蓝色和灰色基础设施分类程序被所述处理器执行时实现如权利要求1至7中任一项所述的绿色、蓝色和灰色基础设施分类方法的步骤。
- 一种介质,其特征在于,所述介质为计算机可读存储介质,所述计算机可读存储 介质上存储有绿色、蓝色和灰色基础设施分类程序,所述绿色、蓝色和灰色基础设施分类程序被处理器执行时实现如权利要求1至7中任一项所述的绿色、蓝色和灰色基础设施分类方法的步骤。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US18/556,730 US12608913B2 (en) | 2021-12-20 | 2022-11-29 | Method, device, system and medium for classifying green-blue-gray infrastructure |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111565957.7 | 2021-12-20 | ||
| CN202111565957.7A CN114359630B (zh) | 2021-12-20 | 2021-12-20 | 绿色、蓝色和灰色基础设施分类方法、装置、系统与介质 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023116359A1 true WO2023116359A1 (zh) | 2023-06-29 |
Family
ID=81102284
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2022/134944 Ceased WO2023116359A1 (zh) | 2021-12-20 | 2022-11-29 | 绿色、蓝色和灰色基础设施分类方法、装置、系统与介质 |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US12608913B2 (zh) |
| CN (1) | CN114359630B (zh) |
| WO (1) | WO2023116359A1 (zh) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114359630B (zh) * | 2021-12-20 | 2025-09-16 | 南方科技大学 | 绿色、蓝色和灰色基础设施分类方法、装置、系统与介质 |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20210061817A (ko) * | 2019-11-20 | 2021-05-28 | 한국해양과학기술원 | 식생현황분석장치 및 그 동작 방법 |
| CN114359630A (zh) * | 2021-12-20 | 2022-04-15 | 南方科技大学 | 绿色、蓝色和灰色基础设施分类方法、装置、系统与介质 |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8503761B2 (en) * | 2009-11-12 | 2013-08-06 | Harris Corporation | Geospatial modeling system for classifying building and vegetation in a DSM and related methods |
| US9147132B2 (en) * | 2013-09-11 | 2015-09-29 | Digitalglobe, Inc. | Classification of land based on analysis of remotely-sensed earth images |
| KR101965235B1 (ko) * | 2018-12-10 | 2019-04-03 | 주식회사 지오스토리 | 무인기 원격탐사를 통한 잘피군락지 분포조사방법 |
| CN109740562B (zh) * | 2019-01-14 | 2020-12-08 | 中国科学院地理科学与资源研究所 | 一种生态海绵型城市建设适宜区的系统及方法 |
| CN109977901A (zh) * | 2019-04-03 | 2019-07-05 | 山东理工大学 | 一种基于无人机遥感的玉米田间杂草识别方法 |
| CN110672550B (zh) * | 2019-09-10 | 2021-11-19 | 中国科学院上海技术物理研究所 | 一种微区重要生物资源像谱分析仪 |
| CN112513874A (zh) * | 2019-12-06 | 2021-03-16 | 深圳市大疆创新科技有限公司 | 作物生长状况评估方法和装置 |
| CN111426637A (zh) * | 2020-04-16 | 2020-07-17 | 江苏省环境监测中心 | 一种利用无人机获取城市黑臭河流水质参数的方法 |
| DE102020122052B3 (de) * | 2020-08-24 | 2021-08-26 | Bareways GmbH | Verfahren und system zur kodierung von bilddaten, die eine geografische linie repräsentieren |
| CN112883987A (zh) * | 2021-03-11 | 2021-06-01 | 成都数之联科技有限公司 | 基于遥感光谱特征的目标提取方法及系统及装置及介质 |
-
2021
- 2021-12-20 CN CN202111565957.7A patent/CN114359630B/zh active Active
-
2022
- 2022-11-29 WO PCT/CN2022/134944 patent/WO2023116359A1/zh not_active Ceased
- 2022-11-29 US US18/556,730 patent/US12608913B2/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20210061817A (ko) * | 2019-11-20 | 2021-05-28 | 한국해양과학기술원 | 식생현황분석장치 및 그 동작 방법 |
| CN114359630A (zh) * | 2021-12-20 | 2022-04-15 | 南方科技大学 | 绿色、蓝色和灰色基础设施分类方法、装置、系统与介质 |
Non-Patent Citations (1)
| Title |
|---|
| YANG SHUQIN, SONG ZHISHUANG, YIN HANPING, ZHANG ZHITAO, NING JIFENG: "Crop Classification Method of UVA Multispectral Remote Sensing Based on Deep Semantic Segmentation", TRANSACTIONS OF THE CHINESE SOCIETY FOR AGRICULTURAL MACHINERY., vol. 52, no. 3, 1 March 2021 (2021-03-01), pages 185 - 192, XP093073379, DOI: 10.6441/j.issu.1000-1298.2021.03.020 * |
Also Published As
| Publication number | Publication date |
|---|---|
| US12608913B2 (en) | 2026-04-21 |
| CN114359630A (zh) | 2022-04-15 |
| US20240371133A1 (en) | 2024-11-07 |
| CN114359630B (zh) | 2025-09-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Choi et al. | An automatic approach for tree species detection and profile estimation of urban street trees using deep learning and Google street view images | |
| CN110263717B (zh) | 一种融入街景影像的土地利用类别确定方法 | |
| Ghanea et al. | Building extraction from high-resolution satellite images in urban areas: Recent methods and strategies against significant challenges | |
| Yu et al. | Automated derivation of urban building density information using airborne LiDAR data and object-based method | |
| US9070018B1 (en) | Automated roof identification systems and methods | |
| Herrault et al. | Automatic extraction of forests from historical maps based on unsupervised classification in the CIELab color space | |
| CN113033386A (zh) | 一种基于高分辨率遥感影像的输电线路通道隐患识别方法及系统 | |
| CN113033516A (zh) | 对象识别统计方法及装置、电子设备、存储介质 | |
| US12437498B2 (en) | System and method for home Façade features in a geographic region | |
| CN118298317B (zh) | 一种基于在线地图训练集的自动标注方法及系统 | |
| CN117612038B (zh) | 基于无人机影像的矿区植被碳汇精细演算方法 | |
| JP3380457B2 (ja) | 地理画像上の影成分の除去方法及び地理画像処理装置、記録媒体 | |
| WO2023116359A1 (zh) | 绿色、蓝色和灰色基础设施分类方法、装置、系统与介质 | |
| Liu et al. | A framework of road extraction from airborne lidar data and aerial imagery | |
| CN116108122A (zh) | 一种基于空间熵的城市用地功能自动识别方法 | |
| JPH10269354A (ja) | ノイズ画素の除去方法及び地理画像処理装置、記録媒体 | |
| Zambrano et al. | Comparing methodologies for mapping the afforestation of public streets in Chapada Neighbourhood, using pléiades images | |
| Talebi et al. | Detection of tree crowns based on reclassification using aerial images and lidar data | |
| Nizamuddin et al. | Utilization of GIS Machine Learning for Mapping of Building Shapes in Tibang Village, Banda Aceh City, Aceh, Indonesia | |
| Holland et al. | Automating the photogrammetric workflow in a national mapping agency | |
| KR20230063245A (ko) | Rs gis 기반 친수시설 정보맵 작성 및 유역조사를 위한 시스템 및 방법 | |
| Shorter | Unsupervised building detection from irregularly spaced LiDAR and aerial imagery | |
| Ejikeme et al. | Object-Based Approach for Landuse/Landcover Mapping of Makurdi Area of Benue State, Nigeria using High Resolution Satellite Imagery | |
| El-Naggar | Data capture using vectorization of satellite images and maps to serve change detection | |
| LAWRENCE | EARLY DETECTION OF HERACLEUM MANTEGAZZIANUM (GIANT HOGWEED) BASED ON LEAF SPECTRAL CHARACTERISTICS FROM UAV |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22909674 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 22909674 Country of ref document: EP Kind code of ref document: A1 |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 12.02.2025) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 22909674 Country of ref document: EP Kind code of ref document: A1 |