WO2022077958A1 - 水体分割方法及装置、电子设备和存储介质 - Google Patents
水体分割方法及装置、电子设备和存储介质 Download PDFInfo
- Publication number
- WO2022077958A1 WO2022077958A1 PCT/CN2021/103731 CN2021103731W WO2022077958A1 WO 2022077958 A1 WO2022077958 A1 WO 2022077958A1 CN 2021103731 W CN2021103731 W CN 2021103731W WO 2022077958 A1 WO2022077958 A1 WO 2022077958A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- water body
- target image
- body segmentation
- segmentation result
- target
- Prior art date
Links
- 230000011218 segmentation Effects 0.000 title claims abstract description 602
- 238000000034 method Methods 0.000 title claims abstract description 137
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 871
- 210000000746 body region Anatomy 0.000 claims description 69
- 238000012549 training Methods 0.000 claims description 52
- 230000003595 spectral effect Effects 0.000 claims description 48
- 230000006870 function Effects 0.000 claims description 37
- 238000004590 computer program Methods 0.000 claims description 15
- 238000003062 neural network model Methods 0.000 claims description 11
- 238000001228 spectrum Methods 0.000 abstract description 3
- 238000012545 processing Methods 0.000 description 27
- 238000002372 labelling Methods 0.000 description 26
- 230000008569 process Effects 0.000 description 25
- 238000010586 diagram Methods 0.000 description 24
- 238000004891 communication Methods 0.000 description 10
- 230000000694 effects Effects 0.000 description 6
- 238000013528 artificial neural network Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 230000000295 complement effect Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000001902 propagating effect Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- KLDZYURQCUYZBL-UHFFFAOYSA-N 2-[3-[(2-hydroxyphenyl)methylideneamino]propyliminomethyl]phenol Chemical compound OC1=CC=CC=C1C=NCCCN=CC1=CC=CC=C1O KLDZYURQCUYZBL-UHFFFAOYSA-N 0.000 description 1
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 201000001098 delayed sleep phase syndrome Diseases 0.000 description 1
- 208000033921 delayed sleep phase type circadian rhythm sleep disease Diseases 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000002689 soil Substances 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10032—Satellite or aerial image; Remote sensing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
Definitions
- the present disclosure relates to the field of computer vision, and in particular, to a water body segmentation method and device, an electronic device and a storage medium.
- Water body segmentation can identify and segment water body regions from remote sensing images, which is a key issue in remote sensing image processing.
- problems in water body segmentation such as easy misdetection, often confused with buildings, roads and shadows, or it is difficult to extract narrow water bodies. Therefore, how to obtain high-quality water body segmentation results has become an urgent problem to be solved.
- the present disclosure proposes a water body segmentation scheme.
- a water body segmentation method comprising: segmenting a water body region in the first target image according to spectral information of the first target image to obtain a first image of the first target image. Water body segmentation result; segment the water body region in the first target image by at least one preset water body segmentation method to obtain at least one second water body segmentation result; according to the first water body of the first target image The segmentation result, and the at least one second water body segmentation result, determine the target water body segmentation result of the first target image.
- the target water body segmentation result of the first target image is determined according to the first water body segmentation result of the first target image and the at least one second water body segmentation result , including: merging the at least one second water body segmentation result to obtain a merged water body segmentation result; combining the first water body segmentation result of the first target image and the water body area commonly included in the merged water body segmentation result , as the target water body segmentation result of the first target image.
- the water body region in the first target image is segmented by at least one preset water body segmentation method to obtain at least one second water body segmentation result, including at least one of the following :
- the water body data in the public map determine the water body area in the first target image, and obtain the second water body segmentation result; obtain at least one kind of surface coverage data with a resolution within a preset range, and according to the surface coverage data
- the water body data is determined, and the water body region in the first target image is determined, and at least one second water body segmentation result is obtained.
- the determining the water body area in the first target image according to the water body data in the public map, and obtaining the second water body segmentation result includes: according to the geographic location corresponding to the first target image range, take the water body area corresponding to the geographic range in the public map as the target water body area; if the target water body area is a water body dividing line, extend the water body dividing line in a preset direction to Preset width, take the expanded target water body area as the second water body segmentation result; in the case that the target water body area is a polygonal area and/or a circular area, take the target water body area as the second water body area Water body segmentation results.
- the water body region in the first target image is segmented to obtain a first water body segmentation result of the first target image, including: According to the spectral information of the first target image, the normalized water index of a plurality of pixel points in the first target image is obtained; the value of the normalized water index in the plurality of pixel points is preset The pixel points within the index value range are used as the pixel points of the water body area, and the first water body segmentation result of the first target image is obtained.
- the method further includes: according to the target water body segmentation result of the first target image, labeling the water body region in the first target image to obtain a first target image including the labeling ; Using the first target image containing the label as a sample, the initial neural network model is trained to obtain a water body segmentation network.
- a water body segmentation method comprising: inputting a second target image into a water body segmentation network to obtain a third water body segmentation result of the second target image; information, segment the water body region of the second target image to obtain a fourth water body segmentation result of the second target image; divide the third water body segmentation result of the second target image and the fourth water body
- the water body area commonly included in the segmentation result is used as the target water body segmentation result of the second target image.
- the water body segmentation network is obtained by training according to the first target image and the target water body segmentation result of the first target image.
- the method further includes: segmenting the water body region in the first target image according to the spectral information of the first target image to obtain a first image of the first target image. Water body segmentation result; segment the water body region in the first target image by at least one preset water body segmentation method to obtain at least one second water body segmentation result; according to the first water body of the first target image The segmentation result, and the at least one second water body segmentation result, determine the target water body segmentation result of the first target image.
- the target water body segmentation result of the first target image is determined according to the first water body segmentation result of the first target image and the at least one second water body segmentation result , including: merging the at least one second water body segmentation result to obtain a merged water body segmentation result; combining the first water body segmentation result of the first target image and the water body area commonly included in the merged water body segmentation result , as the target water body segmentation result of the first target image.
- the water body region in the first target image is segmented by at least one preset water body segmentation method to obtain at least one second water body segmentation result, including at least one of the following :
- the water body data in the public map determine the water body area in the first target image, and obtain the second water body segmentation result; obtain at least one kind of surface coverage data with a resolution within a preset range, and according to the surface coverage data
- the water body data is determined, and the water body region in the first target image is determined, and at least one second water body segmentation result is obtained.
- the determining the water body area in the first target image according to the water body data in the public map, and obtaining the second water body segmentation result includes: according to the geographic location corresponding to the first target image range, take the water body area corresponding to the geographic range in the public map as the target water body area; if the target water body area is a water body dividing line, extend the water body dividing line in a preset direction to Preset width, take the expanded target water body area as the second water body segmentation result; in the case that the target water body area is a polygonal area and/or a circular area, take the target water body area as the second water body area Water body segmentation results.
- the water body region in the first target image is segmented to obtain a first water body segmentation result of the first target image, including: According to the spectral information of the first target image, the normalized water index of a plurality of pixel points in the first target image is obtained; the value of the normalized water index in the plurality of pixel points is preset The pixel points within the index value range are used as the pixel points of the water body area, and the first water body segmentation result of the first target image is obtained.
- the method further includes: according to the target water body segmentation result of the first target image, labeling the water body region in the first target image to obtain a first target image including the labeling ; Using the first target image containing the label as a sample, the initial neural network model is trained to obtain a water body segmentation network.
- the water body segmentation network is trained by a preset loss function, wherein, when the water body segmentation network is trained by the preset loss function, the first training result and the third The difference between the two training results is within a preset difference range, and the first training result includes the training result obtained by taking the target water body segmentation result of the first target image as a labeled sample, and the second training result
- the results include the training results obtained by training with the manually input water body segmentation results as the labeled samples.
- a water body segmentation device comprising: a first water body segmentation module, configured to segment the water body region in the first target image according to the spectral information of the first target image to obtain the obtained water body region. the first water body segmentation result of the first target image; the second water body segmentation module is configured to segment the water body region in the first target image by at least one preset water body segmentation method to obtain at least one second water body segmentation result; a target water body segmentation result determination module, configured to determine the target water body segmentation of the first target image according to the first water body segmentation result of the first target image and the at least one second water body segmentation result result.
- a water body segmentation device comprising: a third water body segmentation module for inputting a second target image into a water body segmentation network to obtain a third water body segmentation result of the second target image;
- the four-water body segmentation module is configured to segment the water body region of the second target image according to the spectral information of the second target image to obtain a fourth water body segmentation result of the second target image; obtaining the target water body segmentation result
- the module is configured to use the water body region commonly included in the third water body segmentation result of the second target image and the fourth water body segmentation result as the target water body segmentation result of the second target image.
- an electronic device comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to: execute the above water body segmentation method.
- a computer-readable storage medium on which computer program instructions are stored, and when the computer program instructions are executed by a processor, implement the above-mentioned method for dividing a water body.
- the first water body segmentation result of the first target image is obtained by segmenting the water body region in the first target image according to the spectral information, and the first target image is segmented by at least one preset water body segmentation method.
- the water body area in the image is segmented to obtain at least one second water body segmentation result, so that the target water body segmentation result of the first target image is jointly determined according to the first water body segmentation result and the at least one second water body segmentation result.
- the first water body segmentation result determined based on the spectral information and the second water body segmentation result determined based on multiple preset water body segmentation methods can be combined, and through the mutual correction between the multiple water body segmentation results,
- the obtained target water body segmentation results have higher quality, thereby effectively improving the accuracy and accuracy of water body segmentation.
- FIG. 1 shows a flowchart of a water body segmentation method according to an embodiment of the present disclosure.
- FIG. 2 shows a schematic diagram of a water body segmentation method according to an embodiment of the present disclosure.
- FIG. 3 shows a flowchart of a water body segmentation method according to an embodiment of the present disclosure.
- FIG. 4 shows a flowchart of a water body segmentation method according to an embodiment of the present disclosure.
- FIG. 5 shows a schematic diagram of extending a water body dividing line according to an embodiment of the present disclosure.
- FIG. 6 shows a schematic diagram of annotating a first target image with an expanded second water body segmentation result according to an embodiment of the present disclosure.
- FIG. 7 shows a flowchart of a water body segmentation method according to an embodiment of the present disclosure.
- FIG. 8 shows a flowchart of a water body segmentation method according to an embodiment of the present disclosure.
- FIG. 9 shows a flowchart of a water body segmentation method according to an embodiment of the present disclosure.
- FIG. 10 shows a block diagram of a first water body dividing apparatus according to an embodiment of the present disclosure.
- FIG. 11 shows a block diagram of a second water body dividing apparatus according to an embodiment of the present disclosure.
- FIG. 12 shows a block diagram of an electronic device according to an embodiment of the present disclosure.
- FIG. 13 shows a block diagram of an electronic device according to an embodiment of the present disclosure.
- FIG. 1 shows a flowchart of a water body segmentation method according to an embodiment of the present disclosure.
- the method can be applied to a first water body segmentation device, and the first water body segmentation device can be a terminal device, a server, or other processing devices.
- the terminal device may be user equipment (User Equipment, UE), mobile device, user terminal, terminal, cellular phone, cordless phone, Personal Digital Assistant (PDA), handheld device, computing device, in-vehicle device, available wearable devices, etc.
- the water body segmentation method can be applied to a cloud server or a local server, and the cloud server can be a public cloud server or a private cloud server, which can be flexibly selected according to the actual situation.
- the water body segmentation method can also be implemented by the processor calling computer-readable instructions stored in the memory.
- the water body segmentation method may include:
- Step S11 segment the water body region in the first target image according to the spectral information of the first target image to obtain a first water body segmentation result of the first target image.
- step S12 at least one preset water body segmentation method is used to segment the water body region in the first target image to obtain at least one second water body segmentation result.
- Step S13 Determine a target water body segmentation result of the first target image according to the first water body segmentation result and at least one second water body segmentation result.
- the first target image may be any image that has the requirement of water body segmentation, and the implementation form thereof is not limited in the embodiments of the present disclosure.
- the first target image may be a remote sensing image, and the resolution of the remote sensing image may be flexibly determined according to the actual situation of the acquired image.
- the first target image may be a higher resolution image. 4-band remote sensing images.
- the source and acquisition method of the first target image are not limited in the embodiments of the present disclosure.
- a remote sensing image directly collected by a related hardware device may be acquired. Part or all of the remote sensing images can be read or selected from the database storing the remote sensing images as the first target image.
- the spectral information of the first target image may be spectral information of multiple bands contained in the first target image itself, and which spectral information of the bands contained in the first target image can be flexibly determined according to the actual situation of the first target image.
- the first target image may include spectral information in the visible light band (RGB) and the near-infrared band (NIR, Near Infrared); On the basis of the spectral information of the RGB and NIR bands, more spectral information of other bands can be included.
- step S11 since spectral information of different objects in the image may be different, the water body region in the first target image may be segmented according to the spectral information of the first target image.
- the specific implementation manner of step S11 can be flexibly determined according to the actual situation.
- the first water body segmentation result may include information such as the position and shape of the water body region in the first target image, and the first water body segmentation result obtained after segmentation may be displayed in an intuitive image manner, or may be stored in an information manner.
- the manner may be flexibly determined according to the actual situation, which is not limited in the embodiments of the present disclosure.
- step S12 by using at least one preset water body segmentation method, the implementation method of segmenting the water body region in the first target image can also be flexibly determined according to the actual situation, and reference can also be made to the following disclosed embodiments.
- the preset water body segmentation method can be any method that can segment the water body area in the image, for example, by using a related water body segmentation calculation method, or by searching some databases containing water body segmentation results, etc., or by The neural network with the function of water body segmentation, etc., which method or methods to use can be flexibly determined according to the actual situation.
- the water body segmentation is performed on the first target image by using several preset water body segmentation methods, and the number thereof is also not limited in the embodiment of the present disclosure.
- the obtained second water body segmentation results may also be different. Therefore, in a possible implementation manner, the number of second water body segmentation results may correspond to the types of preset water body segmentation methods.
- the realization form of the second water body segmentation result reference may be made to the first water body segmentation result, which will not be repeated here.
- the realization forms of the first water body segmentation result and the second water body segmentation result may be the same or different. make restrictions.
- first and “second” in the first water body segmentation result and the second water body segmentation result are only used to distinguish the water body segmentation results obtained by different methods, and The order of obtaining the water body segmentation results is not limited, and other numbers of the water body segmentation results in subsequent embodiments are the same, and will not be repeated.
- step S11 and step S12 are not limited in the embodiment of the present disclosure, that is, the order of performing water body segmentation on the first target image in different ways is not limited in the embodiment of the present disclosure, in a possible implementation manner , Steps S11 and S12 may be implemented simultaneously, and in a possible implementation manner, steps S11 and S12 and the like may also be implemented respectively according to a preset implementation sequence.
- the target water body segmentation result of the first target image may be determined according to the first water body segmentation result and the at least one second water body segmentation result.
- the target water body segmentation result may be the final segmentation result of the water body region in the target image. Since both the first water body segmentation result and the second water body segmentation result may have inaccurate water body segmentation, in a possible implementation manner , based on the difference between the first water body segmentation result and the at least one second water body segmentation result, and adjusting on the basis of the first water body segmentation result and/or the second water body segmentation result, a more accurate target water body segmentation can be obtained result.
- the target water body segmentation result For the realization form of the target water body segmentation result, reference may be made to the first water body segmentation result and the second water body segmentation result in the above disclosed embodiments, and details are not described herein again. How to determine the target water body segmentation result based on the first water body segmentation result and the at least one second water body segmentation result can be found in the following disclosed embodiments, which will not be described here.
- the water body region in the first target image is segmented to obtain a first water body segmentation result of the first target image, and the first target image is segmented by at least one preset water body segmentation method. Segment the water body area in the device to obtain at least one second water body segmentation result, so that the target water body segmentation result of the first target image is jointly determined according to the first water body segmentation result and the at least one second water body segmentation result.
- the first water body segmentation result determined based on the spectral information and the second water body segmentation result determined based on multiple preset water body segmentation methods can be combined, and through the mutual correction between the multiple water body segmentation results,
- the obtained target water body segmentation results have higher quality, thereby effectively improving the accuracy and accuracy of water body segmentation.
- step S11 may be flexibly determined according to the actual situation.
- step S11 may include:
- Step S111 obtaining the normalized water index of multiple pixels in the first target image according to the spectral information of the first target image;
- Step S112 taking the pixel points whose values of the normalized water index are within the preset index value range among the plurality of pixel points as the pixel points of the water body area, to obtain the first water body segmentation result of the first target image.
- the normalized water index may be information obtained by performing normalized interpolation processing on a specific waveband of the first target image. Information on areas of water bodies.
- the normalized water index of a plurality of pixels in the first target image is obtained, which may be the normalized water index of each pixel in the first target image, or the first target image according to the actual situation.
- the normalized water index of some pixels in the target image, etc., the specific number of pixels used to obtain the normalized water index can be flexibly selected according to the actual situation, and is not limited in the embodiments of the present disclosure.
- the method of obtaining the normalized water index of multiple pixels in the first target image is not limited in the embodiments of the present disclosure, and any related method that can calculate NDWI can be used as the implementation form of step S111, and is not limited to the following Various disclosed embodiments.
- the manner of obtaining the normalized water index can be expressed by the following formula (1):
- NDWI is the normalized water index of a certain pixel in the first target image
- Green is the spectral value of the green band corresponding to the pixel
- NIR is the spectral value of the near-infrared band corresponding to the pixel.
- step S112 may be used to determine the first water body segmentation result of the first target image.
- the pixel points whose value of the normalized water index is within the range of the preset index value can be used as the pixel points of the water body area.
- the specific value of the preset index value range can be flexibly determined according to the actual situation, and is not limited to the following disclosed embodiments.
- the preset index value range may be greater than zero, that is, in an example, pixels with a value of the normalized water index greater than 0 may be classified as pixels in the water body area, Pixels with a water index value not greater than 0 are classified as background pixels.
- the water area formed by a plurality of pixels classified as water areas can be used as the first image of the first target image. Water body segmentation results.
- the obtained first water body segmentation result may include, in addition to the water body area, buildings or Roads and other areas, so in a possible implementation manner, the water body area actually included in the first target image can be regarded as a subset of the first water body segmentation result.
- FIG. 2 shows a schematic diagram of a water body segmentation method according to an embodiment of the present disclosure. As shown in FIG.
- a satellite image can be used as the first target image, and NDWI calculation can be performed on the satellite image, and then, according to the NDWI
- the water body area can be extracted as the foreground from the satellite image, and the foreground mask shown in the upper right corner of Figure 2 can be obtained as the first water body segmentation result.
- the segmentation result also includes other areas such as buildings or roads.
- FIG. 3 shows a flowchart of a water body segmentation method according to an embodiment of the present disclosure.
- the water body segmentation method may include:
- Step S111 Acquire normalized water indices of multiple pixels in the first target image according to the spectral information of the first target image.
- Step S112 taking the pixel points whose values of the normalized water index are within the preset index value range among the plurality of pixel points as the pixel points of the water body area, to obtain the first water body segmentation result of the first target image.
- step S12 at least one preset water body segmentation method is used to segment the water body region in the first target image to obtain at least one second water body segmentation result.
- Step S13 Determine a target water body segmentation result of the first target image according to the first water body segmentation result and at least one second water body segmentation result.
- the normalized water index of a plurality of pixels in the image is obtained, and then according to the numerical relationship between the normalized water index and the preset index value range, determine Pixel points belonging to the water body area, so as to obtain the first water body segmentation result of the first target image.
- pixel-level water body segmentation can be performed on the water body area in the first target image, and a more comprehensive and clear segmentation boundary can be obtained.
- the first water body segmentation result so that the target water body segmentation result determined based on the first water body segmentation result has a higher accuracy, and the accuracy of the water body segmentation is improved.
- step S12 may include:
- Step S121 according to the water body data in the public map, determine the water body area in the first target image, and obtain the second water body segmentation result. and / or,
- Step S122 Acquire at least one type of surface coverage data with a resolution within a preset range, determine a water body area in the first target image according to the water body data in the surface coverage data, and obtain at least one second water body segmentation result.
- Open Map is an open source map, and the map content can be drawn by users according to handheld GPS devices, aerial photography photos, other free content and local knowledge, etc. Therefore, OSM can contain multiple geographic locations around the world
- the water body area information in the OSM can be used as the water body data in OSM.
- the data form of the water body data is not limited in the embodiments of the present disclosure.
- the water body data in the OSM may be: a colored line segment or a shape (polygon or The specific color, line segment and shape, etc., can be selected flexibly according to the actual situation.
- the water body data in the OSM can include water body area information in multiple geographic locations around the world
- the water body data corresponding to the geographic range can be searched from the OSM according to the geographic range corresponding to the first target image, and the first target image can be obtained by searching for the water body data corresponding to the geographic range
- the determined water body area in the first target image is used as the second water body segmentation result.
- How to determine the geographic range corresponding to the first target image can be flexibly selected according to the actual situation. For details, please refer to the following disclosed embodiments. , which will not be expanded here.
- the OSM labeling result in the figure is the second water body segmentation result determined according to the water body data in the OSM.
- the Narrow bodies of water for efficient segmentation based on the second water body segmentation result determined by the OSM.
- Land cover data can be segmentation results of certain satellite imagery related to the land surface, including water body segmentation results.
- the quality of the segmentation result of the surface coverage data is related to the resolution of the segmented satellite image.
- the surface coverage data with a resolution within a preset range can be obtained, and the result of the water body segmentation in the surface coverage data can be obtained.
- the data of the water body according to the geographical range corresponding to the first target image, the data of the water body corresponding to the geographical range is searched from the surface coverage data to determine the water body area in the first target image, and the determined first target image The water body area in is used as the second water body segmentation result.
- the low-resolution water body product result in the figure is the second water body segmentation result determined based on the surface coverage data. It can be seen from the figure that the second water body segmentation result determined based on the surface coverage data, It can effectively segment wider water bodies such as rivers, and has a clearer segmentation boundary.
- the preset range of the resolution can be flexibly set according to the actual situation.
- a satellite image with a lower resolution can be selected.
- the surface coverage data in an example, the surface coverage data corresponding to a satellite image with a resolution of 10 meters can be selected.
- the range covered by the surface coverage data needs to cover the geographic range corresponding to the first target image as much as possible.
- the data can be global land cover data.
- At least one type of surface coverage data with a resolution within a preset range can be acquired.
- a second water body segmentation result can be obtained according to the surface coverage data; if the surface coverage data with multiple resolutions within the preset range is obtained, for each type of surface coverage data, a second water body segmentation result can be obtained;
- various second water body segmentation results for different land cover data are obtained.
- the resolutions of different ground cover data may be the same or different, which are not limited in the embodiments of the present disclosure.
- step S12 may include step S121 and/or step S122, that is, in the process of obtaining the second water body segmentation result, only the second water body segmentation determined based on the water body data in the OSM may be obtained.
- step S121 may include step S121 and/or step S122, that is, in the process of obtaining the second water body segmentation result, only the second water body segmentation determined based on the water body data in the OSM may be obtained.
- FIG. 4 shows a flowchart of a water body segmentation method according to an embodiment of the present disclosure.
- the water body segmentation method may include:
- Step S11 segment the water body region in the first target image according to the spectral information of the first target image to obtain a first water body segmentation result of the first target image.
- Step S121 according to the water body data in the public map, determine the water body area in the first target image, and obtain the second water body segmentation result; and/or,
- Step S122 Acquire at least one type of surface coverage data with a resolution within a preset range, determine a water body area in the first target image according to the water body data in the surface coverage data, and obtain at least one second water body segmentation result.
- Step S13 Determine a target water body segmentation result of the first target image according to the first water body segmentation result and at least one second water body segmentation result.
- multiple second water body segmentation results can be obtained in various ways, and the data between the multiple second water body segmentation results can be complementary to each other to maximize the The water body in the first target image is segmented more comprehensively, thereby improving the overall segmentation accuracy of the obtained multiple second water body segmentation results, and then improving the accuracy of the target water body segmentation results determined based on the multiple second water body segmentation results.
- step S121 may include:
- the water body area corresponding to the geographical range in the public map is taken as the target water body area
- the target water body area is a water body dividing line
- extend the water body dividing line to a preset width in a preset direction, and use the expanded target water body area as the second water body dividing result
- the target water body area is a polygonal area and/or a circular area
- the target water body area is used as the second water body segmentation result.
- the geographic range corresponding to the first target image may be the geographic area where the water body area in the first target image is located, and how to determine the geographic range corresponding to the first target image can be flexibly determined according to the actual situation of the first target image.
- the first target image when the first target image is a remote sensing image, the first target image itself may contain geographic information, so the geographic information contained in the first target image may be used to determine the corresponding image of the first target image. geographic range.
- the water body area corresponding to the geographic range in the public map can be used as the target water body area.
- the water body data in the OSM can be: covered on the map Colored line segments or shapes (polygons or circles) on the inner water body area, so the target water body area determined from OSM may be a water body dividing line in the form of a line segment, or it may be a non-line segment area.
- the shape is not limited in the embodiments of the present disclosure, and may be a polygon or a circle, or the like.
- the form of the target water body area may not be considered, and the target water body area may be directly used as the second water body segmentation result.
- the obtained second water body segmentation result may be used as the water body region labeling of the first target image to be used for other subsequent water body segmentation processes, such as training a neural network with a water body segmentation function.
- the second water body segmentation result in the form of a water body segmentation line may not be used as an annotation for neural network training and other processes. Therefore, in a possible implementation manner, the second water body segmentation result can also be obtained according to the form of the target water body area.
- the form of the target water body area is a polygon and/or a circle, etc. In the case of line segments, the target water body area can be directly used as the second water body segmentation result.
- the water body dividing line when the target water body area is in the form of a water body dividing line, the water body dividing line can be extended to a predetermined width in a preset direction, so as to obtain an expanded target water body in the form of non-line segments area, the expanded target water body area can be used as the second water body segmentation result.
- both the preset direction and the preset width can be flexibly set according to the actual situation, which are not limited in the embodiments of the present disclosure.
- the preset direction may be a certain direction or multiple directions. In the case where the preset direction includes multiple directions, the preset widths in each direction may be the same or different.
- the water body may be divided into Each point on the line is expanded outward with r as the radius, so as to obtain the polygonal target water body area as the second water body segmentation result.
- Fig. 5 shows a schematic diagram of expanding a water body dividing line according to an embodiment of the present disclosure. It can be seen from Fig. 5 that the water body dividing line in the form of a line segment in the figure can be expanded into a polygonal area with a certain width through expansion. The polygonal area can be used as the second water body segmentation result.
- FIG. 6 shows a schematic diagram of annotating the first target image with the expanded second water body segmentation result according to an embodiment of the present disclosure.
- the second water body segmentation result can also be used as The water body area labeling of the first target image is superimposed with the first target image.
- the expanded target water body area is As the second water body segmentation result, when the target water body area is a polygonal area and/or a circular area, the target water body area is taken as the second water body segmentation result.
- step S13 the first water body segmentation result and at least one second water body segmentation result can be obtained, and then the target water body segmentation result of the first target image can be determined through step S13.
- the implementation manner of step S13 may be flexibly determined according to the actual situation.
- step S13 may include:
- Step S131 combining at least one second water body segmentation result to obtain a combined water body segmentation result
- Step S132 taking the water body region included in the first water body segmentation result and the combined water body segmentation result as the target water body segmentation result of the first target image.
- the combined water body segmentation result may be a result obtained by superimposing at least one second water body segmentation result.
- the second water body segmentation result may be determined according to OSM or at least one type of land cover data
- the segmentation result of the water body based on the OSM can effectively segment the narrower water body, and the segmentation result determined based on the surface cover data can effectively segment the wider water body. Therefore, for different second water bodies
- the superposition of the segmentation results can play a complementary role, and obtain the combined water body segmentation results with higher accuracy.
- the second water body segmentation result determined according to the OSM may include an expansion process for the water body segmentation line, and the expansion process may reduce the accuracy of the boundary of the second water body segmentation result obtained after expansion.
- the second water body segmentation result determined according to the ground cover data may be limited by the accuracy of the ground cover data itself, resulting in a decrease in the boundary precision of the determined second water body segmentation result.
- the first water body segmentation result has a clear segmentation boundary and includes a relatively comprehensive water body area.
- the intersection of the first water body segmentation result and the combined water body segmentation result can be obtained to obtain the water body area commonly included in the first water body segmentation result and the combined water body segmentation result, and then, The jointly included water body area can be used as the target water body segmentation result of the first target image, so that the boundary accuracy of the target water body segmentation result can be effectively improved, and then the accuracy and effect of the water body segmentation can be improved.
- FIG. 7 shows a flowchart of a water body segmentation method according to an embodiment of the present disclosure.
- the water body segmentation method may include:
- Step S11 segment the water body region in the first target image according to the spectral information of the first target image to obtain a first water body segmentation result of the first target image.
- step S12 at least one preset water body segmentation method is used to segment the water body region in the first target image to obtain at least one second water body segmentation result.
- Step S131 combining at least one second water body segmentation result to obtain a combined water body segmentation result
- Step S132 taking the water body region included in the first water body segmentation result and the combined water body segmentation result as the target water body segmentation result of the first target image.
- the combined water body segmentation result is obtained by taking the union of at least one second water body segmentation result
- the target water body segmentation result of the first target image is obtained by taking the intersection of the combined water body segmentation result and the first water body segmentation result.
- the target water body segmentation result of the first target image has higher accuracy and improves the quality of water body segmentation.
- the second water body segmentation result can also be used as the water body region labeling of the first target image, and correspondingly, the first target image obtained based on the second water body segmentation result can also be marked.
- the target water body segmentation result is used to label the first target image. Therefore, FIG. 8 shows a flowchart of a water body segmentation method according to an embodiment of the present disclosure. As shown in FIG. 8 , in a possible implementation manner, the water body segmentation method may further include:
- Step S11 segment the water body region in the first target image according to the spectral information of the first target image to obtain a first water body segmentation result of the first target image.
- step S12 at least one preset water body segmentation method is used to segment the water body region in the first target image to obtain at least one second water body segmentation result.
- Step S13 Determine a target water body segmentation result of the first target image according to the first water body segmentation result and at least one second water body segmentation result.
- Step S14 according to the target water body segmentation result of the first target image, mark the water body region in the first target image, and obtain the first target image including the label.
- Step S15 using the marked first target image as a sample to train an initial neural network model to obtain a water body segmentation network.
- the target water body segmentation result of the first target image obtained by the methods of the above disclosed embodiments may be due to the expansion of the water body segmentation line, resulting in an inaccurate segmentation boundary, or due to the ground surface
- the accuracy of the coverage data is low, which reduces the accuracy of the segmentation result. Therefore, in order to further improve the accuracy of the water body segmentation, the first target image can also be labeled according to the target water body segmentation result of the first target image, so as to use the labeled image.
- the first target image is used as a sample to train the initial neural network model to obtain a water body segmentation network that can be used for water body segmentation.
- the water body region in the first target image is marked, and each water body in the target water body segmentation result of the first target image may be marked in the first target image, It is also possible to select some of the target water body segmentation results for marking. The specific selection can be flexibly determined according to the actual situation, which is not limited in the embodiment of the present disclosure.
- the obtained first target image including the annotation can be used as a training sample to train an initial neural network model, where the initial neural network model can be any model, and is not limited to the following disclosed embodiments.
- the initial neural network model may be a semantic segmentation network model, such as U-Net, FC-Densenet, or HRNet.
- HRNet can be chosen as the initial neural network model.
- the trained water body segmentation network can be used to perform water body segmentation on the images input into the network. Specifically, how to use the water body segmentation network for application is not limited in the embodiments of the present disclosure. For details, please refer to the following disclosed embodiments. Do not expand first.
- FIG. 9 shows a flowchart of a method for dividing a water body according to an embodiment of the present disclosure.
- the method can be applied to a second water body dividing device.
- the second water body dividing device may be the same device as the first water body dividing device, or may be different devices.
- the second water body dividing device may be a terminal device, a server, or other processing devices.
- the terminal device reference may be made to the above disclosed embodiments, which will not be repeated here.
- the water body segmentation method can be applied to a cloud server or a local server, and the cloud server can be a public cloud server or a private cloud server, which can be flexibly selected according to the actual situation.
- the water body segmentation method can also be implemented by the processor calling computer-readable instructions stored in the memory.
- an embodiment of the present disclosure further proposes a water body segmentation method, including:
- Step S21 the second target image is input into the water body segmentation network to obtain a third water body segmentation result of the second target image.
- Step S22 segment the water body region of the second target image according to the spectral information of the second target image to obtain a fourth water body segmentation result of the second target image.
- Step S23 taking the water body region included in the third water body segmentation result and the fourth water body segmentation result as the target water body segmentation result of the second target image.
- the second target image may be any image that has the requirement of water body segmentation, and its implementation form may refer to the first target image in the above disclosed embodiments, which will not be repeated here.
- the "first" and “second" in the first target image and the second target image are only used to distinguish which water body segmentation process the image is used in, and do not limit the Whether the implementation manner is the same, in a possible implementation manner, the first target image and the second target image may be the same image, or may be different images.
- the water body segmentation network may be any neural network with a water body segmentation function, and its implementation form is not limited in the embodiments of the present disclosure.
- the water body segmentation network may be the one mentioned in the above disclosed embodiment,
- the specific form of the neural network obtained by training the target water body segmentation result of the first target image can be found in the above disclosed embodiments, which will not be repeated here.
- the third water body segmentation result may be a result obtained by using a water body segmentation network to perform water body segmentation on the second target image, and its implementation form may also refer to the first water body segmentation result or the second water body segmentation result, which will not be repeated here.
- step S22 the water body region of the second target image is segmented according to the spectral information of the second target image.
- the segmentation process reference may be made to the spectral information of the first target image in the above-mentioned disclosed embodiments.
- the fourth water body dividing result obtained in step S22 reference may also be made to the first water body dividing result or the second water body dividing result in the above disclosed embodiments, which will not be repeated here.
- step S21 and step S22 are not limited in the embodiment of the present disclosure, that is, the order of performing water body segmentation on the second target image in different ways is not limited in the embodiment of the present disclosure.
- step S21 and step S22 may be implemented simultaneously, and in a possible implementation manner, steps S21 and S22 and the like may also be implemented respectively according to a preset implementation sequence.
- the water body region jointly included in the third water body segmentation result and the fourth water body segmentation result may be used as the target water body segmentation result of the second target image.
- the fourth water body segmentation result can be obtained by segmenting according to the spectral information of the second target image, referring to the acquisition process of the first water body segmentation result, it can be known that the water body area actually included in the second target image can be regarded as the fourth water body area. Subset of water body segmentation results.
- the water body area commonly included between the third water body segmentation result obtained by the water body segmentation network and the fourth water body segmentation result is used as the target water body segmentation result of the second target image, and the fourth water body segmentation result does not belong to the water body.
- the segmentation results of the regions are excluded to obtain more accurate segmentation results.
- the water body segmentation is performed on the second target image through the water body segmentation network and the spectral information of the second target image, respectively, to obtain a third water body segmentation result and a fourth water body segmentation result, so that the third water body segmentation result is divided into The water body region included in the fourth water body segmentation result is used as the target water body segmentation result of the second target image.
- the method of determining the third water body segmentation result through the water body segmentation network can reduce the problem of confusion between water bodies and buildings, roads, shadows, etc., when the second target image belongs to different data sources or contains large Under the circumstance of the range of the region, it can have a stable water body segmentation effect, so that the obtained water body segmentation results have high accuracy, and the segmentation is more convenient and easy to achieve; on the other hand, using the The four water body segmentation results are intersected with the third water body segmentation results to obtain the target water body segmentation results of the second target image, which can further optimize the boundaries of the obtained water body segmentation results and reduce the false scenes that are incorrectly segmented in the water body segmentation results.
- the water body segmentation network may be trained by the target water body segmentation result of the first target image, that is, in a possible implementation manner, the water body segmentation network may be based on the first target image.
- a target image and the target water body segmentation result of the first target image are obtained by training.
- how to train the water body segmentation network according to the first target image and the target water body segmentation result of the first target image is not limited in the embodiments of the present disclosure.
- the first target image is marked with the target water body segmentation result of the first target image, and the marked image is used as a sample to input
- the water body segmentation network is obtained by training the initial neural network model.
- a third water body segmentation result is obtained by performing water body segmentation on the second target image through a water body segmentation network trained according to the first target image and the target water body segmentation result of the first target image. Since the third water body segmentation result has high segmentation accuracy, it can be seen that through the above process, the water body segmentation network obtained by training can have a better water body segmentation effect, which can not only improve the accuracy of the third water body segmentation result, further, The accuracy of the target water body segmentation result of the second target image can also be improved.
- the target water body segmentation result of the first target image can be obtained flexibly in different ways. Therefore, in a possible implementation manner, the water body segmentation method proposed by the embodiments of the present disclosure may further include:
- the water body region in the first target image is segmented to obtain a first water body segmentation result of the first target image
- the target water body segmentation result of the first target image is determined.
- the process of obtaining the target water body segmentation result of the first target image used for training the water body segmentation network can be jointly determined based on the spectral information and at least one preset water body segmentation method. Therefore, the training of the water body segmentation network Data can be automatically generated, reducing the cost of manual labeling, while having high accuracy and quality.
- the loss function can be flexibly selected according to the actual situation.
- the water body segmentation network is trained through a preset loss function, wherein, in the case of training the water body segmentation network through a preset loss function, the difference between the first training result and the second training result The difference is within the preset difference range, the first training result includes the training result obtained by training with the target water body segmentation result of the first target image as the labeled sample, and the second training result includes the manually input water body segmentation result as the labeled sample.
- the training results obtained by training samples are provided by training samples.
- the water body segmentation network can be trained by using a preset loss function.
- the preset loss function may be a loss function with noise robustness, wherein the loss function with noise robustness may be obtained and not obtained when there is noise in the annotations in the sample (such as inaccurate annotations, etc.).
- the training results of samples containing noise are similar.
- the segmentation result of the target water body of the first target image may be due to the expansion of the water body segmentation line or the accuracy of the surface coverage data, etc., resulting in a less clear segmentation boundary.
- the target water body segmentation result as the labeled sample may contain a certain amount of noise.
- the labeled samples that is, those labeled with artificial water body segmentation results, can generally be considered to contain no noise.
- the preset loss function is based on the noise-containing samples (for example, the above-mentioned first target image containing annotations, that is, the first target image using the target water segmentation result of the first target image as the annotated first target image).
- the difference between the two is the preset Within the range of difference, that is, the two can have a relatively close training effect.
- the preset difference range can be flexibly determined according to the actual situation, which is not limited in the embodiments of the present disclosure.
- What kind of loss function with robustness to noise is specifically selected as the preset loss function is not limited in this embodiment of the present disclosure.
- a GCE loss function and/or an RCE loss function may be selected. , as the default loss function.
- Using a preset loss function with noise robustness to train the water body segmentation network can further reduce inaccurate or erroneous segmentation results in the target water body segmentation results of the first target image, and learn and train the water body segmentation network. Therefore, the obtained water body segmentation network has higher water body segmentation accuracy, thereby improving the accuracy of the target water body segmentation result of the second target image obtained subsequently.
- FIG. 10 shows a block diagram of a first water body dividing apparatus according to an embodiment of the present disclosure.
- the first water body segmentation device 30 may include: a first water body segmentation module 31, configured to segment the water body region in the first target image according to the spectral information of the first target image to obtain the first target The first water body segmentation result of the image;
- the second water body segmentation module 32 is configured to segment the water body region in the first target image by at least one preset water body segmentation method to obtain at least one second water body segmentation result; the target water body segmentation result determination module 33 is used for According to the first water body segmentation result and the at least one second water body segmentation result, the target water body segmentation result of the first target image is determined.
- the target water body segmentation result determination module is configured to: combine at least one second water body segmentation result to obtain a combined water body segmentation result;
- the water body area is used as the target water body segmentation result of the first target image.
- the second water body segmentation module is configured to: determine the water body region in the first target image according to the water body data in the public map, and obtain the second water body segmentation result; and/or obtain at least one For the surface coverage data with a resolution within a preset range, the water body region in the first target image is determined according to the water body data in the surface coverage data, and at least one second water body segmentation result is obtained.
- the second water body segmentation module is further configured to: according to the geographical range corresponding to the first target image, take the water body area corresponding to the geographical range in the public map as the target water body area; in the target water body area, In the case of a water body dividing line, extend the water body dividing line to a preset width in a preset direction, and use the expanded target water body area as the second water body segmentation result; if the target water body area is a polygonal area and/or a circular area In this case, the target water body area is used as the second water body segmentation result.
- the first water body segmentation module is configured to: obtain the normalized water index of multiple pixels in the first target image according to the spectral information of the first target image; The pixel points whose value of the water index is within the range of the preset index value are regarded as the pixel points of the water body area, and the first water body segmentation result of the first target image is obtained.
- the device is further configured to: mark the water body region in the first target image according to the target water body segmentation result of the first target image, so as to obtain a first target image including the label;
- the first target image is taken as a sample, and the initial neural network model is trained to obtain a water body segmentation network.
- FIG. 11 shows a block diagram of a second water body dividing apparatus according to an embodiment of the present disclosure.
- the second water body segmentation device 40 may include: a third water body segmentation module 41 for inputting the second target image into a water body segmentation network to obtain a third water body segmentation result of the second target image; a fourth water body The segmentation module 42 is used for segmenting the water body region of the second target image according to the spectral information of the second target image to obtain a fourth water body segmentation result of the second target image; the target water body segmentation result acquisition module 43 is used for The water body region included in the three water body segmentation results and the fourth water body segmentation result is used as the target water body segmentation result of the second target image.
- the water body segmentation network is obtained by training according to the first target image and the target water body segmentation result of the first target image.
- the device is further configured to: segment the water body region in the first target image according to the spectral information of the first target image to obtain a first water body segmentation result of the first target image; A preset water body segmentation method, in which the water body area in the first target image is segmented to obtain at least one second water body segmentation result; the first target image is determined according to the first water body segmentation result and the at least one second water body segmentation result The target water body segmentation result.
- the water body segmentation network is trained through a preset loss function, wherein, in the case of training the water body segmentation network through a preset loss function, the difference between the first training result and the second training result The difference is within the preset difference range, the first training result includes the training result obtained by training with the target water body segmentation result of the first target image as the labeled sample, and the second training result includes the manually input water body segmentation result as the labeled sample.
- the application example of the present disclosure proposes a water body segmentation method, which can segment the water body region in an image with high precision.
- the water body segmentation method proposed in the application example of the present disclosure may include:
- the first step is to automate the construction of water body labeling datasets.
- the NDWI of each pixel in the image can be calculated by formula (1) in the above disclosed embodiment according to the spectrum of the satellite image, and then the pixel whose value is greater than zero is set as For category 1 (that is, the foreground of the water body area), set the pixels whose value is less than or equal to 0 to category 0 (that is, the background), and obtain a foreground mask with a good segmentation boundary as the first water body segmentation result, as shown in the upper right corner of Figure 2.
- the obtained foreground mask basically includes all the water body areas, but there are also other categories, such as buildings and roads, so the water body can be regarded as a subset of the foreground mask.
- the second water body segmentation result can also be obtained according to the labeling result of the water body area in the OSM. Since the labeling of the water body area in the OSM is divided into two categories, one is the polygon labeling, as shown in the shaded part in Figure 5. , the polygon label can be directly obtained and used for subsequent water body labeling of satellite images. The other type is water body segmentation line labeling, as shown in the line segment in Figure 5. This water body segmentation line cannot be directly used as the water body labeling for subsequent satellite images.
- the water body dividing line can be expanded and expanded outward with a radius of r to obtain a polygonal result, and then the polygonal annotation and the expanded polygonal result of the water body dividing line can be superimposed to obtain an OSM-based
- the second water body segmentation result that is, the OSM labeling result in Figure 2).
- the problem of rough boundary may occur.
- the second water body segmentation result can also be obtained from the low-resolution water body product.
- a 10-meter resolution global surface coverage product (10 types in total) can be selected as the surface coverage data, and the surface coverage data can be divided into The data of the middle water body is extracted separately as the second water body segmentation result (ie, the low-resolution water body product result in Figure 2).
- the second water body segmentation result can better extract the wider river, and the boundary is also Finer, as shown in the display box of the low-resolution water product results in Figure 2, but narrower rivers (as shown in the display box of the OSM annotation results in Figure 2) cannot be extracted.
- the second water body segmentation result based on OSM can be superimposed with the second water body segmentation result obtained based on the low-resolution water body product to obtain the combined water body segmentation result, so that the narrower water body labeling in OSM and the low-resolution water body can be combined.
- the wider river annotation in the rate water product plays a complementary role and can greatly improve the quality of the annotation dataset.
- intersection of the first water body segmentation result and the combined water body segmentation result is taken, on the one hand, the intersection can be used as the water body segmentation result of the satellite image (that is, the target water body segmentation result of the first target image mentioned in the above disclosed embodiments), and on the other hand, the intersection can be used as the water body segmentation result of the satellite image.
- it can be used as the water body area labeling of satellite images (that is, the data set constructed in Figure 2) to construct an automated water body labeling data set, thereby effectively improving the boundary effect of water body area labeling, as shown in the display box in the lower right corner of Figure 2. Show.
- the expansion and expansion of the water body dividing line and the inaccuracy of the low-resolution water body product result itself may lead to a decrease in the accuracy of the intersection result.
- the second step is automated water body segmentation.
- Water body segmentation can be regarded as a two-class problem (two types of background and water).
- the method of deep learning semantic segmentation can be used, and the image in the automatic water body labeling dataset obtained in the first step can be used as input, A water body segmentation network is obtained by performing supervised learning with labeled data as labels.
- any common semantic segmentation network can be used, such as U-Net, FC-Densenet, etc.
- the semantic segmentation network HRNet with better effect can be selected.
- a loss function with noise robust properties can also be used to train the water body segmentation network, as described in the present disclosure.
- any loss function with noise robustness can be used, such as GCE loss function or RCE loss function. The impact of water body segmentation network learning.
- the image to be subjected to water body segmentation (that is, the second target image in the above disclosed embodiments) can be input into the water body segmentation network to obtain a third water body segmentation result.
- the third water body segmentation result output by the water body segmentation network can be post-processed.
- NDWI can be used to extract the foreground mask of the second target image for water body segmentation to obtain the fourth water body.
- the segmentation result is obtained, and then the intersection of the third water body segmentation result and the fourth water body segmentation result is obtained to obtain the target water body segmentation result of the second target image, so that the boundary of the water body segmentation result can be further optimized, and the virtual scene in the water body segmentation result can be suppressed.
- the water body segmentation method proposed in the application example of the present disclosure can not only be applied to the segmentation of water body regions, but also can be further extended to be applied to the segmentation of other object regions, such as soil or buildings.
- the sampling segmentation method can be flexibly changed with different objects, and is not limited to the above disclosed embodiments.
- the writing order of each step does not mean a strict execution order but constitutes any limitation on the implementation process, and the specific execution order of each step should be based on its function and possible Internal logic is determined.
- Embodiments of the present disclosure further provide a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the foregoing method is implemented.
- the computer-readable storage medium may be a volatile computer-readable storage medium or a non-volatile computer-readable storage medium.
- An embodiment of the present disclosure further provides an electronic device, including: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to perform the above method.
- the above-mentioned memory can be a volatile memory (volatile memory), such as RAM; or a non-volatile memory (non-volatile memory), such as ROM, flash memory (flash memory), hard disk (Hard Disk Drive) , HDD) or solid-state drive (Solid-State Drive, SSD); or a combination of the above types of memory, and provide instructions and data to the processor.
- volatile memory such as RAM
- non-volatile memory such as ROM, flash memory (flash memory), hard disk (Hard Disk Drive) , HDD) or solid-state drive (Solid-State Drive, SSD); or a combination of the above types of memory, and provide instructions and data to the processor.
- the above-mentioned processor can be at least one of ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, and microprocessor. It can be understood that, for different devices, the electronic device used to implement the function of the processor may also be other, which is not specifically limited in the embodiment of the present disclosure.
- the electronic device may be provided as a terminal, server or other form of device.
- an embodiment of the present disclosure further provides a computer program, which implements the above method when the computer program is executed by a processor.
- FIG. 12 is a block diagram of an electronic device 800 according to an embodiment of the present disclosure.
- electronic device 800 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, fitness device, personal digital assistant, etc. terminal.
- an electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814 , and the communication component 816 .
- the processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations.
- the processing component 802 can include one or more processors 820 to execute instructions to perform all or some of the steps of the methods described above.
- processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components.
- processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.
- Memory 804 is configured to store various types of data to support operation at electronic device 800 . Examples of such data include instructions for any application or method operating on electronic device 800, contact data, phonebook data, messages, pictures, videos, and the like. Memory 804 may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.
- SRAM static random access memory
- EEPROM electrically erasable programmable read only memory
- EPROM erasable Programmable Read Only Memory
- PROM Programmable Read Only Memory
- ROM Read Only Memory
- Magnetic Memory Flash Memory
- Magnetic or Optical Disk Magnetic Disk
- Power supply assembly 806 provides power to various components of electronic device 800 .
- Power supply components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 800 .
- Multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user.
- the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user.
- the touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe action.
- the multimedia component 808 includes a front-facing camera and/or a rear-facing camera. When the electronic device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each of the front and rear cameras can be a fixed optical lens system or have focal length and optical zoom capability.
- Audio component 810 is configured to output and/or input audio signals.
- audio component 810 includes a microphone (MIC) that is configured to receive external audio signals when electronic device 800 is in operating modes, such as calling mode, recording mode, and voice recognition mode.
- the received audio signal may be further stored in memory 804 or transmitted via communication component 816 .
- audio component 810 also includes a speaker for outputting audio signals.
- the I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to: home button, volume buttons, start button, and lock button.
- Sensor assembly 814 includes one or more sensors for providing status assessment of various aspects of electronic device 800 .
- the sensor assembly 814 can detect the on/off state of the electronic device 800, the relative positioning of the components, such as the display and the keypad of the electronic device 800, the sensor assembly 814 can also detect the electronic device 800 or one of the electronic device 800 Changes in the position of components, presence or absence of user contact with the electronic device 800 , orientation or acceleration/deceleration of the electronic device 800 and changes in the temperature of the electronic device 800 .
- Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact.
- Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
- the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
- Communication component 816 is configured to facilitate wired or wireless communication between electronic device 800 and other devices.
- Electronic device 800 may access wireless networks based on communication standards, such as WiFi, 2G or 3G, or a combination thereof.
- the communication component 816 receives broadcast signals or broadcast related personnel information from an external broadcast management system via a broadcast channel.
- the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication.
- NFC near field communication
- the NFC module may be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
- RFID radio frequency identification
- IrDA infrared data association
- UWB ultra-wideband
- Bluetooth Bluetooth
- electronic device 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmed gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation is used to perform the above method.
- ASICs application specific integrated circuits
- DSPs digital signal processors
- DSPDs digital signal processing devices
- PLDs programmable logic devices
- FPGA field programmable A programmed gate array
- controller microcontroller, microprocessor or other electronic component implementation is used to perform the above method.
- a non-volatile computer-readable storage medium such as a memory 804 comprising computer program instructions executable by the processor 820 of the electronic device 800 to perform the above method is also provided.
- FIG. 13 is a block diagram of an electronic device 1900 according to an embodiment of the present disclosure.
- the electronic device 1900 may be provided as a server.
- electronic device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource, represented by memory 1932, for storing instructions executable by processing component 1922, such as applications.
- An application program stored in memory 1932 may include one or more modules, each corresponding to a set of instructions.
- the processing component 1922 is configured to execute instructions to perform the above-described methods.
- the electronic device 1900 may also include a power supply assembly 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input output (I/O) interface 1958 .
- Electronic device 1900 may operate based on an operating system stored in memory 1932, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM or the like.
- a non-volatile computer-readable storage medium such as memory 1932 comprising computer program instructions executable by processing component 1922 of electronic device 1900 to perform the above-described method.
- the present disclosure may be a system, method and/or computer program product.
- the computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the present disclosure.
- a computer-readable storage medium may be a tangible device that can hold and store instructions for use by the instruction execution device.
- the computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing.
- Non-exhaustive list of computer readable storage media include: portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM) or flash memory), static random access memory (SRAM), portable compact disk read only memory (CD-ROM), digital versatile disk (DVD), memory sticks, floppy disks, mechanically coded devices, such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above.
- RAM random access memory
- ROM read only memory
- EPROM erasable programmable read only memory
- flash memory static random access memory
- SRAM static random access memory
- CD-ROM compact disk read only memory
- DVD digital versatile disk
- memory sticks floppy disks
- mechanically coded devices such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above.
- Computer-readable storage media are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (eg, light pulses through fiber optic cables), or through electrical wires transmitted electrical signals.
- the computer readable program instructions described herein may be downloaded to various computing/processing devices from a computer readable storage medium, or to an external computer or external storage device over a network such as the Internet, a local area network, a wide area network, and/or a wireless network.
- the network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers.
- a network adapter card or network interface in each computing/processing device receives computer-readable program instructions from a network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .
- Computer program instructions for carrying out operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or instructions in one or more programming languages.
- Source or object code written in any combination, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as the "C" language or similar programming languages.
- the computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement.
- the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through the Internet connect).
- electronic circuits such as programmable logic circuits, field programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are personalized by utilizing state personnel information of computer readable program instructions.
- Computer readable program instructions can be executed to implement various aspects of the present disclosure.
- These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer or other programmable data processing apparatus to produce a machine that causes the instructions when executed by the processor of the computer or other programmable data processing apparatus , resulting in means for implementing the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.
- These computer readable program instructions can also be stored in a computer readable storage medium, these instructions cause a computer, programmable data processing apparatus and/or other equipment to operate in a specific manner, so that the computer readable medium on which the instructions are stored includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.
- Computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other equipment to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other equipment to produce a computer-implemented process , thereby causing instructions executing on a computer, other programmable data processing apparatus, or other device to implement the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.
- each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more functions for implementing the specified logical function(s) executable instructions.
- the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
- each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Analysis (AREA)
Abstract
Description
Claims (14)
- 一种水体分割方法,包括:根据第一目标图像的光谱信息,对所述第一目标图像中的水体区域进行分割,得到所述第一目标图像的第一水体分割结果;通过至少一种预设水体分割方式,对所述第一目标图像中的水体区域进行分割,得到至少一个第二水体分割结果;根据所述第一目标图像的所述第一水体分割结果,以及所述至少一个第二水体分割结果,确定所述第一目标图像的目标水体分割结果。
- 根据权利要求1所述的方法,其特征在于,所述根据所述第一目标图像的所述第一水体分割结果,以及所述至少一个第二水体分割结果,确定所述第一目标图像的目标水体分割结果,包括:对所述至少一个第二水体分割结果进行合并,得到合并水体分割结果;将所述第一目标图像的所述第一水体分割结果和所述合并水体分割结果中共同包含的水体区域,作为所述第一目标图像的目标水体分割结果。
- 根据权利要求1或2所述的方法,其特征在于,所述通过至少一种预设水体分割方式,对所述第一目标图像中的水体区域进行分割,得到至少一个第二水体分割结果,包括以下中的至少一个:根据公开地图中的水体数据,确定所述第一目标图像中的水体区域,得到第二水体分割结果;获取至少一种分辨率在预设范围内的地表覆盖数据,根据所述地表覆盖数据中水体的数据,确定所述第一目标图像中的水体区域,得到至少一种第二水体分割结果。
- 根据权利要求3所述的方法,其特征在于,所述根据公开地图中的水体数据,确定所述第一目标图像中的水体区域,得到第二水体分割结果,包括:根据所述第一目标图像对应的地理范围,将所述公开地图中与所述地理范围对应的水体区域,作为目标水体区域;在所述目标水体区域为水体分割线的情况下,在预设方向上将所述水体分割线扩展至预设宽度,将扩展后的目标水体区域作为所述第二水体分割结果;在所述目标水体区域为多边形区域和/或圆形区域的情况下,将所述目标水体区域作为所述第二水体分割结果。
- 根据权利要求1至4中任意一项所述的方法,其特征在于,所述根据第一目标图像的光谱信息,对所述第一目标图像中的水体区域进行分割,得到所述第一目标图像的第一水体分割结果,包括:根据所述第一目标图像的光谱信息,获取所述第一目标图像中多个像素点的归一化水指数;将所述多个像素点中所述归一化水指数的值在预设指数值范围内的像素点作为水体区域的像素点,得到所述第一目标图像的第一水体分割结果。
- 根据权利要求1至5中任意一项所述的方法,其特征在于,所述方法还包括:根据所述第一目标图像的目标水体分割结果,对所述第一目标图像中的水体区域进行标注,得到包含标注的第一目标图像;将所述包含标注的第一目标图像作为样本,对初始神经网络模型进行训练,得到水体分割网络。
- 一种水体分割方法,包括:将第二目标图像输入水体分割网络,得到所述第二目标图像的第三水体分割结果;根据所述第二目标图像的光谱信息,对所述第二目标图像的水体区域进行分割,得到所述第二目标图像的第四水体分割结果;将所述第二目标图像的所述第三水体分割结果和所述第四水体分割结果中共同包含的水体 区域,作为所述第二目标图像的目标水体分割结果。
- 根据权利要求7所述的方法,其特征在于,所述水体分割网络为根据第一目标图像以及所述第一目标图像的目标水体分割结果进行训练得到的。
- 根据权利要求8所述的方法,其特征在于,所述方法还包括:根据所述第一目标图像的光谱信息,对所述第一目标图像中的水体区域进行分割,得到所述第一目标图像的第一水体分割结果;通过至少一种预设水体分割方式,对所述第一目标图像中的水体区域进行分割,得到至少一个第二水体分割结果;根据所述第一目标图像的所述第一水体分割结果,以及所述至少一个第二水体分割结果,确定所述第一目标图像的目标水体分割结果。
- 根据权利要求8至9任一所述的方法,其特征在于,在通过预设损失函数对所述水体分割网络进行训练的情况下,第一训练结果和第二训练结果之间的差异在预设差异范围以内,所述第一训练结果包括以所述第一目标图像的目标水体分割结果作为标注的样本进行训练所得到的训练结果,所述第二训练结果包括以人工输入的水体分割结果作为标注的样本进行训练所得到的训练结果。
- 一种水体分割装置,包括:第一水体分割模块,用于根据第一目标图像的光谱信息,对所述第一目标图像中的水体区域进行分割,得到所述第一目标图像的第一水体分割结果;第二水体分割模块,用于通过至少一种预设水体分割方式,对所述第一目标图像中的水体区域进行分割,得到至少一个第二水体分割结果;目标水体分割结果确定模块,用于根据所述第一目标图像的所述第一水体分割结果,以及所述至少一个第二水体分割结果,确定所述第一目标图像的目标水体分割结果。
- 一种水体分割装置,包括:第三水体分割模块,用于将第二目标图像输入水体分割网络,得到所述第二目标图像的第三水体分割结果;第四水体分割模块,用于根据所述第二目标图像的光谱信息,对所述第二目标图像的水体区域进行分割,得到所述第二目标图像的第四水体分割结果;目标水体分割结果获取模块,用于将所述第二目标图像的所述第三水体分割结果和所述第四水体分割结果中共同包含的水体区域,作为所述第二目标图像的目标水体分割结果。
- 一种电子设备,其特征在于,包括:处理器;用于存储处理器可执行指令的存储器;其中,所述处理器被配置为调用所述存储器存储的指令,以执行权利要求1至10中任意一项所述的方法。
- 一种计算机可读存储介质,其上存储有计算机程序指令,其特征在于,所述计算机程序指令被处理器执行时实现权利要求1至10中任意一项所述的方法。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2022520222A JP2023502194A (ja) | 2020-10-13 | 2021-06-30 | 水域分割方法及び装置、電子機器並びに記憶媒体 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011092192.5 | 2020-10-13 | ||
CN202011092192.5A CN112164083A (zh) | 2020-10-13 | 2020-10-13 | 水体分割方法及装置、电子设备和存储介质 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022077958A1 true WO2022077958A1 (zh) | 2022-04-21 |
Family
ID=73866763
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/103731 WO2022077958A1 (zh) | 2020-10-13 | 2021-06-30 | 水体分割方法及装置、电子设备和存储介质 |
Country Status (3)
Country | Link |
---|---|
JP (1) | JP2023502194A (zh) |
CN (1) | CN112164083A (zh) |
WO (1) | WO2022077958A1 (zh) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115170947A (zh) * | 2022-05-12 | 2022-10-11 | 广东省科学院广州地理研究所 | 基于遥感图像的河口浑浊带与水体分类方法、装置及设备 |
CN117409203A (zh) * | 2023-11-14 | 2024-01-16 | 自然资源部国土卫星遥感应用中心 | 一种浅水湖泊面积提取的方法 |
CN117994797A (zh) * | 2024-04-02 | 2024-05-07 | 杭州海康威视数字技术股份有限公司 | 一种水尺读数方法、装置、存储介质和电子设备 |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112164083A (zh) * | 2020-10-13 | 2021-01-01 | 上海商汤智能科技有限公司 | 水体分割方法及装置、电子设备和存储介质 |
CN112668530A (zh) * | 2021-01-04 | 2021-04-16 | 北京简巨科技有限公司 | 水体提取方法、装置、电子设备及存储介质 |
CN113343945B (zh) * | 2021-08-02 | 2021-12-31 | 航天宏图信息技术股份有限公司 | 水体识别方法、装置、电子设备及存储介质 |
CN114332637B (zh) * | 2022-03-17 | 2022-08-30 | 北京航空航天大学杭州创新研究院 | 遥感影像水体提取方法、遥感影像水体提取的交互方法 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109977801A (zh) * | 2019-03-08 | 2019-07-05 | 中国水利水电科学研究院 | 一种联合光学和雷达的区域水体快速动态提取方法及系统 |
CN111127486A (zh) * | 2019-12-25 | 2020-05-08 | Oppo广东移动通信有限公司 | 图像分割方法、装置、终端及存储介质 |
CN111160349A (zh) * | 2019-12-16 | 2020-05-15 | 广州地理研究所 | 基于哨兵遥感数据的水体提取方法及装置、设备 |
CN112164083A (zh) * | 2020-10-13 | 2021-01-01 | 上海商汤智能科技有限公司 | 水体分割方法及装置、电子设备和存储介质 |
-
2020
- 2020-10-13 CN CN202011092192.5A patent/CN112164083A/zh not_active Withdrawn
-
2021
- 2021-06-30 WO PCT/CN2021/103731 patent/WO2022077958A1/zh active Application Filing
- 2021-06-30 JP JP2022520222A patent/JP2023502194A/ja not_active Withdrawn
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109977801A (zh) * | 2019-03-08 | 2019-07-05 | 中国水利水电科学研究院 | 一种联合光学和雷达的区域水体快速动态提取方法及系统 |
CN111160349A (zh) * | 2019-12-16 | 2020-05-15 | 广州地理研究所 | 基于哨兵遥感数据的水体提取方法及装置、设备 |
CN111127486A (zh) * | 2019-12-25 | 2020-05-08 | Oppo广东移动通信有限公司 | 图像分割方法、装置、终端及存储介质 |
CN112164083A (zh) * | 2020-10-13 | 2021-01-01 | 上海商汤智能科技有限公司 | 水体分割方法及装置、电子设备和存储介质 |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115170947A (zh) * | 2022-05-12 | 2022-10-11 | 广东省科学院广州地理研究所 | 基于遥感图像的河口浑浊带与水体分类方法、装置及设备 |
CN115170947B (zh) * | 2022-05-12 | 2023-04-18 | 广东省科学院广州地理研究所 | 基于遥感图像的河口浑浊带与水体分类方法、装置及设备 |
CN117409203A (zh) * | 2023-11-14 | 2024-01-16 | 自然资源部国土卫星遥感应用中心 | 一种浅水湖泊面积提取的方法 |
CN117409203B (zh) * | 2023-11-14 | 2024-04-02 | 自然资源部国土卫星遥感应用中心 | 一种浅水湖泊面积提取的方法 |
CN117994797A (zh) * | 2024-04-02 | 2024-05-07 | 杭州海康威视数字技术股份有限公司 | 一种水尺读数方法、装置、存储介质和电子设备 |
Also Published As
Publication number | Publication date |
---|---|
CN112164083A (zh) | 2021-01-01 |
JP2023502194A (ja) | 2023-01-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2022077958A1 (zh) | 水体分割方法及装置、电子设备和存储介质 | |
US10169896B2 (en) | Rebuilding images based on historical image data | |
EP3226204B1 (en) | Method and apparatus for intelligently capturing image | |
TWI753348B (zh) | 位姿確定方法、位姿確定裝置、電子設備和電腦可讀儲存媒介 | |
US10025472B2 (en) | Method and apparatus for displaying data regarding a device's traversal through a region | |
US9280852B2 (en) | Augmented reality virtual guide system | |
WO2020134866A1 (zh) | 关键点检测方法及装置、电子设备和存储介质 | |
WO2020181728A1 (zh) | 图像处理方法及装置、电子设备和存储介质 | |
WO2016192325A1 (zh) | 视频文件的标识处理方法及装置 | |
WO2023103377A1 (zh) | 标定方法及装置、电子设备、存储介质及计算机程序产品 | |
WO2019205605A1 (zh) | 人脸特征点的定位方法及装置 | |
TWI749532B (zh) | 一種定位方法及定位裝置、電子設備和電腦可讀儲存媒介 | |
US20210168279A1 (en) | Document image correction method and apparatus | |
CN113450459B (zh) | 目标物的三维模型构建方法及装置 | |
EP3933753A1 (en) | Method for processing image, related device and storage medium | |
WO2022017140A1 (zh) | 目标检测方法及装置、电子设备和存储介质 | |
CN111339880A (zh) | 一种目标检测方法及装置、电子设备和存储介质 | |
WO2023142554A1 (zh) | 计数方法及装置、电子设备、存储介质和计算机程序产品 | |
WO2023155350A1 (zh) | 一种人群定位方法及装置、电子设备和存储介质 | |
WO2023230927A1 (zh) | 图像处理方法、装置及可读存储介质 | |
WO2019174606A1 (zh) | 图像处理方法和终端 | |
CN113722410A (zh) | 车位信息管理方法、装置、存储介质及电子设备 | |
CN116310663A (zh) | 点云配准效果的测试方法、设备、存储介质及程序产品 | |
CN114170242A (zh) | 样本图像的生成方法、图像预测方法、装置、设备及介质 | |
CN114511712A (zh) | 一种目标对象确定方法及装置、电子设备和存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2022520222 Country of ref document: JP Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21879006 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21879006 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 22.09.2023) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21879006 Country of ref document: EP Kind code of ref document: A1 |