WO2016099378A1 - Method and system for classifying a terrain type in an area - Google Patents

Method and system for classifying a terrain type in an area Download PDF

Info

Publication number
WO2016099378A1
WO2016099378A1 PCT/SE2015/051309 SE2015051309W WO2016099378A1 WO 2016099378 A1 WO2016099378 A1 WO 2016099378A1 SE 2015051309 W SE2015051309 W SE 2015051309W WO 2016099378 A1 WO2016099378 A1 WO 2016099378A1
Authority
WO
WIPO (PCT)
Prior art keywords
terrain type
area
type index
images
aerial images
Prior art date
Application number
PCT/SE2015/051309
Other languages
English (en)
French (fr)
Inventor
Leif Haglund
Folke Isaksson
Per CARLBOM
Ola NYGREN
Johan Borg
Sanna Ringqvist
Anton Nordmark
Original Assignee
Vricon Systems Aktiebolag
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vricon Systems Aktiebolag filed Critical Vricon Systems Aktiebolag
Publication of WO2016099378A1 publication Critical patent/WO2016099378A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes
    • G06V20/13Satellite images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/05Geographic models
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/50Depth or shape recovery
    • G06T7/507Depth or shape recovery from shading
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10032Satellite or aerial image; Remote sensing
    • G06T2207/10036Multispectral image; Hyperspectral image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30181Earth observation

Definitions

  • the present disclosure relates to a method for classifying a terrain type in an area. It also relates to a system for classifying a terrain type in an area, to a computer program and a computer program product.
  • Satellites used for providing pictures of the Earth's surface can often generate multi-spectral images, i.e. the images generated by these satellites can comprise information in different wavelength areas, for example from ultraviolet (UV) to infrared (IR).
  • the satellites WorldView-2 and WorldView-3 operated by the company DigitalGlobe provide images from eight different spectral bands named coastal blue (400-450 nm), blue (450-510 nm), green (510-580 nm), yellow (585-625 nm), red (630-690 nm), red-edge (705-745 nm), near IR (NIR) 1 (770-895 nm), and NIR2 (860-1040 nm).
  • the images can be analysed for identifying, for example, water, other terrain types, cities, etc.
  • a water index can be generated for every pixel in the images.
  • the water index is defined by defining a ratio _ P coastal blue ⁇ PNIR2
  • Pcoastal blue + PNIR2 as water index.
  • p N i R2 denotes the reflectance in the NIR2-spectral band
  • p CO astai biue denotes the reflectance in the coastal blue-spectral band.
  • a pre-determined threshold for the water index can then determine whether that pixel should be classified as water or not.
  • One reason why the water index above works is that water usually reflects blue wavelengths quite well, whereas NIR-wavelengths usually are reflected only to small amounts. Another example is
  • p green denotes the reflectance in the green-spectral band
  • p NIR denotes the reflectance in the NIR-spectral band.
  • l/l , Gf can, for example, be used for the GeoEye-1 satellite which has four spectral bands, namely blue, green, red, and near IR (NIR). Also other quantities than the reflectance can be used.
  • NIR near IR
  • This confidence score is calculated via stereo matching of images and denotes how well pixels from different images could be matched together in a stereo matching process. It is assumed that water areas are more difficult to match, which results in that pixels within the water areas in general have much less confidence in a stereo matching procedure than pixels from land areas. A threshold for this confidence can then be determined and pixels originally classified as corresponding to water/non-water can then, depending on which side of the threshold of the confidence score they are, keep or change their status as pixels within/outside water areas.
  • stereo matching puts restraints on the images used in the stereo matching process as they should be taken at the same time of the year for allowing stereo matching, since snow or different appearances of deciduous trees otherwise might make it impossible to find corresponding pixels. Further, stereo matching requires a lot of
  • One object of the present disclosure is to provide an improved way of classifying terrain types.
  • Another object of the present disclosure is to provide an alternative way of classifying terrain types. In one example this has been achieved by a method for classifying a terrain type in an area.
  • the method comprises a step of obtaining a plurality of overlapping aerial images of the area.
  • the method also comprises calculating at least one terrain type index for each part of each of the aerial images which lies in the area, where the at least one terrain type index represents the terrain type.
  • the method also comprises a step of determining at least one effective terrain type index for each part of the area based on the calculated at least one terrain type index for each part of each of the aerial images; and a step of classifying the parts of the area for which at least one pre-determined conditions is met as containing the terrain type, wherein at least one of the at least one predetermined condition relates to a value of the determined at least one effective terrain type index.
  • a "wrong" terrain type index in one or a few of the pluralities of the pictures will likely not affect the final classification too much.
  • Problems with shadows are, for example, reduced. This is due to the fact that images in the plurality of the images usually are taken at different times of day and/or different times of the year so that the shadows are at different areas on different images. The shadows in each respective image do not heavily contribute when determining the effective terrain type index. Also other reasons for wrong classification are reduced. Boats, ships, or other moving water-based objects which usually would be classified as small islands will not do so with the present method.
  • the classified terrain type is water and the at least one terrain type index comprises a water index. This is especially useful since water areas often are important to recognise since the water areas can preclude different tasks, like being traversed by land-based vehicles, constructing buildings or infrastructure, or the like.
  • surface elevation data is used to relate the images in the obtained plurality of overlapping aerial images to area data and/or to relate the effective terrain type index to area data. Making this relation is an easy way to assure that a specific part of an image and the determined effective terrain type index relate to a specific part of the area, for example a specific part of the Earth's surface.
  • the aerial images are images taken from at least one satellite. This allows for easily classifying large areas. Especially if the images are provided from several satellites, a larger amount of images will be available. This will increase the accuracy and/or the reliability of the determined at least one effective terrain type and thus of the
  • the method further comprises a step of calibrating said plurality of aerial images of an area for at least one wavelength band and preferably for all wavelength bands which are used for calculating the at least one terrain type index. This improves the accuracy of the calculated terrain type indices and thus the determined at least one effective terrain type index even further.
  • the step of determining the at least one effective terrain index for each part of the area comprises using a voting mechanism and/or a statistical method. This is especially useful for removing wrong classifications due to shadows, moving objects, or the like. Further, voting and/or statistical methods are computationally easy to calculate.
  • the method is used to classify a plurality of terrain types based on a plurality of terrain type indices each representing a specific terrain type. This is useful for many applications like urban planning, infrastructure constructions, or the like.
  • the method further comprises a step of obtaining surface elevation data of the area, and the at least one pre-determined condition relates also to surface elevation data for the corresponding part of the area. This can improve the classification even further since some terrain types are incompatible with some surface elevation profiles.
  • the method further comprises a step of obtaining at least one shadow mask. This allows for removing unreliable results from the method and thus provides a method where wrong classifications of the terrain type are even further reduced.
  • the step of obtaining the at least one shadow mask comprises the step of obtaining for each of the images in the plurality of overlapping aerial images information relating to the position of the sun at the time the image was taken and
  • It further comprises the steps of providing a three-dimensional model of the area and of determining the position of the shadow in each of the images in the plurality of overlapping aerial images based on the provided three-dimensional model of the area, based on the information relating to the position of the sun at the time the image was taken and based on the information relating to the angle from which the image was taken. Using these steps is an efficient way of
  • the terrain type index is only calculated, alternatively only used, for the parts of each of the images in the plurality of overlapping aerial images for which no shadow has been determined. Since terrain type indices in shadowed areas can be unreliable, this has the effect that unreliable results will not influence the classification. By omitting the calculation of unreliable results the method can further be speeded up.
  • at least some of the objects have been achieved by a computer program comprising a program code for classifying a terrain type in an area.
  • the computer program comprises the step of obtaining a plurality of overlapping aerial images of the area.
  • the computer program also comprises classifying the parts of the area for which at least one pre-determined conditions is met as containing the terrain type, wherein at least one of the at least one predetermined condition relates to a value of the determined at least one effective terrain type index.
  • a computer program product comprising a program code stored on a computer readable storage medium for classifying a terrain type in an area.
  • the program code is configured to execute the step of obtaining a plurality of overlapping aerial images of the area. It is further configured to execute the step of calculating at least one terrain type index for each part of each of the aerial images, where the at least one terrain type index represents the terrain type. It is even further configured to execute the step of determining at least one effective terrain type index for each part of the area based on the calculated at least one terrain type index for each part of each of the aerial images.
  • the program code is configured to also execute the step of classifying the parts of the area for which at least one pre-determined conditions is met as containing the terrain type, wherein at least one of the at least one predetermined condition relates to a value of the determined at least one effective terrain type index.
  • a system for classifying a terrain type in an area comprises memory means which are arranged to store a plurality of overlapping aerial images of the area.
  • the system also comprises a processing unit which is arranged to calculate at least one terrain type index for each part of each of the aerial images, where the at least one terrain type index represents the terrain type.
  • the processing unit is further arranged to determine at least one effective terrain type index for each part of the area based on the calculated at least one terrain type index for each part of each of the aerial images.
  • the processor unit is even further arranged to classify the parts of the area for which at least one pre-determined conditions is met as containing the terrain type, wherein at least one of the at least one predetermined condition relates to a value of the determined at least one effective terrain type index.
  • the processing unit is further arranged to calibrate said plurality of aerial images of an area for at least one wavelength band and preferably for all wavelength bands which are used for calculating the at least one terrain type index.
  • the processing unit is further arranged to obtain at least one shadow mask.
  • surface elevation data of the area is attributed to the plurality of overlapping aerial images of the area, and where the at least one pre-determined condition also relates to surface elevation data for the corresponding part of the area.
  • the system, the computer program and the computer program product show similar advantages as have been described in relation to the method for classifying a terrain type in an area.
  • Fig. 1 shows a sketch of an image with a scene
  • Fig. 2 shows a sketch of a scene
  • Fig. 3 shows an illustrative sketch of a method according to first embodiments of the present disclosure
  • Fig. 4 shows a flow diagram of a method according to second embodiments of the present disclosure
  • Fig. 5 shows a flow diagram of sub-steps of an optional step according to the present disclosure
  • Fig. 6 shows a system for classifying a terrain type according to the present disclosure.
  • Fig. 1 shows a sketch of an image 1 with a scene as can be seen when the image is an aerial image.
  • the aerial image can, for example, originate from an airplane, a helicopter, a balloon, an unmanned aerial vehicle (UAV), a satellite, or the like.
  • UAV unmanned aerial vehicle
  • a big lake or a sea 10 with a shoreline 20 is depicted.
  • a land area 12 is on the other side of the shoreline 20 than the big lake or the sea 10.
  • On the land area 12 a building or another construction 13 is shown. This building or construction 13 can give rise to a shadow 14. The position of the shadow 14 depends on the position of the sun.
  • the sun is situated to the left so that the shadow 14 of the building or the construction 13 is on the side of the building or the construction 13 which is not exposed to the sun.
  • this is the right side of the building or construction 14.
  • a small lake or a pool 11 with a shoreline 21 is depicted as well.
  • Fig. 1 is only a sketch. In reality images can show much more complex structures. There are, for example, other sources of water areas possible. These other sources can be any of rivers, becks, ditches, water reservoirs, swimming pools, etc.
  • Fig. 2 shows a sketch of a scene 2.
  • Fig. 1 shows an aerial image taken "from above”
  • Fig. 2 shows the scene 2 in a side view.
  • the scene comprises a flat water area 50, a land area 51, starting at the end of the water area 50 and continuing with variations in its surface elevation on the right side of the scene 2.
  • the land area 51 is when following it from left to right in Fig. 2 first substantially flat. Then, it rises substantially in the section where the line from the land areas reference number touches the land area. It then turns into a light increasing section on which a building 52 with a roof is constructed and then turns into a more increasing section.
  • three areas 53, 54, 55 are classified as water.
  • the area 55 is correctly classified as water, whereas the areas 53 and 54 are incorrectly classified as water. For the area 53 this incorrect classification might originate due to shadows from the building 53.
  • the incorrect classification of the area 54 might originate due to other reasons.
  • Fig. 1 and Fig. 2 provide examples of situations in which the disclosed methods, systems, computer programs, and computer program products for classifying an terrain type in an area can be used.
  • a method 400 for classifying a terrain type in an area will be described in more detail in relation to Fig. 3 and Fig. 4.
  • the method starts with a step 410 of obtaining a plurality of overlapping aerial images of the area.
  • the aerial images can, for example, originate from an airplane, a helicopter, a balloon, an unmanned aerial vehicle (UAV), a satellite, or the like. If the aerial images are provided from satellites they are especially useful since satellite images usually are available in several wavelength bands as described before, which facilitates calculating terrain type indices. Further, satellite images might provide images over huge areas.
  • the method 400 takes special advantage in case images are taken at different day times and/or times of the year. Also, the method 400 is able to combine images taken at different times of the year.
  • the method 400 shows also special advantages if the images in the plurality of overlapping aerial images are not taken simultaneously. All these occurrences are usually given by satellite images. It should, however, be noted that none of the above named occurrences is a requirement for the method to work, and that all of these occurrences in principle also could be achieved with images taken by other means than satellites. It should also be noted that the method works with images taken by the same satellite, as well as with images taken from different satellites.
  • the aerial images are images taken from one satellite.
  • the aerial images are images taken from different satellites.
  • the term plurality of images does refer to different images, i.e. images taken at different times, or from different angles, or by different camera arrangements, or the like.
  • the term does not relate to images which only differ by the wavelength band they use.
  • an image from, for example, the NIR2-band and an image from the green-band taken basically simultaneously and showing basically the same area would thus count in the terminology of this paper as one image and not as a plurality of images.
  • overlapping it should be understood that the images overlap inside the area where the terrain type is classified. In one example every part of the area for which the terrain type is classified is covered by at least two images from the plurality of overlapping aerial images.
  • surface elevation data is used to relate the images in the obtained plurality of overlapping aerial images to area data (not shown in Fig. 4). This could be the same kind of SED as described later, for example in relation to step 460.
  • the area data comprises in one example two-, or three-dimensional coordinates of the area.
  • area does thus not necessarily refer to a flat surface but could in one example include a height dimension as well.
  • the term relating refers to projecting.
  • the images are thus projected onto a model of the ground, for example a digital elevation model, DEM, or a digital surface model, DSM.
  • step 410 images of said plurality of aerial images of an area are calibrated for at least one wavelength band and preferably for all wavelength bands which are used for calculating the at least one terrain type index.
  • this calibration comprises aerosols in the atmosphere and/or angles of the sun.
  • step 420 is optional.
  • the images could, for example, already have been calibrated at an earlier stage. In one example, the images are not calibrated at all. This could, for example, be the case if the information extractable from the images is well suited for comparison and for calculating terrain indices even without calibrating it.
  • step 430 the method continues with step 430.
  • step 430 at least one terrain type index is calculated for each part of each of the aerial images which lies in the area.
  • the at least one terrain type index represents the terrain type.
  • the terrain type is water and the terrain type index is a water index.
  • the term part denotes any suitable subdivision of the image.
  • a terrain type index is calculated for every pixel or group of pixels of the image.
  • a terrain type index is calculated for a group of pixels.
  • each of the above named parts of an image corresponds to a part of the area, there will thus generally be different values calculated for the terrain type index of a part of the area. This is due to the fact that the a part in one image and a part in another image, both corresponding to the same part of the area, in general look different due to the different times the images were taken. Especially different times of the year or different times of the day usually influence the appearance of an image. This is due to different appearance of vegetation and different positions of shadows. Also movable objects usually differ between two images.
  • the calculated terrain type indices for each image do in one example allow classifying each image 435 with the terrain type, for example via thresholds.
  • this step comprises a step 460 of obtaining surface elevation data, SED, of the area.
  • SED surface elevation data
  • this SED is obtained via other sources, for example via a provider of SED.
  • this SED is calculated based on the obtained plurality of overlapping aerial images.
  • the SED uses in one example of the method 400 the SED to determine whether a value of the terrain type index is compatible with the SED.
  • the area 54 would under some circumstances not be compatible with a water index indicating water since the SED shows an inclining surface. Whereas this would be allowable for becks or rivers, an inclining surface would not be compatible with a lake.
  • the water index thus shows that an area in the form of a lake or similar is calculated for a part of an image for which the SED shows that this is not possible, one can then mark the value of the water index for this area as not reliable or simply disregard the values for the water index of that area.
  • the values for the water index can be different for different images as described above. This might result in that only the water indices of an area in one or in some images is/are not reliable whereas the water indices of other image(s) can still be reliable and thus used. SED can also be used for other terrain types than water.
  • step 430 comprises the step 470 of obtaining at least one shadow mask. This step is described in more detail in relation Fig. 5.
  • step 440 at least one effective terrain type index is determined for each part of the area based on the calculated at least one terrain type index for each part of each of the aerial images.
  • the calculated indices for each image, which were calculated in step 430 are used to determine a final at least one terrain type index for each part of the area.
  • the effective terrain type index of an area A is determined based on the calculated terrain type indices from the parts of the images which correspond to the area A.
  • step 440 comprises using a voting mechanism and/or a statistical method.
  • the effective terrain type index for a part of the area can for example be determined via taking the statistical average, or a weighted statistical average, of the terrain type indices from the parts of the images corresponding to this part of the area.
  • One example of weighing is shadows of clouds, in case this information is available, since images shadowed by clouds will have other appearances and other reliability than images which are exposed to direct sunlight.
  • Another, or additional, example of weighing is the angle of the sun. In case the sun is directly reflected from the ground into the sensor which takes the images the reliability of the parts of the images causing this reflection is generally quite low. Parts of the images which in the previous step have been determined having a disregarded or unreliable terrain type index are then excluded when taking the average, or at least drastically reduced in their weight.
  • SED obtained via step 460 is used in step 440. If the determined effective terrain type index is incompatible with the SED for a part of the area, the effective terrain type index for this part of the area can be marked as not reliable or simply be disregarded.
  • SED is used to relate the effective terrain type index to the area data.
  • the images have not been attributed to specific parts of the area yet, as, for example, described above, the attribution could now be made with the effective terrain type index instead.
  • a specific effective terrain type index i.e. the effective terrain type index for a specific part of the area, actually is attributed to a specific part of the area.
  • step 450 the parts of the area for which at least one pre-determined condition is met are classified as containing the terrain type, wherein at least one of the at least one predetermined condition relates to a value of the determined at least one effective terrain type index.
  • the at least one pre-determined condition is a threshold of the effective terrain type index.
  • a threshold for the determined at least one effective terrain type index is then used in the following way. Every part of the area having an effective terrain type index above the threshold is classified as containing the terrain type, while every part of the area having an effective terrain type index below the threshold is then classified as not containing the terrain type, or vice versa.
  • the determined effective terrain type index is an average of the calculated terrain type indices, or has been determined by similar statistical methods or voting mechanism, this has the effect that some calculated terrain type indices being on the "wrong" side of the threshold might be on the average on the "right” side of the threshold, thus reducing the number of wrongful classification.
  • the step 470 has been used together with step 430 and/or when SED has been used in step 430 and/or step 440, resulting in that parts of the images with incompatible or undeterminable terrain type indices were corrected or disregarded, further resulting in that the contributions of wrongful calculated terrain type indices to the final classification were already drastically reduced in previous steps, this allows an even further improved final classification of the area.
  • the number of determined effective terrain type indices which are on the "wrong" side of the threshold in step 450 is very low, resulting in an improved classification.
  • the influence of movable objects is reduced. Since movable objects usually are not at the same position in different images they will not contribute significantly to the determined effective terrain type index. This is due to the effect that their contribution is eliminated or at least reduced when averaging or voting. As a consequence the influence of these objects is also reduced when classifying the area in step 450, thus further improving right classifications. Especially the influence of ships, boats or other movable water objects will be reduced, thus reducing the probability of wrongfully classifying them as small islands, i.e. non-water areas.
  • the at least one pre-determined condition relates to the SED.
  • it is checked in step 450 if the classification is compatible with the SED. This is similar to what have been described above. If it is concluded that the classification is not compatible with the SED, the classification is in one example changed. If it, for example, is concluded that a water area in the form of a lake lies on an inclining surface, this area will be changed in its classification from water area to non-water area. Even if SED has already been used in step 430 and/or step 440 and not explicitly again in step 450, the pre-determined condition would still indirectly relate to the SED since the SED has been taken care of in determining the terrain type index.
  • the method 400 finishes after step 450.
  • the method 400 is used to classify a plurality of terrain types based on a plurality of terrain type indices each representing a specific terrain type. In one example this is done by sequentially running the method 400 for different terrain types.
  • the method 400 can, for example, first be applied to classify the area into water and non-water area. Then, at the next application of the method 400, the non- water area can be classified into area with constructions and area with no construction. Then, the area with no-construction or with construction can be further sub-classified.
  • the different terrain type indices are calculated and determined in parallel, i.e.
  • the plurality of terrain type indices is calculated in step 430, then the plurality of effective terrain type indices is determined in step 440 and then the parts of the area are classified as containing one of the plurality of terrain types in step 450.
  • strategies have to be used to avoid incompatible double-classification. Classifying a part of an area as forest and as water simultaneously would, for example, be not compatible.
  • One such strategy is to define that one classification overrules another classification, for example, that water-classification overrules any other classification.
  • a step 500 of obtaining a shadow mask is explained in more detail.
  • This step 500 is in one example performed for every of the at least one shadow masks obtained in step 470.
  • the step 500 starts with a sub-step 510 of obtaining for each of the images in the plurality of overlapping aerial images information relating to the position of the sun at the time the image was taken and information relating to the angle from which the image was taken.
  • the information relating to the angle from which the image was taken is in one example information relating to at least one of the pitch, yaw and roll angle of the camera arrangement taking the image. In one example the information relates to all of the pitch, yaw and roll angle of the camera arrangement.
  • the information relating to the position of the sun at the time the image was taken is in one example the time and date when the image was taken and the geographical location of the camera arrangement. Knowing this information, it will be possible to determine the position of the sun at the time the image was taken. This is well known in the art and not described here any further.
  • the step 500 continues with the sub-step 520.
  • a three-dimensional (3D) model of the area is provided.
  • this 3D-model of the area is derived from the SED which is obtained in the optional step 460.
  • the 3D-model is derived from the plurality of overlapping aerial images, for example via stereo matching.
  • a pre-existing 3D-model of the area is used.
  • the position of the shadow in each of the images in the plurality of overlapping aerial images is determined based on the provided three-dimensional model of the area, based on the information relating to the position of the sun at the time the image was taken and based on the information relating to the angle from which the image was taken.
  • the position of the sun and having a 3D-model of the area, one can determine which parts of the areas are covered by shadows which are caused by structures in the area. These structures of the area are for examples buildings, constructions, mountains, hills, trees, etc. The parts of the areas which are in this way determined as being covered by shadow are then determined as being the shadow mask.
  • the step 500 finishes.
  • step 500 can be divided into sub-steps.
  • the step 500 has in one example further sub-steps. It is also possible to change order of the sub-steps. Especially the sub-steps 510 and 520 do not depend on each other and can be performed in a different order or in parallel.
  • the so-determined shadow mask is unique to every image out of the plurality of obtained overlapping aerial images.
  • the terrain type index is only calculated, alternatively only used, for the parts of each of the images in the plurality of overlapping aerial images for which no shadow has been determined.
  • a terrain type index for an image is only calculated for the parts of the image which are not covered by the shadow map which corresponds to the image.
  • the terrain type index for an image is only used for the parts of the image which are not covered by the shadow map which corresponds to the image.
  • the terrain type index is in one example marked as not reliable and/or undeterminable for the parts of an image which are covered by the corresponding shadow map. As an effect, parts of an image which are covered by shadow will not contribute to determining the terrain type index. Instead, only those images where the corresponding part is not covered by shadow will contribute. This has the effect that unreliable results are not used and the determination and finally the classification will only be based on reliable results, thus reducing the number of wrong classifications.
  • Fig. 6 depicts schematically a system 600 for classifying a terrain type in an area.
  • the system 600 comprises memory means 610 and a processing unit 620.
  • the term link relates to any kind of link allowing the transmission of information.
  • the link is a wireless link.
  • the link is a physical link, for example a link comprising at least one wire or at least one fibre.
  • the memory means 610 are arranged to store a plurality of overlapping aerial images of the area. This plurality of the overlapping aerial images can be obtained as described in relation to step 410.
  • the plurality of the overlapping aerial images is provided to the memory means 610 via image providing means 630.
  • These image providing means 630 comprise in one example at least one camera arrangement.
  • the image providing means 630 comprise an image archive.
  • the memory means 610 are also arranged to store information relating to the position of the sun at the time the image was taken and information relating to the angle from which the image was taken. This information is in one example according to what is described in relation to step 510. This information is in one example provided via the image providing means 630.
  • the memory means are further arranged to store information relating to SED and/or relating to a 3D-model. This information is in one example provided via SED and/or 3D- model providing means 640.
  • the processing unit 620 is arranged to calculate at least one terrain type index for each part of each of the aerial images, where the at least one terrain type index represents the terrain type. This can be done according to what is described in step 430.
  • the processing unit is further arranged to determine at least one effective terrain type index for each part of the area based on the calculated at least one terrain type index for each part of each of the aerial images. This can be done according to what is described in relation to step 440.
  • the processor unit 620 is even further arranged to classify the parts of the area for which at least one predetermined conditions is met as containing the terrain type, wherein at least one of the at least one predetermined condition relates to a value of the determined at least one effective terrain type index. This can be done according to what is described in relation to step 450.
  • the system 600 comprises a link 615 between the processor unit and the memory means. This link allows transmission of information between the processor unit 620 and the memory means 610.
  • the processing unit 620 is further arranged to calibrate said plurality of aerial images of an area for at least one wavelength band and preferably for all wavelength bands which are used for calculating the at least one terrain type index. This can be preferably done in a way described in relation to step 420.
  • the processing unit 620 is further arranged to obtain at least one shadow mask.
  • information relating to the classification of the area is transmitted to an output device 690.
  • the output device 690 is a displaying unit.
  • the output device is a storage arrangement. The communication between the system 600 and the output device 690, the SED and/or 3D-model providing means 640 and/or the image providing means 630 is in one example arranged to be performed via links.
  • the present disclosure relates also to a computer program comprising a program code for classifying a terrain type in an area. It also relates to a computer program product comprising a program code stored on a computer readable storage medium for classifying a terrain type in an area.
  • the computer program comprises any of the steps of the method described above.
  • the program code is configured to execute any of the steps of the method as described above.
  • the computer program product is a non- transitory computer program product.
  • the computer readable storage medium is a non-transitory computer readable storage medium.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Remote Sensing (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Astronomy & Astrophysics (AREA)
  • Computer Graphics (AREA)
  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)
PCT/SE2015/051309 2014-12-16 2015-12-04 Method and system for classifying a terrain type in an area WO2016099378A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14/571,992 2014-12-16
US14/571,992 US9367743B1 (en) 2014-12-16 2014-12-16 Method and system for classifying a terrain type in an area

Publications (1)

Publication Number Publication Date
WO2016099378A1 true WO2016099378A1 (en) 2016-06-23

Family

ID=52394896

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SE2015/051309 WO2016099378A1 (en) 2014-12-16 2015-12-04 Method and system for classifying a terrain type in an area

Country Status (6)

Country Link
US (2) US9367743B1 (pl)
EP (1) EP3035237B1 (pl)
ES (1) ES2673599T3 (pl)
PL (1) PL3035237T3 (pl)
TR (1) TR201807718T4 (pl)
WO (1) WO2016099378A1 (pl)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9367743B1 (en) 2014-12-16 2016-06-14 Vricon Systems Aktiebolag Method and system for classifying a terrain type in an area
DE102015224854A1 (de) * 2015-12-10 2017-06-14 Siemens Aktiengesellschaft Verfahren zur Erstellung einer Tiefenkarte
US9846975B2 (en) * 2016-02-18 2017-12-19 Skycatch, Inc. Generating filtered, three-dimensional digital ground models utilizing multi-stage filters
US10699119B2 (en) * 2016-12-02 2020-06-30 GEOSAT Aerospace & Technology Methods and systems for automatic object detection from aerial imagery
US10546195B2 (en) * 2016-12-02 2020-01-28 Geostat Aerospace & Technology Inc. Methods and systems for automatic object detection from aerial imagery
CN107240153B (zh) * 2017-06-16 2020-09-22 千寻位置网络有限公司 基于dsm的无人机飞行安全区域计算显示方法
CN107563296B (zh) * 2017-08-07 2021-01-19 深圳先进技术研究院 基岩海岸岸线的提取方法及系统
JP6935511B2 (ja) * 2017-12-08 2021-09-15 アジア航測株式会社 地物高別色付画像生成装置及び地物高別色付画像生成プログラム
US10878588B2 (en) * 2018-06-22 2020-12-29 X Development Llc Detection and replacement of transient obstructions from high elevation digital images
CN109544558B (zh) * 2018-09-27 2021-05-11 浙江工业大学 一种城市复杂环境下阴影与水体分离方法
US11170264B2 (en) 2019-05-31 2021-11-09 Raytheon Company Labeling using interactive assisted segmentation
CN110286091B (zh) * 2019-06-11 2021-08-31 华南农业大学 一种基于无人机的近地遥感图像采集方法
US11682142B2 (en) 2019-12-20 2023-06-20 Raytheon Company Information weighted rendering of 3D point set
CN113158934A (zh) * 2021-04-28 2021-07-23 中国科学院空天信息创新研究院 基于高分辨率遥感影像的城市用地分类方法及装置、设备
EP4365852A1 (en) 2022-11-01 2024-05-08 Maxar International Sweden AB A computer implemented method for attribution of land use/land cover, a tool for building a transport network map and a navigation device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008118977A1 (en) * 2007-03-26 2008-10-02 Desert Research Institute Data analysis process
US20130004065A1 (en) * 2011-06-30 2013-01-03 Weyerhaeuser Nr Company Method and apparatus for removing artifacts from aerial images
US20140119639A1 (en) * 2012-10-31 2014-05-01 Microsoft Corporation Water-body classification
US20140212055A1 (en) * 2013-01-25 2014-07-31 Shyam Boriah Automated Mapping of Land Cover Using Sequences of Aerial Imagery

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9062983B2 (en) * 2013-03-08 2015-06-23 Oshkosh Defense, Llc Terrain classification system for a vehicle
US9367743B1 (en) 2014-12-16 2016-06-14 Vricon Systems Aktiebolag Method and system for classifying a terrain type in an area

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008118977A1 (en) * 2007-03-26 2008-10-02 Desert Research Institute Data analysis process
US20130004065A1 (en) * 2011-06-30 2013-01-03 Weyerhaeuser Nr Company Method and apparatus for removing artifacts from aerial images
US20140119639A1 (en) * 2012-10-31 2014-05-01 Microsoft Corporation Water-body classification
US20140212055A1 (en) * 2013-01-25 2014-07-31 Shyam Boriah Automated Mapping of Land Cover Using Sequences of Aerial Imagery

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
CHUA TAT-SENG ET AL.: "COASTLINE DETECTION BY A MARKOVIAN SEGMENTATION ON SAR IMAGES", SIGNAL PROCESSING, vol. 55, no. 1, November 1996 (1996-11-01), AMSTERDAM, NL, pages 123 - 132 *

Also Published As

Publication number Publication date
US20160171279A1 (en) 2016-06-16
PL3035237T3 (pl) 2018-10-31
US9704041B2 (en) 2017-07-11
TR201807718T4 (tr) 2018-06-21
EP3035237B1 (en) 2018-04-25
EP3035237A1 (en) 2016-06-22
US9367743B1 (en) 2016-06-14
US20160253545A1 (en) 2016-09-01
ES2673599T3 (es) 2018-06-25

Similar Documents

Publication Publication Date Title
US9704041B2 (en) Method and system for classifying a terrain type in an area
US11995886B2 (en) Large-scale environment-modeling with geometric optimization
AU2015404215B2 (en) Vegetation management for power line corridor monitoring using computer vision
AU2015404580B2 (en) Condition detection using image processing
CN107610164B (zh) 一种基于多特征混合的高分四号影像配准方法
CN111832518B (zh) 基于时空融合的tsa遥感影像土地利用方法
US11776104B2 (en) Roof condition assessment using machine learning
CN110070025A (zh) 基于单目图像的三维目标检测系统及方法
CN110569797A (zh) 地球静止轨道卫星影像山火检测方法、系统及其存储介质
Axelsson et al. Roof type classification using deep convolutional neural networks on low resolution photogrammetric point clouds from aerial imagery
CN115512247A (zh) 基于图像多参数提取的区域建筑损伤等级评定方法
Vakalopoulou et al. Simultaneous registration, segmentation and change detection from multisensor, multitemporal satellite image pairs
Jabari et al. Stereo-based building detection in very high resolution satellite imagery using IHS color system
CN117274799A (zh) 基于先验知识和遥感数据的城市绿地提取方法
Feurer et al. Using kites for 3-D mapping of gullies at decimetre-resolution over several square kilometres: a case study on the Kamech catchment, Tunisia
JP7028336B2 (ja) 学習装置、学習方法および学習プログラム
Krauss et al. Fusing stereo and multispectral data from WorldView-2 for urban modeling
CN116740514A (zh) 时空误差容忍的多智能体协同感知方法、装置和电子设备
Arcidiacono et al. Improving per-pixel classification of crop-shelter coverage by texture analyses of high-resolution satellite panchromatic images
WO2023178162A1 (en) Systems and methods for digital surface model reconstruction from images using artificial intelligence
Schipper Exploring the morphological development of embryo dunes in Terschelling using unmanned aerial vehicle imagery
Cao Research on data processing and information extraction of remote sensing image based on the UAV aerial photography
Iikura et al. Surface reflectance estimation from satellite imagery with inhomogeneous atmospheric conditions
CN117726943A (zh) 一种超高分辨率植被冠层高度估算方法
Aval et al. Airborne Optical Remote Sensing Potential for Pool Mapping in an Urban Environment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15870454

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15870454

Country of ref document: EP

Kind code of ref document: A1