WO2010068185A1 - Procédé de génération d'un produit de base de données de référence géodésique - Google Patents

Procédé de génération d'un produit de base de données de référence géodésique Download PDF

Info

Publication number
WO2010068185A1
WO2010068185A1 PCT/US2008/013500 US2008013500W WO2010068185A1 WO 2010068185 A1 WO2010068185 A1 WO 2010068185A1 US 2008013500 W US2008013500 W US 2008013500W WO 2010068185 A1 WO2010068185 A1 WO 2010068185A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
image
orthorectified
earth surface
images
Prior art date
Application number
PCT/US2008/013500
Other languages
English (en)
Inventor
Krzysztof Miksa
James Hagan
Jay Clark
Original Assignee
Tele Atlas B.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tele Atlas B.V. filed Critical Tele Atlas B.V.
Priority to PCT/US2008/013500 priority Critical patent/WO2010068185A1/fr
Publication of WO2010068185A1 publication Critical patent/WO2010068185A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29—Geographical information databases

Definitions

  • the present invention relates to the field of generating a geodetic reference database product.
  • the invention further relates to a computer implemented system for generating a geodetic reference database product, a geodetic reference database product, a computer program product and a processor readable medium provided with the computer program product or the geodetic reference database product.
  • a geodetic reference database product can be useful when orthorectifying different images of the same geographic area
  • Ground control points are used in image rectification of satellite, aerial or aero survey imagery to standard map projections.
  • Image rectification in GIS converts images to a standard map coordinate system. This is done by matching ground control points (GCP) in the mapping system to points in the image.
  • GCP ground control points
  • a ground control point can be any point on the surface of the earth which is recognizable on remotely sensed images, maps and aerial /satellite photographs and which can be accurately located on each of these.
  • a ground control point is a point on the surface of the earth of known location (i.e. fixed within an established co-ordinate reference system).
  • GCP' s are used to geo-reference image data sources, such as remotely sensed images or scanned maps.
  • a GCP could be:
  • a GCP comprises associated precise X, Y and Z coordinates in a coordinate reference system.
  • a GCP describes an earth surface feature which is clearly identifiable in a satellite or aerial imagery. The most significant requirement for a GCP is it's visibility in the image to be orthorectified. A secondary characteristic is that it be durable.
  • a GCP should ideally have a size which is at least 4 times the size of a pixel in the image to be orthorectified.
  • Earth surface features used for defining GCP' s can be cultural features, line features and natural features.
  • a cultural (man made) feature is usually the best point to use as GCP. It covers road intersections, road and rail road intersections, road and visible biogeographic boundary intersections, such as the intersection of a road and the boundary line between a forest and an agricultural field, river bridges, large low buildings (hangars, industrial buildings, etc), airports, etcetera.
  • Line features could be used when they have well defined edges in the imagery.
  • the GCP is normally selected as a center of the intersection of two line features.
  • the two line features forming the intersection have to cross with an angle larger than 60 degrees.
  • Natural features are generally not preferred because of their amorphous shapes. It may however be necessary to use natural features in areas lacking suitable built features. If a natural feature has well defined edges, it may be used as a GCP. It could be forest boundaries forest paths, forest clearings, river confluence, etc. When selecting such points it must to be taken into account that certain boundaries can be subject to variations (forest, water bodies) in time. In situations where there are insufficient suitable features, it is possible for the surveyor to create an observable feature for the purpose of identifying a GCP.
  • An orthophoto or orthophotograph is an aerial photograph that has been geometrically corrected (“orthorectified") such that the scale of the photograph is uniform, meaning that the photo can be considered equivalent to a map.
  • an orthophotograph can be used to measure true distances, because it is an accurate representation of the earth's surface, having been adjusted for topographic relief, lens distortion, and camera tilt.
  • Orthographic views project at a right angle to the data plane.
  • Perspective views project from the surface onto the datum plane from a fixed location.
  • Aerial photographs are useful for providing spatial information, but they usually contain geometric distortion. Maps that are geometrically precise are called planimetric or orthographic maps. An orthographic map plots the position of objects after they have been projected onto a datum or reference plane. Spatial features above or below the plane are projected up or down in a vertical format onto the horizontal plane. Most aerial photographs unfortunately show a non-orthographic perspective view.
  • a set of GCP' s has to be selected for each image.
  • the GCP' s of a set should be uniformly selected in the image. Points near the edges of an image should be selected and preferably with even distribution in the image.
  • the set of GCP' s should preferably also respect terrain variations in the scene, i.e. select point at both highest and lowest elevations.
  • GCP' s could be generated by a human going into the field and gathering both an image or corresponding description of the GCP and the corresponding X, Y and Z coordinate in a coordinate reference system by a position determination means of for example a GPS receiver.
  • a position determination means of for example a GPS receiver.
  • GCP's had to be established and their exact spatial location recorded to ensure accurate georectification of the imagery.
  • Ten GCP's were setup strategically throughout the area to be georectified.
  • the GCP's were setup using two strips of plastic, six inches wide and six feet long, laid across each other in the shape of a cross (+). All GCP's were oriented with each arm of the cross pointing in one of the four cardinal directions (north, south, east, west). After placement of each GCP a GPS location was recorded at the center of the cross using a Trimble GeoXT GPS unit. Said document makes clear the huge amount of time and effort that is necessary to collect accurate GCP' s. Only after such a set up the aerial images can be taken and must be done before weather and other effect move or obliterate the markers.
  • Orthorectification is the transformation of a perspective view image into an image wherein each pixel has a known XY-position on the geoid describing the earth surface and wherein each pixel is regarded to be viewed perpendicular to the earth surface in said XY-position.
  • elevation distortion is the major cause of horizontal errors. This is illustrated in figure 1.
  • a camera mounted in an aircraft 1 records perspective view images of the earth surface 2 (shown here in profile).
  • Figure 1 shows a profile of the earth surface for a given y coordinate.
  • Horizontal line 3 is assumed to represent a profile of a reference surface of the earth for the given y coordinate in a coordinate reference system, for example WGS84 or any other geoid describing the earth surface in a coordinate reference system.
  • Shown is a building structure 4, for example a bridge, on the earth surface whose xyz positions on the earth surface 2 and height are known.
  • the position and orientation in the coordinate reference system of the capturing point 5 of the aerial image is known (for example by means of accurate GPS and/or other position/orientation determination means).
  • Figure 2 shows an orthorectified image wherein a digital elevation model (DEM) is used to oithorectify the aerial image.
  • DEM digital elevation model
  • a DEM or "bald earth” , which it is often referred to as, is created by digitally removing all of the cultural/built features inherent to a digital surface model DSM by exposing the underlying terrain.
  • a DSM is a first surface view of the earth containing both location and elevation information in a coordinate reference system.
  • the USGS 10m National Elevation Data Set (NED) is a cost-effective DEM available but fails to allow for accurate orthorectification for bridges, buildings and elevated structures as shown in figure 2. By not taking into account the height of the bridges, the upper sides of the bridges are shifted with respect to the real location of the bridges.
  • FIG. 2 The real location of the bridges in figure 2 are indicated by the white lines superimposed on the orthorectified image.
  • Figure 3 shows an orthorectified image wherein an accurately geo-coded DSM is used to oithorectify the aerial image.
  • the upper surface of the building structures i.e. the road surfaces
  • the upper surface of building structures are correctly projected when the white lines indicating the outlines of the building structures coincide with the visual outlines in the orthorectified image.
  • DEMs and DSMs provide only a model of the earth surface. They do not comprise information which is easy recognizable on sensed images, maps and aerial photographs. Without GCP's associated with a DEM or DSM, they cannot be used to orthorectify such images. The accuracy of the GCP's used will determine the accuracy of the resultant image or orthorectification process.
  • Geographic Information Systems often combine both digital map information and orthorectified images in one view. Information from the image can be extracted or analyzed to add to, correct or validate the digital map information. Similarly, orthorectified images could be used to extract digital map information for use in a navigation device. In both situations it is important that the location of features in the orthorectified images correspond to their real locations on the earth. In the first case, due to incorrect heights, the position of road surfaces in the orthorectified image do not coincide with the corresponding road surfaces from the digital map. For an example see figure 2. In this case, the navigation device could measure positions that are different from those in its map database that were extracted from the poorly orthorectified image and could provide an alarm erroneously informing the user of the navigation device about unsafe driving conditions.
  • a requirement for generating a correct orthorectified image of the road surfaces from an aerial image or satellite image is that sufficient GCP' s related to the road surface are present within the area represented by the orthorectified image.
  • the costs of orthorectification increase linearly with the number of GCP' s to be captured by humans. The more, GCP' s are needed to obtain the required accuracy of an orthorectified image, the more human effort is needed.
  • ADAS Advanced Driver Assistance Systems
  • a geodetic reference database product that comprises sufficient GCP' s or ground control information to orthorectify aerial or satellite imagery with enough accuracy to use the orthorectified images as a reliable data source for GIS applications at least as it applies to the surface of roads.
  • the present invention seeks to provide an alternative method of generating a geodetic reference database product, that could be used in numerous GIS application such as: Image orthorectification, base mapping, location-based systems, 3D- visualisation, topographic mapping, vehicle navigation, intelligent vehicle systems, ADAS, flight simulation, in-cockpit situational awareness.
  • the method comprises: - acquiring mobile mapping data captured by means of digital cameras, range sensors and position determination means including GPS and IMU mounted to a vehicle driving across the earth surface, the mobile mapping data comprising simultaneously captured image data, range data and associated position data in a geographic coordinate system;
  • the invention is based on the recognition that to accurately oithorectify sensed aerial and satellite images an accurate 3D model of the earth surface is needed. Furthermore, the relation of the sensed image and the 3D model has to be determined.
  • Current 3D models such as DSM and DEM describe the earth surface in terms of 3D coordinates. These 3D coordinates do not have an associated color value corresponding the earth surface when viewed from above. Therefore, it is not possible to align the 3D models and the sensed images.
  • Pixel size of commercially available images is 5.0 m with a horizontal accuracy RSME of 2.0 m and a vertical accuracy RMSE of 1.0 m. These resolution and accuracy limit orthorectification processes to generate orthorectified images with a higher accuracy.
  • Mobile mapping vehicles capture mobile mapping data captured by means of digital cameras, range sensors such as laser/radar/sonar sensors, and position determination means including GPS and IMU mounted to a vehicle driving across the road based earth surface, the mobile mapping data comprising simultaneously captured image data, range data and associated position data in a geographic coordinate system.
  • Position determining means enables us to determine the position with a horizontal absolute accuracy of 0.5 - 2 m l sigma and a vertical accuracy of 1.5 - 3 m.
  • the laser/radar sensor data in combination of the associated determined position data it is possible to create a surface model with a pixel size from 2 cm x 2 cm, a relative horizontal accuracy of 0.5m over 100m cm and a relative vertical accuracy of 0.35m/ over 100m.
  • the surface model could be used to transform the image data into oithorectified images of the earth surface with a pixel size from 2 cm, a relative horizontal accuracy of 0.5m over 100m.
  • the height information from the surface model could be added to each pixel of the oithorectified image to obtain a 3D oithorectified image having a relative vertical accuracy of 1.5m.
  • stationary earth surface features or Ground Control Objects GCO such as road paintings, could be extracted and stored as GCP' s in a database for orthorectification of imagery.
  • GCP' Objects such as road paintings
  • the present invention enables us to generate a huge amount of GCP' s in an easy way and short time period. It is not necessary that a human first identifies locations suitable for orthorectification, goes into the field to set-out the mark to visually identify the location or goes to the identified location and measures the accurate position of the GCP. Another advantage is that it uses ground control objects, i.e. road markings, that could not be selected in exiting paper maps or digital maps as they are not present in said maps. The method helps us to capture GCP' s which could up till now only be collected manually by humans making a survey.
  • the method according to the invention combines the best of three worlds, accurate position determination, processing of high resolution laser/radar data or other range data and processing of high resolution images.
  • Both the range data and image have a high resolution and accuracy as they represent data captured at relative short distance to the recorded surface compared to aerial imagery. This allows us to use less expensive digital cameras and laser sensors.
  • a stationary earth surface feature could be any physical and visual feature in the earth's surface selected from a group comprising at least one of: road paintings, stark changes in pavement type, monument bases, sharp curb edges, metal caps for man-hole covers and sewer grates, unique low-lying geological features and the like.
  • a stationary earth surface feature can be any linear features, such as lane markings, and may even be road segments.
  • a GCP point is used to identify one point in a coordinate reference system
  • a linear feature of for example a dashed lane marking extends the single point approach of a GCP to identify an in principle near infinite number of accurately positions along the line and thus providing a corresponding number of traditional GCP points each identifying only one single reference point in a coordinate reference system.
  • the dashed lane marking they are basically uniform distributed along the linear feature and provide a set of GCP for generating a oithorectified image with uniform accuracy in the area of the image corresponding to the line feature.
  • the 3D-orthorectified images are combined to obtain a continuous linear control network, wherein branches of the network correspond to road segments; and storing the continuous linear control network in the geodetic reference database product.
  • the continuous linear control network provides us not individual GCP' s but a continuous network of GCP' s which can be detected and matched with the aerial or satellite imagery. By means of the continuous linear control network, it is possible to significantly improve the orthorectification of the roads in the imagery.
  • the continuous linear control network provides a very accurate DEM or DSM of the surface of the roads and road structures with a resolution which is at present 5 times better than commercially available DSMs or DEMs.
  • the stationary earth surface features are determined by generating oithorectified images from the mobile mapping data by combining the image data, range data and associated position data. Then, the oithorectified images are processed to determine areas of interest having high contrast in the oithorectified images. Finally, areas of interest having predefined characteristics are selected as the stationary earth surface features.
  • Road markings such as "Warning of 'Give Way' just ahead,", Stop lines, guidance arrows, pedestrian crossings, tapered road edge lines at highway exits, hatched markings, chevron markings, etc., should be visible at any time and can be easily detected by image processing. This enables us to generate cheap, accurate and well distributed ground control points to help control positionally accurate navigation and mapping applications.
  • Fig. 1 shows schematically a source of distortion in the orthorectification process
  • Fig. 2 shows an oithorectified image with use of a DEM
  • Fig. 3 shows an oithorectified image with use of a DSM
  • Fig. 4 shows a flow diagram of the method according to the invention
  • Fig. 5 is a block diagram of an exemplar computer system for implementing the method according to the invention.
  • Fig. 6 shows a MMS system with a camera and a laser scanner
  • Fig. 7 shows a diagram of location and orientation parameters
  • Fig. 8 shows some examples of stationary road surface features.
  • FIG. 4 shows a simplified flow diagram of the method according to the invention.
  • the method start with action 400, by acquiring mobile mapping data.
  • Mobile mapping data is captured by means of digital cameras, laser sensors and position/orientation determination means including GPS and IMU mounted to a vehicle driving across the earth surface, the mobile mapping data comprising simultaneously captured image data, laser data and associated position/orientation data in a geographic coordinate system.
  • a vehicle provided with position/orientation determination means, laser sensors and digital cameras for collecting mobile mapping data is called a mobile mapping system MMS.
  • any other range sensor such as a LADAR, LIDAR and RADAR, could be used to capture range data that can be used to generate a 3D model or image.
  • Figure 6 shows a MMS system that takes the form of a car 20.
  • the looking angle of the one or more cameras 29(i) can be in any direction with respect to the driving direction of the car 21 and can thus be a front looking camera, a side looking camera or rear looking camera, etc.
  • the viewing window(s) of the camera(s) 29(i) cover(s) the whole road surface in front the vehicle.
  • the angle between the driving direction of the car 21 and the looking angle of a camera is within the range of -45 degree - +45 degree on either side.
  • the car 21 can be driven by a driver along roads of interest.
  • the car 21 is provided with a plurality of wheels 22. Moreover, the car 21 is provided with a high accuracy position/orientation determination device. As shown in figure 6, the position/orientation determination device comprises the following components:
  • the GPS unit is connected to a microprocessor ⁇ P. Based on the signals received from the GPS unit, the microprocessor ⁇ P may determine suitable display signals to be displayed on a monitor 24 in the car 1, informing the driver where the car is located and possibly in what direction it is traveling. Instead of a GPS unit a differential GPS unit could be used.
  • DGPS Differential Global Positioning System
  • GPS Global Positioning System
  • a DMI Distance Measurement Instrument
  • This instrument is an odometer that measures a distance traveled by the car 21 by sensing the number of rotations of one or more of the wheels 22.
  • the DMI is also connected to the microprocessor ⁇ P to allow the microprocessor ⁇ P to take the distance as measured by the DMI into account while calculating the display signal from the output signal from the GPS unit.
  • an IMU Inertial Measurement Unit
  • Such an IMU can be implemented as three gyro units arranged to measure rotational accelerations and translational accelerations along three orthogonal directions.
  • the IMU is also connected to the microprocessor ⁇ P to allow the microprocessor ⁇ P to take the measurements by the DMI into account while calculating the display signal from the output signal from the GPS unit.
  • the EvIU could also comprise dead reckoning sensors.
  • the system as shown in figure 6 is a so-called "mobile mapping system” which collects geographic data, for instance by taking pictures with one or more camera(s) 29(i) mounted on the car 21.
  • the camera(s) 29(i) are connected to the microprocessor ⁇ P.
  • the camera(s) 29(i) in front of the car could be a stereoscopic camera.
  • the camera(s) could be arranged to generate an image sequence wherein the images have been captured with a predefined frame rate.
  • one or more of the camera(s) are still picture cameras arranged to capture a picture every predefined displacement of the car 21 or every interval of time.
  • the camera(s) 29(i) send the images to the ⁇ P.
  • the mobile mapping vehicle comprises three cameras, one front looking camera and a camera at each side having a looking axis within a range of 30 - 60 degree and preferably 45 degree, with respect to the heading direction of the vehicle.
  • the front looking camera captures images especially suitable for detecting road directions above the road surface and the side looking cameras captures images especially suitable for detecting objects, such as road signs, along the road.
  • the laser scanners 23(j) take laser samples while the car 21 is driving along roads of interest.
  • the laser samples thus, comprise data relating to the environment associated with these roads of interest, and may include data relating to the road surface, building blocks, trees, traffic signs, parked cars, people, direction signposts, the road side etc.
  • the laser scanners 23(j) are also connected to the microprocessor ⁇ P and send these laser samples to the microprocessor ⁇ P.
  • the laser scanners 23(j) provide a cloud of laser scanner points dense enough to visualize in a 3D representation of along-the-road information.
  • the laser scanner(s) 23 (j) are arranged to produce an output with minimal 50 Hz and 1 deg resolution in order to produce a dense enough output for the method.
  • a laser scanner such as MODEL LMS291-S05 produced by SICK is capable of producing such output.
  • one laser scanner sensing the road surface after or ahead the car 21 could be mounted on the car.
  • two laser scanners should be used, and preferably four.
  • two laser scanners positioned at the front of the car have a rotation axis having an angle of about 45 degree with respect to the driving direction of the car and two laser scanners positioned at the back of the car have a rotation axis having an angle of about 45 degree with respect to the driving direction.
  • Figure 7 shows which position signals can be obtained from the three measurement units GPS, DMI and EVIU shown in figure 6.
  • the microprocessor ⁇ P is arranged to calculate six different parameters, i.e., three distance parameters x, y, z relative to an origin in a predetermined coordinate system and three angle parameters ⁇ x , ⁇ y , and ⁇ z , respectively, which denote a rotation about the x-axis, y-axis and z-axis respectively.
  • the z-direction coincides with the direction of the gravity vector.
  • the global UTM or WGS84 coordinate system could be used as predetermined coordinate reference system.
  • the method according to the invention can be used with a local coordinate reference system, such as NAD 83 and other national grid systems.
  • the six different parameters provide the 6- degree of freedom which is needed to track the position and orientation of the vehicle in time.
  • the camera(s) and laser scanners have a fixed position and orientation with respect to the car 21. This enables us to determine accurately from the six parameters the position of each laser sample in the coordinate reference system and the position and orientation of the camera in the coordinate reference system at the moment of taking an image or laser sample.
  • action 402 the position data, image data and laser data is combined and processed to generate orthorectified images.
  • An orthorectified image is an image representing an area of the surface of the earth.
  • a geoid describes a model of the earth surface related to a geographic reference system.
  • Each pixel of an orthorectified image has an associated xy-position in the geographic reference system.
  • each pixel value is regarded to represent the earth surface as seen perpendicular to the orientation of the surface at the xy-position.
  • International Application WO08044927 discloses a method to generate orthorectified tiles and mosaics from Mobile Mapping Images.
  • the images are projected on a virtual plane representative of the road surface ahead the mobile mapping vehicle.
  • a real surface model of the road surface can be derived from the laser data.
  • a skilled person can adapt easily the method disclosed in WO08044927 to project the images on the real surface model instead of the virtual plane to produce the orthorectified images.
  • the orthorectified images represent the surface of the earth where the MMS system has been driven across the earth surface. In most cases they represent the road surface, pavement and a part of the road side along the road.
  • the orthorectified images are applied to image processing to determine areas of interest which are easy to detect in images.
  • an area of interest AOI is a region having high contrast with the surrounding are selected.
  • an image of the road surface can be applied to a threshold algorithm to determine the areas of the road markings.
  • Unpublished International Application PCT/NL2007/050569 discloses an improved method of filtering orthorectified images and producing linear lane information, such as lane dividers, edge lines, from them.
  • a characteristic of road markings is that they are stationary earth surface features.
  • road markings having a shape that can be used to identify the orientation of the road markings. This makes it possible to define uniquely the location and orientation of said road marking in a coordinate reference system. These makes them suitable to be used as individual GCP.
  • any other road painting, stark changes in pavement type, monument bases, sharp curb edges, metal caps for man-hole covers and sewer grates, unique low- lying geological features could be used as photo identifiable objects.
  • the centre pixel of the group of pixels in the oithorectified image of the stationary earth surface features could be used to define the position of the feature in the coordinate reference system.
  • a visual characteristic point of the group of pixels could be used. A visual characteristic point could be any position, i.e.
  • the group of pixels should comprise associated data, indicating which of the group of pixels is used to define the position of the feature to a position in the coordinate system.
  • a 3D-orthorectified image is an oithorectified image wherein at least one pixel has an associated height value, i.e. z coordinate, in the coordinate reference system. This means that the oithorectified image has a XYZ- position in the coordinate reference system.
  • One pixel having an associated height value is sufficient for paint markings on the road, as these are on smooth surfaces and not likely to have z values that differ much.
  • the 3D-orthorectified image comprises an oithorectified image with metadata describing an associated height value for each pixel. This could be done by determining for each pixel and associated height value. If the stationary earth surface feature could be approximated by an inclined plane, a vector could be used to describe the orientation of the surface.
  • the metadata comprises associated height values for the corner pixels. By means of linear interpolation between the XYZ-coordinates of the corner pixels the height value for the other pixels could be determined.
  • the metadata described the contour of the image in XYZ-coordinates by means of a polyline.
  • Figure 8 shows some examples of stationary road surface features that could be used as GCP. It shows a stop line 81, "Warning of 'Give Way' just ahead" 82, guidance arrows 83, sewer grates 84, speed limits 85, pedestrian crossings 86, tapered road edge lines at exits 87, sharp curb edges 88, metal caps for man-hole covers 89 and any other direction indications 90.
  • Other road surface features are hatched markings or chevron markings, reflection arrows, bifurcation arrows. Traffic Signs Manual 2003, Chapter 5, Road Markings, ISBN 0 11 552479 7, provides a complete overview of road markings that can be used as GCP.
  • Some stationary road surface features could exist in the same appearance in for example a squared area of 50 x 50 meters, for example guidance arrows, metal caps for man covers and sewer grates. In that case, a feature cannot be used as individual GCP to identify uniquely the corresponding feature in an image to be rectified. However, in combination with other nearby stationary road surface feature they can form a unique footprint to identify the position in the image to be rectified. It should be noted, that such a footprint will have both a unique position and orientation on the earth, which enables an orthorectification process to correct image errors by translation, scaling and rotation.
  • a 3D-orthorectified image is generated.
  • the 3D-orthorectified image could be an orthorectified image in the form of a rectangle showing the stationary road surface feature and its surrounding background.
  • the pixels of the 3D-orthorectified image describes only the stationary earth surface feature.
  • the 3D-orthorectified image could be generated by selecting the pixels representative of the stationary earth surface feature or GCO and determining the corresponding height information for each pixel and storing them as an image chip in a chip database.
  • a chip database is a collection of image chips or subsets of images where each image is linked to a coordinate reference system. The image chip could have a reference to the original orthorectified image or tile.
  • the image chip comprises a snapshot image of the location from the orthorectified image and metadata representative of the XY position in the coordinate reference system and elevation of height information.
  • each pixel of an image chip is associated with an XYZ-position in the coordinate reference system.
  • the size of an image chip depends on the size of the stationary road surface feature and the pixel size. Necessary pixel size depends on the resolution of the image to be rectified. From the mobile mapping data, image chips with a pixel size of 2cm could be generated.
  • an image chip preferably comprises pixels which each representing an area of 7 by 7 cm, and having an absolute horizontal accuracy up to 0.5 - 2m 1 sigma and comprising associated elevation information having an absolute vertical 0.5 - 3m 1 sigma in a coordinate reference system .
  • action 408 performs the actions: deriving 3D-polylines defining the position of edge lines of the surface of a stationary earth surface features in the coordinate reference system, generating an orthorectified image for the surface defined by the 3D-polylines and linking the 3D-polylines and orthorectified image to obtain a 3D-oithorectified image.
  • a polyline is a continuous line composed of one or more line segments.
  • a polyline is specified by the endpoints of each line segment.
  • This embodiment is very suitable for planar surfaces such as road segments, upper side of bridges. In that case, the surface can be approximated by the planar surface defined by the polylines.
  • the elevation information i.e.
  • the Z- coordinate can easily be derived by interpolation between the polylines.
  • An advantage of the polylines is that they could be used as break lines when triangulating digital elevation models, i.e. generating the surface for a DEM represented by elevation points on a raster, forming a grid of squares.
  • the 3D-orthorectified images are stored in a geodetic reference database, for example a chip database.
  • a geodetic reference database for example a chip database.
  • the description is for each pixel an XYZ-position.
  • the data comprises a description describing the XY-position of the corners of the image and for each pixel a Z-coordinate.
  • the data comprises a description describing the XYZ-position of the edges of the image by means of polylines.
  • the XYZ-position of each pixel could be calculated by means of linear interpolation.
  • a skilled person is able to find easily several alternative description, for example using a mixture of absolute and relative coordinates in the coordinate reference system.
  • the orthorectified images generated by action 402 or the 3D- orthorectified images generated by action 408, are combined to generate a continuous linear control network.
  • the continuous linear control network is an earth surface model like a DSM or DEM, wherein the model represents all earth surface captured by the digital cameras and laser sensors by means of orthorectified images, wherein each pixel has a XYZ-position in a coordinate reference system.
  • the continuous linear control network is continuous as subsequent, neighboring or overlapping images of the network perfectly match with each other and form seamlessly a part of the earth surface, without discontinuities.
  • the continuous linear control network is linear as the roads between junctions have a linear appearance and form a strip of the model of the earth surface.
  • the continuous linear control network is geographic as each pixel of the orthorectified images forming the earth surface model is associated with a XYZ-coordinate in a coordinate reference system.
  • the continuous linear control network is a network as the strips representative of the road surfaces form together a network, wherein nodes of the network are junctions and the branches of the network represent the road surface of the road segments between the junctions.
  • the continuous linear control network establish a consistent countrywide 3D surface network with details which can be identified in aerial and satellite images.
  • the continuous linear control network is stored in the geodetic reference database product.
  • the method according to the invention generates a geodetic reference database product from data that has been captured by means of a relatively inexpensive vehicle which could be provided with relative inexpensive digital cameras, laser sensors and position determining means.
  • the method creates photo-identifiable data that can be used as ground control objects in rectification processes.
  • the invention allows us for high volume collection of GCP' s which is orders of magnitude greater than traditional ground control production.
  • the invention delivers a continuous road network surface of the road corridor in the form of image chips mosaic augmented with corresponding surface model, which could be in the form of break lines.
  • the method has a consistent and verifiable accuracy profile in all geodetic dimensions.
  • the method does not need that first special photo-identifiable earth surface marks are created in the field to be used to orthorectify future aerial imagery.
  • the database product comprises substantially photo-identifiable material that will exist for many years. As the database product comprises 3D information by means of elevation information, it can be used to correct 3D surfaces as well.
  • the images data as well as the laser data records areas of the earth surface more than once when crossing a junction or traveling a road segment more than once.
  • These areas could comprise a stationary road surface feature that can be used as a ground control object.
  • the stationary road surface feature has the same location in the coordinate reference system.
  • the position determining could have some absolute and relative inaccuracy within one mobile mapping session. The method according to the invention will select these stationary road surface features two or more times and corresponding XY position and elevation information Z-coordinate will be determined each time.
  • a record could be made in the database comprising an image chip and metadata describing the XYZ position and optionally a reference to the original orthorectified image.
  • redundant information can be removed from the database. For example, by combining, i.e. averaging, or anomaly exclusion, the images and metadata of the same stationary road surface features, redundant information can be removed.
  • meta data with averaged values for the XYZ coordinates could be calculated. Averaged values will in general more accurately define the position of the GCO in the coordinate reference system.
  • the computer arrangement 500 comprises a processor 511 for carrying out arithmetic operations.
  • the processor 511 is connected to a plurality of memory components, including a hard disk 512, Read Only Memory (ROM) 513, Electrical Erasable Programmable Read Only Memory (EEPROM) 514, and Random Access Memory (RAM) 515.
  • the memory components comprises a computer program comprising data, i.e. instructions arranged to allow the processor 511 to perform the method for generating a spatial-data-change message or the method for processing a spatial-data-change message according to the invention. Not all of these memory types need necessarily be provided.
  • these memory components need not be located physically close to the processor 511 but may be located remote from the processor 511.
  • the input data and output data associated with the methods may or may not be stored as part of the computer arrangement 500.
  • the input data may be accessed via web services. It might even be possible, that an action is performed by a process running on another processor.
  • the processor 511 is also connected to means for inputting instructions, data etc. by a user, like a keyboard 516, and a mouse 517.
  • a user like a keyboard 516, and a mouse 517.
  • Other input means such as a touch screen, a track ball and/or a voice converter, known to persons skilled in the art may be provided too.
  • a reading unit 519 connected to the processor 511 may be provided.
  • the reading unit 519 is arranged to read data from and possibly write data on a removable data carrier or removable storage medium, like a floppy disk 520 or a CDROM 521.
  • Other removable data carriers may be tapes, DVD, CD-R, DVD-R, memory sticks, solid state memory (SD cards, USB sticks) compact flash cards, HD DVD, blue ray, etc. as is known to persons skilled in the art.
  • the processor 511 may be connected to a printer 523 for printing output data on paper, as well as to a display 518, for instance, a monitor or LCD (liquid Crystal Display) screen, head up display (projected to front window), or any other type of display known to persons skilled in the art.
  • a printer 523 for printing output data on paper
  • a display 518 for instance, a monitor or LCD (liquid Crystal Display) screen, head up display (projected to front window), or any other type of display known to persons skilled in the art.
  • the processor 511 may be connected to a loudspeaker 529 and/or to an optical reader 531, such as a digital camera/web cam or a scanner, arranged for scanning graphical and other documents.
  • an optical reader 531 such as a digital camera/web cam or a scanner, arranged for scanning graphical and other documents.
  • the processor 511 may be connected to a communication network 527, for instance, the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), Wireless LAN (WLAN), GPRS, UMTS, the Internet etc. by means of I/O means 525.
  • the processor 511 may be arranged to communicate with other communication arrangements through the network 527.
  • the data carrier 520, 521 may comprise a computer program product in the form of data and instructions arranged to provide the processor with the capacity to perform a method in accordance to the invention.
  • computer program product may, alternatively, be downloaded via the telecommunication network 527 into a memory component.
  • the processor 511 may be implemented as a stand alone system, or as a plurality of parallel operating processors each arranged to carry out subtasks of a larger computer program, or as one or more main processors with several sub-processors. Parts of the functionality of the invention may even be carried out by remote processors communicating with processor 511 through the telecommunication network 527.
  • the computer system of Figure 5 can be a personal computer, a workstation, a minicomputer, a mainframe computer, etc.
  • the computer can also include different bus configurations, networked platforms, multi-processor platforms, etc.
  • Various operating systems can be used including UNIX, Solaris, Linux, Windows, Macintosh OS, and other suitable operating systems.

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Remote Sensing (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
  • Instructional Devices (AREA)

Abstract

L'invention porte sur un procédé de génération d'un produit de base de données de référence géodésique. Le procédé comprend l'acquisition de données cartographiques mobiles capturées au moyen d’appareils photo numériques, de capteurs télémétriques et de moyens de détermination de position/orientation montés sur un véhicule se déplaçant à la surface de la Terre, les données cartographiques mobiles comprenant des données d'image, des données télémétriques et des données de position/orientation associées capturées simultanément dans un système de coordonnées géographiques. Des caractéristiques de la surface terrestre fixes sont déterminées à partir des données cartographiques mobiles par combinaison des données d'image, des données télémétriques et des données de position/orientation associées. Des images orthoredressées en 3D pour les caractéristiques de la surface terrestre fixes sont générées. Au moins un pixel de l'image orthoredressée en 3D a des coordonnées xyz correspondantes dans le système de référence de coordonnées. Les images orthoredressées en 3D sont mémorisées dans une base de données pour obtenir le produit de base de données de référence géodésique.
PCT/US2008/013500 2008-12-09 2008-12-09 Procédé de génération d'un produit de base de données de référence géodésique WO2010068185A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/US2008/013500 WO2010068185A1 (fr) 2008-12-09 2008-12-09 Procédé de génération d'un produit de base de données de référence géodésique

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2008/013500 WO2010068185A1 (fr) 2008-12-09 2008-12-09 Procédé de génération d'un produit de base de données de référence géodésique

Publications (1)

Publication Number Publication Date
WO2010068185A1 true WO2010068185A1 (fr) 2010-06-17

Family

ID=40459893

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2008/013500 WO2010068185A1 (fr) 2008-12-09 2008-12-09 Procédé de génération d'un produit de base de données de référence géodésique

Country Status (1)

Country Link
WO (1) WO2010068185A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102018220115A1 (de) * 2018-11-23 2020-05-28 Zf Friedrichshafen Ag Ortsbezogene Radar-, Lidar-, und GCP-Daten
US10970317B2 (en) 2015-08-11 2021-04-06 Continental Automotive Gmbh System and method of a two-step object data processing by a vehicle and a server database for generating, updating and delivering a precision road property database
US20210148722A1 (en) * 2019-11-20 2021-05-20 Thinkware Corporation Method, apparatus, computer program, and computer-readable recording medium for producing high-definition map
US11085774B2 (en) 2015-08-11 2021-08-10 Continental Automotive Gmbh System and method of matching of road data objects for generating and updating a precision road database
CN117994463A (zh) * 2024-04-07 2024-05-07 云南三乾科技信息有限公司 一种建设用地测绘方法及系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004061295A (ja) * 2002-07-29 2004-02-26 Hitachi Software Eng Co Ltd 地上基準点測定装置
WO2008044911A1 (fr) * 2006-10-09 2008-04-17 Tele Atlas B.V. Procédé et appareil destinés à produire des pavés orthocorrigés
WO2008054203A1 (fr) * 2006-10-30 2008-05-08 Tele Atlas B.V. Procédé et appareil détection d'objets à partir de données de mappage mobile terrestre

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004061295A (ja) * 2002-07-29 2004-02-26 Hitachi Software Eng Co Ltd 地上基準点測定装置
WO2008044911A1 (fr) * 2006-10-09 2008-04-17 Tele Atlas B.V. Procédé et appareil destinés à produire des pavés orthocorrigés
WO2008054203A1 (fr) * 2006-10-30 2008-05-08 Tele Atlas B.V. Procédé et appareil détection d'objets à partir de données de mappage mobile terrestre

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
CHENG W ET AL: "AUTOMATIC ROAD VECTOR EXTRACTION FOR MOBILE MAPPING SYSTEMS", CONFERENCE PROCEEDINGS XXI ISPRS CONGRESS, vol. XXXVII, no. B3b, 3 July 2008 (2008-07-03) - 11 July 2008 (2008-07-11), Beijing, XP002521411, Retrieved from the Internet <URL:http://www.isprs.org/congresses/beijing2008/proceedings/3b_pdf/98.pdf> [retrieved on 20090926] *
EL-SHEIMY N ET AL: "VISAT:Mapping what you see", COORDINATES, vol. III, no. 5, May 2007 (2007-05-01), pages 6 - 11, XP002521410, Retrieved from the Internet <URL:http://mycoordinates.org/pdf/may07.pdf> [retrieved on 20090326] *
GÜLCH E: "Automatic Control POint Measurement", CONFERENCE PROCEEDINGS PHOTOGRAMMETRIC WEEK 1995, 1995, XP002521475, Retrieved from the Internet <URL:http://www.ifp.uni-stuttgart.de/publications/phowo95/G%C3%BClch.pdf> [retrieved on 20090326] *
HASSAN T ET AL: "COMMON ADJUSTMENT OF LAND-BASED AND AIRBORNE MOBILE MAPPING SYSTEM DATA", CONFERENCE PROCEEDINGS XXI ISPRS CONGRESS, vol. XXXVII, no. B5, 3 July 2008 (2008-07-03) - 11 July 2008 (2008-07-11), pages 835 - 842, XP002521412, Retrieved from the Internet <URL:http://www.isprs.org/congresses/beijing2008/proceedings/5_pdf/147.pdf> [retrieved on 20090326] *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10970317B2 (en) 2015-08-11 2021-04-06 Continental Automotive Gmbh System and method of a two-step object data processing by a vehicle and a server database for generating, updating and delivering a precision road property database
US11085774B2 (en) 2015-08-11 2021-08-10 Continental Automotive Gmbh System and method of matching of road data objects for generating and updating a precision road database
DE102018220115A1 (de) * 2018-11-23 2020-05-28 Zf Friedrichshafen Ag Ortsbezogene Radar-, Lidar-, und GCP-Daten
US20210148722A1 (en) * 2019-11-20 2021-05-20 Thinkware Corporation Method, apparatus, computer program, and computer-readable recording medium for producing high-definition map
US11971274B2 (en) * 2019-11-20 2024-04-30 Thinkware Corporation Method, apparatus, computer program, and computer-readable recording medium for producing high-definition map
CN117994463A (zh) * 2024-04-07 2024-05-07 云南三乾科技信息有限公司 一种建设用地测绘方法及系统

Similar Documents

Publication Publication Date Title
US8958980B2 (en) Method of generating a geodetic reference database product
Agueera-Vega et al. Reconstruction of extreme topography from UAV structure from motion photogrammetry
Brenner Extraction of features from mobile laser scanning data for future driver assistance systems
Guan et al. Automated road information extraction from mobile laser scanning data
Tao Mobile mapping technology for road network data acquisition
JP4344869B2 (ja) 計測装置
US8665263B2 (en) Aerial image generating apparatus, aerial image generating method, and storage medium having aerial image generating program stored therein
US20100208937A1 (en) Method of capturing linear features along a reference-line across a surface for use in a map database
CN101681525A (zh) 产生多视点全景图的方法及设备
Abuhadrous et al. Digitizing and 3D modeling of urban environments and roads using vehicle-borne laser scanner system
Soheilian et al. Generation of an integrated 3D city model with visual landmarks for autonomous navigation in dense urban areas
WO2010068185A1 (fr) Procédé de génération d&#39;un produit de base de données de référence géodésique
TW201024664A (en) Method of generating a geodetic reference database product
TW201024665A (en) Method of generating a geodetic reference database product
Williams Accuracy assessment of LiDAR point cloud geo-referencing
Wang Semi-automated generation of high-accuracy digital terrain models along roads using mobile laser scanning data
Keitaanniemi et al. Measurement strategies for street-level SLAM laser scanning of Urban environments
Bassani et al. Alignment data collection of highways using mobile mapping and image analysis techniques
Al-Hanbali et al. Building 3D GIS modeling applications in Jordan: methodology and implementation aspects
Prieto Road surface structure monitoring and analysis using high precision gps Mobile Measurement Systems (mms)
Davidović et al. Modern geodetic technologies as a basis of the design and planning
Franzini et al. The Digital Twin of the Metropolitan Area of Milan: Quality Assessment of Aerial and Terrestrial Data
Habib et al. LiDAR-based mobile mapping system for lane width estimation in work zones
Tian Methodologies and Applications of Data Coordinate Conversion for Roadside LiDAR
Agüera-Vega et al. Reconstruction of Earth Extreme Topography from UAV Structure from Motion Photogrammetry

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08876372

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 08876372

Country of ref document: EP

Kind code of ref document: A1