WO1999018732A1 - Digital-image mapping - Google Patents

Digital-image mapping Download PDF

Info

Publication number
WO1999018732A1
WO1999018732A1 PCT/US1998/020809 US9820809W WO9918732A1 WO 1999018732 A1 WO1999018732 A1 WO 1999018732A1 US 9820809 W US9820809 W US 9820809W WO 9918732 A1 WO9918732 A1 WO 9918732A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
data
georeferencing
information
camera
Prior art date
Application number
PCT/US1998/020809
Other languages
French (fr)
Inventor
John A. Ciampa
Original Assignee
Ciampa John A
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ciampa John A filed Critical Ciampa John A
Priority to AU97837/98A priority Critical patent/AU9783798A/en
Publication of WO1999018732A1 publication Critical patent/WO1999018732A1/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01VGEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
    • G01V8/00Prospecting or detecting by optical means
    • G01V8/02Prospecting
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • G01C11/02Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures

Definitions

  • the present invention pertains to the capture and automatic georeferencing of a camera and/or images captured by the camera by utilizing a portable camera and data unit and, more particularly, to a system and method of obtaining precisely located, oblique, digitized land images, taking into account diverse topography and varying camera angles, including changes in heading, roll and yaw.
  • the present invention combines into a single unit a portable camera with a data unit containing a Global Position Satellite (GPS) antenna/receiver, including but not limited to differential GPS or other type GPS system, a compass and inclinometer.
  • GPS Global Position Satellite
  • the data unit provides camera coordinates and triaxial angle data, which are combined with the digital representations of the photographic image. Trigonometric formulas correlate to the image pixel and corresponding ground coordinates.
  • An iterative algorithm is used to compensate for the changes and variations in the landscape topography. This is accomplished by using known Digital Elevation Models (DEM) that are furnished by the United States Geophysical Survey (USGS) or other digital terrain models captured as a result of laser signals.
  • DEM Digital Elevation Models
  • the particular camera to be utilized with this invention may be an analog, digital video or still digital camera.
  • the camera may be carried by an operator who is on foot or in a land, sea or air craft.
  • the inclinometer, the GPS antenna/receiver and a compass are affixed to the camera so that they move together as a unit.
  • the inclinometer detect changes in the depression angle and the roll angles of the camera.
  • the photographic data is attached to the image file and is transferred to a small microprocessor (CPU) , where the storage device can be a PCMCIA memory card.
  • the microprocessor processes and links the shot data from the instruments with a digital image file. All of the data regarding depression angle, global position, heading (or bearing) and image are interpolated and combined with the shot time. This digitized image and other information are then stored in a spatially managed image file mosaic software, whereby images can be retrieved based on their map location or from a gallery or "contact sheet" of digital miniature thumbnails.
  • the method of the invention comprises the following steps.
  • the image is first digitally captured by a "digital" camera or other digitizing device, along with the aforementioned shot data.
  • "Shot data” is then analyzed by the computer, including location (i.e., latitude, longitude and altitude); camera bearing or heading (the compass direction in which the lens is pointing) ; the camera depression angle or azimuth; and the camera roll (i.e., the yaw of the camera, with respect to its horizontal axis) .
  • the shot data is then mathematically adjusted (trigonometrically) to coordinate the points on the ground plane with the points in the image plane, so as to produce an automatically computationally georeferenced digital image.
  • Elevation data may be used to corroborate or enhance the accuracy of the trigonometric interpolation.
  • the result of all of this processing provides an image, or a portion thereof, from which can be obtained geographic coordinates of any point on the ground and/or ground measurements taken between any two points in the image.
  • This "georeferencing" of each image also determines its placement in a series of adjacent images, so that each image can be depicted as a "tile” within a "mosaic” of tiled images.
  • Each image, in addition to its georeference, is processed so as to contain a discrete sequential identifier, the date and the time.
  • Trigonometric processing also takes into account fixed variables, such as lens focal length, the size of the image plane, the number of pixels in the X-Y axes
  • an image capture and georeferencing unit comprises in combination, a portable camera with a Global Position Satellite (GPS) antenna/receiver that captures global coordinates, a compass for determining the direction and an inclinometer for calculating the photographic angle.
  • GPS Global Position Satellite
  • the camera and other instruments feed image and shot data to a CPU, where the shot data is analyzed, mathematically interpolated and reconciled with known constants.
  • the image and shot data are then stored in memory.
  • the "shot data" analyzed by the computer includes camera location (i.e., latitude, longitude and altitude), time, camera bearing (the compass direction in which the lens is pointing) , the camera depression or azimuth, and camera roll (i.e., the yaw of the camera with respect to its horizontal axis) .
  • the portable camera and data-gathering instruments move together and, therefore, function as a single unit that provides precise, accurate data and digitized photographic image information, despite topographical changes and/or altitude variations of the camera. They also provide precise data on the GPS location of the camera and its altitude with respect to the ground. Exact digital representations with precise coordinates are instantly available for precise reconnaissance purposes.
  • the photographic shot data is mathematically adjusted (trigonometrically) to coordinate the points on the ground plane with the points in the image plane in order to produce an automatically computationally georeferenced digital image. Elevation data may be used to corroborate or enhance the accuracy of the trigonometric interpolations.
  • the result of all of this processing provides an image, or a portion thereof, from which can be obtained geographic coordinates of any point on the ground and/or measurements on the ground taken between any two points in the image.
  • the "georeferencing" of each image also determines its placement in a series of adjacent images, so that each image can be depicted as a "tile” within a "mosaic” of tiled images.
  • Each image, in addition to - its georeference, is processed so as to contain a discrete sequential identifier, the date and the time. Many images of the same landscape may be taken by using different angles and camera positions, each of which is accessible by means of a graphical user interface. Processing adjusts the shot data to compensate for fixed camera data, such as the lens focal length, the size of the image plane, the number of pixels in the X-Y axes (horizontal and vertical planes) and the size of the pixels.
  • FIGURE 1 illustrates a schematic, block diagram of the camera and instruments of this invention
  • FIGURE 2 depicts a flow diagram of the processing method used in the system shown in FIGURE 1, in which an image is captured, digitized and combined with shot data and other georeferencing information, and thereafter stored for future use;
  • FIGURE 3 shows a flow diagram of the image file management software of the inventive system depicted in FIGURE 1 ;
  • FIGURES 4 A-C illustrate the inventive technique used to mathematically calculate the georeference at each pixel of the image ;
  • FIGURES 5 A-B illustrate a schematic view of the inventive technique used to mathematically reconcile the shot data with Digital Elevation Models and/or other known "ground truth” .
  • the invention features an imaging system, including a novel combination of a portable camera, GPS receiver, bearing compass and inclinometer (s) . All of the components move and function as a single unit, so that, despite changes in the depression and the roll angles of the camera, each digital image is captured, along with shot data, which becomes automatically, computationally georeferenced.
  • FIGURE 1 an imaging system 10 of this invention is illustrated.
  • the system combines a camera 11 with an inclinometer 12, a compass 14, an optional altimeter 16 and a Global Position Satellite (GPS) antenna/receiver, 15a and 15b, respectively.
  • the particular camera 11 that can be utilized with this invention may be a databack film camera that is capable of affixing shot time and subsequent digitization.
  • the camera 11 can also be an analog, a digital video or a still digital camera.
  • the camera 11, inclinometer 12, compass 14, optional altimeter 16 and GPS receiver 15b are each individually connected to a CPU processor 18 containing a fixed or removable memory 28 (such as a PCMCIA card) via respective lines 21, 22, 24, 26 and 25.
  • a fixed or removable memory 28 such as a PCMCIA card
  • the GPS antenna 15a is connected to the GPS receiver 15b via line 17. Also connected to the CPU processor 18 are an optional key-pad- and microphone 19 via line 29.
  • the key-pad-and-microphone 19 can be used to enter comments or additional information with respect to the photographed site. Where altitude provided by the GPS is adequate, the altimeter 16 may be dispensed with. Where comments are impractical, the key-pad-and-microphone 19 may also be dispensed with.
  • the invention reflects the discovery that in addition to camera location, it is necessary to factor into the calculations the changes in the elevation of the depicted land, the depression and the bearing of the camera, with respect to this encompassed land.
  • the compass 14 provides camera heading or bearing information; the GPS antenna/receiver 15a and 15b provide the camera position information (latitude, longitude and altitude) ; the inclinometers 12 provide the depression and roll angles; and the optional altimeter laser or other 16 provides additional altitude information.
  • the system may computationally deduce elevations within the image by assessing deficiencies in measurements of known objects such as cars. These variables are combined with the digital image, plane measurements, focal length, and pixel data to give a georeferenced image down to the pixel level .
  • the instrument's shot data are recorded and used to coordinate the points on the ground plane with the points in the image plane in order to produce a georeference for each pixel .
  • DEM data are used to corroborate or enhance the accuracy of the trigonometric interpolations.
  • the result of all of this processing provides an image, or a portion thereof, from which can be obtained geographic coordinates of any point on the ground and/or measurements on the ground taken between any two points in the image.
  • the "georeferencing" of each image also determines its placement in a series of adjacent images, so that each image can be depicted as a "tile” within a "mosaic" of tiled images.
  • Each image in addition to its georeference, is processed so as to contain a discrete sequential identifier, the date and the time. Many images of the same landscape may be taken by using different angles and camera positions, each of which is accessible by means of a graphical user interface. Processing adjusts the shot data to compensate for the lens focal length, the size of the image plane, the number of pixels in the X-Y axes
  • the GPS antenna/receiver 15a and 15b can be obtained from, among others, Trimble Navigation Systems of Sunnyvale,
  • a fluxgate compass 14 and inclinometers 12 are available from, among others, KVH Industries, Inc., of
  • the CPU 18 accesses Digital Elevation Model (DEM) data from a database in order to adjust the image data for topographical variations.
  • DEM Digital Elevation Model
  • the position variables (camera X, Y and Z coordinates) are obtained from the
  • GPS Global Position Satellite
  • the processing assumes a simple, pin-hole camera model.
  • the ground position of the photographed image can be defined by simple triangular, trigonometric processing of the depression angle ⁇ D , the size of the image plane and the focal length (FL) of the camera as shown in FIGURE 4A.
  • a pixel location (P x , P y ) of a particular point selected on a displayed image can be processed for a particular depression angle by calculating the inverse tangent of the angle as shown in FIGURE 4B.
  • the angle ⁇ D (depression angle) is offset by the arctangent (film height [y] * (row containing focal axis [F y ] -row of selected pixel [P y ])/2* image plane height [Z] * focal length [FL] ) resulting in angle ⁇ p .
  • the angle ⁇ p is subtracted from the recorded depression angle ⁇ p and denoted as p v relative to the point on the ground immediately below the camera, with camera altitude above the ground "Z" (height) .
  • the northerly distance to the selected point [P x , P y ] is Z* sin ( ⁇ / 2 - p v ) .
  • the east- west distance is calculated from the (column of selected pixel
  • Ground location for terrain "T” that is not flat is adjusted by using DEM data and an iterative algorithm, well known in the art of optimization routines.
  • the processor 18 uses the algorithm and the point [g assumed for a flat terrain as shown in FIGURE 5A.
  • the processor accesses the DEM data for that point and obtains the elevation [g 2 ] as shown in FIGURE 5B .
  • the process is complete if the elevation at that camera location is the same as that of the selected point. Otherwise, the camera elevation is modified to account for the difference in the ground elevation of the selected point.
  • the revised value is then used to estimate the ground location (G 3 ) .
  • the iterative algorithm continues to revise the estimate until it converges to within acceptable limits.
  • the algorithm is modified to adjust for roll of the camera by transforming pixel coordinates to a new set of coordinates. The transformation is a simple rotation about focal axis "F" by well-known mathematical methods.
  • T ⁇ [cos ⁇ sin ⁇ ] - sin ⁇ cos ⁇
  • the data points provided by the DEM are sampled along the ground every 30 meters in an orthogonal grid bounded by g 2 and g lf as shown. Intermediate points are obtained by interpolation, such as by using bilinear interpolation or bicubic splines.
  • the position of the camera and the pointing angles are subject to a small degree of error and, therefore, may be reconciled with measured ground truth other than DEM data. This is accomplished by locating or measuring discrete objects in several images and then modifying the collected data so as to obtain more accurate estimates.
  • a flow chart 100 is illustrated for the image-and-data-capture process of this invention.
  • An image is captured by camera 12, step 101; the image information is converted to digital form, step 102.
  • the camera altitude, ground location, tilt, depression angle and heading (bearing) are then obtained, as shown in step 103.
  • the information from steps 102 and 103 is then combined, step 104.
  • the data is then adjusted according to focal length, pixel size, pixel location and focal axis, as previously explained with reference to FIGURE 4, step 105.
  • the result of all of the processing provides an image, or a portion thereof, from which can be obtained geographic coordinates on the ground and/or ground measurements taken between any two image points.
  • each image determines its placement in a series of adjacent images, so that each image can be depicted as a "tile” within a "mosaic” of tiles images, step 106.
  • the DEM data is then used to adjust the image data for variations in the terrain, step 107.
  • the image data is then compressed for storage purposes, step 108.
  • a flow chart 200 illustrates in more detail the DEM adjustment process for the data obtained in FIGURE 2.
  • a tile from the mosaic is obtained, steps 201 and 202.
  • an associated DEM elevation file is accessed, step 203.
  • the accessed data is then combined and the digitized data decompressed, step 204.
  • the image and adjoining images are then displayed, step 206.
  • Certain features of the images are selected, step 207, and the horizontal or vertical measurements are selected for review, step 208.
  • Different images are reviewed, step 210, and the end points are measured, step 209.
  • the ground points are then estimated, step 211, and compared with the DEM data, step 212. If the elevation estimate is different, the elevation is revised, step 214, and entered via line 215.
  • a new estimate is made via return loop 205, and the re-entering of step 211. After a few iterations, the decision is made, step 212, to report distance between points, step 217 via line 216. When the estimate is found accurate, the actual distance between the selected ground points is made, step 217. The process is then repeated via return loop 220, in order to obtain the distance values for other selected points and tiles.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Life Sciences & Earth Sciences (AREA)
  • Geophysics (AREA)
  • Position Fixing By Use Of Radio Waves (AREA)
  • Instructional Devices (AREA)

Abstract

In accordance with the present invention, there is provided an image capture and georeferencing unit. The unit comprises in combination, a portable camera (11) with a GPS antenna and receiver (15b) that captures global coordinates, a compass (14) for determining the direction and an inclinometer (12) for the photographic angle. The camera and other instruments feed image and shot data to a CPU (18), where the shot data is analyzed, mathematically interpolated and reconciled with known constants. The image and shot data are stored in memory (28). The 'shot data' analyzed by the computer includes camera parameters such as camera: location, latitude, longitude and altitude, time, bearing, depression angle/pitch or azimuth, roll and yaw. The portable camera and data-gathering instruments move together and, therefore, function as a single unit that provides precise, accurate data and digitized photographic image information, despite topographical changes and/or altitude variations of the camera. Exact digital representations with precise coordinates are instantly available for precise reconnaissance purposes. The photographic shot data is mathematically adjusted (trigonometrically) to coordinate the points on the ground plane with the points in the image plane in order to produce an automatically computationally georeferenced digital image. Elevation data may be used to corroborate or enhance the accuracy of the trigonometric interpolations.

Description

DIGITAL-IMAGE MAPPING
FIELD OF THE INVENTION
The present invention pertains to the capture and automatic georeferencing of a camera and/or images captured by the camera by utilizing a portable camera and data unit and, more particularly, to a system and method of obtaining precisely located, oblique, digitized land images, taking into account diverse topography and varying camera angles, including changes in heading, roll and yaw.
BACKGROUND OF THE INVENTION
Aerial photography of land images for reconnaissance purposes is well known, as illustrated in United States Patent No. 5,247,356 (issued to John A. Ciampa on September 21, 1993), entitled METHOD AND APPARATUS FOR MAPPING AND MEASURING LAND. This patent teaches that coordinates of a land location can be calculated and combined with photographic information about the terrain. The global position and the elevation information are converted into digitized form, along with the image information and then stored in computer memory.
One of the problems of such aerial-photography methodology is that photographs must be taken over landscapes of relatively flat terrain, while a plane's altitude is generally parallel with the landscape, or at aircraft altitudes where topographical variations are generally minimized in the angular calculations. The inability of the prior art of aerial photographic systems to coordinate image information with collateral measurements has often required the use of expensive flight platforms, preordained flight paths and orthogonal camera angles .
In order to obtain exact geographic coordinates of any land image, it is no longer necessary to stabilize the camera, flight path and elevation, as previously calculated in the aforementioned patent. Due to additional data and calculations, the camera may now be freed up, regardless of topographical changes and changes of camera angles with respect to this changing topography.
The present invention combines into a single unit a portable camera with a data unit containing a Global Position Satellite (GPS) antenna/receiver, including but not limited to differential GPS or other type GPS system, a compass and inclinometer. The data unit provides camera coordinates and triaxial angle data, which are combined with the digital representations of the photographic image. Trigonometric formulas correlate to the image pixel and corresponding ground coordinates. An iterative algorithm, as is well known in fuzzy logic and optimization routines, is used to compensate for the changes and variations in the landscape topography. This is accomplished by using known Digital Elevation Models (DEM) that are furnished by the United States Geophysical Survey (USGS) or other digital terrain models captured as a result of laser signals. In addition the system's mathematical algorithms take account of the differences in measurements of known objects such as cars and distribute these differences to fixed variables which has the effect of raising, lowering, tilting or reshaping a virtual ground plane that compensates for differences caused by elevation. The particular camera to be utilized with this invention may be an analog, digital video or still digital camera. The camera may be carried by an operator who is on foot or in a land, sea or air craft.
The inclinometer, the GPS antenna/receiver and a compass are affixed to the camera so that they move together as a unit. The inclinometer detect changes in the depression angle and the roll angles of the camera. The photographic data is attached to the image file and is transferred to a small microprocessor (CPU) , where the storage device can be a PCMCIA memory card. The microprocessor processes and links the shot data from the instruments with a digital image file. All of the data regarding depression angle, global position, heading (or bearing) and image are interpolated and combined with the shot time. This digitized image and other information are then stored in a spatially managed image file mosaic software, whereby images can be retrieved based on their map location or from a gallery or "contact sheet" of digital miniature thumbnails.
The method of the invention comprises the following steps. The image is first digitally captured by a "digital" camera or other digitizing device, along with the aforementioned shot data. "Shot data" is then analyzed by the computer, including location (i.e., latitude, longitude and altitude); camera bearing or heading (the compass direction in which the lens is pointing) ; the camera depression angle or azimuth; and the camera roll (i.e., the yaw of the camera, with respect to its horizontal axis) . The shot data is then mathematically adjusted (trigonometrically) to coordinate the points on the ground plane with the points in the image plane, so as to produce an automatically computationally georeferenced digital image. Elevation data may be used to corroborate or enhance the accuracy of the trigonometric interpolation. The result of all of this processing provides an image, or a portion thereof, from which can be obtained geographic coordinates of any point on the ground and/or ground measurements taken between any two points in the image. This "georeferencing" of each image also determines its placement in a series of adjacent images, so that each image can be depicted as a "tile" within a "mosaic" of tiled images. Each image, in addition to its georeference, is processed so as to contain a discrete sequential identifier, the date and the time.
Many images of the same landscape may be taken by using different angles and camera positions, each of which is accessible by means of a graphical user interface. Trigonometric processing also takes into account fixed variables, such as lens focal length, the size of the image plane, the number of pixels in the X-Y axes
(horizontal and vertical planes) and the size of the pixels.
It is the object of the present invention to provide an improved oblique aerial -photography system so that any person without special "photo- interpreting" skills may conduct electronic field studies of land and building, as well as ground- based visual inventories.
It is another object of this invention to provide a portable photography system that combines into a single operational unit a photographic camera with a GPS antenna/receiver that captures global coordinates, a compass for determining camera direction and inclinometer for calculating the photographic angle.
It is a further object of this invention to provide a digital photographic imaging system that "georeferences" each geographical image, so that each image, or part thereof, can be depicted as a "tile" within a "mosaic" of tiled images. SUMMARY OF THE INVENTION
In accordance with the present invention, there is provided an image capture and georeferencing unit. The unit comprises in combination, a portable camera with a Global Position Satellite (GPS) antenna/receiver that captures global coordinates, a compass for determining the direction and an inclinometer for calculating the photographic angle. The camera and other instruments feed image and shot data to a CPU, where the shot data is analyzed, mathematically interpolated and reconciled with known constants. The image and shot data are then stored in memory. The "shot data" analyzed by the computer includes camera location (i.e., latitude, longitude and altitude), time, camera bearing (the compass direction in which the lens is pointing) , the camera depression or azimuth, and camera roll (i.e., the yaw of the camera with respect to its horizontal axis) . The portable camera and data-gathering instruments move together and, therefore, function as a single unit that provides precise, accurate data and digitized photographic image information, despite topographical changes and/or altitude variations of the camera. They also provide precise data on the GPS location of the camera and its altitude with respect to the ground. Exact digital representations with precise coordinates are instantly available for precise reconnaissance purposes. The photographic shot data is mathematically adjusted (trigonometrically) to coordinate the points on the ground plane with the points in the image plane in order to produce an automatically computationally georeferenced digital image. Elevation data may be used to corroborate or enhance the accuracy of the trigonometric interpolations.
The result of all of this processing provides an image, or a portion thereof, from which can be obtained geographic coordinates of any point on the ground and/or measurements on the ground taken between any two points in the image. The "georeferencing" of each image also determines its placement in a series of adjacent images, so that each image can be depicted as a "tile" within a "mosaic" of tiled images. Each image, in addition to - its georeference, is processed so as to contain a discrete sequential identifier, the date and the time. Many images of the same landscape may be taken by using different angles and camera positions, each of which is accessible by means of a graphical user interface. Processing adjusts the shot data to compensate for fixed camera data, such as the lens focal length, the size of the image plane, the number of pixels in the X-Y axes (horizontal and vertical planes) and the size of the pixels.
BRIEF DESCRIPTION OF THE DRAWINGS
A complete understanding of the present invention may be obtained by reference to the accompanying drawings, when considered in conjunction with the subsequent detailed description, in which:
FIGURE 1 illustrates a schematic, block diagram of the camera and instruments of this invention;
FIGURE 2 depicts a flow diagram of the processing method used in the system shown in FIGURE 1, in which an image is captured, digitized and combined with shot data and other georeferencing information, and thereafter stored for future use;
FIGURE 3 shows a flow diagram of the image file management software of the inventive system depicted in FIGURE 1 ; and
FIGURES 4 A-C illustrate the inventive technique used to mathematically calculate the georeference at each pixel of the image ; and
FIGURES 5 A-B illustrate a schematic view of the inventive technique used to mathematically reconcile the shot data with Digital Elevation Models and/or other known "ground truth" .
DESCRIPTION OF THE PREFERRED EMBODIMENT
Generally speaking, the invention features an imaging system, including a novel combination of a portable camera, GPS receiver, bearing compass and inclinometer (s) . All of the components move and function as a single unit, so that, despite changes in the depression and the roll angles of the camera, each digital image is captured, along with shot data, which becomes automatically, computationally georeferenced.
Now referring to FIGURE 1, an imaging system 10 of this invention is illustrated. The system combines a camera 11 with an inclinometer 12, a compass 14, an optional altimeter 16 and a Global Position Satellite (GPS) antenna/receiver, 15a and 15b, respectively. The particular camera 11 that can be utilized with this invention may be a databack film camera that is capable of affixing shot time and subsequent digitization. The camera 11 can also be an analog, a digital video or a still digital camera. The camera 11, inclinometer 12, compass 14, optional altimeter 16 and GPS receiver 15b are each individually connected to a CPU processor 18 containing a fixed or removable memory 28 (such as a PCMCIA card) via respective lines 21, 22, 24, 26 and 25. The GPS antenna 15a is connected to the GPS receiver 15b via line 17. Also connected to the CPU processor 18 are an optional key-pad- and microphone 19 via line 29. The key-pad-and-microphone 19 can be used to enter comments or additional information with respect to the photographed site. Where altitude provided by the GPS is adequate, the altimeter 16 may be dispensed with. Where comments are impractical, the key-pad-and-microphone 19 may also be dispensed with.
The invention reflects the discovery that in addition to camera location, it is necessary to factor into the calculations the changes in the elevation of the depicted land, the depression and the bearing of the camera, with respect to this encompassed land. The compass 14 provides camera heading or bearing information; the GPS antenna/receiver 15a and 15b provide the camera position information (latitude, longitude and altitude) ; the inclinometers 12 provide the depression and roll angles; and the optional altimeter laser or other 16 provides additional altitude information. As an alternative to or in addition to instrumental measurements of land, the system may computationally deduce elevations within the image by assessing deficiencies in measurements of known objects such as cars. These variables are combined with the digital image, plane measurements, focal length, and pixel data to give a georeferenced image down to the pixel level .
The instrument's shot data are recorded and used to coordinate the points on the ground plane with the points in the image plane in order to produce a georeference for each pixel . DEM data are used to corroborate or enhance the accuracy of the trigonometric interpolations. The result of all of this processing provides an image, or a portion thereof, from which can be obtained geographic coordinates of any point on the ground and/or measurements on the ground taken between any two points in the image. The "georeferencing" of each image also determines its placement in a series of adjacent images, so that each image can be depicted as a "tile" within a "mosaic" of tiled images.
Each image, in addition to its georeference, is processed so as to contain a discrete sequential identifier, the date and the time. Many images of the same landscape may be taken by using different angles and camera positions, each of which is accessible by means of a graphical user interface. Processing adjusts the shot data to compensate for the lens focal length, the size of the image plane, the number of pixels in the X-Y axes
(horizontal and vertical plans) and the size of the pixels.
The GPS antenna/receiver 15a and 15b can be obtained from, among others, Trimble Navigation Systems of Sunnyvale,
California. A fluxgate compass 14 and inclinometers 12 are available from, among others, KVH Industries, Inc., of
Middletown, Rhode Island.
In processing the information, the CPU 18 accesses Digital Elevation Model (DEM) data from a database in order to adjust the image data for topographical variations. The position variables (camera X, Y and Z coordinates) are obtained from the
Global Position Satellite (GPS) receiver. The pointing variables
(camera heading or bearing) are obtained from the compass 14, and the depression and the roll information are obtained from the inclinometers 12.
The processing assumes a simple, pin-hole camera model. The ground position of the photographed image can be defined by simple triangular, trigonometric processing of the depression angle φD, the size of the image plane and the focal length (FL) of the camera as shown in FIGURE 4A. A pixel location (Px, Py) of a particular point selected on a displayed image can be processed for a particular depression angle by calculating the inverse tangent of the angle as shown in FIGURE 4B.
Referring to FIGURE 4C, assuming a northerly direction, the angle φD (depression angle) is offset by the arctangent (film height [y] * (row containing focal axis [Fy] -row of selected pixel [Py])/2* image plane height [Z] * focal length [FL] ) resulting in angle φp. The angle φp is subtracted from the recorded depression angle φp and denoted as pv relative to the point on the ground immediately below the camera, with camera altitude above the ground "Z" (height) . The northerly distance to the selected point [Px, Py] is Z* sin (π/2 - pv) . The east- west distance is calculated from the (column of selected pixel
[Px] -focal axis column [Fx] /2) *film width [x] /image plane width
[x •
east-west distance = Camera Z*cos φ/2*focal length * sin pv
When the direction is other than north, a simple rotation is made on the point to establish the ground location. The true location is then obtained by translating the ground location of the camera into its recorded position.
Ground location for terrain "T" that is not flat is adjusted by using DEM data and an iterative algorithm, well known in the art of optimization routines. The processor 18 uses the algorithm and the point [g assumed for a flat terrain as shown in FIGURE 5A. The processor accesses the DEM data for that point and obtains the elevation [g2] as shown in FIGURE 5B . The process is complete if the elevation at that camera location is the same as that of the selected point. Otherwise, the camera elevation is modified to account for the difference in the ground elevation of the selected point. The revised value is then used to estimate the ground location (G3) . The iterative algorithm continues to revise the estimate until it converges to within acceptable limits. The algorithm is modified to adjust for roll of the camera by transforming pixel coordinates to a new set of coordinates. The transformation is a simple rotation about focal axis "F" by well-known mathematical methods.
Tμ = [cos μ sin μ ] - sinμ cos μ
The data points provided by the DEM are sampled along the ground every 30 meters in an orthogonal grid bounded by g2 and glf as shown. Intermediate points are obtained by interpolation, such as by using bilinear interpolation or bicubic splines.
The position of the camera and the pointing angles are subject to a small degree of error and, therefore, may be reconciled with measured ground truth other than DEM data. This is accomplished by locating or measuring discrete objects in several images and then modifying the collected data so as to obtain more accurate estimates.
Referring to FIGURE 2, a flow chart 100 is illustrated for the image-and-data-capture process of this invention. An image is captured by camera 12, step 101; the image information is converted to digital form, step 102. The camera altitude, ground location, tilt, depression angle and heading (bearing) are then obtained, as shown in step 103. The information from steps 102 and 103 is then combined, step 104. The data is then adjusted according to focal length, pixel size, pixel location and focal axis, as previously explained with reference to FIGURE 4, step 105. The result of all of the processing provides an image, or a portion thereof, from which can be obtained geographic coordinates on the ground and/or ground measurements taken between any two image points. The "georeferencing" of each image determines its placement in a series of adjacent images, so that each image can be depicted as a "tile" within a "mosaic" of tiles images, step 106. The DEM data is then used to adjust the image data for variations in the terrain, step 107. The image data is then compressed for storage purposes, step 108.
Referring to FIGURE 3, a flow chart 200 illustrates in more detail the DEM adjustment process for the data obtained in FIGURE 2. A tile from the mosaic is obtained, steps 201 and 202. In conjunction with the selection, an associated DEM elevation file is accessed, step 203. The accessed data is then combined and the digitized data decompressed, step 204. The image and adjoining images are then displayed, step 206. Certain features of the images are selected, step 207, and the horizontal or vertical measurements are selected for review, step 208. Different images are reviewed, step 210, and the end points are measured, step 209. The ground points are then estimated, step 211, and compared with the DEM data, step 212. If the elevation estimate is different, the elevation is revised, step 214, and entered via line 215. A new estimate is made via return loop 205, and the re-entering of step 211. After a few iterations, the decision is made, step 212, to report distance between points, step 217 via line 216. When the estimate is found accurate, the actual distance between the selected ground points is made, step 217. The process is then repeated via return loop 220, in order to obtain the distance values for other selected points and tiles.
The invention has been described in detail with particular reference to certain preferred embodiments thereof, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention.

Claims

What is claimed is:
1. An image georeferencing system, comprising:
a portable, data-capturing device affixed to a camera, with said camera providing an image, said portable, data-capturing device and said camera being carried by hand or upon an aerial surveillance vehicle or other craft, said portable, data-capturing device providing data for computationally generating a georeference, and being independently operative of any aeronautical instruments, said portable, data-capturing device further including at least one inclinometer for determining depression angle, a means for determining heading or bearing of said data-capturing device and a global position satellite antenna/receiver for obtaining georeferencing information, said at least one inclinometer and said global position satellite antenna/receiver being movable as a single unit; and
a processor operatively connected to said portable, data-capturing device and said camera, said processor comprising data storage means, including digital elevation information and a program for modifying image and georeferencing information with respect to variations in terrain and changes in heading, roll and yaw of said data-capturing device, said processor computationally generating a georeference of any object within said image, in which said object can be located and measured therewithin.
2. The imaging georeferencing system in accordance with claim 1, further comprising an altimeter connected to said processor for determining additional altitude data of said portable, data-capturing device.
3. The imaging georeferencing system in accordance with claim 1, further comprising a key pad connected to said processor for entering pilot information into said processor.
4. The imaging georeferencing system in accordance with claim 1, further comprising a microphone connected to said processor for entering comments into said processor.
5. An image georeferencing system, comprising:
a camera for providing an image in combination with a georeferencing, data-capturing device and inclinometer, said combination carried by hand or upon an aerial surveillance vehicle or other craft, said georeferencing, data-capturing device capturing data for computationally generating a georeference of any object within said image; and
a processor connected to said camera and georeferencing, data-capturing device combination, said processor comprising data storage means, including digital elevation information and a program for modifying image and georeferencing information with respect to variations in terrain and changes in heading, roll and yaw of said data-capturing device and processing said captured data for computing a georeference of any object within said image.
6. The image georeferencing system in accordance with claim 5, wherein said camera and georeferencing, data-capturing device combination comprises at least one inclinometer for determining depression angle, a means for determining heading of said image and a global position satellite antenna/receiver for obtaining georeferencing information with respect to said image, said at least one inclinometer and said global position satellite antenna/receiver being movable as a single unit, with each being connected to said processor.
7. The image georeferencing system in accordance with claim 6, further comprising an altimeter connected to said processor for determining additional altitude data.
8. The image georeferencing system in accordance with claim 5, further comprising a key pad connected to said processor for entering comments into said processor.
9. The image georeferencing system in accordance with claim 5, further comprising a microphone connected to said processor for entering comments into said processor.
10. A method of computationally georeferencing images, comprising the steps of:
a) capturing an image of terrain to provide digitized image information;
b) combining said digitized image information with shot data from instrumental data and camera data;
c) analyzing said combined digitized image and said shot data;
d) obtaining information with respect to image location data, including at least one of a group of location data including variations in camera latitude, longitude, altitude, camera bearing, camera depression angle, roll and yaw; and
e) adjusting information obtained in step (b) and utilizing information obtained in step (d) to coordinate points on a ground plane with points in an image plane to produce a georeferenced digital image of the terrain.
11. The method in accordance with claim 10, further comprising the step of:
f) utilizing digital elevation model data to enhance accuracy of image and georeferencing information obtained in step (b) .
12. The method in accordance with claim 10, further comprising the step of:
f) processing said information obtained in step (b) to provide an image, or a portion thereof, that can be spatially located by using geographic coordinates and/or measurements taken between any two points.
13. The method in accordance with claim 10, further comprising the step of:
f) depicting combined image information and georeferencing information as a "tile" within a "mosaic" of tiled images, with each image, in addition to its respective georeference, being processed so as to contain a discrete sequential identifier, date and time.
14. The method in accordance with claim 10, further comprising the step of:
f) capturing a multiplicity of images of the same terrain in accordance with step (a) by using different angles and capture positions to provide different points of view of the same scene, each of which being accessible by means of a graphical user interface.
15. The method in accordance with claim 10, further comprising the steps of:
f) obtaining information with respect to lens focal length, size of image plane, number of pixels in horizontal and vertical planes, and size of pixels; and
g) processing said image information in step (a) with respect to said information obtained in step (f) to adjust said image information.
16. A method of aerial surveillance of terrain, comprising the steps of:
f) aerially capturing an image of terrain to provide image information;
g) combining said image information with shot data as georeferencing variables;
h) analyzing said combined image and said georeferencing variables;
i) obtaining information with respect to image location data, including at least one of a group of location data including variations in camera latitude, longitude, altitude, camera bearing, camera depression angle, roll and yaw; and
j) adjusting information obtained in step (b) and utilizing information obtained in step (d) to coordinate points on a ground plane with points in an image plane to produce an exact image of the terrain.
17. The method in accordance with claim 16, further comprising the step of: f) utilizing digital elevation model data to enhance accuracy of image and georeferencing information obtained in step (b) .
18. The method in accordance with claim 16, further comprising the step of :
f) processing said information obtained in step (b) to provide an image, or a portion thereof, that can be spatially located by using geographic coordinates and/or make known geographic coordinates of the ground at any point depicted in the image and/or ground measurements taken between any two points of the image.
19. The method in accordance with claim 16, further comprising the step of:
f) depicting combined image information and georeferencing information as a "tile" within a "mosaic" of tiled images, with each image, in addition to its respective georeference, being processed so as to contain a discrete sequential identifier, date and time.
20. The method in accordance with claim 16, further comprising the step of:
f) taking a multiplicity of images of the terrain in accordance with step (a) by using different angles and capture positions to provide multiple views, accessible by means of a window-like, graphical user interface.
21. The method in accordance with claim 16, further comprising the steps of: f) obtaining information with respect to lens focal length, size of image plane, number of pixels in horizontal and vertical planes, and size of pixels; and
g) processing said image information obtained in step (a) with respect to said information obtained in step (f) to adjust said image information.
22. An image georeferencing system comprising
a camera for providing an image in combination with a georeferencing, data-capturing device, said combination carried by hand or upon an aerial surveillance vehicle or other craft, said georeferencing, data-capturing device capturing data for computationally generating and recording a georeference of the camera for each captured image; and further comprising a device selected from the group consisting of an inclinometer, means for determining heading or bearing of the camera.
23. The image georeferencing system of claim 22 further comprising a processor connected to said camera and georeferencing, data-capturing device combination, said processor comprising data storage means, including digital elevation information and a program for modifying image and georeferencing information with respect to variations in terrain and changes in heading, roll and yaw of said data-capturing device and processing said captured data for computing a georeference of any object within said image.
24. The image georeferencing system of claim 23 wherein said camera further comprising means for recording the depression and roll angle of the camera for each image captured by the camera .
25. The image georeferencing system of claim 23 wherein said camera further comprising means for recording the altitude of the camera for each image captured by the camera.
26. The image georeferencing system of claim 23 wherein said georeference data is obtained by a global position system antenna and receiver connected to the processing unit .
27. The image georeferencing system of claim 26 wherein said processing unit is within said camera.
28. The image georeferencing system of claim 24 wherein said angle means is an inclinometer connected to the processing unit.
29. The image georeferencing system of claim 25 wherein said altitude means is an altimeter connected to the processing unit.
30. A digital mapping system, comprising:
a portable data-capturing device affixed to a camera, said camera providing an image, said portable data- capturing device and said camera being carried by hand or upon an aerial surveillance vehicle or other craft for providing a pixel-based image, said portable data-capturing device providing data for computationally generating a georeference for each pixel of said pixel -based image, said data-capturing device being independently operative of any aeronautical instruments, said portable data-capturing device further including at least one inclinometer for determining declination angel, a means for determining heading or bearing of said image-capturing device and a global position satellite antenna/receiver for obtaining georeferencing information, said at least one inclinometer and said global position satellite antenna/receiver being movable as a single unit; and
a processor operatively connected to said portable data- capturing device and said camera, said processor comprising data storage means, including digital elevation information and a program for modifying image and georeferencing information with respect to variations in terrain and changes in heading, roll and yaw of said data-capturing device, said processor computationally generating a georeference of each pixel and any object within said image, wherein said object can be located and measured within said image.
31. The imaging georeferencing system in accordance with claim 30, further comprising a key pad connected to said processor for entering pilot information into said processor.
32. The imaging georeferencing system in accordance with claim 30, further comprising a microphone connected to said processor for entering comments into said processor.
33. An image georeferencing system in accordance with claim 30, further comprising:
a camera for providing an image in combination with a georeferencing, data-capturing device and inclinometer, said combination carried by hand or upon an aerial surveillance vehicle or other craft, said georeferencing, data-capturing device capturing data for computationally generating a georeference of any object within said image; and
a processor connected to said camera and georeferencing, data-capturing device combination, said processor comprising data storage means, including digital elevation information and a program for modifying image and georeferencing information with respect to variations in terrain and changes in heading, roll and yaw of said data-capturing device and processing said captured data for computing a georeference of any object within said image.
34. A digital mapping system, comprising:
a camera for providing a pixel-based image in combination with a georeferencing data-capturing device, said combination carried by hand or upon an aerial surveillance vehicle or other craft, said georeferencing data-capturing device capturing data for computationally generating a georeference of each pixel and any object within said image; and
a processor connected to said camera and georeferencing data-capturing device combination, said processor comprising data storage means, including digital elevation information and a program for modifying image and georeferencing information with respect to variations in terrain and changes in heading, roll and yaw of said image-capturing device, and processing said captured data for computing a georeference of each pixel and any object within said image.
35. The image georeferencing system in accordance with claim 34, wherein said camera and georeferencing, data-capturing device combination comprises at least one inclinometer for determining depression angle, a means for determining heading of said image and a global position satellite antenna/receiver for obtaining georeferencing information with respect to said image, said at least one inclinometer and said global position satellite antenna/receiver being movable as a single unit, with each being connected to said processor.
36. The image georeferencing system in accordance with claim 35, further comprising an altimeter connected to said processor for determining additional altitude data.
37. The image georeferencing system in accordance with claim 34, further comprising a key pad connected to said processor for entering comments into said processor.
38. The image georeferencing system in accordance with claim 34, further comprising a microphone connected to said processor for entering comments into said processor.
39. A method of digitally mapping terrain, comprising the steps of :
a) capturing a pixel -based image of terrain to provide digitized image information;
b) capturing georeferencing information;
c) combining said digitized image information with said captured georeferencing information; and
d) processing said combined digitized image information and said captured georeferencing information in order to generate a georeference of each pixel and any object within said image of said terrain, whereby said object can be located within said image of terrain.
40. The method in accordance with claim 39, further comprising the step of:
f) utilizing digital elevation model data to enhance accuracy of image and georeferencing information obtained in step (b) .
41. The method in accordance with claim 39, further comprising the step of :
f) processing said information obtained in step (b) to provide an image, or a portion thereof, that can be spatially located by using geographic coordinates and/or measurements taken between any two points.
42. The method in accordance with claim 39, further comprising the step of:
f) depicting combined image information and georeferencing information as a "tile" within a "mosaic" of tiled images, with each image, in addition to its respective georeference, being processed so as to contain a discrete sequential identifier, date and time.
43. The method in accordance with claim 39, further comprising the step of:
f) capturing a multiplicity of images of the same terrain in accordance with step (a) by using different angles and capture positions to provide different points of view of the same scene, each of which being accessible by means of a graphical user interface.
44. The method in accordance with claim 39, further comprising the steps of:
f) obtaining information with respect to lens focal length, size of image plane, number of pixels in horizontal and vertical planes, and size of pixels; and
g) processing said image information in step (a) with respect to said information obtained in step (f) to adjust said image information.
45. A method of aerial surveillance of terrain, comprising the steps of:
a) aerially capturing a [n] pixel -based image of terrain to provide image information;
b) combining said image information with georeferencing information; and
c) processing said combined image and said georeferencing information, in order to generate a georeference of each pixel and any object within said image of terrain, whereby said object can be located within said image of terrain.
46. The method in accordance with claim 45, further comprising the step of:
f) utilizing digital elevation model data to enhance accuracy of image and georeferencing information obtained in step (b) .
47. The method in accordance with claim 45, further comprising the step of:
f) processing said information obtained in step
(b) to provide an image, or a portion thereof, that can be spatially located by using geographic coordinates and/or make known geographic coordinates of the ground at any point depicted in the image and/or ground measurements taken between any two points of the image.
48. The method in accordance with claim 45, further comprising the step of:
f) depicting combined image information and georeferencing information as a "tile" within a "mosaic" of tiled images, with each image, in addition to its respective georeference, being processed so as to contain a discrete sequential identifier, date and time.
49. The method in accordance with claim 45, further comprising the step of :
f) taking a multiplicity of images of the terrain in accordance with step (a) by using different angles and capture positions to provide multiple views, accessible by means of a window- like, graphical user interface.
50. The method in accordance with claim 45, further comprising the steps of :
f) obtaining information with respect to lens focal length, size of image plane, number of pixels in horizontal and vertical planes, and size of pixels; and
g) processing said image information obtained in step (a) with respect to said information obtained in step (f) to adjust said image information.
PCT/US1998/020809 1997-10-06 1998-10-05 Digital-image mapping WO1999018732A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU97837/98A AU9783798A (en) 1997-10-06 1998-10-05 Digital-image mapping

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US94488797A 1997-10-06 1997-10-06
US08/944,887 1997-10-06

Publications (1)

Publication Number Publication Date
WO1999018732A1 true WO1999018732A1 (en) 1999-04-15

Family

ID=25482223

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1998/020809 WO1999018732A1 (en) 1997-10-06 1998-10-05 Digital-image mapping

Country Status (2)

Country Link
AU (1) AU9783798A (en)
WO (1) WO1999018732A1 (en)

Cited By (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2368219A (en) * 2000-09-13 2002-04-24 Roke Manor Research Camera system with GPS
EP1348983A1 (en) * 2002-03-27 2003-10-01 Sick Ag Optoelectronic sensor including position locating device
US6657661B1 (en) * 2000-06-20 2003-12-02 Hewlett-Packard Development Company, L.P. Digital camera with GPS enabled file management and a device to determine direction
EP1418402A1 (en) * 2002-11-08 2004-05-12 Pictometry International Corp. Method and apparatus for capturing, geolocating and measuring oblique images
US6906643B2 (en) 2003-04-30 2005-06-14 Hewlett-Packard Development Company, L.P. Systems and methods of viewing, modifying, and interacting with “path-enhanced” multimedia
US6985240B2 (en) 2002-12-23 2006-01-10 International Business Machines Corporation Method and apparatus for retrieving information about an object of interest to an observer
US7149961B2 (en) 2003-04-30 2006-12-12 Hewlett-Packard Development Company, L.P. Automatic generation of presentations from “path-enhanced” multimedia
EP1788349A3 (en) * 2005-11-22 2007-07-11 The Boeing Company Method for geocoding a perspective image
EP1845493A2 (en) * 2006-04-10 2007-10-17 Honeywell International Inc. Enhanced image compression using scene prediction
DE102007001949A1 (en) * 2007-01-13 2008-07-17 Schuster, Werner, Dr. Dipl.-Ing. Camera e.g. video camera, for use with computer, is connected with global positioning system receiver for impression of position and height of image recording, and is connected with directional device e.g. digital compass
WO2008116376A1 (en) * 2007-03-24 2008-10-02 Yuejun Yan A portable digital photographing system
WO2008028040A3 (en) * 2006-08-30 2008-11-13 Pictometry Int Corp Mosaic oblique images and methods of making and using same
US7526718B2 (en) 2003-04-30 2009-04-28 Hewlett-Packard Development Company, L.P. Apparatus and method for recording “path-enhanced” multimedia
US7580591B2 (en) 2005-07-01 2009-08-25 The Boeing Company Method for generating a synthetic perspective image
EP2149787A1 (en) * 2008-07-31 2010-02-03 Dcns System for inspecting a structure, in particular a vessel
WO2010032057A1 (en) * 2008-09-22 2010-03-25 U-Blox A.G. Direction estimation using single gps antenna and measured signal stength
US7751651B2 (en) 2004-04-02 2010-07-06 The Boeing Company Processing architecture for automatic image registration
US7773799B2 (en) 2004-04-02 2010-08-10 The Boeing Company Method for automatic stereo measurement of a point of interest in a scene
WO2010089427A1 (en) * 2009-02-03 2010-08-12 Universidad Politectica De Valencia Portable multi-camera photogrammetric system support for terrestrial uses
EP1696204A3 (en) * 2002-11-08 2011-01-26 Pictometry International Corp. Method and apparatus for capturing, geolocating and measuring oblique images
CN102186183A (en) * 2011-04-15 2011-09-14 吴长松 Reconnaissance method, device and network optimization equipment
US8055100B2 (en) 2004-04-02 2011-11-08 The Boeing Company Method and system for image registration quality confirmation and improvement
CN103220469A (en) * 2013-04-27 2013-07-24 林宁 Camera smart box, camera data processing system and camera data processing method
US8797402B2 (en) 2002-11-19 2014-08-05 Hewlett-Packard Development Company, L.P. Methods and apparatus for imaging and displaying a navigable path
US8896695B2 (en) 2002-08-28 2014-11-25 Visual Intelligence Lp Retinal concave array compound camera system
US8994822B2 (en) 2002-08-28 2015-03-31 Visual Intelligence Lp Infrastructure mapping system and method
US9183538B2 (en) 2012-03-19 2015-11-10 Pictometry International Corp. Method and system for quick square roof reporting
US9262818B2 (en) 2007-05-01 2016-02-16 Pictometry International Corp. System for detecting image abnormalities
US9275080B2 (en) 2013-03-15 2016-03-01 Pictometry International Corp. System and method for early access to captured images
US9275496B2 (en) 2007-12-03 2016-03-01 Pictometry International Corp. Systems and methods for rapid three-dimensional modeling with real facade texture
US9292913B2 (en) 2014-01-31 2016-03-22 Pictometry International Corp. Augmented three dimensional point collection of vertical structures
US9330494B2 (en) 2009-10-26 2016-05-03 Pictometry International Corp. Method for the automatic material classification and texture simulation for 3D models
US9389298B2 (en) 2002-09-20 2016-07-12 Visual Intelligence Lp Self-calibrated, remote imaging and data processing system
US9503615B2 (en) 2007-10-12 2016-11-22 Pictometry International Corp. System and process for color-balancing a series of oblique images
US9612598B2 (en) 2014-01-10 2017-04-04 Pictometry International Corp. Unmanned aircraft structure evaluation system and method
US9753950B2 (en) 2013-03-15 2017-09-05 Pictometry International Corp. Virtual property reporting for automatic structure detection
US9881163B2 (en) 2013-03-12 2018-01-30 Pictometry International Corp. System and method for performing sensitive geo-spatial processing in non-sensitive operator environments
US9898802B2 (en) 2008-08-05 2018-02-20 Pictometry International Corp. Cut line steering methods for forming a mosaic image of a geographical area
US9933254B2 (en) 2009-05-22 2018-04-03 Pictometry International Corp. System and process for roof measurement using aerial imagery
US9953112B2 (en) 2014-02-08 2018-04-24 Pictometry International Corp. Method and system for displaying room interiors on a floor plan
US10325350B2 (en) 2011-06-10 2019-06-18 Pictometry International Corp. System and method for forming a video stream containing GIS data in real-time
US10402676B2 (en) 2016-02-15 2019-09-03 Pictometry International Corp. Automated system and methodology for feature extraction
US10502813B2 (en) 2013-03-12 2019-12-10 Pictometry International Corp. LiDAR system producing multiple scan paths and method of making and using same
US10621463B2 (en) 2010-12-17 2020-04-14 Pictometry International Corp. Systems and methods for processing images with edge detection and snap-to feature
US10671648B2 (en) 2016-02-22 2020-06-02 Eagle View Technologies, Inc. Integrated centralized property database systems and methods
USRE49105E1 (en) 2002-09-20 2022-06-14 Vi Technologies, Llc Self-calibrated, remote imaging and data processing system
US11483518B2 (en) 2010-07-07 2022-10-25 Pictometry International Corp. Real-time moving platform management system
CN115442531A (en) * 2022-09-05 2022-12-06 深圳奇迹智慧网络有限公司 Method for determining direction of camera and camera direction determining device

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8593518B2 (en) 2007-02-01 2013-11-26 Pictometry International Corp. Computer system for continuous oblique panning
US8520079B2 (en) 2007-02-15 2013-08-27 Pictometry International Corp. Event multiplexer for managing the capture of images
US8385672B2 (en) 2007-05-01 2013-02-26 Pictometry International Corp. System for detecting image abnormalities

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5467271A (en) * 1993-12-17 1995-11-14 Trw, Inc. Mapping and analysis system for precision farming applications
US5506644A (en) * 1992-08-18 1996-04-09 Olympus Optical Co., Ltd. Camera
US5508736A (en) * 1993-05-14 1996-04-16 Cooper; Roger D. Video signal processing apparatus for producing a composite signal for simultaneous display of data and video information

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5506644A (en) * 1992-08-18 1996-04-09 Olympus Optical Co., Ltd. Camera
US5508736A (en) * 1993-05-14 1996-04-16 Cooper; Roger D. Video signal processing apparatus for producing a composite signal for simultaneous display of data and video information
US5467271A (en) * 1993-12-17 1995-11-14 Trw, Inc. Mapping and analysis system for precision farming applications

Cited By (126)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6657661B1 (en) * 2000-06-20 2003-12-02 Hewlett-Packard Development Company, L.P. Digital camera with GPS enabled file management and a device to determine direction
GB2368219A (en) * 2000-09-13 2002-04-24 Roke Manor Research Camera system with GPS
EP1348983A1 (en) * 2002-03-27 2003-10-01 Sick Ag Optoelectronic sensor including position locating device
US8896695B2 (en) 2002-08-28 2014-11-25 Visual Intelligence Lp Retinal concave array compound camera system
US8994822B2 (en) 2002-08-28 2015-03-31 Visual Intelligence Lp Infrastructure mapping system and method
US9389298B2 (en) 2002-09-20 2016-07-12 Visual Intelligence Lp Self-calibrated, remote imaging and data processing system
US9797980B2 (en) 2002-09-20 2017-10-24 Visual Intelligence Lp Self-calibrated, remote imaging and data processing system
USRE49105E1 (en) 2002-09-20 2022-06-14 Vi Technologies, Llc Self-calibrated, remote imaging and data processing system
JP2010112959A (en) * 2002-11-08 2010-05-20 Pictometry Internatl Corp Oblique geolocation and measuring system
US20120020571A1 (en) * 2002-11-08 2012-01-26 Schultz Stephen L Method and apparatus for capturing, geolocating and measuring oblique images
US7424133B2 (en) * 2002-11-08 2008-09-09 Pictometry International Corporation Method and apparatus for capturing, geolocating and measuring oblique images
US9443305B2 (en) * 2002-11-08 2016-09-13 Pictometry International Corp. Method and apparatus for capturing, geolocating and measuring oblique images
US8634594B2 (en) * 2002-11-08 2014-01-21 Pictometry International Corp. Method and apparatus for capturing, geolocating and measuring oblique images
US20120288158A1 (en) * 2002-11-08 2012-11-15 Schultz Stephen L Method and Apparatus for Capturing, Geolocating and Measuring Oblique Images
US8233666B2 (en) * 2002-11-08 2012-07-31 Pictometry International Corp. Method and apparatus for capturing, geolocating and measuring oblique images
US8204341B2 (en) * 2002-11-08 2012-06-19 Pictometry International Corp. Method and apparatus for capturing, geolocating and measuring oblique images
EP2261600A3 (en) * 2002-11-08 2012-03-21 Pictometry International Corp. Method and apparatus for capturing, geolocating and measuring oblique images
EP1418402A1 (en) * 2002-11-08 2004-05-12 Pictometry International Corp. Method and apparatus for capturing, geolocating and measuring oblique images
US8068643B2 (en) * 2002-11-08 2011-11-29 Pictometry International Corp. Method and apparatus for capturing, geolocating and measuring oblique images
US11069077B2 (en) 2002-11-08 2021-07-20 Pictometry International Corp. Method and apparatus for capturing, geolocating and measuring oblique images
US20180122093A1 (en) * 2002-11-08 2018-05-03 Pictometry International Corp. Method and apparatus for capturing, geolocating and measuring oblique images
EP1696204A3 (en) * 2002-11-08 2011-01-26 Pictometry International Corp. Method and apparatus for capturing, geolocating and measuring oblique images
CN101793514A (en) * 2002-11-08 2010-08-04 皮克托米特里国际公司 Method and apparatus for capturing, geolocating and measuring oblique images
US9182657B2 (en) * 2002-11-08 2015-11-10 Pictometry International Corp. Method and apparatus for capturing, geolocating and measuring oblique images
US10607357B2 (en) 2002-11-08 2020-03-31 Pictometry International Corp. Method and apparatus for capturing, geolocating and measuring oblique images
US9811922B2 (en) 2002-11-08 2017-11-07 Pictometry International Corp. Method and apparatus for capturing, geolocating and measuring oblique images
US8797402B2 (en) 2002-11-19 2014-08-05 Hewlett-Packard Development Company, L.P. Methods and apparatus for imaging and displaying a navigable path
US6985240B2 (en) 2002-12-23 2006-01-10 International Business Machines Corporation Method and apparatus for retrieving information about an object of interest to an observer
US7149961B2 (en) 2003-04-30 2006-12-12 Hewlett-Packard Development Company, L.P. Automatic generation of presentations from “path-enhanced” multimedia
US6906643B2 (en) 2003-04-30 2005-06-14 Hewlett-Packard Development Company, L.P. Systems and methods of viewing, modifying, and interacting with “path-enhanced” multimedia
US7526718B2 (en) 2003-04-30 2009-04-28 Hewlett-Packard Development Company, L.P. Apparatus and method for recording “path-enhanced” multimedia
US8055100B2 (en) 2004-04-02 2011-11-08 The Boeing Company Method and system for image registration quality confirmation and improvement
US7751651B2 (en) 2004-04-02 2010-07-06 The Boeing Company Processing architecture for automatic image registration
US8107722B2 (en) 2004-04-02 2012-01-31 The Boeing Company System and method for automatic stereo measurement of a point of interest in a scene
US7773799B2 (en) 2004-04-02 2010-08-10 The Boeing Company Method for automatic stereo measurement of a point of interest in a scene
US7873240B2 (en) 2005-07-01 2011-01-18 The Boeing Company Method for analyzing geographic location and elevation data and geocoding an image with the data
US7580591B2 (en) 2005-07-01 2009-08-25 The Boeing Company Method for generating a synthetic perspective image
EP2103903A3 (en) * 2005-11-22 2009-09-30 The Boeing Company Method for geocoding a perspective image
EP1788349A3 (en) * 2005-11-22 2007-07-11 The Boeing Company Method for geocoding a perspective image
EP1845493A2 (en) * 2006-04-10 2007-10-17 Honeywell International Inc. Enhanced image compression using scene prediction
EP1845493A3 (en) * 2006-04-10 2009-04-08 Honeywell International Inc. Enhanced image compression using scene prediction
US10489953B2 (en) 2006-08-30 2019-11-26 Pictometry International Corp. Mosaic oblique images and methods of making and using same
US7873238B2 (en) * 2006-08-30 2011-01-18 Pictometry International Corporation Mosaic oblique images and methods of making and using same
US8660382B2 (en) * 2006-08-30 2014-02-25 Pictometry International Corp. Mosaic oblique images and methods of making and using same
US20120201478A1 (en) * 2006-08-30 2012-08-09 Stephen Schultz Mosaic oblique images and methods of making and using same
US8081841B2 (en) * 2006-08-30 2011-12-20 Pictometry International Corp. Mosaic oblique images and methods of making and using same
US20180247442A1 (en) * 2006-08-30 2018-08-30 Pictometry International Corp. Mosaic oblique images and methods of making and using same
US9959653B2 (en) 2006-08-30 2018-05-01 Pictometry International Corporation Mosaic oblique images and methods of making and using same
US8452125B2 (en) 2006-08-30 2013-05-28 Pictometry International Corp. Mosaic oblique images and methods of making and using same
US9437029B2 (en) 2006-08-30 2016-09-06 Pictometry International Corp. Mosaic oblique images and methods of making and using same
US9805489B2 (en) 2006-08-30 2017-10-31 Pictometry International Corp. Mosaic oblique images and methods of making and using same
US11080911B2 (en) 2006-08-30 2021-08-03 Pictometry International Corp. Mosaic oblique images and systems and methods of making and using same
WO2008028040A3 (en) * 2006-08-30 2008-11-13 Pictometry Int Corp Mosaic oblique images and methods of making and using same
DE102007001949A1 (en) * 2007-01-13 2008-07-17 Schuster, Werner, Dr. Dipl.-Ing. Camera e.g. video camera, for use with computer, is connected with global positioning system receiver for impression of position and height of image recording, and is connected with directional device e.g. digital compass
WO2008116376A1 (en) * 2007-03-24 2008-10-02 Yuejun Yan A portable digital photographing system
US9633425B2 (en) 2007-05-01 2017-04-25 Pictometry International Corp. System for detecting image abnormalities
US11100625B2 (en) 2007-05-01 2021-08-24 Pictometry International Corp. System for detecting image abnormalities
US10198803B2 (en) 2007-05-01 2019-02-05 Pictometry International Corp. System for detecting image abnormalities
US11514564B2 (en) 2007-05-01 2022-11-29 Pictometry International Corp. System for detecting image abnormalities
US10679331B2 (en) 2007-05-01 2020-06-09 Pictometry International Corp. System for detecting image abnormalities
US9959609B2 (en) 2007-05-01 2018-05-01 Pictometry International Corporation System for detecting image abnormalities
US9262818B2 (en) 2007-05-01 2016-02-16 Pictometry International Corp. System for detecting image abnormalities
US9503615B2 (en) 2007-10-12 2016-11-22 Pictometry International Corp. System and process for color-balancing a series of oblique images
US10580169B2 (en) 2007-10-12 2020-03-03 Pictometry International Corp. System and process for color-balancing a series of oblique images
US11087506B2 (en) 2007-10-12 2021-08-10 Pictometry International Corp. System and process for color-balancing a series of oblique images
US10896540B2 (en) 2007-12-03 2021-01-19 Pictometry International Corp. Systems and methods for rapid three-dimensional modeling with real façade texture
US9972126B2 (en) 2007-12-03 2018-05-15 Pictometry International Corp. Systems and methods for rapid three-dimensional modeling with real facade texture
US9836882B2 (en) 2007-12-03 2017-12-05 Pictometry International Corp. Systems and methods for rapid three-dimensional modeling with real facade texture
US9275496B2 (en) 2007-12-03 2016-03-01 Pictometry International Corp. Systems and methods for rapid three-dimensional modeling with real facade texture
US10229532B2 (en) 2007-12-03 2019-03-12 Pictometry International Corporation Systems and methods for rapid three-dimensional modeling with real facade texture
US9520000B2 (en) 2007-12-03 2016-12-13 Pictometry International Corp. Systems and methods for rapid three-dimensional modeling with real facade texture
US11263808B2 (en) 2007-12-03 2022-03-01 Pictometry International Corp. Systems and methods for rapid three-dimensional modeling with real façade texture
US10573069B2 (en) 2007-12-03 2020-02-25 Pictometry International Corp. Systems and methods for rapid three-dimensional modeling with real facade texture
FR2934682A1 (en) * 2008-07-31 2010-02-05 Dcns SYSTEM FOR ASSISTANCE IN NON-DESTRUCTIVE CONTROL OF A STRUCTURE SUCH AS IN PARTICULAR A SHIP
EP2149787A1 (en) * 2008-07-31 2010-02-03 Dcns System for inspecting a structure, in particular a vessel
US11551331B2 (en) 2008-08-05 2023-01-10 Pictometry International Corp. Cut-line steering methods for forming a mosaic image of a geographical area
US9898802B2 (en) 2008-08-05 2018-02-20 Pictometry International Corp. Cut line steering methods for forming a mosaic image of a geographical area
US10424047B2 (en) 2008-08-05 2019-09-24 Pictometry International Corp. Cut line steering methods for forming a mosaic image of a geographical area
US10839484B2 (en) 2008-08-05 2020-11-17 Pictometry International Corp. Cut-line steering methods for forming a mosaic image of a geographical area
WO2010032057A1 (en) * 2008-09-22 2010-03-25 U-Blox A.G. Direction estimation using single gps antenna and measured signal stength
WO2010089427A1 (en) * 2009-02-03 2010-08-12 Universidad Politectica De Valencia Portable multi-camera photogrammetric system support for terrestrial uses
ES2347626A1 (en) * 2009-02-03 2010-11-02 Universidad Politecnica De Valencia Portable multi-camera photogrammetric system support for terrestrial uses
US9933254B2 (en) 2009-05-22 2018-04-03 Pictometry International Corp. System and process for roof measurement using aerial imagery
US9959667B2 (en) 2009-10-26 2018-05-01 Pictometry International Corp. Method for the automatic material classification and texture simulation for 3D models
US10198857B2 (en) 2009-10-26 2019-02-05 Pictometry International Corp. Method for the automatic material classification and texture simulation for 3D models
US9330494B2 (en) 2009-10-26 2016-05-03 Pictometry International Corp. Method for the automatic material classification and texture simulation for 3D models
US11483518B2 (en) 2010-07-07 2022-10-25 Pictometry International Corp. Real-time moving platform management system
US11003943B2 (en) 2010-12-17 2021-05-11 Pictometry International Corp. Systems and methods for processing images with edge detection and snap-to feature
US10621463B2 (en) 2010-12-17 2020-04-14 Pictometry International Corp. Systems and methods for processing images with edge detection and snap-to feature
CN102186183A (en) * 2011-04-15 2011-09-14 吴长松 Reconnaissance method, device and network optimization equipment
US10325350B2 (en) 2011-06-10 2019-06-18 Pictometry International Corp. System and method for forming a video stream containing GIS data in real-time
US9183538B2 (en) 2012-03-19 2015-11-10 Pictometry International Corp. Method and system for quick square roof reporting
US10346935B2 (en) 2012-03-19 2019-07-09 Pictometry International Corp. Medium and method for quick square roof reporting
US9881163B2 (en) 2013-03-12 2018-01-30 Pictometry International Corp. System and method for performing sensitive geo-spatial processing in non-sensitive operator environments
US10311238B2 (en) 2013-03-12 2019-06-04 Pictometry International Corp. System and method for performing sensitive geo-spatial processing in non-sensitive operator environments
US10502813B2 (en) 2013-03-12 2019-12-10 Pictometry International Corp. LiDAR system producing multiple scan paths and method of making and using same
US11525897B2 (en) 2013-03-12 2022-12-13 Pictometry International Corp. LiDAR system producing multiple scan paths and method of making and using same
US9805059B2 (en) 2013-03-15 2017-10-31 Pictometry International Corp. System and method for early access to captured images
US10311089B2 (en) 2013-03-15 2019-06-04 Pictometry International Corp. System and method for early access to captured images
US9275080B2 (en) 2013-03-15 2016-03-01 Pictometry International Corp. System and method for early access to captured images
US9753950B2 (en) 2013-03-15 2017-09-05 Pictometry International Corp. Virtual property reporting for automatic structure detection
CN103220469A (en) * 2013-04-27 2013-07-24 林宁 Camera smart box, camera data processing system and camera data processing method
US10032078B2 (en) 2014-01-10 2018-07-24 Pictometry International Corp. Unmanned aircraft structure evaluation system and method
US10204269B2 (en) 2014-01-10 2019-02-12 Pictometry International Corp. Unmanned aircraft obstacle avoidance
US11747486B2 (en) 2014-01-10 2023-09-05 Pictometry International Corp. Unmanned aircraft structure evaluation system and method
US10037463B2 (en) 2014-01-10 2018-07-31 Pictometry International Corp. Unmanned aircraft structure evaluation system and method
US10318809B2 (en) 2014-01-10 2019-06-11 Pictometry International Corp. Unmanned aircraft structure evaluation system and method
US9612598B2 (en) 2014-01-10 2017-04-04 Pictometry International Corp. Unmanned aircraft structure evaluation system and method
US10181081B2 (en) 2014-01-10 2019-01-15 Pictometry International Corp. Unmanned aircraft structure evaluation system and method
US11120262B2 (en) 2014-01-10 2021-09-14 Pictometry International Corp. Unmanned aircraft structure evaluation system and method
US10037464B2 (en) 2014-01-10 2018-07-31 Pictometry International Corp. Unmanned aircraft structure evaluation system and method
US10181080B2 (en) 2014-01-10 2019-01-15 Pictometry International Corp. Unmanned aircraft structure evaluation system and method
US11087131B2 (en) 2014-01-10 2021-08-10 Pictometry International Corp. Unmanned aircraft structure evaluation system and method
US9542738B2 (en) 2014-01-31 2017-01-10 Pictometry International Corp. Augmented three dimensional point collection of vertical structures
US10571575B2 (en) 2014-01-31 2020-02-25 Pictometry International Corp. Augmented three dimensional point collection of vertical structures
US10338222B2 (en) 2014-01-31 2019-07-02 Pictometry International Corp. Augmented three dimensional point collection of vertical structures
US11686849B2 (en) 2014-01-31 2023-06-27 Pictometry International Corp. Augmented three dimensional point collection of vertical structures
US9292913B2 (en) 2014-01-31 2016-03-22 Pictometry International Corp. Augmented three dimensional point collection of vertical structures
US10942276B2 (en) 2014-01-31 2021-03-09 Pictometry International Corp. Augmented three dimensional point collection of vertical structures
US11100259B2 (en) 2014-02-08 2021-08-24 Pictometry International Corp. Method and system for displaying room interiors on a floor plan
US9953112B2 (en) 2014-02-08 2018-04-24 Pictometry International Corp. Method and system for displaying room interiors on a floor plan
US10402676B2 (en) 2016-02-15 2019-09-03 Pictometry International Corp. Automated system and methodology for feature extraction
US11417081B2 (en) 2016-02-15 2022-08-16 Pictometry International Corp. Automated system and methodology for feature extraction
US10796189B2 (en) 2016-02-15 2020-10-06 Pictometry International Corp. Automated system and methodology for feature extraction
US10671648B2 (en) 2016-02-22 2020-06-02 Eagle View Technologies, Inc. Integrated centralized property database systems and methods
CN115442531A (en) * 2022-09-05 2022-12-06 深圳奇迹智慧网络有限公司 Method for determining direction of camera and camera direction determining device

Also Published As

Publication number Publication date
AU9783798A (en) 1999-04-27

Similar Documents

Publication Publication Date Title
WO1999018732A1 (en) Digital-image mapping
US10607357B2 (en) Method and apparatus for capturing, geolocating and measuring oblique images
KR102007567B1 (en) Stereo drone and method and system for calculating earth volume in non-control points using the same
Schläpfer et al. Geo-atmospheric processing of airborne imaging spectrometry data. Part 1: Parametric orthorectification
US10789673B2 (en) Post capture imagery processing and deployment systems
US20090154793A1 (en) Digital photogrammetric method and apparatus using intergrated modeling of different types of sensors
EP1696204B1 (en) Method for capturing, geolocating and measuring oblique images
CN112862966B (en) Method, device, equipment and storage medium for constructing surface three-dimensional model
EP1052599A2 (en) Formation of orthogonally projected image from centrally projected image
JP4152698B2 (en) 3D building model data generator
Meyer A parametric approach for the Geocoding of Airborne visible/infrared Imaging Spectrometer (AVIRIS) Data in rugged terrain
Hood et al. Image processing techniques for digital orthophotoquad production
US20240144509A1 (en) Methods and systems for determining 3d coordinates describing a scene
CaMda I+ B,. ma& du Canada
Meyer et al. Preprocessing: Geocoding of AVIRIS data using navigation, engineering, DEM, and radar tracking system data
Robinson HDS--High defi nition surveying.

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE GH GM HR HU ID IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG UZ VN YU ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

NENP Non-entry into the national phase

Ref country code: KR

NENP Non-entry into the national phase

Ref country code: CA

122 Ep: pct application non-entry in european phase