US20020049530A1 - Method of tracking and sensing position of objects - Google Patents
Method of tracking and sensing position of objects Download PDFInfo
- Publication number
- US20020049530A1 US20020049530A1 US09/689,741 US68974100A US2002049530A1 US 20020049530 A1 US20020049530 A1 US 20020049530A1 US 68974100 A US68974100 A US 68974100A US 2002049530 A1 US2002049530 A1 US 2002049530A1
- Authority
- US
- United States
- Prior art keywords
- location
- sensor
- features
- relative
- feature
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/16—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using electromagnetic waves other than radio waves
Definitions
- the present invention relates to sensing and tracking the position of objects in an environment, particularly but not exclusively an environment where the features of the environment are not well controlled or predefined.
- the environment may be composed of natural or artificial features and may be complex thus possessing little or no regular structure.
- some features in the surroundings may be in motion relative to other features nearby.
- U.S. Pat. No. 5,051,906 to Evans, Jr., et al discloses an apparatus and method which provides for the determination of a vehicle's orientation and position in an environment, such as a hallway, from an image of a retroreflective ceiling feature.
- inertial navigation systems Other methods which enable a machine to navigate using inertial navigation systems have been disclosed.
- the operation of inertial navigation systems is usually based on assumptions about the reference frame—for example the rotation and revolution of the earth. Double integration of the acceleration determined by the navigation system often results in unacceptable drift in the calculated position determined by the inertial navigation system. Also, repeated changes in acceleration and repeated movement about a point tend to produce cumulative errors in inertial systems, as the next position assessment is based upon the previously determined value.
- U.S. Pat. No. 4,626,995 to Lofgren et al discloses an arrangement in which a computer determines the Cartesian coordinates of a single light source through a camera attached to a vehicle. This arrangement requires that the height of the light source and the height of the sensor be predetermined.
- U.S. Pat. No. 4,858,132 to Holmquist discloses a system in which a computer determines the bearing of a composite light source through a camera attached to a vehicle, and from the apparent spacing between the elements of the lights determines bearing and range.
- U.S. Pat. No. 5,483,455 discloses an arrangement in which targets located at predefined positions with respect to a base reference frame are detected and the position of a vehicle relative to the target determined. Location of the vehicle relative to the base reference frame is determined from the position of the vehicle relative to the known target.
- laser scanners may be used to determine position on a known path relative to a defined set of fixed reference points.
- a laser or light transmitter scans a volume in which are located characteristic features consisting of reflectors intended to direct the emitted light back to a sensor located with the transmitter.
- the prior art also teaches the use of laser scanners to determine position relative to natural features and to memorise the position of such features in a two dimensional plane only in order to navigate between them.
- 4,954,962 to Evans, Jr., et al discloses a navigation control system of a robot which inputs data from a vision system and infers therefrom data relating to the configuration of the environment which lies in front of the robot so that the robot may navigate to a desired point without collision with obstacles or features in its environment.
- Obstacle avoidance or collision avoidance systems are not required to determine and track the true position and orientation of the machine within the defined environment and therefore cannot be used for navigation and guidance except in the very local sense of avoiding collisions.
- a plurality of methods have been disclosed involving the use of methods such as predetermined or installed reference points, stored maps of the local environment, infrastructure such as the Global Positioning System (GPS) or local radio navigation systems and systems such as inertial navigation systems. All of these methods use infrastructure which may be integral with the immediate environment or external to the immediate environment and must exist or be installed.
- methods such as predetermined or installed reference points, stored maps of the local environment, infrastructure such as the Global Positioning System (GPS) or local radio navigation systems and systems such as inertial navigation systems. All of these methods use infrastructure which may be integral with the immediate environment or external to the immediate environment and must exist or be installed.
- GPS Global Positioning System
- the present invention provides a method for determining the position of a movable object, including the steps of:
- a 3-D imaging sensor which provides measurements of the true relative position in 3-D space of objects relative to the sensor and may additionally provide measurements of the optical reflectance of objects in the field of view (such as is acquired in a camera image or seen with the eye) such optical reflectance being registered with the spatial information collected by the sensor, is mounted on the movable object with a predetermined (known) orientation and position thereon.
- the reference locations may form part of a natural feature such as a definite surface and/or define such feature, as well as artificial bodies with features defining a 3-D object.
- the present invention provides an autonomous vehicle, said vehicle including:
- drive means for selectively moving said vehicle
- sensor means mounted at a known orientation and position on said vehicle, said sensor means providing 3-D imaging data representative of at least a selected volume about said vehicle;
- processing means for receiving said sensor data, processing said sensor data in accordance with a pre-determined instruction set so as to locate one or more fixed points, determining the position of said vehicle with respect to said fixed points in the selected volume, and so determine the position and orientation of said vehicle and generate control signals for said drive means.
- the invention further includes apparatus enabled to implement the invention, and a system for controlling a set of autonomous vehicles using the inventive method.
- the invention relates to a method for using knowledge of the position of the sensor, in three dimensions, relative to a known reference or fixed features to track the position of the sensor in three dimensions over a period of time.
- the sensor produces data in three dimensions which are measurements of the distance and bearing to objects in the field of regard of the sensor; that is the sensor is a ‘three dimensional imaging system’.
- the data is used to determine the position of the sensor relative to fixed features in the surroundings of the sensor.
- Knowledge of the position of the sensor relative to a fixed object or objects in three dimensions completely determines the local position of the sensor.
- the position of the sensor relative to a fixed object or set of objects must be known in three dimensions at one time and must then be determined at a second time.
- the movement of the object is then determined directly from the difference between the two positions.
- Motion of the sensor may be tracked by successive determinations of the change in position of the sensor.
- the sensor may be mounted on equipment such as a vehicle or other machinery and used to track the movement of the equipment.
- the movement of the sensor can be determined from changes in position relative to natural features or characterising features intended to provide specific reference points for guidance.
- the three dimensional spatial relationship of the sensor and features in the sensor environment is the key data used to track the sensor—not a predetermined map or an external reference system. Changes in position may be determined relative to a fixed point or a set of fixed points.
- the total movement of the sensor over a period of time can be determined by determining the position of the sensor at a succession of times. When starting from a known or predetermined position, the true position of the sensor at a specific time can be determined from knowledge of the starting position and knowledge of the movement of the sensor from the starting position up to that time.
- a fixed object or a succession of fixed objects is used to determine the position of the moving sensor at successive times and the absolute position of the moving sensor relative to the known position from which it started may be determined at each of these times and the moving sensor thereby tracked.
- An object for instance a vehicle, fitted with a three dimensional sensor system and a processing system to execute the algorithm can therefore track the position in three dimensions of the object carrying the sensor using knowledge of the starting position and knowledge of the movement in three dimensions.
- the object When fitted with a suitable three dimensional sensor and processing system the object can track its motion and determine its position relative to its starting point without requiring transmission of information to the object such as transmissions of radio waves as used in the Global Positioning System (GPS) or sensing elements of the motion of the object such as velocity or acceleration as used in inertial guidance systems.
- the three dimensional information acquired by the sensor consists of spatial measurements and embodies no scaling of the data. The representation of features therefore provides information as to the position and structure of objects in the field of view directly.
- the invention described is a means of using knowledge of the three dimensional position relative to the surroundings to track the motion and thus navigate from a known starting position or relative to sensed features known to be fixed.
- the knowledge of the relative three dimensional position is obtained using a three dimensional imaging system.
- the object may be, for example, an autonomous vehicle, wherein the location method described is used for navigation.
- the reference location may be predefined elements in whole or part where the environment is well defined. However, they may equally be determined by an instruction set (software) provided on the vehicle, according to some criteria to ensure the feature will be locatable after subsequent movement.
- the sensing arrangement may be any suitable sensor which provides a direct indication of the absolute position or displacement of points relative to the sensor. As the arrangement of the sensor on the object is known, the sensing arrangement can also provide data about the orientation or attitude of the object, as the orientation of the reference feature will change with changes in the object orientation.
- inventive arrangement does not require the environment to be fully defined or fitted with carefully plotted reference points.
- inventive method simply selects suitable fixed features or parts of fixed features as reference points in transit. It does not rely on referencing to the predetermined location of the points, and so elaborate set up arrangements as are necessary in the prior art are not required.
- the present invention includes a method of navigation, wherein location is sensed as above, and appropriate direction, acceleration and velocity decisions are made in accordance with software instructions.
- location is sensed as above, and appropriate direction, acceleration and velocity decisions are made in accordance with software instructions.
- Many such proposals are described in the prior art—it is the underlying location scheme which is of key significance and difference to the prior art.
- the vehicle will be provided with an intended destination or waypoint defined in three dimensions, conveniently relative to the start position or some agreed reference point.
- the inventive arrangement may be used in conjunction with an INS or other positioning system to refine the position estimates and increase the accuracy or reliability of either means of estimating position.
- the inventive arrangement may be combined with or work with a collision avoidance or obstacle avoidance system to provide a plurality of functions.
- Known means of determining position include devices such as ultrasound sensors or other range measurement devices or two dimensional imaging systems such as video cameras. These devices provide information in one or two dimensions directly. The acquisition of information in three dimensions requires data from more than one sensor and, in some cases, extensive computation of the data from a number of sensors.
- a three dimensional imaging system may be comprised of a combination of such sensors and processors or may be a special purpose three dimensional sensor such as a three dimensional laser range measurement scanning system.
- two dimensional imaging systems only provide information on the angular relationships between features directly and provide no scale but may provide three dimensional information indirectly. To obtain three dimensional information using a two dimensional imaging system generally requires a great deal of computation.
- Position determination is based on the measurement of position relative to a known reference such as terrestrial landmarks or stars or on the determination of movement from a known position as in an inertial navigation system.
- Position consists of three components. These may be x,y,z coordinates in a Cartesian reference frame or on the surface of the earth these may be latitude, longitude and elevation relative to the geoid. In many applications only one component of the position relative to the known reference can be determined. This component may be the bearing to the reference position as used in navigation from maps using triangulation or the distance to a reference as used in the Global Positioning System where the reference is a satellite in a known orbit.
- FIG. 1 is a representation of a vehicle and sensor in accordance with one aspect of the present invention.
- FIG. 2A is a representation of the sensor as it may be installed on a vehicle or other suitable object
- FIG. 2B describes the field of view of typical sensors in three dimensions
- FIG. 3 illustrates how a suitable sensor system may determine its position at some time relative to a fixed object.
- FIG. 4 illustrates how the sensor may determine its position relative to the fixed object at a later time and how the movement of the sensor and thus the object carrying the sensor is determined from the measurement of position at the two separate times.
- FIG. 5 illustrates operation of the sensor in two dimensions to determine 2-dimensional position in a plane.
- FIGS. 5A,5B illustrate a flow chart of the steps involved in the method of the present invention.
- the sensor system includes a motorised vehicle (object) 20 as shown in FIG. 1, and a sensor 10 mounted atop the vehicle.
- vehicle 20 has a main body 22 and tracks 23 .
- vehicle 20 may have any other configuration and means of locomotion.
- the sensor 10 will provide an image in three dimensions of any features 30 in the proximity of the vehicle. Determination of the position of the object 20 carrying the sensor 10 relative to any point on a fixed object 20 in the image is then readily performed. To determine motion of the object carrying the sensor it is not necessary to know the true position of any feature 30 in proximity to the object.
- FIGS. 3 and 4 In a sequence of two or more images, the positions in three dimensions of the object 20 carrying the sensor 10 relative to features 30 in the proximity of the object are determined for each image in the sequence. These positions thus provide measurement of the motion of the object carrying the sensor relative to the fixed objects in the proximity. As the object 20 carrying the sensor 10 moves, new fixed objects will enter the proximity of the sensor and can be used to provide an ongoing measurement of the motion of the object carrying the sensor.
- FIG. 2B provides a representation of object 20 and sensor 10 , with the “field of view” of sensor 10 defined by volume 56 .
- a data processing system 21 such as a computer is used to match like features in the three dimensional images.
- the identification of the position of a like feature relative to the sensor 10 is used to measure the displacement of the feature relative to the sensor.
- three dimensional ‘images’ of a volume 40 containing the feature 30 are obtained at two separate times producing feature images 31 and 32 .
- the images are compared and the displacement of the feature in the three dimensional image determined by identifying the displacement or offset 33 within the images at which the feature is determined to be positioned. In this manner the knowledge of three dimensional structure and the position of a sensor relative to the three dimensional structure is used to determine motion relative to a random set of fixed objects.
- the feature 30 To determine the position relative to a feature in the three dimensional image, the feature 30 must be identified in the image. If the feature has an axis of symmetry, the determination of the change of position and orientation of the sensor relative to the feature will not be complete. To determine fully the orientation and position of the sensor relative to features which have symmetry, a number of features are required, for example, the orientation and position of the sensor relative to cylindrical poles requires that the sensor 10 see two poles to fully determine its position and orientation. In a sequence of two or more images the same feature or features must be recognised, (i.e. detected and identified) in each image and their positions and orientations relative to the sensor must be determined.
- a computer or digital signal processor 21 is used to process the data obtained by the sensor 10 and identify the features used to determine the positions of the object 20 in a sequence of images.
- a number of methods can be used to identify the features in images and match the features in different images. These methods include area based, edge based, feature based, model based and multilevel or hierarchical approaches and may be based on matching methods such as minimisation of least squares measures of disparity or determination of the degree of correlation between two features using devices intended to determine the degree of correlation (correlators). These methods may operate on spatial data alone or may operate on a combination of spatial and optical data as acquired by some types of 3-D imaging sensor.
- the true position of the vehicle 20 carrying the sensor 10 is fully determined from the three dimensional image data at any time that the sensor 10 can “see” the artificial feature.
- the process of tracking the moving object is shown in FIGS. 6A and 6B.
- the system is initiated by determining the position of object 20 in three dimensions, when the object is at a known position. This may be done for example by simply manually loading the known coordinates of the object's location into the processor.
- the system obtains data, via sensor 10 , indicative of the three-dimensional location of one or more fixed features 30 .
- the processor 21 of object 20 then processes the obtained data to determine the three-dimensional position of object 20 relative to the fixed feature or features 30 .
- step 420 object 20 moves to a new location.
- Step 430 involves obtaining new data indicative of the new three-dimensional location(s) of the known fixed feature(s) 30 relative to object 20 .
- the processor 21 uses this data in step 440 to determine the displacement of object 20 in three-dimensions, from the previously known location.
- the actual three-dimensional coordinates for the new location of the object can then be determined in step 450 from the knowledge of the coordinates of the previous location and the displacement calculated above.
- processor 21 checks to see if certain predetermined conditions have been satisfied.
- a predetermined condition may be a destination location. If the conditions are satisfied (e.g. object 20 has reached its destination), processor 21 generates control signals causing object 20 to stop. If the conditions are not satisfied, the process continues to element 402 which proceeds to step 470 in FIG. 6B.
- step 470 sensor 10 obtains additional data indicative of the new three-dimensional locations of the known fixed reference features. Note that this step need not be undertaken if the data obtained in step 430 is still suitable for use. For example, if the feature or features used in step 430 may not be visible from the new location of object 20 once it has moved again, then step 470 is undertaken to select new and more appropriate reference points.
- the reference point chosen need not be a new structure. It may be a more visible feature of the existing structure, or an extension of the existing structure.
- processor 21 may also elect to obtain data of new features or structures which have come into view since object 20 moved. If this step is selected, then appropriate data indicative of the three-dimensional location of the new feature relative to object 20 is obtained via sensor 10 , at step 490 .
- step 480 results in a negative, i.e. there are no new features visible, then processor 21 skips ahead to junction element 403 , omitting step 490 .
- processor 21 proceeds to element 401 to loop back to step 420 in FIG. 6A to move object 20 and repeat the sequence. This loop is repeated until the predetermined conditions are satisfied in step 460 , and object 20 stops.
- Sensor 10 and processor 21 may be used to determine the relationship between objects and estimate the position of the object carrying the sensor in a number of ways based on this simple process. For example multiple objects may be used. Objects in the sensor field of view may be compared to determine the relationship of these objects relative to each other and thus determine whether they are moving relative to each other and eliminate moving objects from the estimation of position.
- a simpler implementation may be realised by the use of a spatial position and orientation sensor 60 which acquires information describing the actual spatial position relative to the sensor of objects 70 , 71 , 72 in the field of view of the sensor in two dimensions (see FIG. 5).
- sensor 60 acquires spatial data in a plane 80 and the position of the sensor relative to features 70 , 71 , 72 in the environment is determined within the plane of measurement. Movement relative to features in the environment is then characterised by changes in position within the plane of measurement, for example the surface of the sea or ocean in the case of a surface vessel.
- the method for estimating motion in two dimensions is analogous to the method used to estimate motion in three dimensions described previously but eliminates the use of the spatial position component which is not contained by the plane of measurement.
- the sensor 60 may be a laser range measurement system such as a laser rangefinder or a radar system which is rotated ( 61 ) and used repetitively so as to measure the range(s) to features in the plane of rotation. Knowledge of the direction in which the rangefinder is oriented at the time at which a range is measured then completely determines the position of a feature in the plane of measurement.
- FIG. 4 illustrates the operation of the invention in two dimensions.
- a key aspect of the present invention is the use of the characteristics of a true 3-D image to navigate.
- Two dimensional data such as position in a plane determined by a laser scanner, angular position such as determined by an imaging system, one dimensional data such as range or bearing and single point three dimensional data such as range combined with azimuth and elevation and bearing to a single point can not be used to navigate in three dimensions.
- 3-D images may be produced by:
- Three dimensional images are acquired using scanning range measurement devices by recording the range to points in the object space at which the range measurement device is directed.
- the range measurement device is scanned over the object space and the range recorded over a grid of points for which the position and orientation of the sensor is known, a range map is produced which is then readily converted to a three dimensional image.
- the use of a laser range finder scanned over an object space to produce a three dimensional image has been demonstrated many times. Ultrasonic or radar range finders can be used to generate similar images.
- Triangulation systems require that we have two components of the sensor which each allow us to determine the direction in three dimensions to a point in the object space. The position and orientation of each component of the sensor is known and, since for each component of the sensor the angular direction to the point is known, the position in space of the point is readily determined thus providing a three dimensional image. Triangulation may be subdivided into techniques: passive triangulation and active triangulation.
- Passive triangulation encompasses such techniques as aerial or terrestrial photogrammetry where the components of the measurement system are two or more cameras, or one camera taking two or more images. Points in each image are matched and from the position in each image of the matched points the spatial position is determined. Fast systems using two television cameras and image processing systems are sometimes classified as stereo vision.
- Active triangulation encompassed such techniques as structured light imaging where a light stripe is projected into an object space and viewed by a camera or similar sensor from another position. In some instances two cameras are used. Knowledge of the direction of projection of the light stripe and the position and orientation of the camera or cameras enables calculation of the position in space of any point reflecting the light.
- Another form of active triangulation involves the use of a spot of light scanned over the object space.
- Range gated imaging is achieved by obtaining a series of images of a scene which is illuminated with a controlled light source.
- the light source has an extremely short duration and is turned on and off. Each time that the light source is turned on an image of the scene is obtained for an extremely short time after a variable delay. Those features in the scene which reflect light during this period and are therefore at a known range from the camera thus produce an image.
- a range map of the scene is obtained.
- the position and orientation of the sensor is known and, since for each image the angular direction of the features is known, the range map is then converted to a three dimensional image.
- a Moire pattern is an interference pattern of low spatial frequency.
- the interference pattern is projected into the object space and surface depth information is encoded in and recovered from the phase information embodied in the observed interference pattern in the object space.
- Holographic interferometers use coherent radiation to produce interference patterns.
- a photodetector is used to detect the reflected radiation and the three dimensional image is constructed from the structure of the interference pattern.
- Interferometry may be performed with radiation of wavelengths typically used for radar systems.
- the optical configuration required to achieve focus of an imaging system can be used to infer the range to a feature in the object space.
- This data is treated similarly to the range and image data in a range gated imaging system to produce a three dimensional image.
- the degree of defocus of an imaging system can be used to infer the range to a feature in the object space.
- the estimation of the range to an object is achieved by modelling the effect that the optical configuration of a camera, namely the range at which best focus is achieved, has on images acquired with a small depth of field.
- Range information is recovered from defocused images by calculating the range of various points in an image by estimating the degree of defocus at the said points.
Abstract
Description
- The present invention relates to sensing and tracking the position of objects in an environment, particularly but not exclusively an environment where the features of the environment are not well controlled or predefined.
- In order to undertake tasks in an environment that is known or unknown a priori, systems controlling machinery which must move in or through the environment, for example mining equipment, must have knowledge of the absolute or true position and orientation of the machinery in relation to the surroundings of the machinery. For some instances of controlled operation whereby elements of the control are exercised by a human operator and for autonomous operation, a control system must be equipped with a means to determine the absolute or true position and orientation of the machinery and the complete relationship of the machinery to the surroundings it is operating in.
- The environment may be composed of natural or artificial features and may be complex thus possessing little or no regular structure. In addition, some features in the surroundings may be in motion relative to other features nearby.
- Many methods have been disclosed, which enable a machine to navigate (determine its position and control its position) by using artificial features in a predetermined environment. For example, U.S. Pat. No. 4,831,539 to Hagenbuch discloses a system for identifying the location of a vehicle using distinctive signposts located at predefined positions. U.S. Pat. Nos. 4,811,228 to Hyyppa and 5,367,458 to Roberts utilise predefined target or signpost devices which are identified in some way by the vehicle to provide location information.
- U.S. Pat. No. 5,051,906 to Evans, Jr., et al discloses an apparatus and method which provides for the determination of a vehicle's orientation and position in an environment, such as a hallway, from an image of a retroreflective ceiling feature.
- These systems are inherently limited in their application by the requirement to determine the environment prior to operation of the machine and in many cases install artificial features which are used to determine the position of the machine within the defined environment. For example, it may be possible in a warehouse environment to provide a well controlled environment without unexpected features—however, this is much more difficult in a changing environment such as an open cut mine or underground mine, where the shape and location of objects are inherently in a state of change.
- Other methods which enable a machine to navigate using inertial navigation systems have been disclosed. The operation of inertial navigation systems is usually based on assumptions about the reference frame—for example the rotation and revolution of the earth. Double integration of the acceleration determined by the navigation system often results in unacceptable drift in the calculated position determined by the inertial navigation system. Also, repeated changes in acceleration and repeated movement about a point tend to produce cumulative errors in inertial systems, as the next position assessment is based upon the previously determined value.
- U.S. Pat. No. 4,626,995 to Lofgren et al discloses an arrangement in which a computer determines the Cartesian coordinates of a single light source through a camera attached to a vehicle. This arrangement requires that the height of the light source and the height of the sensor be predetermined. U.S. Pat. No. 4,858,132 to Holmquist discloses a system in which a computer determines the bearing of a composite light source through a camera attached to a vehicle, and from the apparent spacing between the elements of the lights determines bearing and range.
- U.S. Pat. No. 5,483,455 discloses an arrangement in which targets located at predefined positions with respect to a base reference frame are detected and the position of a vehicle relative to the target determined. Location of the vehicle relative to the base reference frame is determined from the position of the vehicle relative to the known target.
- It has been disclosed in the prior art that laser scanners may be used to determine position on a known path relative to a defined set of fixed reference points. In one embodiment, a laser or light transmitter scans a volume in which are located characteristic features consisting of reflectors intended to direct the emitted light back to a sensor located with the transmitter. The prior art also teaches the use of laser scanners to determine position relative to natural features and to memorise the position of such features in a two dimensional plane only in order to navigate between them.
- It is also disclosed in the prior art to use scanning laser rangefinders to position equipment 2-dimensionally in a constrained environment such as a tunnel. Such techniques, known as wall following, are used for obstacle detection and the avoidance of collisions with fixed features such as walls and other obstacles. Such techniques may also be used to fuse data referenced to a known local environment with data from a dead reckoning system such as an inertial navigation system (INS) by periodically resetting the INS see “Experiments In Autonomous Underground Guidance”, Scheding S., Nebot E., Stevens M.,Durrant-Whyte H., Roberts J., Corke P., Cunningham J., Cook B; in IEEE Conference on Robotics and Automation, Albuquerque 1997.
- In “An Experiment in Guidance and Navigation of an Autonomous Robot Vehicle”, Bianche IEEE Transactions on Robotics and Automation, Vol 7, No 2, April 1991, an experimental vehicle designed to operate autonomously within a structured office or factory environment is discussed. The disclosed device uses an odometry and steering angle based primary system, with a laser rangefinder used to correct this with respect to a predetermined 2-D map of the environment, and remotely generated path plans.
- Methods have been disclosed also, which enable a machine to avoid collision with features in its environment, obstacle avoidance, that is, to determine its position and control its position relative to those features in such a manner as to avoid contact with the features. For example, U.S. Pat. No. 5,758,298 to Guldner discloses an autonomous navigation system for a mobile robot or manipulator. In the description of this patent all operations are performed on the local navigation level in the robot coordinate system. U.S. Pat. No. 4,954,962 to Evans, Jr., et al discloses a navigation control system of a robot which inputs data from a vision system and infers therefrom data relating to the configuration of the environment which lies in front of the robot so that the robot may navigate to a desired point without collision with obstacles or features in its environment.
- Obstacle avoidance or collision avoidance systems are not required to determine and track the true position and orientation of the machine within the defined environment and therefore cannot be used for navigation and guidance except in the very local sense of avoiding collisions.
- A plurality of methods have been disclosed involving the use of methods such as predetermined or installed reference points, stored maps of the local environment, infrastructure such as the Global Positioning System (GPS) or local radio navigation systems and systems such as inertial navigation systems. All of these methods use infrastructure which may be integral with the immediate environment or external to the immediate environment and must exist or be installed.
- It is an object of the present invention to provide a location and navigation system which will enable a machine to operate over an extended area knowing its true location in that area which does not require the use of a predetermined reference frame or network of reference features, and is not reliant upon INS or GPS or similar sensing arrangements.
- According to a first aspect, the present invention provides a method for determining the position of a movable object, including the steps of:
- (a) initiating the process of determining the absolute or true position of said object in 3 dimensions when said object is at a known position in 3 dimensions;
- (b) obtaining data indicative of the 3 dimensional location of one or more fixed features which may then be used as reference locations relative to said object via a sensing means, that is determining from said data the position in three dimensions of said one or more fixed features with respect to said object;
- (c) moving said object;
- (d) at the new position, obtaining data indicative of the new location in 3 dimensions of said one or more fixed features relative to said object via said sensing means, and determining from said data the displacement of said object with respect to said one or more fixed features;
- (e) determining from said displacement of the object and said knowledge of the initial (or previous) position of the object the new position of the object in three dimensions;
- (f) obtaining additional data indicative of the 3 dimensional location relative to said object of said fixed features or obtaining data indicative of extensions of said fixed features not previously visible to the sensors and
- (g) when possible or necessary i.e. if the object is moving out of view of previously known fixed reference features or when new fixed references are in view, obtaining data indicative of the 3 dimensional location of one or more new fixed features which may be used as new reference locations (which are different to the aforementioned ones) relative to said object via said sensing means, that is determining from said data the position of said one or more new fixed reference locations with respect to said object; and
- (h) repeating steps (c) to (g) as required until predefined conditions regarding the location of the object are fulfilled.
- Conveniently, a 3-D imaging sensor, which provides measurements of the true relative position in 3-D space of objects relative to the sensor and may additionally provide measurements of the optical reflectance of objects in the field of view (such as is acquired in a camera image or seen with the eye) such optical reflectance being registered with the spatial information collected by the sensor, is mounted on the movable object with a predetermined (known) orientation and position thereon. The reference locations may form part of a natural feature such as a definite surface and/or define such feature, as well as artificial bodies with features defining a 3-D object.
- According to another aspect, the present invention provides an autonomous vehicle, said vehicle including:
- drive means for selectively moving said vehicle;
- sensor means mounted at a known orientation and position on said vehicle, said sensor means providing 3-D imaging data representative of at least a selected volume about said vehicle;
- processing means for receiving said sensor data, processing said sensor data in accordance with a pre-determined instruction set so as to locate one or more fixed points, determining the position of said vehicle with respect to said fixed points in the selected volume, and so determine the position and orientation of said vehicle and generate control signals for said drive means.
- The invention further includes apparatus enabled to implement the invention, and a system for controlling a set of autonomous vehicles using the inventive method.
- The invention relates to a method for using knowledge of the position of the sensor, in three dimensions, relative to a known reference or fixed features to track the position of the sensor in three dimensions over a period of time. The sensor produces data in three dimensions which are measurements of the distance and bearing to objects in the field of regard of the sensor; that is the sensor is a ‘three dimensional imaging system’. The data is used to determine the position of the sensor relative to fixed features in the surroundings of the sensor. Knowledge of the position of the sensor relative to a fixed object or objects in three dimensions completely determines the local position of the sensor. To measure movement, the position of the sensor relative to a fixed object or set of objects must be known in three dimensions at one time and must then be determined at a second time. The movement of the object is then determined directly from the difference between the two positions. Motion of the sensor may be tracked by successive determinations of the change in position of the sensor. The sensor may be mounted on equipment such as a vehicle or other machinery and used to track the movement of the equipment.
- The movement of the sensor can be determined from changes in position relative to natural features or characterising features intended to provide specific reference points for guidance. The three dimensional spatial relationship of the sensor and features in the sensor environment is the key data used to track the sensor—not a predetermined map or an external reference system. Changes in position may be determined relative to a fixed point or a set of fixed points. The total movement of the sensor over a period of time can be determined by determining the position of the sensor at a succession of times. When starting from a known or predetermined position, the true position of the sensor at a specific time can be determined from knowledge of the starting position and knowledge of the movement of the sensor from the starting position up to that time.
- A fixed object or a succession of fixed objects is used to determine the position of the moving sensor at successive times and the absolute position of the moving sensor relative to the known position from which it started may be determined at each of these times and the moving sensor thereby tracked. An object, for instance a vehicle, fitted with a three dimensional sensor system and a processing system to execute the algorithm can therefore track the position in three dimensions of the object carrying the sensor using knowledge of the starting position and knowledge of the movement in three dimensions. When fitted with a suitable three dimensional sensor and processing system the object can track its motion and determine its position relative to its starting point without requiring transmission of information to the object such as transmissions of radio waves as used in the Global Positioning System (GPS) or sensing elements of the motion of the object such as velocity or acceleration as used in inertial guidance systems. The three dimensional information acquired by the sensor consists of spatial measurements and embodies no scaling of the data. The representation of features therefore provides information as to the position and structure of objects in the field of view directly.
- The invention described is a means of using knowledge of the three dimensional position relative to the surroundings to track the motion and thus navigate from a known starting position or relative to sensed features known to be fixed. The knowledge of the relative three dimensional position is obtained using a three dimensional imaging system.
- The object may be, for example, an autonomous vehicle, wherein the location method described is used for navigation. The reference location may be predefined elements in whole or part where the environment is well defined. However, they may equally be determined by an instruction set (software) provided on the vehicle, according to some criteria to ensure the feature will be locatable after subsequent movement.
- The sensing arrangement may be any suitable sensor which provides a direct indication of the absolute position or displacement of points relative to the sensor. As the arrangement of the sensor on the object is known, the sensing arrangement can also provide data about the orientation or attitude of the object, as the orientation of the reference feature will change with changes in the object orientation.
- It will be appreciated that a key advantage of the inventive arrangement is that it does not require the environment to be fully defined or fitted with carefully plotted reference points. The inventive method simply selects suitable fixed features or parts of fixed features as reference points in transit. It does not rely on referencing to the predetermined location of the points, and so elaborate set up arrangements as are necessary in the prior art are not required.
- It will be appreciated that the present invention includes a method of navigation, wherein location is sensed as above, and appropriate direction, acceleration and velocity decisions are made in accordance with software instructions. Many such proposals are described in the prior art—it is the underlying location scheme which is of key significance and difference to the prior art. In a navigation system, the vehicle will be provided with an intended destination or waypoint defined in three dimensions, conveniently relative to the start position or some agreed reference point.
- The inventive arrangement may be used in conjunction with an INS or other positioning system to refine the position estimates and increase the accuracy or reliability of either means of estimating position. The inventive arrangement may be combined with or work with a collision avoidance or obstacle avoidance system to provide a plurality of functions.
- Considering an environment such as a mine, the advantages of the present invention will become apparent. In a mine, the floor over which a vehicle travels is not uniform in smoothness, grade or surface composition. Any techniques that rely on assumptions about the operating surface being a plane will not be operative. Sensing based upon steer angle or wheel rotations will be inaccurate, and pot holes and wheel spins will alter the apparent distance travelled. Also, in a mine environment, the location in depth may be as important as the two dimensional location, and hence techniques reliant on range estimation based upon height of a target over a plane will be ineffective.
- In an environment such as a mine, the shape of the environment alters on a regular basis, due to the nature of extraction of material from the environment. It is also an environment where extraneous features may be added, due to spillage, new working, etc. Hence, as the inventive arrangement does not require elaborate advance mapping, it is ideally suited to such an environment.
- Whilst the prior art teaches to use a sequence of monocular (camera) images for the determination of motion, it does not teach the use of matching of features (which may be natural or artificial) in multiple three dimensional images in all three dimensions to determine the position and orientation of an object in the three dimensional space of the field of view of the sensor, which thus allows determining changes in the position of the sensor in three dimensions and tracking the actual position of the sensor.
- Known means of determining position include devices such as ultrasound sensors or other range measurement devices or two dimensional imaging systems such as video cameras. These devices provide information in one or two dimensions directly. The acquisition of information in three dimensions requires data from more than one sensor and, in some cases, extensive computation of the data from a number of sensors. A three dimensional imaging system may be comprised of a combination of such sensors and processors or may be a special purpose three dimensional sensor such as a three dimensional laser range measurement scanning system. For example, two dimensional imaging systems only provide information on the angular relationships between features directly and provide no scale but may provide three dimensional information indirectly. To obtain three dimensional information using a two dimensional imaging system generally requires a great deal of computation. Position determination is based on the measurement of position relative to a known reference such as terrestrial landmarks or stars or on the determination of movement from a known position as in an inertial navigation system. Position consists of three components. These may be x,y,z coordinates in a Cartesian reference frame or on the surface of the earth these may be latitude, longitude and elevation relative to the geoid. In many applications only one component of the position relative to the known reference can be determined. This component may be the bearing to the reference position as used in navigation from maps using triangulation or the distance to a reference as used in the Global Positioning System where the reference is a satellite in a known orbit. When only one component of relative position to a specified reference is known, complete determination of the position of an object requires the knowledge of this component for a number of reference positions. For example, when navigating by map and compass, two bearings are used to determine the position of the object. Three bearings are used to improve the accuracy of determination of the position of the object. When navigating by map and compass the combination of compass bearing and map provide the estimate of position in three dimensions. When all three components of position relative to a reference position are known, the position of an object is fully determined within some limits imposed by measurement error. A three dimensional imaging system provides knowledge of all three position components of objects in the field of view of the sensor and therefore fully determines the position relative to the sensor of an object in the field of view of the sensor.
- One embodiment of the present invention will now be described with reference to the accompanying drawings, in which:
- FIG. 1 is a representation of a vehicle and sensor in accordance with one aspect of the present invention.
- FIG. 2A is a representation of the sensor as it may be installed on a vehicle or other suitable object;
- FIG. 2B describes the field of view of typical sensors in three dimensions;
- FIG. 3 illustrates how a suitable sensor system may determine its position at some time relative to a fixed object.
- FIG. 4 illustrates how the sensor may determine its position relative to the fixed object at a later time and how the movement of the sensor and thus the object carrying the sensor is determined from the measurement of position at the two separate times.
- FIG. 5 illustrates operation of the sensor in two dimensions to determine 2-dimensional position in a plane.
- FIGS. 5A,5B illustrate a flow chart of the steps involved in the method of the present invention.
- Whilst the operation of the invention is described with reference to a particular implementation, it will be appreciated that many alternative implementations are possible.
- The operation of an illustrative tracking system is as follows. Typically, the sensor system includes a motorised vehicle (object)20 as shown in FIG. 1, and a
sensor 10 mounted atop the vehicle. In one embodiment,vehicle 20 has amain body 22 and tracks 23. In practice however,vehicle 20 may have any other configuration and means of locomotion. Thesensor 10 will provide an image in three dimensions of anyfeatures 30 in the proximity of the vehicle. Determination of the position of theobject 20 carrying thesensor 10 relative to any point on a fixedobject 20 in the image is then readily performed. To determine motion of the object carrying the sensor it is not necessary to know the true position of anyfeature 30 in proximity to the object. It suffices that thefeatures 30 recognised are fixed or do not move during the time theobject 20 is moving (see FIGS. 3 and 4). In a sequence of two or more images, the positions in three dimensions of theobject 20 carrying thesensor 10 relative to features 30 in the proximity of the object are determined for each image in the sequence. These positions thus provide measurement of the motion of the object carrying the sensor relative to the fixed objects in the proximity. As theobject 20 carrying thesensor 10 moves, new fixed objects will enter the proximity of the sensor and can be used to provide an ongoing measurement of the motion of the object carrying the sensor. FIG. 2B provides a representation ofobject 20 andsensor 10, with the “field of view” ofsensor 10 defined by volume 56. Adata processing system 21 such as a computer is used to match like features in the three dimensional images. The identification of the position of a like feature relative to thesensor 10 is used to measure the displacement of the feature relative to the sensor. In use, three dimensional ‘images’ of avolume 40 containing thefeature 30 are obtained at two separate times producingfeature images - To determine the position relative to a feature in the three dimensional image, the
feature 30 must be identified in the image. If the feature has an axis of symmetry, the determination of the change of position and orientation of the sensor relative to the feature will not be complete. To determine fully the orientation and position of the sensor relative to features which have symmetry, a number of features are required, for example, the orientation and position of the sensor relative to cylindrical poles requires that thesensor 10 see two poles to fully determine its position and orientation. In a sequence of two or more images the same feature or features must be recognised, (i.e. detected and identified) in each image and their positions and orientations relative to the sensor must be determined. A computer ordigital signal processor 21 is used to process the data obtained by thesensor 10 and identify the features used to determine the positions of theobject 20 in a sequence of images. A number of methods can be used to identify the features in images and match the features in different images. These methods include area based, edge based, feature based, model based and multilevel or hierarchical approaches and may be based on matching methods such as minimisation of least squares measures of disparity or determination of the degree of correlation between two features using devices intended to determine the degree of correlation (correlators). These methods may operate on spatial data alone or may operate on a combination of spatial and optical data as acquired by some types of 3-D imaging sensor. In the case of artificial features whose position is known, the true position of thevehicle 20 carrying thesensor 10 is fully determined from the three dimensional image data at any time that thesensor 10 can “see” the artificial feature. In the preferred embodiment, the process of tracking the moving object is shown in FIGS. 6A and 6B. Atstage 400, the system is initiated by determining the position ofobject 20 in three dimensions, when the object is at a known position. This may be done for example by simply manually loading the known coordinates of the object's location into the processor. Instep 410, the system obtains data, viasensor 10, indicative of the three-dimensional location of one or more fixed features 30. Theprocessor 21 ofobject 20 then processes the obtained data to determine the three-dimensional position ofobject 20 relative to the fixed feature or features 30. Instep 420, object 20 moves to a new location. Step 430 involves obtaining new data indicative of the new three-dimensional location(s) of the known fixed feature(s) 30 relative to object 20. Using this data instep 440, theprocessor 21 then determines the displacement ofobject 20 in three-dimensions, from the previously known location. The actual three-dimensional coordinates for the new location of the object can then be determined instep 450 from the knowledge of the coordinates of the previous location and the displacement calculated above. - In
step 460,processor 21 checks to see if certain predetermined conditions have been satisfied. For example, a predetermined condition may be a destination location. If the conditions are satisfied (e.g. object 20 has reached its destination),processor 21 generates controlsignals causing object 20 to stop. If the conditions are not satisfied, the process continues toelement 402 which proceeds to step 470 in FIG. 6B. - At
step 470,sensor 10 obtains additional data indicative of the new three-dimensional locations of the known fixed reference features. Note that this step need not be undertaken if the data obtained instep 430 is still suitable for use. For example, if the feature or features used instep 430 may not be visible from the new location ofobject 20 once it has moved again, then step 470 is undertaken to select new and more appropriate reference points. The reference point chosen need not be a new structure. It may be a more visible feature of the existing structure, or an extension of the existing structure. - In
step 480,processor 21 may also elect to obtain data of new features or structures which have come into view sinceobject 20 moved. If this step is selected, then appropriate data indicative of the three-dimensional location of the new feature relative to object 20 is obtained viasensor 10, atstep 490. - If
step 480 results in a negative, i.e. there are no new features visible, thenprocessor 21 skips ahead tojunction element 403, omittingstep 490. - From
element 403,processor 21 proceeds toelement 401 to loop back to step 420 in FIG. 6A to moveobject 20 and repeat the sequence. This loop is repeated until the predetermined conditions are satisfied instep 460, and object 20 stops. -
Sensor 10 andprocessor 21 may be used to determine the relationship between objects and estimate the position of the object carrying the sensor in a number of ways based on this simple process. For example multiple objects may be used. Objects in the sensor field of view may be compared to determine the relationship of these objects relative to each other and thus determine whether they are moving relative to each other and eliminate moving objects from the estimation of position. - A simpler implementation may be realised by the use of a spatial position and
orientation sensor 60 which acquires information describing the actual spatial position relative to the sensor ofobjects sensor 60 acquires spatial data in aplane 80 and the position of the sensor relative to features 70, 71, 72 in the environment is determined within the plane of measurement. Movement relative to features in the environment is then characterised by changes in position within the plane of measurement, for example the surface of the sea or ocean in the case of a surface vessel. The method for estimating motion in two dimensions is analogous to the method used to estimate motion in three dimensions described previously but eliminates the use of the spatial position component which is not contained by the plane of measurement. Thesensor 60 may be a laser range measurement system such as a laser rangefinder or a radar system which is rotated (61) and used repetitively so as to measure the range(s) to features in the plane of rotation. Knowledge of the direction in which the rangefinder is oriented at the time at which a range is measured then completely determines the position of a feature in the plane of measurement. FIG. 4 illustrates the operation of the invention in two dimensions. - A key aspect of the present invention is the use of the characteristics of a true 3-D image to navigate. Two dimensional data such as position in a plane determined by a laser scanner, angular position such as determined by an imaging system, one dimensional data such as range or bearing and single point three dimensional data such as range combined with azimuth and elevation and bearing to a single point can not be used to navigate in three dimensions.
- When three dimensional data is acquired from a sensor the position of the sensor in the object space is completely determined and this thus differentiates a three dimensional sensor system from one and two dimensional sensors which must be used in conjunction with additional knowledge such as knowledge of a map or other sensors to determine the position of the sensor. With a three dimensional system, changes in the position of the sensor can be readily tracked in three dimensions and knowledge of the true position of the sensor maintained. If the sensor is mounted on an object such as a vehicle and the position of the sensor on the vehicle known and the orientation of the sensor relative to the vehicle known then the position of the vehicle is known and can be tracked. The tracking can be performed in three dimensions without the use of artificial features or the requirement to know the position of selected artificial or natural features.
- The present implementation is discussed primarily with reference to the use of laser based range measurement implementations. However, numerous alternative 3-D imaging systems may be used to implement the inventive concept, some of which are discussed briefly below.
- Alternative Methods of Producing 3-D Images
- Two primary methods are employed for 3-D imaging:
- measurement of range and orientation to a plurality of points including scanning range measurement devices, and
- triangulation to a plurality of points.
- In addition 3-D images may be produced by:
- Range gated imaging
- Moire techniques
- Holographic interferometry
- Adaptive focussing systems
- Estimation of range from image defocus
- Each of these will be discussed below.
- Scanning Range Measurement Devices
- Three dimensional images are acquired using scanning range measurement devices by recording the range to points in the object space at which the range measurement device is directed. When the range measurement device is scanned over the object space and the range recorded over a grid of points for which the position and orientation of the sensor is known, a range map is produced which is then readily converted to a three dimensional image. The use of a laser range finder scanned over an object space to produce a three dimensional image has been demonstrated many times. Ultrasonic or radar range finders can be used to generate similar images.
- Triangulation Systems
- Triangulation systems require that we have two components of the sensor which each allow us to determine the direction in three dimensions to a point in the object space. The position and orientation of each component of the sensor is known and, since for each component of the sensor the angular direction to the point is known, the position in space of the point is readily determined thus providing a three dimensional image. Triangulation may be subdivided into techniques: passive triangulation and active triangulation.
- Passive triangulation encompasses such techniques as aerial or terrestrial photogrammetry where the components of the measurement system are two or more cameras, or one camera taking two or more images. Points in each image are matched and from the position in each image of the matched points the spatial position is determined. Fast systems using two television cameras and image processing systems are sometimes classified as stereo vision.
- Active triangulation encompassed such techniques as structured light imaging where a light stripe is projected into an object space and viewed by a camera or similar sensor from another position. In some instances two cameras are used. Knowledge of the direction of projection of the light stripe and the position and orientation of the camera or cameras enables calculation of the position in space of any point reflecting the light. Another form of active triangulation involves the use of a spot of light scanned over the object space.
- Range Gated Imaging
- Range gated imaging is achieved by obtaining a series of images of a scene which is illuminated with a controlled light source. The light source has an extremely short duration and is turned on and off. Each time that the light source is turned on an image of the scene is obtained for an extremely short time after a variable delay. Those features in the scene which reflect light during this period and are therefore at a known range from the camera thus produce an image. By acquiring a series of images of this form a range map of the scene is obtained. The position and orientation of the sensor is known and, since for each image the angular direction of the features is known, the range map is then converted to a three dimensional image.
- Moire Techniques
- A Moire pattern is an interference pattern of low spatial frequency. The interference pattern is projected into the object space and surface depth information is encoded in and recovered from the phase information embodied in the observed interference pattern in the object space.
- Holography
- Holographic interferometers use coherent radiation to produce interference patterns. When optical radiation is used, a photodetector is used to detect the reflected radiation and the three dimensional image is constructed from the structure of the interference pattern. Interferometry may be performed with radiation of wavelengths typically used for radar systems.
- Adaptive Focussing
- The optical configuration required to achieve focus of an imaging system can be used to infer the range to a feature in the object space. By varying the focus and recording the focus conditions, e.g. the optical configuration required to achieve focus, when a feature is in focus the range to features in the object space is mapped. This data is treated similarly to the range and image data in a range gated imaging system to produce a three dimensional image.
- Estimation of Range from Image Defocus
- The degree of defocus of an imaging system can be used to infer the range to a feature in the object space. The estimation of the range to an object is achieved by modelling the effect that the optical configuration of a camera, namely the range at which best focus is achieved, has on images acquired with a small depth of field. Range information is recovered from defocused images by calculating the range of various points in an image by estimating the degree of defocus at the said points. These methods are discussed, for example in, Rajagopalan A. N., Chaudhuri Space Variant Approaches To Recovery of Depth From Defocused Images; Computer Vision and Image Understanding Vol 68, No 2, December 1997.
- Obviously other alternative 3-D imaging techniques can be employed to implement the present invention. For example, as discussed in Besl, P. J., Active Optical Range Imaging Sensors; Machine Vision and Applications Vol 1 1988.
- It will be appreciated that the invention has been described in terms of a preferred embodiment. Many variations and modifications are possible within the scope of the present invention as defined by the following claims.
Claims (12)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AUPP2994 | 1998-04-15 | ||
AUPP2994A AUPP299498A0 (en) | 1998-04-15 | 1998-04-15 | Method of tracking and sensing position of objects |
PCT/AU1999/000274 WO1999053335A1 (en) | 1998-04-15 | 1999-04-15 | Method of tracking and sensing position of objects |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/AU1999/000274 Continuation WO1999053335A1 (en) | 1998-04-15 | 1999-04-15 | Method of tracking and sensing position of objects |
Publications (2)
Publication Number | Publication Date |
---|---|
US20020049530A1 true US20020049530A1 (en) | 2002-04-25 |
US6442476B1 US6442476B1 (en) | 2002-08-27 |
Family
ID=3807253
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/689,741 Expired - Fee Related US6442476B1 (en) | 1998-04-15 | 2000-10-13 | Method of tracking and sensing position of objects |
Country Status (7)
Country | Link |
---|---|
US (1) | US6442476B1 (en) |
EP (1) | EP1086383A4 (en) |
JP (1) | JP3561473B2 (en) |
AU (1) | AUPP299498A0 (en) |
CA (1) | CA2328227C (en) |
WO (1) | WO1999053335A1 (en) |
ZA (1) | ZA200005640B (en) |
Cited By (55)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030176965A1 (en) * | 2002-03-14 | 2003-09-18 | Microsoft Corporation | Landmark-based location of users |
WO2004025947A3 (en) * | 2002-09-13 | 2004-05-21 | Irobot Corp | A navigational control system for a robotic device |
US20040207355A1 (en) * | 2001-06-12 | 2004-10-21 | Jones Joseph L. | Method and system for multi-mode coverage for an autonomous robot |
US20040224229A1 (en) * | 2003-05-09 | 2004-11-11 | Mansuetto Michael F. | Alkaline cell with copper oxide cathode |
EP1517117A1 (en) * | 2003-09-22 | 2005-03-23 | Leica Geosystems AG | Method and system for the determination of the actual position of a positioning apparatus |
US20050137750A1 (en) * | 2003-12-23 | 2005-06-23 | Samsung Electronics Co., Ltd. | Method and apparatus for using rotational movement amount of mobile device and computer-readable recording medium for storing computer program |
US20060058954A1 (en) * | 2003-10-08 | 2006-03-16 | Haney Philip J | Constrained tracking of ground objects using regional measurements |
US20060082590A1 (en) * | 2004-10-14 | 2006-04-20 | Stevick Glen R | Method and apparatus for dynamic space-time imaging system |
US20060145703A1 (en) * | 2004-12-20 | 2006-07-06 | Marcus Steinbichler | Automatic component testing |
WO2006079439A2 (en) * | 2005-01-28 | 2006-08-03 | Siemens Aktiengesellschaft | Position determination by means of a radio locating system, in particular by means of lpr, despite time limiting failure of the radio locating components |
EP1759173A1 (en) * | 2004-06-02 | 2007-03-07 | Athena Technologies, Inc. | Image-augmented inertial navigation system (iains) and method |
US20070081695A1 (en) * | 2005-10-04 | 2007-04-12 | Eric Foxlin | Tracking objects with markers |
EP1777498A1 (en) * | 2005-10-19 | 2007-04-25 | Aisin Aw Co., Ltd. | Vehicle moving distance detecting method, vehicle moving distance detecting device, current vehicle position detecting method, and current vehicle position detecting device |
US20070103461A1 (en) * | 2005-11-08 | 2007-05-10 | Sony Corporation | Virtual space image display method, apparatus, virtual space image display program, and recording medium |
US20070185681A1 (en) * | 2006-02-08 | 2007-08-09 | Honeywell International Inc. | Mapping systems and methods |
US20070219720A1 (en) * | 2006-03-16 | 2007-09-20 | The Gray Insurance Company | Navigation and control system for autonomous vehicles |
US20070271003A1 (en) * | 2006-05-16 | 2007-11-22 | Samsung Electronics Co., Ltd. | Robot using absolute azimuth and mapping method thereof |
EP1972893A1 (en) * | 2007-03-21 | 2008-09-24 | Universiteit Gent | System and method for position determination |
US20090033548A1 (en) * | 2007-08-01 | 2009-02-05 | Camero-Tech Ltd. | System and method for volume visualization in through-the-obstacle imaging system |
US20090196491A1 (en) * | 2004-08-30 | 2009-08-06 | Maxwell Leslie Stainlay | Method for automated 3d imaging |
US20090209343A1 (en) * | 2008-02-15 | 2009-08-20 | Eric Foxlin | Motion-tracking game controller |
US7594556B1 (en) * | 2004-08-27 | 2009-09-29 | Cook Technologies, Inc. | System for storing and retrieving a personal-transportation vehicle |
US20100048140A1 (en) * | 2006-11-20 | 2010-02-25 | Toyota Jidosha Kabushiki Kaisha | Device for measuring a position of a mobile station |
CN101029831B (en) * | 2005-11-24 | 2010-05-12 | 株式会社拓普康 | Method and apparatus for creating three-dimensional data |
US20110050903A1 (en) * | 2009-04-08 | 2011-03-03 | Topcon Positioning Systems, Inc. | Method for determining position and orientation of vehicle trailers |
US20110144805A1 (en) * | 2002-09-13 | 2011-06-16 | Chiappetta Mark J | Navigational control system for a robotic device |
US20110227915A1 (en) * | 2006-03-08 | 2011-09-22 | Mandella Michael J | Computer interface employing a manipulated object with absolute pose detection component and a display |
US8049658B1 (en) * | 2007-05-25 | 2011-11-01 | Lockheed Martin Corporation | Determination of the three-dimensional location of a target viewed by a camera |
US8078349B1 (en) | 2011-05-11 | 2011-12-13 | Google Inc. | Transitioning a mixed-mode vehicle to autonomous mode |
WO2013112842A1 (en) * | 2012-01-25 | 2013-08-01 | Adept Technology, Inc. | Positive and negative obstacle avoidance system for a mobile robot |
US8548671B2 (en) | 2011-06-06 | 2013-10-01 | Crown Equipment Limited | Method and apparatus for automatically calibrating vehicle parameters |
US8655588B2 (en) | 2011-05-26 | 2014-02-18 | Crown Equipment Limited | Method and apparatus for providing accurate localization for an industrial vehicle |
US20140078312A1 (en) * | 2002-07-27 | 2014-03-20 | Sony Computer Entertainment Inc. | Method and apparatus for tracking three-dimensional movements of an object using a depth sensing camera |
US8825391B1 (en) * | 2011-08-04 | 2014-09-02 | Google Inc. | Building elevation maps from laser data |
US8838274B2 (en) | 2001-06-12 | 2014-09-16 | Irobot Corporation | Method and system for multi-mode coverage for an autonomous robot |
WO2014200979A1 (en) * | 2013-06-12 | 2014-12-18 | Caterpillar Inc. | System and method for mapping a raised contour |
US20150161795A1 (en) * | 2013-12-10 | 2015-06-11 | GM Global Technology Operations LLC | Distance determination using a monoscopic imager in a vehicle |
US20150160003A1 (en) * | 2013-12-10 | 2015-06-11 | GM Global Technology Operations LLC | Distance determination system for a vehicle using holographic techniques |
US9056754B2 (en) | 2011-09-07 | 2015-06-16 | Crown Equipment Limited | Method and apparatus for using pre-positioned objects to localize an industrial vehicle |
US9188982B2 (en) | 2011-04-11 | 2015-11-17 | Crown Equipment Limited | Method and apparatus for efficient scheduling for multiple automated non-holonomic vehicles using a coordinated path planner |
US9206023B2 (en) | 2011-08-26 | 2015-12-08 | Crown Equipment Limited | Method and apparatus for using unique landmarks to locate industrial vehicles at start-up |
US9229540B2 (en) | 2004-01-30 | 2016-01-05 | Electronic Scripting Products, Inc. | Deriving input from six degrees of freedom interfaces |
US9381424B2 (en) | 2002-07-27 | 2016-07-05 | Sony Interactive Entertainment America Llc | Scheme for translating movements of a hand-held controller into inputs for a system |
US9393487B2 (en) | 2002-07-27 | 2016-07-19 | Sony Interactive Entertainment Inc. | Method for mapping movements of a hand-held controller to game commands |
US20170123425A1 (en) * | 2015-10-09 | 2017-05-04 | SZ DJI Technology Co., Ltd | Salient feature based vehicle positioning |
US20170341235A1 (en) * | 2016-05-27 | 2017-11-30 | General Electric Company | Control System And Method For Robotic Motion Planning And Control |
CN107608342A (en) * | 2017-07-25 | 2018-01-19 | 昆明理工大学 | A kind of robotic vision system and its control method for mine rescue |
US10089586B2 (en) | 2012-02-08 | 2018-10-02 | Omron Adept Technologies, Inc. | Job management system for a fleet of autonomous mobile robots |
US10310054B2 (en) * | 2014-03-21 | 2019-06-04 | The Boeing Company | Relative object localization process for local positioning system |
CN111094895A (en) * | 2018-06-29 | 2020-05-01 | 百度时代网络技术(北京)有限公司 | System and method for robust self-repositioning in pre-constructed visual maps |
CN112557390A (en) * | 2019-09-10 | 2021-03-26 | 惠州旭鑫智能技术有限公司 | Monocular visual inspection method for dislocation defect of bare cell tab of power battery |
CN112580582A (en) * | 2020-12-28 | 2021-03-30 | 达闼机器人有限公司 | Action learning method, action learning device, action learning medium and electronic equipment |
US11138753B2 (en) * | 2019-04-04 | 2021-10-05 | Aptiv Technologies Limited | Method and device for localizing a sensor in a vehicle |
WO2022093860A1 (en) * | 2020-10-26 | 2022-05-05 | Mohammad Amin Arbabian | Centralized tracking system with distributed fixed sensors |
US11577159B2 (en) | 2016-05-26 | 2023-02-14 | Electronic Scripting Products Inc. | Realistic virtual/augmented/mixed reality viewing and interactions |
Families Citing this family (140)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6535210B1 (en) * | 1995-06-07 | 2003-03-18 | Geovector Corp. | Vision system computer modeling apparatus including interaction with real scenes with respect to perspective and spatial relationship as measured in real-time |
DE19916999A1 (en) * | 1999-04-15 | 2000-10-19 | Noell Stahl Und Maschinenbau G | Positioning system for container stacking trucks uses laser scanner to avoid adjusting crane |
US8788092B2 (en) | 2000-01-24 | 2014-07-22 | Irobot Corporation | Obstacle following sensor scheme for a mobile robot |
US8412377B2 (en) | 2000-01-24 | 2013-04-02 | Irobot Corporation | Obstacle following sensor scheme for a mobile robot |
US6956348B2 (en) | 2004-01-28 | 2005-10-18 | Irobot Corporation | Debris sensor for cleaning apparatus |
JP4672175B2 (en) | 2000-05-26 | 2011-04-20 | 本田技研工業株式会社 | Position detection apparatus, position detection method, and position detection program |
US6608913B1 (en) | 2000-07-17 | 2003-08-19 | Inco Limited | Self-contained mapping and positioning system utilizing point cloud data |
US7571511B2 (en) | 2002-01-03 | 2009-08-11 | Irobot Corporation | Autonomous floor-cleaning robot |
US6690134B1 (en) | 2001-01-24 | 2004-02-10 | Irobot Corporation | Method and system for robot localization and confinement |
US8396592B2 (en) | 2001-06-12 | 2013-03-12 | Irobot Corporation | Method and system for multi-mode coverage for an autonomous robot |
DE10138719A1 (en) * | 2001-08-07 | 2003-03-06 | Siemens Ag | Method and device for displaying driving instructions, especially in car navigation systems |
AU2003229008A1 (en) * | 2002-05-10 | 2003-11-11 | Honda Giken Kogyo Kabushiki Kaisha | Real-time target tracking of an unpredictable target amid unknown obstacles |
WO2004020267A2 (en) * | 2002-08-30 | 2004-03-11 | Aethon, Inc. | Robotic cart pulling vehicle |
CN101075461A (en) * | 2002-09-02 | 2007-11-21 | 三星电子株式会社 | Optical information storage medium and apparatus of recording and/or reproducing the same |
US8428778B2 (en) | 2002-09-13 | 2013-04-23 | Irobot Corporation | Navigational control system for a robotic device |
US8386081B2 (en) | 2002-09-13 | 2013-02-26 | Irobot Corporation | Navigational control system for a robotic device |
US7069124B1 (en) * | 2002-10-28 | 2006-06-27 | Workhorse Technologies, Llc | Robotic modeling of voids |
WO2004045215A1 (en) * | 2002-11-12 | 2004-05-27 | Intellivid Corporation | Method and system for tracking and behavioral monitoring of multiple objects moving throuch multiple fields-of-view |
US7221775B2 (en) * | 2002-11-12 | 2007-05-22 | Intellivid Corporation | Method and apparatus for computerized image background analysis |
US6975959B2 (en) * | 2002-12-03 | 2005-12-13 | Robert Bosch Gmbh | Orientation and navigation for a mobile device using inertial sensors |
FI115414B (en) * | 2003-07-03 | 2005-04-29 | Sandvik Tamrock Oy | Arrangement for monitoring the location of a mine vehicle in a mine |
US7170252B2 (en) * | 2003-07-23 | 2007-01-30 | Renesas Technology Corporation | Location aware automata |
US7286157B2 (en) * | 2003-09-11 | 2007-10-23 | Intellivid Corporation | Computerized method and apparatus for determining field-of-view relationships among multiple image sensors |
DE10343331A1 (en) * | 2003-09-12 | 2005-04-07 | Valeo Schalter Und Sensoren Gmbh | Method and computer program for detecting the contour of an obstacle in the surroundings of a vehicle |
US7346187B2 (en) * | 2003-10-10 | 2008-03-18 | Intellivid Corporation | Method of counting objects in a monitored environment and apparatus for the same |
US7280673B2 (en) * | 2003-10-10 | 2007-10-09 | Intellivid Corporation | System and method for searching for changes in surveillance video |
WO2005043081A1 (en) * | 2003-10-31 | 2005-05-12 | Fujitsu Limited | Distance calculation device and calculation program |
US7332890B2 (en) | 2004-01-21 | 2008-02-19 | Irobot Corporation | Autonomous robot auto-docking and energy management systems and methods |
JP2007530978A (en) | 2004-03-29 | 2007-11-01 | エヴォリューション ロボティクス インコーポレイテッド | Position estimation method and apparatus using reflected light source |
US9008835B2 (en) | 2004-06-24 | 2015-04-14 | Irobot Corporation | Remote control scheduler and method for autonomous robotic device |
US8972052B2 (en) | 2004-07-07 | 2015-03-03 | Irobot Corporation | Celestial navigation system for an autonomous vehicle |
US7706917B1 (en) | 2004-07-07 | 2010-04-27 | Irobot Corporation | Celestial navigation system for an autonomous robot |
US7499774B2 (en) * | 2004-10-22 | 2009-03-03 | Irobot Corporation | System and method for processing safety signals in an autonomous vehicle |
US7499804B2 (en) * | 2004-10-22 | 2009-03-03 | Irobot Corporation | System and method for multi-modal control of an autonomous vehicle |
US7499775B2 (en) * | 2004-10-22 | 2009-03-03 | Irobot Corporation | System and method for terrain feature tracking |
US7499776B2 (en) * | 2004-10-22 | 2009-03-03 | Irobot Corporation | Systems and methods for control of an unmanned ground vehicle |
US8078338B2 (en) | 2004-10-22 | 2011-12-13 | Irobot Corporation | System and method for behavior based control of an autonomous vehicle |
US7191056B2 (en) * | 2005-01-04 | 2007-03-13 | The Boeing Company | Precision landmark-aided navigation |
US7620476B2 (en) | 2005-02-18 | 2009-11-17 | Irobot Corporation | Autonomous surface cleaning robot for dry cleaning |
US8392021B2 (en) | 2005-02-18 | 2013-03-05 | Irobot Corporation | Autonomous surface cleaning robot for wet cleaning |
EP2145573B1 (en) | 2005-02-18 | 2011-09-07 | iRobot Corporation | Autonomous surface cleaning robot for wet and dry cleaning |
DE602006020422D1 (en) * | 2005-03-25 | 2011-04-14 | Sensormatic Electronics Llc | INTELLIGENT CAMERA SELECTION AND OBJECT PURSUIT |
US8930023B2 (en) | 2009-11-06 | 2015-01-06 | Irobot Corporation | Localization by learning of wave-signal distributions |
US20060276958A1 (en) * | 2005-06-02 | 2006-12-07 | Jervis B. Webb Company | Inertial navigational guidance system for a driverless vehicle utilizing laser obstacle sensors |
US7728869B2 (en) * | 2005-06-14 | 2010-06-01 | Lg Electronics Inc. | Matching camera-photographed image with map data in portable terminal and travel route guidance method |
EP1904914B1 (en) * | 2005-06-30 | 2014-09-03 | Philips Intellectual Property & Standards GmbH | Method of controlling a system |
US9036028B2 (en) * | 2005-09-02 | 2015-05-19 | Sensormatic Electronics, LLC | Object tracking and alerts |
WO2007047510A2 (en) | 2005-10-14 | 2007-04-26 | Aethon, Inc. | Robotic inventory management |
DE102005051155A1 (en) * | 2005-10-24 | 2007-04-26 | Alsa Gmbh | Decorated plastic shoe, process for its manufacture and mold |
US8228382B2 (en) * | 2005-11-05 | 2012-07-24 | Ram Pattikonda | System and method for counting people |
KR101099808B1 (en) | 2005-12-02 | 2011-12-27 | 아이로보트 코퍼레이션 | Robot system |
EP2816434A3 (en) | 2005-12-02 | 2015-01-28 | iRobot Corporation | Autonomous coverage robot |
ES2623920T3 (en) | 2005-12-02 | 2017-07-12 | Irobot Corporation | Robot system |
EP2270619B1 (en) | 2005-12-02 | 2013-05-08 | iRobot Corporation | Modular robot |
KR101300492B1 (en) | 2005-12-02 | 2013-09-02 | 아이로보트 코퍼레이션 | Coverage robot mobility |
WO2007109624A2 (en) | 2006-03-17 | 2007-09-27 | Irobot Corporation | Robot confinement |
US8666661B2 (en) * | 2006-03-31 | 2014-03-04 | The Boeing Company | Video navigation |
EP2548489B1 (en) | 2006-05-19 | 2016-03-09 | iRobot Corporation | Removing debris from cleaning robots |
TWI293555B (en) * | 2006-05-23 | 2008-02-21 | Ind Tech Res Inst | Omni-directional robot cleaner |
US8417383B2 (en) | 2006-05-31 | 2013-04-09 | Irobot Corporation | Detecting robot stasis |
US7825792B2 (en) * | 2006-06-02 | 2010-11-02 | Sensormatic Electronics Llc | Systems and methods for distributed monitoring of remote sites |
US7671728B2 (en) | 2006-06-02 | 2010-03-02 | Sensormatic Electronics, LLC | Systems and methods for distributed monitoring of remote sites |
WO2008008970A2 (en) * | 2006-07-13 | 2008-01-17 | Velodyne Acoustics, Inc | High definition lidar system |
USRE46672E1 (en) | 2006-07-13 | 2018-01-16 | Velodyne Lidar, Inc. | High definition LiDAR system |
JP5112666B2 (en) * | 2006-09-11 | 2013-01-09 | 株式会社日立製作所 | Mobile device |
US20080162046A1 (en) * | 2006-10-24 | 2008-07-03 | General Electric Company | Method and system for tracking an arrangement of medical apparatuses |
JP5121258B2 (en) * | 2007-03-06 | 2013-01-16 | 株式会社東芝 | Suspicious behavior detection system and method |
KR101339513B1 (en) | 2007-05-09 | 2013-12-10 | 아이로보트 코퍼레이션 | Autonomous coverage robot |
EP2163095A4 (en) * | 2007-06-09 | 2011-05-18 | Sensormatic Electronics Llc | System and method for integrating video analytics and data analytics/mining |
US7538724B1 (en) | 2007-06-15 | 2009-05-26 | Itt Manufacturing Enterprises, Inc. | Method and system for relative tracking |
US20090062958A1 (en) * | 2007-08-31 | 2009-03-05 | Morris Aaron C | Autonomous mobile robot |
EP2107504A1 (en) * | 2008-03-31 | 2009-10-07 | Harman Becker Automotive Systems GmbH | Method and device for generating a real time environment model for vehicles |
US8060280B2 (en) * | 2008-04-15 | 2011-11-15 | Autoliv Asp, Inc. | Vision system for deploying safety systems |
US20100076599A1 (en) * | 2008-09-20 | 2010-03-25 | Steven Jacobs | Manually driven determination of a region of interest (roi) or a path of interest (poi) for a robotic device |
US8103056B2 (en) * | 2008-10-15 | 2012-01-24 | Honeywell International Inc. | Method for target geo-referencing using video analytics |
US8237389B2 (en) * | 2008-11-12 | 2012-08-07 | Irobot Corporation | Multi mode safety control module |
US8730130B1 (en) * | 2008-12-04 | 2014-05-20 | RPA Electronic Solutions, Inc. | System and method for automatically aligning immersive displays |
JP5559997B2 (en) | 2009-07-17 | 2014-07-23 | 株式会社トプコン | Position measuring method and position measuring apparatus |
US8400511B2 (en) * | 2009-12-04 | 2013-03-19 | Lockheed Martin Corporation | Optical detection and ranging sensor system for sense and avoid, and related methods |
CN105147193B (en) | 2010-02-16 | 2018-06-12 | 艾罗伯特公司 | Vacuum brush |
US8225895B1 (en) * | 2010-04-22 | 2012-07-24 | Sandia Corporation | Robotic vehicle with multiple tracked mobility platforms |
US11480965B2 (en) | 2010-11-19 | 2022-10-25 | Maid Ip Holdings Pty/Ltd | Automatic location placement system |
US9778657B2 (en) | 2010-11-19 | 2017-10-03 | Bradley Tyers | Automatic location placement system |
US9148650B2 (en) * | 2012-09-17 | 2015-09-29 | Nec Laboratories America, Inc. | Real-time monocular visual odometry |
KR20140137893A (en) * | 2013-05-24 | 2014-12-03 | 한국전자통신연구원 | Method and appratus for tracking object |
JP5405687B1 (en) * | 2013-05-30 | 2014-02-05 | 株式会社日立パワーソリューションズ | Autonomous mobile device, autonomous mobile system, and autonomous mobile method |
US9719801B1 (en) | 2013-07-23 | 2017-08-01 | Waymo Llc | Methods and systems for calibrating sensors using road map data |
CN106462161B (en) | 2014-03-31 | 2020-03-06 | 美国iRobot公司 | Autonomous mobile robot |
US9746323B2 (en) | 2014-07-25 | 2017-08-29 | Lockheed Martin Corporation | Enhanced optical detection and ranging |
KR101610502B1 (en) * | 2014-09-02 | 2016-04-07 | 현대자동차주식회사 | Apparatus and method for recognizing driving enviroment for autonomous vehicle |
US9510505B2 (en) | 2014-10-10 | 2016-12-06 | Irobot Corporation | Autonomous robot localization |
US9516806B2 (en) | 2014-10-10 | 2016-12-13 | Irobot Corporation | Robotic lawn mowing boundary determination |
US9420741B2 (en) | 2014-12-15 | 2016-08-23 | Irobot Corporation | Robot lawnmower mapping |
JP6692817B2 (en) * | 2014-12-17 | 2020-05-13 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | Method and system for calculating displacement of target object |
US9538702B2 (en) | 2014-12-22 | 2017-01-10 | Irobot Corporation | Robotic mowing of separated lawn areas |
US9868211B2 (en) | 2015-04-09 | 2018-01-16 | Irobot Corporation | Restricting movement of a mobile robot |
US9889559B2 (en) * | 2015-06-26 | 2018-02-13 | Intel Corporation | Robotic system for updating devices |
US9712472B2 (en) | 2015-07-02 | 2017-07-18 | Microsoft Technology Licensing, Llc | Application spawning responsive to communication |
US9658836B2 (en) | 2015-07-02 | 2017-05-23 | Microsoft Technology Licensing, Llc | Automated generation of transformation chain compatible class |
US9733915B2 (en) | 2015-07-02 | 2017-08-15 | Microsoft Technology Licensing, Llc | Building of compound application chain applications |
US9733993B2 (en) | 2015-07-02 | 2017-08-15 | Microsoft Technology Licensing, Llc | Application sharing using endpoint interface entities |
US10198252B2 (en) | 2015-07-02 | 2019-02-05 | Microsoft Technology Licensing, Llc | Transformation chain application splitting |
US9785484B2 (en) | 2015-07-02 | 2017-10-10 | Microsoft Technology Licensing, Llc | Distributed application interfacing across different hardware |
US9860145B2 (en) | 2015-07-02 | 2018-01-02 | Microsoft Technology Licensing, Llc | Recording of inter-application data flow |
US10261985B2 (en) | 2015-07-02 | 2019-04-16 | Microsoft Technology Licensing, Llc | Output rendering in dynamic redefining application |
US10031724B2 (en) | 2015-07-08 | 2018-07-24 | Microsoft Technology Licensing, Llc | Application operation responsive to object spatial status |
US10198405B2 (en) | 2015-07-08 | 2019-02-05 | Microsoft Technology Licensing, Llc | Rule-based layout of changing information |
US11115798B2 (en) | 2015-07-23 | 2021-09-07 | Irobot Corporation | Pairing a beacon with a mobile robot |
US10034421B2 (en) | 2015-07-24 | 2018-07-31 | Irobot Corporation | Controlling robotic lawnmowers |
US10277582B2 (en) | 2015-08-27 | 2019-04-30 | Microsoft Technology Licensing, Llc | Application service architecture |
US10627490B2 (en) | 2016-01-31 | 2020-04-21 | Velodyne Lidar, Inc. | Multiple pulse, LIDAR based 3-D imaging |
US10021830B2 (en) | 2016-02-02 | 2018-07-17 | Irobot Corporation | Blade assembly for a grass cutting mobile robot |
US10459063B2 (en) | 2016-02-16 | 2019-10-29 | Irobot Corporation | Ranging and angle of arrival antenna system for a mobile robot |
JP7149256B2 (en) | 2016-03-19 | 2022-10-06 | ベロダイン ライダー ユーエスエー,インコーポレイテッド | Integrated illumination and detection for LIDAR-based 3D imaging |
WO2017210418A1 (en) | 2016-06-01 | 2017-12-07 | Velodyne Lidar, Inc. | Multiple pixel scanning lidar |
US11726487B1 (en) | 2016-06-06 | 2023-08-15 | AI Incorporated | Method for robotic devices to identify doorways using machine learning |
CN110234955B (en) | 2016-12-07 | 2022-03-29 | 魔眼公司 | Distance sensor for projecting parallel patterns |
WO2018183843A1 (en) | 2017-03-31 | 2018-10-04 | Velodyne Lidar, Inc. | Integrated lidar illumination power control |
JP2020519881A (en) | 2017-05-08 | 2020-07-02 | ベロダイン ライダー, インク. | LIDAR data collection and control |
WO2019013989A1 (en) | 2017-07-14 | 2019-01-17 | Irobot Corporation | Blade assembly for a grass cutting mobile robot |
CN111164650B (en) * | 2017-10-08 | 2021-10-29 | 魔眼公司 | System and method for determining sensor position |
JP2020537237A (en) | 2017-10-08 | 2020-12-17 | マジック アイ インコーポレイテッド | Distance measurement using vertical grid pattern |
JP6986936B2 (en) * | 2017-11-21 | 2021-12-22 | 株式会社日立製作所 | Vehicle control system |
US11294041B2 (en) * | 2017-12-08 | 2022-04-05 | Velodyne Lidar Usa, Inc. | Systems and methods for improving detection of a return signal in a light ranging and detection system |
EP3769121A4 (en) | 2018-03-20 | 2021-12-29 | Magik Eye Inc. | Distance measurement using projection patterns of varying densities |
EP3769505A4 (en) | 2018-03-20 | 2021-12-01 | Magik Eye Inc. | Adjusting camera exposure for three-dimensional depth sensing and two-dimensional imaging |
EP3803266A4 (en) | 2018-06-06 | 2022-03-09 | Magik Eye Inc. | Distance measurement using high density projection patterns |
WO2020033169A1 (en) | 2018-08-07 | 2020-02-13 | Magik Eye Inc. | Baffles for three-dimensional sensors having spherical fields of view |
US11971507B2 (en) | 2018-08-24 | 2024-04-30 | Velodyne Lidar Usa, Inc. | Systems and methods for mitigating optical crosstalk in a light ranging and detection system |
US10712434B2 (en) | 2018-09-18 | 2020-07-14 | Velodyne Lidar, Inc. | Multi-channel LIDAR illumination driver |
US11082010B2 (en) | 2018-11-06 | 2021-08-03 | Velodyne Lidar Usa, Inc. | Systems and methods for TIA base current detection and compensation |
US11885958B2 (en) | 2019-01-07 | 2024-01-30 | Velodyne Lidar Usa, Inc. | Systems and methods for a dual axis resonant scanning mirror |
WO2020150131A1 (en) | 2019-01-20 | 2020-07-23 | Magik Eye Inc. | Three-dimensional sensor including bandpass filter having multiple passbands |
US10755571B1 (en) * | 2019-03-01 | 2020-08-25 | Amazon Technologies, Inc. | Identifying parking location using single camera reverse projection |
WO2020197813A1 (en) | 2019-03-25 | 2020-10-01 | Magik Eye Inc. | Distance measurement using high density projection patterns |
US11019249B2 (en) | 2019-05-12 | 2021-05-25 | Magik Eye Inc. | Mapping three-dimensional depth map data onto two-dimensional images |
US10613203B1 (en) | 2019-07-01 | 2020-04-07 | Velodyne Lidar, Inc. | Interference mitigation for light detection and ranging |
JP2023504157A (en) | 2019-12-01 | 2023-02-01 | マジック アイ インコーポレイテッド | Improving triangulation-based 3D range finding using time-of-flight information |
US11580662B2 (en) | 2019-12-29 | 2023-02-14 | Magik Eye Inc. | Associating three-dimensional coordinates with two-dimensional feature points |
CN115151945A (en) | 2020-01-05 | 2022-10-04 | 魔眼公司 | Converting coordinate system of three-dimensional camera into incident point of two-dimensional camera |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4626995A (en) * | 1984-03-26 | 1986-12-02 | Ndc Technologies, Inc. | Apparatus and method for optical guidance system for automatic guided vehicle |
US4831539A (en) * | 1984-04-27 | 1989-05-16 | Hagenbuch Roy George Le | Apparatus and method for locating a vehicle in a working area and for the on-board measuring of parameters indicative of vehicle performance |
SE451770B (en) * | 1985-09-17 | 1987-10-26 | Hyypae Ilkka Kalevi | KIT FOR NAVIGATION OF A LARGE VESSEL IN ONE PLAN, EXTRA A TRUCK, AND TRUCK FOR EXTENDING THE KIT |
US4727259A (en) * | 1986-02-24 | 1988-02-23 | The United States Of America As Represented By The Secretary Of The Air Force | Monolithic area array with shutter operable to only transmit light between the minimum and maximum ranges for laser rangefinding |
JP2680312B2 (en) | 1987-07-10 | 1997-11-19 | アイシン・エィ・ダブリュ株式会社 | Vehicle navigation system |
US4858132A (en) * | 1987-09-11 | 1989-08-15 | Ndc Technologies, Inc. | Optical navigation system for an automatic guided vehicle, and method |
GB2218590B (en) | 1988-05-13 | 1992-05-20 | Gen Electric Co Plc | Automated vehicle control |
US4954962A (en) * | 1988-09-06 | 1990-09-04 | Transitions Research Corporation | Visual navigation and obstacle avoidance structured light system |
US5051906A (en) * | 1989-06-07 | 1991-09-24 | Transitions Research Corporation | Mobile robot navigation employing retroreflective ceiling features |
US5155706A (en) * | 1991-10-10 | 1992-10-13 | Westinghouse Electric Corp. | Automatic feature detection and side scan sonar overlap navigation via sonar image matching |
IL100633A (en) | 1992-01-12 | 1999-04-11 | Israel State | Large area movement robot |
GB2270438B (en) * | 1992-09-08 | 1996-06-26 | Caterpillar Inc | Apparatus and method for determining the location of a vehicle |
US5367458A (en) * | 1993-08-10 | 1994-11-22 | Caterpillar Industrial Inc. | Apparatus and method for identifying scanned reflective anonymous targets |
DE4408982C1 (en) * | 1994-03-16 | 1995-05-18 | Deutsche Forsch Luft Raumfahrt | Autonomous navigation system for mobile robot or manipulator |
US5530330A (en) | 1994-03-30 | 1996-06-25 | Inco Limited | Automated guidance system for a vehicle |
DE4416557A1 (en) * | 1994-05-11 | 1995-11-23 | Bodenseewerk Geraetetech | Method and device for supporting the inertial navigation of a missile autonomously controlling a distant target |
US5838262A (en) * | 1996-12-19 | 1998-11-17 | Sikorsky Aircraft Corporation | Aircraft virtual image display system and method for providing a real-time perspective threat coverage display |
FR2764075B1 (en) * | 1997-05-30 | 1999-08-27 | Thomson Csf | METHOD FOR RECORDING THE NAVIGATION OF A MOBILE USING RADAR MAPPING OF HIGHER RELIEF FIELD AREAS |
-
1998
- 1998-04-15 AU AUPP2994A patent/AUPP299498A0/en not_active Abandoned
-
1999
- 1999-04-15 EP EP99913020A patent/EP1086383A4/en not_active Withdrawn
- 1999-04-15 WO PCT/AU1999/000274 patent/WO1999053335A1/en active IP Right Grant
- 1999-04-15 JP JP2000543846A patent/JP3561473B2/en not_active Expired - Fee Related
- 1999-04-15 CA CA002328227A patent/CA2328227C/en not_active Expired - Fee Related
-
2000
- 2000-10-12 ZA ZA200005640A patent/ZA200005640B/en unknown
- 2000-10-13 US US09/689,741 patent/US6442476B1/en not_active Expired - Fee Related
Cited By (108)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040207355A1 (en) * | 2001-06-12 | 2004-10-21 | Jones Joseph L. | Method and system for multi-mode coverage for an autonomous robot |
US8838274B2 (en) | 2001-06-12 | 2014-09-16 | Irobot Corporation | Method and system for multi-mode coverage for an autonomous robot |
US7173391B2 (en) * | 2001-06-12 | 2007-02-06 | Irobot Corporation | Method and system for multi-mode coverage for an autonomous robot |
US9128486B2 (en) | 2002-01-24 | 2015-09-08 | Irobot Corporation | Navigational control system for a robotic device |
US20030176965A1 (en) * | 2002-03-14 | 2003-09-18 | Microsoft Corporation | Landmark-based location of users |
US6766245B2 (en) * | 2002-03-14 | 2004-07-20 | Microsoft Corporation | Landmark-based location of users |
US10220302B2 (en) * | 2002-07-27 | 2019-03-05 | Sony Interactive Entertainment Inc. | Method and apparatus for tracking three-dimensional movements of an object using a depth sensing camera |
US20140078312A1 (en) * | 2002-07-27 | 2014-03-20 | Sony Computer Entertainment Inc. | Method and apparatus for tracking three-dimensional movements of an object using a depth sensing camera |
US9381424B2 (en) | 2002-07-27 | 2016-07-05 | Sony Interactive Entertainment America Llc | Scheme for translating movements of a hand-held controller into inputs for a system |
US9393487B2 (en) | 2002-07-27 | 2016-07-19 | Sony Interactive Entertainment Inc. | Method for mapping movements of a hand-held controller to game commands |
US8793020B2 (en) | 2002-09-13 | 2014-07-29 | Irobot Corporation | Navigational control system for a robotic device |
WO2004025947A3 (en) * | 2002-09-13 | 2004-05-21 | Irobot Corp | A navigational control system for a robotic device |
US20060136096A1 (en) * | 2002-09-13 | 2006-06-22 | Irobot Corporation | Navigational control system for a robotic device |
US20110144805A1 (en) * | 2002-09-13 | 2011-06-16 | Chiappetta Mark J | Navigational control system for a robotic device |
US7024278B2 (en) | 2002-09-13 | 2006-04-04 | Irobot Corporation | Navigational control system for a robotic device |
US8515578B2 (en) | 2002-09-13 | 2013-08-20 | Irobot Corporation | Navigational control system for a robotic device |
US20040111184A1 (en) * | 2002-09-13 | 2004-06-10 | Chiappetta Mark J. | Navigational control system for a robotic device |
US7188000B2 (en) | 2002-09-13 | 2007-03-06 | Irobot Corporation | Navigational control system for a robotic device |
US20040224229A1 (en) * | 2003-05-09 | 2004-11-11 | Mansuetto Michael F. | Alkaline cell with copper oxide cathode |
EP1517117A1 (en) * | 2003-09-22 | 2005-03-23 | Leica Geosystems AG | Method and system for the determination of the actual position of a positioning apparatus |
WO2005031259A1 (en) * | 2003-09-22 | 2005-04-07 | Leica Geosystems Ag | Method and system for determining the spatial position of a hand-held measuring appliance |
US7742176B2 (en) | 2003-09-22 | 2010-06-22 | Leica Geosystems Ag | Method and system for determining the spatial position of a hand-held measuring appliance |
US20060058954A1 (en) * | 2003-10-08 | 2006-03-16 | Haney Philip J | Constrained tracking of ground objects using regional measurements |
US20050137750A1 (en) * | 2003-12-23 | 2005-06-23 | Samsung Electronics Co., Ltd. | Method and apparatus for using rotational movement amount of mobile device and computer-readable recording medium for storing computer program |
US7747348B2 (en) * | 2003-12-23 | 2010-06-29 | Samsung Electronics Co., Ltd. | Method and apparatus for using rotational movement amount of mobile device and computer-readable recording medium for storing computer program |
US9229540B2 (en) | 2004-01-30 | 2016-01-05 | Electronic Scripting Products, Inc. | Deriving input from six degrees of freedom interfaces |
US9939911B2 (en) | 2004-01-30 | 2018-04-10 | Electronic Scripting Products, Inc. | Computer interface for remotely controlled objects and wearable articles with absolute pose detection component |
US10191559B2 (en) | 2004-01-30 | 2019-01-29 | Electronic Scripting Products, Inc. | Computer interface for manipulated objects with an absolute pose detection component |
US9235934B2 (en) | 2004-01-30 | 2016-01-12 | Electronic Scripting Products, Inc. | Computer interface employing a wearable article with an absolute pose detection component |
EP1759173A1 (en) * | 2004-06-02 | 2007-03-07 | Athena Technologies, Inc. | Image-augmented inertial navigation system (iains) and method |
US8407000B2 (en) * | 2004-06-02 | 2013-03-26 | Rockwell Collins Control Technologies, Inc. | Image augmented inertial navigation system (IAINS) and method |
EP1759173A4 (en) * | 2004-06-02 | 2012-02-22 | Rockwell Collins Control Technologies Inc | Image-augmented inertial navigation system (iains) and method |
US20100235097A1 (en) * | 2004-06-02 | 2010-09-16 | Athena Technologies, Inc. | Image augmented inertial navigation system (iains) and method |
US7594556B1 (en) * | 2004-08-27 | 2009-09-29 | Cook Technologies, Inc. | System for storing and retrieving a personal-transportation vehicle |
US8312953B1 (en) * | 2004-08-27 | 2012-11-20 | Fs Partners, Llc | System for storing and retrieving a personal-transportation vehicle |
US20120275688A1 (en) * | 2004-08-30 | 2012-11-01 | Commonwealth Scientific And Industrial Research Organisation | Method for automated 3d imaging |
US20090196491A1 (en) * | 2004-08-30 | 2009-08-06 | Maxwell Leslie Stainlay | Method for automated 3d imaging |
US20060082590A1 (en) * | 2004-10-14 | 2006-04-20 | Stevick Glen R | Method and apparatus for dynamic space-time imaging system |
US7620209B2 (en) * | 2004-10-14 | 2009-11-17 | Stevick Glen R | Method and apparatus for dynamic space-time imaging system |
US20060145703A1 (en) * | 2004-12-20 | 2006-07-06 | Marcus Steinbichler | Automatic component testing |
WO2006079439A3 (en) * | 2005-01-28 | 2006-12-21 | Siemens Ag | Position determination by means of a radio locating system, in particular by means of lpr, despite time limiting failure of the radio locating components |
WO2006079439A2 (en) * | 2005-01-28 | 2006-08-03 | Siemens Aktiengesellschaft | Position determination by means of a radio locating system, in particular by means of lpr, despite time limiting failure of the radio locating components |
US8224024B2 (en) | 2005-10-04 | 2012-07-17 | InterSense, LLC | Tracking objects with markers |
WO2007044301A2 (en) * | 2005-10-04 | 2007-04-19 | Intersense, Inc. | Tracking objects with markers |
US20070081695A1 (en) * | 2005-10-04 | 2007-04-12 | Eric Foxlin | Tracking objects with markers |
WO2007044301A3 (en) * | 2005-10-04 | 2007-12-06 | Intersense Inc | Tracking objects with markers |
EP1777498A1 (en) * | 2005-10-19 | 2007-04-25 | Aisin Aw Co., Ltd. | Vehicle moving distance detecting method, vehicle moving distance detecting device, current vehicle position detecting method, and current vehicle position detecting device |
US20070103461A1 (en) * | 2005-11-08 | 2007-05-10 | Sony Corporation | Virtual space image display method, apparatus, virtual space image display program, and recording medium |
CN101029831B (en) * | 2005-11-24 | 2010-05-12 | 株式会社拓普康 | Method and apparatus for creating three-dimensional data |
US20080040071A1 (en) * | 2006-02-08 | 2008-02-14 | Honeywell International Inc. | Mapping systems and methods |
US20070185681A1 (en) * | 2006-02-08 | 2007-08-09 | Honeywell International Inc. | Mapping systems and methods |
US7516039B2 (en) | 2006-02-08 | 2009-04-07 | Honeywell International Inc. | Mapping systems and methods |
US7302359B2 (en) * | 2006-02-08 | 2007-11-27 | Honeywell International Inc. | Mapping systems and methods |
US20110227915A1 (en) * | 2006-03-08 | 2011-09-22 | Mandella Michael J | Computer interface employing a manipulated object with absolute pose detection component and a display |
US8553935B2 (en) | 2006-03-08 | 2013-10-08 | Electronic Scripting Products, Inc. | Computer interface employing a manipulated object with absolute pose detection component and a display |
US8050863B2 (en) | 2006-03-16 | 2011-11-01 | Gray & Company, Inc. | Navigation and control system for autonomous vehicles |
WO2008048707A2 (en) * | 2006-03-16 | 2008-04-24 | Gray Matter Inc. | Navigation and control system for autonomous vehicles |
US8346480B2 (en) | 2006-03-16 | 2013-01-01 | Gray & Company, Inc. | Navigation and control system for autonomous vehicles |
WO2008048707A3 (en) * | 2006-03-16 | 2008-07-31 | Gray Matter Inc | Navigation and control system for autonomous vehicles |
US20070219720A1 (en) * | 2006-03-16 | 2007-09-20 | The Gray Insurance Company | Navigation and control system for autonomous vehicles |
US20070271003A1 (en) * | 2006-05-16 | 2007-11-22 | Samsung Electronics Co., Ltd. | Robot using absolute azimuth and mapping method thereof |
US20100048140A1 (en) * | 2006-11-20 | 2010-02-25 | Toyota Jidosha Kabushiki Kaisha | Device for measuring a position of a mobile station |
US8035554B2 (en) * | 2006-11-20 | 2011-10-11 | Toyota Jidosha Kabushiki Kaisha | Device for measuring a position of a mobile station |
US20100017115A1 (en) * | 2007-03-21 | 2010-01-21 | Sidharta Gautama | System and method for position determination |
EP1972893A1 (en) * | 2007-03-21 | 2008-09-24 | Universiteit Gent | System and method for position determination |
WO2008113861A2 (en) * | 2007-03-21 | 2008-09-25 | Universiteit Gent | System and method for position determination |
WO2008113861A3 (en) * | 2007-03-21 | 2008-11-06 | Univ Gent | System and method for position determination |
US8049658B1 (en) * | 2007-05-25 | 2011-11-01 | Lockheed Martin Corporation | Determination of the three-dimensional location of a target viewed by a camera |
US20090033548A1 (en) * | 2007-08-01 | 2009-02-05 | Camero-Tech Ltd. | System and method for volume visualization in through-the-obstacle imaging system |
US20090209343A1 (en) * | 2008-02-15 | 2009-08-20 | Eric Foxlin | Motion-tracking game controller |
US8696458B2 (en) | 2008-02-15 | 2014-04-15 | Thales Visionix, Inc. | Motion tracking system and method using camera and non-camera sensors |
US20110050903A1 (en) * | 2009-04-08 | 2011-03-03 | Topcon Positioning Systems, Inc. | Method for determining position and orientation of vehicle trailers |
US9958873B2 (en) | 2011-04-11 | 2018-05-01 | Crown Equipment Corporation | System for efficient scheduling for multiple automated non-holonomic vehicles using a coordinated path planner |
US9188982B2 (en) | 2011-04-11 | 2015-11-17 | Crown Equipment Limited | Method and apparatus for efficient scheduling for multiple automated non-holonomic vehicles using a coordinated path planner |
US8078349B1 (en) | 2011-05-11 | 2011-12-13 | Google Inc. | Transitioning a mixed-mode vehicle to autonomous mode |
US8655588B2 (en) | 2011-05-26 | 2014-02-18 | Crown Equipment Limited | Method and apparatus for providing accurate localization for an industrial vehicle |
US8548671B2 (en) | 2011-06-06 | 2013-10-01 | Crown Equipment Limited | Method and apparatus for automatically calibrating vehicle parameters |
US8825391B1 (en) * | 2011-08-04 | 2014-09-02 | Google Inc. | Building elevation maps from laser data |
US10185324B1 (en) | 2011-08-04 | 2019-01-22 | Waymo Llc | Building elevation maps from laser data |
US9709679B1 (en) | 2011-08-04 | 2017-07-18 | Waymo Llc | Building elevation maps from laser data |
US9206023B2 (en) | 2011-08-26 | 2015-12-08 | Crown Equipment Limited | Method and apparatus for using unique landmarks to locate industrial vehicles at start-up |
US9580285B2 (en) | 2011-08-26 | 2017-02-28 | Crown Equipment Corporation | Method and apparatus for using unique landmarks to locate industrial vehicles at start-up |
US10611613B2 (en) | 2011-08-26 | 2020-04-07 | Crown Equipment Corporation | Systems and methods for pose development using retrieved position of a pallet or product load to be picked up |
US9056754B2 (en) | 2011-09-07 | 2015-06-16 | Crown Equipment Limited | Method and apparatus for using pre-positioned objects to localize an industrial vehicle |
US8688275B1 (en) | 2012-01-25 | 2014-04-01 | Adept Technology, Inc. | Positive and negative obstacle avoidance system and method for a mobile robot |
US9592609B2 (en) | 2012-01-25 | 2017-03-14 | Omron Adept Technologies, Inc. | Autonomous mobile robot for handling job assignments in a physical environment inhabited by stationary and non-stationary obstacles |
WO2013112842A1 (en) * | 2012-01-25 | 2013-08-01 | Adept Technology, Inc. | Positive and negative obstacle avoidance system for a mobile robot |
US10089586B2 (en) | 2012-02-08 | 2018-10-02 | Omron Adept Technologies, Inc. | Job management system for a fleet of autonomous mobile robots |
WO2014200979A1 (en) * | 2013-06-12 | 2014-12-18 | Caterpillar Inc. | System and method for mapping a raised contour |
US9097520B2 (en) | 2013-06-12 | 2015-08-04 | Caterpillar Inc. | System and method for mapping a raised contour |
US20150161795A1 (en) * | 2013-12-10 | 2015-06-11 | GM Global Technology Operations LLC | Distance determination using a monoscopic imager in a vehicle |
US9404742B2 (en) * | 2013-12-10 | 2016-08-02 | GM Global Technology Operations LLC | Distance determination system for a vehicle using holographic techniques |
US9280826B2 (en) * | 2013-12-10 | 2016-03-08 | GM Global Technologies Operations LLC | Distance determination using a monoscopic imager in a vehicle |
US20150160003A1 (en) * | 2013-12-10 | 2015-06-11 | GM Global Technology Operations LLC | Distance determination system for a vehicle using holographic techniques |
US10585167B2 (en) * | 2014-03-21 | 2020-03-10 | The Boeing Company | Relative object localization process for local positioning system |
US10310054B2 (en) * | 2014-03-21 | 2019-06-04 | The Boeing Company | Relative object localization process for local positioning system |
US11927969B2 (en) | 2015-05-01 | 2024-03-12 | Transportation Ip Holdings, Llc | Control system and method for robotic motion planning and control |
US10599149B2 (en) * | 2015-10-09 | 2020-03-24 | SZ DJI Technology Co., Ltd. | Salient feature based vehicle positioning |
US20170123425A1 (en) * | 2015-10-09 | 2017-05-04 | SZ DJI Technology Co., Ltd | Salient feature based vehicle positioning |
US11577159B2 (en) | 2016-05-26 | 2023-02-14 | Electronic Scripting Products Inc. | Realistic virtual/augmented/mixed reality viewing and interactions |
US20170341235A1 (en) * | 2016-05-27 | 2017-11-30 | General Electric Company | Control System And Method For Robotic Motion Planning And Control |
CN107608342A (en) * | 2017-07-25 | 2018-01-19 | 昆明理工大学 | A kind of robotic vision system and its control method for mine rescue |
CN111094895A (en) * | 2018-06-29 | 2020-05-01 | 百度时代网络技术(北京)有限公司 | System and method for robust self-repositioning in pre-constructed visual maps |
US11788845B2 (en) * | 2018-06-29 | 2023-10-17 | Baidu Usa Llc | Systems and methods for robust self-relocalization in a visual map |
US11138753B2 (en) * | 2019-04-04 | 2021-10-05 | Aptiv Technologies Limited | Method and device for localizing a sensor in a vehicle |
CN112557390A (en) * | 2019-09-10 | 2021-03-26 | 惠州旭鑫智能技术有限公司 | Monocular visual inspection method for dislocation defect of bare cell tab of power battery |
WO2022093860A1 (en) * | 2020-10-26 | 2022-05-05 | Mohammad Amin Arbabian | Centralized tracking system with distributed fixed sensors |
CN112580582A (en) * | 2020-12-28 | 2021-03-30 | 达闼机器人有限公司 | Action learning method, action learning device, action learning medium and electronic equipment |
Also Published As
Publication number | Publication date |
---|---|
US6442476B1 (en) | 2002-08-27 |
ZA200005640B (en) | 2002-01-14 |
CA2328227A1 (en) | 1999-10-21 |
EP1086383A4 (en) | 2005-04-20 |
EP1086383A1 (en) | 2001-03-28 |
WO1999053335A1 (en) | 1999-10-21 |
AUPP299498A0 (en) | 1998-05-07 |
CA2328227C (en) | 2004-06-22 |
JP2002511614A (en) | 2002-04-16 |
JP3561473B2 (en) | 2004-09-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6442476B1 (en) | Method of tracking and sensing position of objects | |
EP3715785B1 (en) | Slam assisted ins | |
Borenstein et al. | Mobile robot positioning: Sensors and techniques | |
US7619561B2 (en) | Managed traverse system and method to acquire accurate survey data in absence of precise GPS data | |
Atia et al. | Integrated indoor navigation system for ground vehicles with automatic 3-D alignment and position initialization | |
Davison et al. | Mobile robot localisation using active vision | |
JP3485336B2 (en) | Method and apparatus for determining the position of a vehicle | |
US6453223B1 (en) | Infrastructure independent position determining system | |
CN104932515B (en) | A kind of autonomous cruise method and equipment of cruising | |
RU2740229C1 (en) | Method of localizing and constructing navigation maps of mobile service robot | |
JP2003015739A (en) | External environment map, self-position identifying device and guide controller | |
CN112068152A (en) | Method and system for simultaneous 2D localization and 2D map creation using a 3D scanner | |
RU2515469C1 (en) | Method of aircraft navigation | |
Escalera et al. | Continuous mobile robot localization by using structured light and a geometric map | |
López et al. | Machine vision: approaches and limitations | |
Demetriou | A Survey of Sensors for Localization of Unmanned Ground Vehicles (UGVs). | |
AU756108B2 (en) | Method of tracking and sensing position of objects | |
WO1995029380A1 (en) | Navigation system for fast automated vehicles and mobile robots | |
Wei | Multi-sources fusion based vehicle localization in urban environments under a loosely coupled probabilistic framework | |
Browne et al. | Localization of autonomous mobile ground vehicles in a sterile environment: a survey | |
Heidarsson et al. | Active online calibration of multiple sensors for autonomous surface vessels | |
Mazulina et al. | Developing a movement algorithm for a wheeled robot moving over a rough terrain | |
Muhammad | Contributions to the use of 3D lidars for autonomous navigation: calibration and qualitative localization | |
Yokoya et al. | Autonomously generating a 3D map of unknown environment by using mobile robots equipped with LRF | |
Tahir | Development of an Autonomous Vehicle Platform |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: RESEARCH ORGANISATION, AUSTRALIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:POROPAT, GEORGE;REEL/FRAME:011377/0326 Effective date: 20001030 |
|
AS | Assignment |
Owner name: COMMONWEALTH SCIENTIFIC AND INSUSTRIAL RESEARCH OR Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED ON REEL 011377, FRAME 0326;ASSIGNOR:POROPAT, GEORGE;REEL/FRAME:013949/0290 Effective date: 20001030 |
|
CC | Certificate of correction | ||
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
REMI | Maintenance fee reminder mailed | ||
LAPS | Lapse for failure to pay maintenance fees | ||
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20140827 |