WO2012012819A1 - Three dimensional scanning beam system and method - Google Patents

Three dimensional scanning beam system and method Download PDF

Info

Publication number
WO2012012819A1
WO2012012819A1 PCT/AU2010/000939 AU2010000939W WO2012012819A1 WO 2012012819 A1 WO2012012819 A1 WO 2012012819A1 AU 2010000939 W AU2010000939 W AU 2010000939W WO 2012012819 A1 WO2012012819 A1 WO 2012012819A1
Authority
WO
WIPO (PCT)
Prior art keywords
ranging apparatus
environment
signals
linkage mechanism
reactive linkage
Prior art date
Application number
PCT/AU2010/000939
Other languages
French (fr)
Inventor
Michael Bosse
Robert Zlot
Original Assignee
Commonwealth Scientific And Industrial Research Organisation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Commonwealth Scientific And Industrial Research Organisation filed Critical Commonwealth Scientific And Industrial Research Organisation
Priority to PCT/AU2010/000939 priority Critical patent/WO2012012819A1/en
Priority to EP10855130.0A priority patent/EP2598964A4/en
Priority to CN201080069024.2A priority patent/CN103180794B/en
Priority to KR1020137004389A priority patent/KR101698939B1/en
Priority to JP2013520923A priority patent/JP2013540985A/en
Priority to AU2010358358A priority patent/AU2010358358A1/en
Priority to US13/811,982 priority patent/US9146315B2/en
Publication of WO2012012819A1 publication Critical patent/WO2012012819A1/en
Priority to ZA2013/00646A priority patent/ZA201300646B/en
Priority to AU2016205004A priority patent/AU2016205004B2/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/02Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
    • G01S13/06Systems determining position data of a target
    • G01S13/08Systems for measuring distance only
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/02Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems using reflection of acoustic waves
    • G01S15/06Systems determining the position data of a target
    • G01S15/08Systems for measuring distance only
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06Systems determining position data of a target
    • G01S17/08Systems determining position data of a target for measuring distance only
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06Systems determining position data of a target
    • G01S17/42Simultaneous measurement of distance and other co-ordinates
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/89Lidar systems specially adapted for specific applications for mapping or imaging
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481Constructional features, e.g. arrangements of optical elements
    • G01S7/4817Constructional features, e.g. arrangements of optical elements relating to scanning
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/93Lidar systems specially adapted for specific applications for anti-collision purposes
    • G01S17/931Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles

Definitions

  • the present invention relates generally to scanning beam systems.
  • the invention relates to a system and method for three dimensional (3D) scanning using a reactive linkage mechanism.
  • Vehicles, people or robots that operate in environments where no a priori map is available often must construct a map in order to function and adapt to their working environment, or to provide accurate models for an end user.
  • mapping and localization are fundamental problems in mobile robotics, and include scenarios in which a moving object with no known map or accurate measure of its pose must estimate and maintain both.
  • the pose of an object refers to its position and orientation in space.
  • GPS global positioning system
  • SLAM systems which may include inertial measurement units (IMUs) or other sensors to determine position and orientation.
  • IMUs inertial measurement units
  • 3D scanning beam systems can provide data for mapping and/or localization applications.
  • such systems include an active, powered linkage mechanism that moves a sensor in multiple degrees of freedom, effectively increasing the field of view of the sensor, to obtain a 3D scan.
  • some systems may include a laser ranging apparatus that outputs a one dimensional beam. If the ranging apparatus is mounted to a powered multiple-degree-of-freedom linkage or powered gimbal mechanism, the laser can be repetitively swept through a three dimensional space, such as a space in front of a vehicle. Data collected from the apparatus then can be used to define a 3D "point cloud", which effectively defines an image or map of an environment.
  • Other ranging apparatus can include two dimensional laser scanners that are rotated about a central axis, or moved in a third dimension when fixed to a vehicle, to define a 3D point cloud.
  • 3D flash light detection and ranging (LIDAR) apparatuses can incorporate multiple detectors in parallel to generate 3D ranging data.
  • 3D scanning beam systems are rigidly mounted to a vehicle or robot, and continuously scan a particular region relative to an orientation of the vehicle or robot. Collected data then can be used for mapping and/or localization applications or more basic object detection and scene awareness purposes. However, in some circumstances errors can be
  • the present invention is a three dimensional scanning beam system, comprising:
  • a reactive linkage mechanism having a first end and a second end, wherein the first end is connected to the ranging apparatus and the second end is connected to an object that moves the system through an environment;
  • the system further comprises an orientation sensor attached to the ranging apparatus.
  • the system further comprises a computer system operatively coupled to the ranging apparatus, wherein the computer comprises a computer readable medium that stores program code components defining a registration algorithm, and wherein the registration algorithm processes data from the ranging apparatus to define a 3D point cloud of the environment.
  • the ranging apparatus comprises a laser.
  • the laser comprises a two dimensional scanning beam laser.
  • the 3D point cloud is defined in real time.
  • the ranging apparatus transmits and receives at least one of the following types of signals: light signals, acoustic signals, ultrasonic signals, radio frequency signals, gamma radiation signals, microwave signals.
  • the reactive linkage mechanism comprises a spring.
  • the orientation sensor comprises an inertial measurement unit
  • a connection between the first end of the reactive linkage mechanism and the ranging apparatus is a fluidic coupling.
  • the present invention is a method for obtaining a three dimensional scan of an environment, the method comprising:
  • the method further comprises:
  • the computer system comprises a computer readable medium that stores program code components defining a registration algorithm
  • the registration algorithm defines a 3D point cloud of the environment.
  • FIG. 1 is a schematic diagram illustrating a side view of a 3D scanning beam system, according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram illustrating a side view of the system of FIG. 1 connected to a front end of an automobile.
  • FIG. 3 is a schematic diagram illustrating a side view of the system of
  • FIG. 1 connected to a top of a construction safety helmet.
  • FIG. 4 is a diagram illustrating translational movement of a scanner relative to surfaces in an environment, according to some embodiments of the present invention.
  • FIG. 5 is a general flow diagram illustrating a method of obtaining a three dimensional scan of an environment, according to an embodiment of the present invention.
  • FIG. 6 is a block diagram illustrating components of a system including a computer system for defining a 3D point cloud, according to some embodiments of the present invention.
  • FIG. 7 is a schematic diagram illustrating a side view of a 3D scanning beam system, according to an alternative embodiment of the present invention.
  • the present invention relates to a 3D scanning beam system and method.
  • 3D scans of an environment can be obtained economically and reliably.
  • Data from the 3D scans then can be used for various purposes such as object detection, proximity detection, mapping, localization, or collision avoidance.
  • adjectives such as first and second, left and right, top and bottom, etc., are used solely to define one element or method step from another element or method step without necessarily requiring a specific relative position or sequence that is described by the adjectives.
  • Words such as “comprises” or “includes” are not used to define an exclusive set of elements or method steps. Rather, such words merely define a minimum set of elements or method steps included in a particular embodiment of the present invention.
  • FIG. 1 a schematic diagram illustrates a side view of a 3D scanning beam system 100, according to an embodiment of the present invention.
  • the system 100 includes a ranging apparatus in the form of a 2D laser beam scanner 105, and a reactive linkage mechanism in the form of a coil spring 1 10.
  • a first end 1 15 of the coil spring 1 10 is connected to the 2D laser beam scanner 105.
  • a second end 120 of the coil spring 1 10 is connected to an object 125.
  • Translational acceleration (as indicated by arrows 130) of the object 125 is then converted by the reactive linkage mechanism to rotational motion (as indicated by arrows 135) of the 2D laser beam scanner 105.
  • the 2D laser beam scanner 105 is thus able to significantly increase its field of view and scan an environment in front of the object 125 in 3D. No independently powered gimbal mechanisms or other independent excitation source is required to produce the rotational motion of the 2D laser beam scanner 105.
  • the system 100 thus can be economical and effective where cost or spatial constraints place limits on the hardware required to scan an environment using a ranging apparatus.
  • an optional orientation sensor such as an inertial measurement unit (IMU) 145, camera, magnetometer or other device, may be attached to the ranging apparatus.
  • IMU inertial measurement unit
  • Such an orientation sensor can assist in processing data from the ranging apparatus in applications where data defining the position or orientation of the ranging apparatus is required.
  • FIG. 2 a schematic diagram illustrates a side view of the system 100 connected to a front end of an automobile 200. The object 125 is thus replaced by the automobile 200. Translational acceleration of the
  • automobile 200 is converted to rotational motion of the 2D laser beam scanner 105, enabling a region in front of the automobile 200 to be scanned in 3D.
  • Other naturally occurring accelerations of the automobile 200 during normal use such as jounce (i.e., up and down) accelerations and turning accelerations, can assist in exciting rotational motion of the 2D laser beam scanner 105.
  • forces and torques applied to the object 125 induce motion (primarily rotational motions, but also small translational motions) of the scanner 105 relative to the object 125. The result is amplified motion of the scanner 105 relative to an environment that is being scanned.
  • 2D laser beam scanners such as the scanner 105 are widely available commercially, or can be readily manufactured using commercially available components.
  • the scanner 105 can comprise a light detection and ranging (LIDAR) laser measurement sensor (LMS) model 291 , manufactured by SICK AG.
  • LIDAR light detection and ranging
  • LMS laser measurement sensor
  • various other types of ranging apparatus can be used, including for example those that use various types of radiation or signals such as light signals, acoustic signals, ultrasonic signals, radio frequency (RF) signals, gamma radiation signals, or microwave signals.
  • RF radio frequency
  • gamma radiation signals or microwave signals.
  • Such radiation or signals can be used in a wide variety of ranging techniques including, for example, time-of-flight (TOF), frequency modulation continuous wave (FMCW), triangulation and phase shift ranging techniques.
  • a ranging apparatus does not need to scan in 2D, but could for example be a simple one dimensional beam ranging apparatus. Rotation of such a one dimensional beam ranging apparatus can also provide an effective 3D scan of an environment.
  • the reactive linkage mechanism also can comprise various types of commercially available off the shelf (COTS) products or custom made products.
  • the coil spring 1 10 can comprise various types of coil springs made of various materials, including polymers and metal alloys.
  • a reactive linkage mechanism can comprise other elements such as multiple springs or spring-like materials connected to a ranging apparatus.
  • a reactive linkage mechanism that converts accelerations of an object to motion of a ranging apparatus.
  • a reactive linkage mechanism can also act as a passive mechanical filter that isolates the scanner 105 from high-frequency motion of the object 125.
  • the reactive linkage mechanism such as the coil spring 1 10, can be tuned both to resonate at particular frequencies to meet application
  • the reactive linkage mechanism can be tuned so that an impulse response of the scanner 105 is lengthened based on time constants associated with the hardware; effectively enabling the scanner 105 to continue moving for a period of time after the object 125 has stopped moving.
  • the reactive linkage mechanism can store energy (such as mechanical or gravitational energy) and release it slowly over time.
  • Still other embodiments of the reactive linkage mechanism can include dampers or other physical limiters of the range of motion available to the mechanism. That can be useful, for example, to limit a field of view of the scanner 105 to a range of interest for a specific application.
  • a schematic diagram illustrates a side view of the system 100 connected to a top of a construction safety helmet 300.
  • walking, nodding or other natural movements of a worker's head while wearing the helmet 300 can be adequate to excite rotational motion of the 2D laser beam scanner 105.
  • the system 100 thus can be used to effectively scan a work site immediately in front of a worker, such as inside a building, in an underground mine, or in various other environments.
  • the system 100 as illustrated in FIG. 3 may be designed to use very little power, as no motors or other powered mechanisms are necessary to excite scanning or rotational motion of the ranging apparatus.
  • the ranging apparatus can be powered by only a relatively low power battery needed to supply power to, for example, solid state circuitry of the ranging apparatus.
  • Some embodiments of the present invention may be used to provide scanning data to a computer system.
  • the computer system may then process the data using a registration algorithm to define a 3D point cloud.
  • a 3D point cloud can be used for various mapping and/or localization applications or imaging applications.
  • a system such as the system 100 thus may be used in various scenarios
  • the system 100 can be mounted on a moving platform, such as a vehicle, push-cart, human or animal and can be used to obtain 3D maps of an environment.
  • a moving platform such as a vehicle, push-cart, human or animal
  • the system 100 can be used for terrain mapping or general scene awareness.
  • various lightweight embodiments of the present invention can be used as wearable or handheld equipment for navigational purposes.
  • first responders such as police, fire or military personnel can use the system 100 inside a building that has already been mapped.
  • Locally acquired maps created from data from the system 100 then can be compared in real time with existing global maps to localise and assist the first responder.
  • Similar localisation and mapping functions can be achieved using robots or other vehicles in remote environments such as underground mines or underwater environments.
  • the scanner 105 thus rotates through additional degrees of freedom and a wider field of view, thereby taking measurements outside of a normal 2D scan plane and providing 3D measurements of the surrounding environment.
  • the exact nature of the scanner motion may be initially unknown.
  • a registration algorithm can recover the translational motion, apply corrections to a rotational motion estimate, and additionally perform timing synchronization.
  • FIG. 4 a diagram illustrates translational movement of the scanner 105 relative to surfaces Zi and z 2 in an environment, according to some embodiments of the present invention.
  • the scanner 105 is at a first position at time ti and at a second position at time ⁇ 2 -
  • the pose (i.e., position and orientation) of the scanner 105 at times ti and t 2 are not known accurately (although some estimates of the positions may be known based on, for example, data from the IMU 145).
  • the surfaces zi and z 2 represent surfaces in an environment that are both measured by beams 140 from the scanner 105 at both the first and second positions.
  • a first step of a registration algorithm is to perform data association that identifies that the scanner 105 is in fact seeing common features at both positions that identify the surfaces Zi and z 2 .
  • a system of constraints H are then formed that link feature matches to corrections x applied to the pose of the scanner 105.
  • FIG. 4 illustrates only a subset of poses and matches; whereas an actual embodiment will generally consider a longer trajectory of the scanner 105 and a full set of range
  • a registration algorithm may use as an input a prior trajectory (e.g., containing only orientation estimates taken from the IMU 145) and a set of range scans. Using the prior trajectory, one can project the scan points (i.e., range measurements) into a non-registered (i.e., generally poorly aligned) 3D point cloud.
  • a trajectory can be defined as a continuous time history of the positions and orientations (in six degrees of freedom (DOF) - three positional and three rotational) of an origin of the scanner 105. Pose is defined in six DOF for a 3D rigid body.
  • a trajectory can be defined as a function ⁇ ( ⁇ ) specifying a six DOF pose of the scanner 105 with respect to a ground coordinate frame, for each time ⁇ over the duration of a sweep of the scanner 105.
  • a workspace of an environment is then discretized into a 3D grid of cells or "voxels" (volume elements), and statistics are computed for each voxel based on the set of scan points that fall within its boundaries.
  • 3D grids are computed at multiple resolutions and offsets.
  • the statistics computed for a given voxel define an ellipsoid that fits the points using first- and second-order moments ⁇ , S that describe the parameters for an ellipsoid fitting the points p, :
  • the ellipsoids can be summarized by their centroid (i.e., mean location) and a set of coordinate axes and magnitudes defining the shape (which can be computed by eigenvalue-eigenvector decomposition of the second-order moment matrix S).
  • the shape additionally can be summarized by shape parameters that describe how planar, cylindrical, or spherical the distributions are based on the computed eigenvalues.
  • a plane is further associated with its normal (the eigenvector corresponding to the smallest eigenvalue), while a cylinder can be associated with its axis (the eigenvector corresponding to the largest eigenvalue).
  • the quantity: is the cylindrical-likeness of the points which range from 0 to 1.
  • the quantity: is the plane-likeness of the points which range from 0 to 1.
  • An iterative optimization algorithm is then used to estimate the sensor trajectory and register the point cloud to produce an accurate 3D map.
  • an input trajectory estimate is given and further corrected to produce an improved output trajectory estimate, which then can be used as the input for the next iteration.
  • the first iteration uses a prior estimate generated from the rotational motion as estimated by the IMU 145.
  • the registration algorithm can be applied to segments of the trajectory at fixed intervals (e.g., once per second), to register the most recent data as it is acquired from the ranging apparatus and orientation sensor. By accumulating registered trajectory segments in this manner (and maintaining continuity constraints between them) a full trajectory can be obtained piece by piece.
  • the registration is implemented as a minimization problem with a linear system of constraints.
  • the trajectory must be discretized by sampling it at regular intervals. Interpolation can be used later to form a continuous trajectory given the discrete solution.
  • the optimization solves for corrections to the trajectory, resulting in a smooth trajectory that best explains the range data.
  • the algorithm operates in sequence on fixed-size, overlapping time segments of a trajectory. For example, a first second of data is processed and then a next second of data (which partially overlaps with the first second of data) is processed.
  • each constraint is one of three types.
  • the first type includes smoothness constraints, which incorporate a model of how the scanner 105 (and thus the object to which the scanner 105 is connected) might move based on physical considerations such as a smooth motion assumption, i.e., gradual acceleration limitations.
  • the second type of constraints include initial condition constraints, which ensure that the current trajectory segment is continuous with the previous segment (i.e., the start of the current segment should be
  • the third type of constraints include match constraints, which take the laser measurements of the external environment into account. Associated pairs of voxels are then identified, which are estimated to be matches originating from the same target in the environment measured at different times.
  • the targets can be for example voxels that are represented by their location and shape parameterization.
  • Such matches generate constraints on trajectory points, so that a trajectory must be constrained in a particular way in order for the particular measurements of the environment to have been obtained at different known times along the trajectory. For example, assume two measurements are made of the same target at different times, but the sensor pose of the scanner 105 at the time of each measurement is not accurately known.
  • An identified voxel match constrains the two sensor poses (relative to one another) since the measured targets should be approximately co-located and aligned; therefore the measurements could not have come from two arbitrarily aligned sensor poses.
  • the matches are determined using a k-nearest neighbours (kNN) search, which given a point in a space containing a representation of the voxels identifies the k closest points in that space.
  • the space for the kNN search is a Si- dimensional space, which combines the positional and shape information for each voxel. Given these candidate matches, the match constraints can be generated and weighted based on the shape parameters (planarity, cylindrical- ness, spherical-ness).
  • the planar constraints state that the distance between the centroids measured along the plane normal, and the difference in alignment of the normal, should be minimized.
  • the cylindrical constraints state that the distance between the centroids away from the cylinder axis and the difference in alignment of the axes should be minimized.
  • Spherical constraints state that the distance between the centroids should be minimized.
  • the three types of constraints can be stacked to form a sparse system of linear constraints, which can be defined by a linear system of equations of the form: where the 07s and ⁇ s are the trajectory corrections at the sampled times r, through r consult , and the A submatrices and b vectors represent three types of linear constraints: match constraints, smoothness constraints, and initial conditions.
  • a robust statistical framework uses weights based on a Cauchy distribution to provide robustness to outliers (e.g., the matches generated above do not all have to be correct).
  • the solution to the linear system is then used as the starting point for the next iteration, where new constraints are formed with the new input trajectory to produce an improved trajectory estimate.
  • the algorithm iterates until a defined tolerance or a maximum number of iterations is reached. High-level pseudo-code defining the algorithm appears as Algorithm 1 in the paper by Bosse et al cited above.
  • an alternative registration algorithm can be described as follows.
  • An alternative registration algorithm can iteratively refine the trajectory of the scanner 105 and surfaces representing the environment to minimize the projection error of the laser measurements of the surfaces. Given a prior trajectory (initially from an orientation sensor such as the IMU 145, and subsequently from the output of the previous iteration), all the laser points are projected into a common world frame.
  • a virtual 3D grid with a specific resolution typically .5m x .5m x .5m
  • An ellipsoid is fit to each group of laser points with sufficient membership.
  • centroid and the smallest eigenvector of the ellipsoid define an initial plane (surface) estimate for that grid cell.
  • the errors of the points in the group to the surface of the plane i.e., the distance between each point and the surface
  • the trajectory corrections are modelled by sub-sampling the trajectory, and linearly
  • the vector of unknowns (x) is comprised of the union of the trajectory subsample corrections and the surface model corrections.
  • Each trajectory subsample correction has six degrees of freedom (three for translation and three for rotation) whereas the surface corrections have three degrees of freedom: one for translation along the surface normal, and two for rotations on axes perpendicular to the surface normal.
  • each constraint involves one trajectory reference and one surface reference. There is one surface constraint for each valid laser point.
  • Smoothness and initial condition constraints can be defined in a similar way to the first method described above.
  • the three types of constraints can be stacked to form a sparse system of linear constraints with a high level structure similar to that defined in Equation 5 above. (A difference is in the form of the A ma tch matrix, and the contents of the x vector.)
  • trajectory and surface corrections are solved from the linearised system of constraints in an iterative re-weighted least squares M-estimator framework, where the surface constraints are weighted based on a Cauchy distribution of the residuals r defined as:
  • rbar is a tunable parameter defining a soft outlier threshold on the error.
  • the M-estimator framework is a standard statistical technique for robustly optimizing constraints in the presence of outliers. The optimization is terminated when the relative change in the sum of weights is below a threshold or when a fixed number of iterations have been completed. The full resolution trajectory corrections are interpolated from the sub-sampled corrections and the laser points are reprojected for the subsequent iterations and for the final solution.
  • FIG. 5 a general flow diagram illustrates a method of obtaining a three dimensional scan of an environment, according to an
  • a ranging apparatus is connected to a first end of a reactive linkage mechanism.
  • the 2D laser beam scanner 105 is connected to the first end 115 of the coil spring 1 10.
  • a second end of the reactive linkage mechanism is
  • the second end 120 of the coil spring 1 10 is connected to the object 125.
  • the object is moved through the environment, whereby acceleration of the object with respect to the environment is converted by the reactive linkage mechanism to motion of the ranging apparatus with respect to the object, which increases the field of view of the ranging apparatus with respect to the environment.
  • acceleration of the object with respect to the environment is converted by the reactive linkage mechanism to motion of the ranging apparatus with respect to the object, which increases the field of view of the ranging apparatus with respect to the environment.
  • translational acceleration illustrated by the arrows 130 is converted by the coil spring 1 10 into rotational motion of the 2D laser beam scanner 105 as illustrated by the arrows 135.
  • data is obtained by the ranging apparatus that defines the three dimensional scan of the environment.
  • lidar data from the beam 140 is collected from surfaces in the environment.
  • a computer system is operatively coupled to the ranging apparatus, wherein the computer system comprises a computer readable medium that stores program code components defining a registration algorithm.
  • the computer system comprises a computer readable medium that stores program code components defining a registration algorithm.
  • the data is processed using the computer system, whereby the registration algorithm defines a 3D point cloud of the environment.
  • FIG. 6 a block diagram illustrates components of a system including a computer system 600 for defining a 3D point cloud, according to some embodiments of the present invention.
  • the computer system 600 comprises user interfaces 605 operatively coupled to at least one processor 610.
  • a memory 615 is also operatively coupled to the processor 610.
  • the memory 615 stores an operating system 620, applications 625 and 3D point cloud data 630.
  • the user interfaces 605 can be a combination of user interfaces including, for example, but not limited to a keypad and a graphical user interface (GUI) such as a computer display screen.
  • GUI graphical user interface
  • a network interface card 640 enables the computer system 600 to be operatively coupled to an electronic communication network such as the Internet, or to the system 100 via a wired or wireless connection 645. It is to be understood that FIG. 6 is for illustrative purposes only and includes only some components of the computer system 600, in accordance with some embodiments of the present invention, and is not intended to be a complete schematic diagram of the various components and connections between components required for all devices that may implement various embodiments of the present invention.
  • the memory 615 also includes computer readable program code components 635 that define a registration algorithm. For example, when the computer readable program code components 635 are processed by the processor 610, the components 635 are configured to cause execution of step 530 of the method 500 for obtaining a 3D scan of an environment, as described above, according to some embodiments of the present invention.
  • FIG. 7 a schematic diagram illustrates a partial cutaway side view of a 3D scanning beam system 700, according to an alternative
  • the system 700 includes a ranging apparatus in the form of a 2D laser beam scanner 705, and a reactive linkage mechanism in the form of a float 710, a fluid 715, and a base 720.
  • a first end 725 (in the form of a top end of the float 710) of the reactive linkage mechanism is connected to the 2D laser beam scanner 705.
  • a second end 730 (in the form of the base 720) of the reactive linkage mechanism is connected to an object (not shown).
  • a cover 735 such as an elastic membrane, can be used to both retain the fluid 715 inside the base 720, and anchor the float 710 in a centre of the base 720.
  • implementation could alternatively be implemented as a hardware electronics component.
  • embodiments of the present invention can be used in various applications, including robotics, surveying, gaming, vehicle safety, object modelling, rock and soil analysis applications using ground penetrating radar, and first responder applications.
  • functions such as mapping and/or localization, object detection, and imaging can be performed significantly more economically and efficiently.

Abstract

A three dimensional scanning beam system (100) and method (500) enable economical and efficient three dimensional scans of an environment. The system (100) includes a ranging apparatus (105), and a reactive linkage mechanism (110) having a first end (115) and a second end (120). The first end (115) is connected to the ranging apparatus (105) and the second end (120) is connected to an object (125) that moves the system (100) through an environment. In use acceleration of the object (125) with respect to the environment is converted by the reactive linkage mechanism (110) to motion of the ranging apparatus (105) with respect to the object (125), which increases the field of view of the ranging apparatus (105) with respect to the environment.

Description

TITLE
"THREE DIMENSIONAL SCANNING BEAM SYSTEM AND METHOD
FIELD OF THE INVENTION
The present invention relates generally to scanning beam systems. In particular, although not exclusively, the invention relates to a system and method for three dimensional (3D) scanning using a reactive linkage mechanism.
BACKGROUND OF THE INVENTION
Vehicles, people or robots that operate in environments where no a priori map is available often must construct a map in order to function and adapt to their working environment, or to provide accurate models for an end user.
Mapping and localization, including simultaneous localisation and mapping (SLAM), are fundamental problems in mobile robotics, and include scenarios in which a moving object with no known map or accurate measure of its pose must estimate and maintain both.
The pose of an object refers to its position and orientation in space.
Accurate knowledge of the pose of moving objects is often important for mobile tasks such as robot navigation, mapping, and planning. In particular, it is well known that in some environments conventional navigation systems cannot operate or are not practical. For example, in environments such as inside buildings, in underground mines, or in deep water, satellite-based global positioning system (GPS) technologies and cellular-based positioning
technologies are often inoperative. If a detailed map of such an environment is not available, vehicles, people or robots operating in the environment may need to rely on alternative navigations systems, such as SLAM systems, which may include inertial measurement units (IMUs) or other sensors to determine position and orientation.
3D scanning beam systems can provide data for mapping and/or localization applications. Generally, such systems include an active, powered linkage mechanism that moves a sensor in multiple degrees of freedom, effectively increasing the field of view of the sensor, to obtain a 3D scan. For example some systems may include a laser ranging apparatus that outputs a one dimensional beam. If the ranging apparatus is mounted to a powered multiple-degree-of-freedom linkage or powered gimbal mechanism, the laser can be repetitively swept through a three dimensional space, such as a space in front of a vehicle. Data collected from the apparatus then can be used to define a 3D "point cloud", which effectively defines an image or map of an environment.
Other ranging apparatus can include two dimensional laser scanners that are rotated about a central axis, or moved in a third dimension when fixed to a vehicle, to define a 3D point cloud. Further, 3D flash light detection and ranging (LIDAR) apparatuses can incorporate multiple detectors in parallel to generate 3D ranging data.
In many cases 3D scanning beam systems are rigidly mounted to a vehicle or robot, and continuously scan a particular region relative to an orientation of the vehicle or robot. Collected data then can be used for mapping and/or localization applications or more basic object detection and scene awareness purposes. However, in some circumstances errors can be
introduced to a rigidly mounted scanning beam system due to vibrations or jouncing of a vehicle or robot to which the system is attached. Therefore complex vibration isolation and stabilisation systems have been devised to effectively isolate 3D scanning beam systems from unwanted vibrations or movement.
In some applications the required hardware necessary to increase the field of view of a scanning sensor to effectively scan a three dimensional region can be prohibitively complex and expensive. Therefore, there is a need for an improved 3D scanning beam system and method.
OBJECTS OF THE INVENTION
It is an object of some embodiments of the present invention to provide consumers with improvements and advantages over the above described prior art, and/or overcome and alleviate one or more of the above described disadvantages of the prior art, and/or provide a useful commercial choice.
SUMMARY OF THE INVENTION
Accordingly, in one form, the present invention is a three dimensional scanning beam system, comprising:
a ranging apparatus; and
a reactive linkage mechanism having a first end and a second end, wherein the first end is connected to the ranging apparatus and the second end is connected to an object that moves the system through an environment;
whereby in use acceleration of the object with respect to the environment is converted by the reactive linkage mechanism to motion of the ranging apparatus with respect to the object, which increases a field of view of the ranging apparatus with respect to the environment.
Optionally, the system further comprises an orientation sensor attached to the ranging apparatus.
Optionally, the system further comprises a computer system operatively coupled to the ranging apparatus, wherein the computer comprises a computer readable medium that stores program code components defining a registration algorithm, and wherein the registration algorithm processes data from the ranging apparatus to define a 3D point cloud of the environment.
Optionally, the ranging apparatus comprises a laser.
Optionally, the laser comprises a two dimensional scanning beam laser.
Optionally, the 3D point cloud is defined in real time.
Optionally, the ranging apparatus transmits and receives at least one of the following types of signals: light signals, acoustic signals, ultrasonic signals, radio frequency signals, gamma radiation signals, microwave signals.
Optionally, the reactive linkage mechanism comprises a spring. Optionally, the orientation sensor comprises an inertial measurement unit
(IMU).
Optionally, a connection between the first end of the reactive linkage mechanism and the ranging apparatus is a fluidic coupling.
According to another form, the present invention is a method for obtaining a three dimensional scan of an environment, the method comprising:
connecting a ranging apparatus to a first end of a reactive linkage mechanism;
connecting a second end of the reactive linkage mechanism to an object; moving the object through the environment, whereby acceleration of the object is converted by the reactive linkage mechanism to motion of the ranging apparatus with respect to the object, which increases the field of view of the ranging apparatus with respect to the environment; and
obtaining data by the ranging apparatus that defines the three
dimensional scan of the environment.
Optionally, the method further comprises:
operatively coupling a computer system to the ranging apparatus, wherein the computer system comprises a computer readable medium that stores program code components defining a registration algorithm; and
processing the data using the computer system, whereby the registration algorithm defines a 3D point cloud of the environment.
Further features and advantages of the present invention will become apparent from the following detailed description.
BRIEF DESCRIPTION OF THE DRAWINGS
To assist in understanding the invention and to enable a person skilled in the art to put the invention into practical effect, preferred embodiments of the invention will be described by way of example only with reference to the accompanying drawings, in which: FIG. 1 is a schematic diagram illustrating a side view of a 3D scanning beam system, according to an embodiment of the present invention.
FIG. 2 is a schematic diagram illustrating a side view of the system of FIG. 1 connected to a front end of an automobile.
FIG. 3 is a schematic diagram illustrating a side view of the system of
FIG. 1 connected to a top of a construction safety helmet.
FIG. 4 is a diagram illustrating translational movement of a scanner relative to surfaces in an environment, according to some embodiments of the present invention.
FIG. 5 is a general flow diagram illustrating a method of obtaining a three dimensional scan of an environment, according to an embodiment of the present invention.
FIG. 6 is a block diagram illustrating components of a system including a computer system for defining a 3D point cloud, according to some embodiments of the present invention.
FIG. 7 is a schematic diagram illustrating a side view of a 3D scanning beam system, according to an alternative embodiment of the present invention.
DETAILED DESCRIPTION OF THE INVENTION
The present invention relates to a 3D scanning beam system and method.
By attaching the system to an object, such as a vehicle, robot, person or animal, 3D scans of an environment can be obtained economically and reliably. Data from the 3D scans then can be used for various purposes such as object detection, proximity detection, mapping, localization, or collision avoidance.
In this patent specification, adjectives such as first and second, left and right, top and bottom, etc., are used solely to define one element or method step from another element or method step without necessarily requiring a specific relative position or sequence that is described by the adjectives. Words such as "comprises" or "includes" are not used to define an exclusive set of elements or method steps. Rather, such words merely define a minimum set of elements or method steps included in a particular embodiment of the present invention.
Referring to FIG. 1 , a schematic diagram illustrates a side view of a 3D scanning beam system 100, according to an embodiment of the present invention. The system 100 includes a ranging apparatus in the form of a 2D laser beam scanner 105, and a reactive linkage mechanism in the form of a coil spring 1 10. A first end 1 15 of the coil spring 1 10 is connected to the 2D laser beam scanner 105. A second end 120 of the coil spring 1 10 is connected to an object 125. Translational acceleration (as indicated by arrows 130) of the object 125 is then converted by the reactive linkage mechanism to rotational motion (as indicated by arrows 135) of the 2D laser beam scanner 105.
The 2D laser beam scanner 105 is thus able to significantly increase its field of view and scan an environment in front of the object 125 in 3D. No independently powered gimbal mechanisms or other independent excitation source is required to produce the rotational motion of the 2D laser beam scanner 105. The system 100 thus can be economical and effective where cost or spatial constraints place limits on the hardware required to scan an environment using a ranging apparatus.
According to some embodiments of the present invention, an optional orientation sensor, such as an inertial measurement unit (IMU) 145, camera, magnetometer or other device, may be attached to the ranging apparatus. Such an orientation sensor can assist in processing data from the ranging apparatus in applications where data defining the position or orientation of the ranging apparatus is required. Referring to FIG. 2, a schematic diagram illustrates a side view of the system 100 connected to a front end of an automobile 200. The object 125 is thus replaced by the automobile 200. Translational acceleration of the
automobile 200 is converted to rotational motion of the 2D laser beam scanner 105, enabling a region in front of the automobile 200 to be scanned in 3D. Other naturally occurring accelerations of the automobile 200 during normal use, such as jounce (i.e., up and down) accelerations and turning accelerations, can assist in exciting rotational motion of the 2D laser beam scanner 105. As will be understood by those having ordinary skill in the art, forces and torques applied to the object 125 induce motion (primarily rotational motions, but also small translational motions) of the scanner 105 relative to the object 125. The result is amplified motion of the scanner 105 relative to an environment that is being scanned.
2D laser beam scanners such as the scanner 105 are widely available commercially, or can be readily manufactured using commercially available components. For example, the scanner 105 can comprise a light detection and ranging (LIDAR) laser measurement sensor (LMS) model 291 , manufactured by SICK AG. Alternatively, various other types of ranging apparatus can be used, including for example those that use various types of radiation or signals such as light signals, acoustic signals, ultrasonic signals, radio frequency (RF) signals, gamma radiation signals, or microwave signals. Such radiation or signals can be used in a wide variety of ranging techniques including, for example, time-of-flight (TOF), frequency modulation continuous wave (FMCW), triangulation and phase shift ranging techniques. Also, a ranging apparatus according to the present invention does not need to scan in 2D, but could for example be a simple one dimensional beam ranging apparatus. Rotation of such a one dimensional beam ranging apparatus can also provide an effective 3D scan of an environment. According to some embodiments of the present invention the reactive linkage mechanism also can comprise various types of commercially available off the shelf (COTS) products or custom made products. For example, the coil spring 1 10 can comprise various types of coil springs made of various materials, including polymers and metal alloys. Further, a reactive linkage mechanism can comprise other elements such as multiple springs or spring-like materials connected to a ranging apparatus. As will be understood by those having ordinary skill in the art, and in light of the present disclosure, various other types of elastic connection mechanisms, including for example simple elastic rods, inflated balloons, sponges, rubber, etc., can be used to provide a reactive linkage mechanism that converts accelerations of an object to motion of a ranging apparatus. Further, those skilled in the art will appreciate that a reactive linkage mechanism according to the present invention can also act as a passive mechanical filter that isolates the scanner 105 from high-frequency motion of the object 125. The reactive linkage mechanism, such as the coil spring 1 10, can be tuned both to resonate at particular frequencies to meet application
requirements, and to suppress high-frequency motions that can be problematic. For example, some high-frequency motions may complicate processing by registration algorithms or may be damaging to the scanner 105.
Further, the reactive linkage mechanism can be tuned so that an impulse response of the scanner 105 is lengthened based on time constants associated with the hardware; effectively enabling the scanner 105 to continue moving for a period of time after the object 125 has stopped moving. Thus the reactive linkage mechanism can store energy (such as mechanical or gravitational energy) and release it slowly over time.
Still other embodiments of the reactive linkage mechanism can include dampers or other physical limiters of the range of motion available to the mechanism. That can be useful, for example, to limit a field of view of the scanner 105 to a range of interest for a specific application.
Referring to FIG. 3, a schematic diagram illustrates a side view of the system 100 connected to a top of a construction safety helmet 300. According to this embodiment, walking, nodding or other natural movements of a worker's head while wearing the helmet 300 can be adequate to excite rotational motion of the 2D laser beam scanner 105. The system 100 thus can be used to effectively scan a work site immediately in front of a worker, such as inside a building, in an underground mine, or in various other environments.
The system 100 as illustrated in FIG. 3 may be designed to use very little power, as no motors or other powered mechanisms are necessary to excite scanning or rotational motion of the ranging apparatus. Thus the ranging apparatus can be powered by only a relatively low power battery needed to supply power to, for example, solid state circuitry of the ranging apparatus. Some embodiments of the present invention may be used to provide scanning data to a computer system. The computer system may then process the data using a registration algorithm to define a 3D point cloud. As known to those having ordinary skill in the art, such a 3D point cloud can be used for various mapping and/or localization applications or imaging applications.
A system such as the system 100 thus may be used in various
applications. For example, in the field of mapping, the system 100 can be mounted on a moving platform, such as a vehicle, push-cart, human or animal and can be used to obtain 3D maps of an environment. In robotics applications the system 100 can be used for terrain mapping or general scene awareness.
As illustrated in FIG. 3, various lightweight embodiments of the present invention can be used as wearable or handheld equipment for navigational purposes. For example, first responders such as police, fire or military personnel can use the system 100 inside a building that has already been mapped. Locally acquired maps created from data from the system 100 then can be compared in real time with existing global maps to localise and assist the first responder. Similar localisation and mapping functions can be achieved using robots or other vehicles in remote environments such as underground mines or underwater environments.
An example of a registration algorithm that can be used in conjunction with the present invention is provided in the paper by Michael Bosse and Robert Zlot, "Continuous 3D Scan-Matching with a 2D Spinning Laser", Proceedings of the IEEE International Conference on Robotics and Automation, pages 4312- 4319, Kobe, Japan, May 12-17 2009, which paper is incorporated by reference herein in its entirety. A summary of how such a registration algorithm functions is provided below.
For example, considering the system 100 connected to the helmet 300 shown in FIG. 3, as a person wearing the helmet 300 moves, motion is excited through the spring 1 10. The scanner 105 thus rotates through additional degrees of freedom and a wider field of view, thereby taking measurements outside of a normal 2D scan plane and providing 3D measurements of the surrounding environment. However, the exact nature of the scanner motion may be initially unknown. One can make an estimate of the rotational movement of the scanner 105 using data from the IMU 145, which is rigidly attached to the laser scanner 105; but translational motion may be completely unknown. A registration algorithm can recover the translational motion, apply corrections to a rotational motion estimate, and additionally perform timing synchronization.
Referring to FIG. 4, a diagram illustrates translational movement of the scanner 105 relative to surfaces Zi and z2 in an environment, according to some embodiments of the present invention. As shown, consider that the scanner 105 is at a first position at time ti and at a second position at time \2- Prior to processing data obtained by the system 100 using a registration algorithm, the pose (i.e., position and orientation) of the scanner 105 at times ti and t2 are not known accurately (although some estimates of the positions may be known based on, for example, data from the IMU 145). As illustrated, the surfaces zi and z2 represent surfaces in an environment that are both measured by beams 140 from the scanner 105 at both the first and second positions. A first step of a registration algorithm is to perform data association that identifies that the scanner 105 is in fact seeing common features at both positions that identify the surfaces Zi and z2. A system of constraints H are then formed that link feature matches to corrections x applied to the pose of the scanner 105. As will be understood by those having ordinary skill in the art, FIG. 4 illustrates only a subset of poses and matches; whereas an actual embodiment will generally consider a longer trajectory of the scanner 105 and a full set of range
measurements.
A registration algorithm may use as an input a prior trajectory (e.g., containing only orientation estimates taken from the IMU 145) and a set of range scans. Using the prior trajectory, one can project the scan points (i.e., range measurements) into a non-registered (i.e., generally poorly aligned) 3D point cloud. A trajectory can be defined as a continuous time history of the positions and orientations (in six degrees of freedom (DOF) - three positional and three rotational) of an origin of the scanner 105. Pose is defined in six DOF for a 3D rigid body. Thus a trajectory can be defined as a function Τ(τ) specifying a six DOF pose of the scanner 105 with respect to a ground coordinate frame, for each time τ over the duration of a sweep of the scanner 105.
A workspace of an environment is then discretized into a 3D grid of cells or "voxels" (volume elements), and statistics are computed for each voxel based on the set of scan points that fall within its boundaries. To account for nonuniform sampling of the environment and boundary effects, 3D grids are computed at multiple resolutions and offsets. The statistics computed for a given voxel define an ellipsoid that fits the points using first- and second-order moments μ, S that describe the parameters for an ellipsoid fitting the points p, :
1 N
S = 77∑ (PtPiT )-WT (Eq. 2)
J i=i
The ellipsoids can be summarized by their centroid (i.e., mean location) and a set of coordinate axes and magnitudes defining the shape (which can be computed by eigenvalue-eigenvector decomposition of the second-order moment matrix S). The shape additionally can be summarized by shape parameters that describe how planar, cylindrical, or spherical the distributions are based on the computed eigenvalues. A plane is further associated with its normal (the eigenvector corresponding to the smallest eigenvalue), while a cylinder can be associated with its axis (the eigenvector corresponding to the largest eigenvalue).
Given sorted eigenvalues λι < λ2 < λ3 of the second order moment matrix S, the quantity: λ3 - λ2
c = (Eq. 3)
λ! + λ2 + λ3
is the cylindrical-likeness of the points which range from 0 to 1. Similarly, the quantity:
Figure imgf000012_0001
is the plane-likeness of the points which range from 0 to 1.
An iterative optimization algorithm is then used to estimate the sensor trajectory and register the point cloud to produce an accurate 3D map. On each iteration, an input trajectory estimate is given and further corrected to produce an improved output trajectory estimate, which then can be used as the input for the next iteration. The first iteration uses a prior estimate generated from the rotational motion as estimated by the IMU 145. The registration algorithm can be applied to segments of the trajectory at fixed intervals (e.g., once per second), to register the most recent data as it is acquired from the ranging apparatus and orientation sensor. By accumulating registered trajectory segments in this manner (and maintaining continuity constraints between them) a full trajectory can be obtained piece by piece.
The registration is implemented as a minimization problem with a linear system of constraints. To form such a system, the trajectory must be discretized by sampling it at regular intervals. Interpolation can be used later to form a continuous trajectory given the discrete solution. The optimization solves for corrections to the trajectory, resulting in a smooth trajectory that best explains the range data.
The algorithm operates in sequence on fixed-size, overlapping time segments of a trajectory. For example, a first second of data is processed and then a next second of data (which partially overlaps with the first second of data) is processed.
In each iteration of the registration algorithm, a set of constraints are generated, where each constraint is one of three types. The first type includes smoothness constraints, which incorporate a model of how the scanner 105 (and thus the object to which the scanner 105 is connected) might move based on physical considerations such as a smooth motion assumption, i.e., gradual acceleration limitations. The second type of constraints include initial condition constraints, which ensure that the current trajectory segment is continuous with the previous segment (i.e., the start of the current segment should be
constrained to match with the end of the previous segment). The third type of constraints include match constraints, which take the laser measurements of the external environment into account. Associated pairs of voxels are then identified, which are estimated to be matches originating from the same target in the environment measured at different times. The targets can be for example voxels that are represented by their location and shape parameterization. Such matches generate constraints on trajectory points, so that a trajectory must be constrained in a particular way in order for the particular measurements of the environment to have been obtained at different known times along the trajectory. For example, assume two measurements are made of the same target at different times, but the sensor pose of the scanner 105 at the time of each measurement is not accurately known. An identified voxel match constrains the two sensor poses (relative to one another) since the measured targets should be approximately co-located and aligned; therefore the measurements could not have come from two arbitrarily aligned sensor poses. The matches are determined using a k-nearest neighbours (kNN) search, which given a point in a space containing a representation of the voxels identifies the k closest points in that space. The space for the kNN search is a Si- dimensional space, which combines the positional and shape information for each voxel. Given these candidate matches, the match constraints can be generated and weighted based on the shape parameters (planarity, cylindrical- ness, spherical-ness). The planar constraints state that the distance between the centroids measured along the plane normal, and the difference in alignment of the normal, should be minimized. The cylindrical constraints state that the distance between the centroids away from the cylinder axis and the difference in alignment of the axes should be minimized. Spherical constraints state that the distance between the centroids should be minimized.
In each iteration, the three types of constraints can be stacked to form a sparse system of linear constraints, which can be defined by a linear system of equations of the form:
Figure imgf000015_0001
where the 07s and δΐ s are the trajectory corrections at the sampled times r, through r„ , and the A submatrices and b vectors represent three types of linear constraints: match constraints, smoothness constraints, and initial conditions. A robust statistical framework uses weights based on a Cauchy distribution to provide robustness to outliers (e.g., the matches generated above do not all have to be correct). The solution to the linear system is then used as the starting point for the next iteration, where new constraints are formed with the new input trajectory to produce an improved trajectory estimate. The algorithm iterates until a defined tolerance or a maximum number of iterations is reached. High-level pseudo-code defining the algorithm appears as Algorithm 1 in the paper by Bosse et al cited above.
As a further example, an alternative registration algorithm can be described as follows. An alternative registration algorithm can iteratively refine the trajectory of the scanner 105 and surfaces representing the environment to minimize the projection error of the laser measurements of the surfaces. Given a prior trajectory (initially from an orientation sensor such as the IMU 145, and subsequently from the output of the previous iteration), all the laser points are projected into a common world frame. A virtual 3D grid with a specific resolution (typically .5m x .5m x .5m) is setup and any laser points falling in the same grid cell are grouped together. An ellipsoid is fit to each group of laser points with sufficient membership. The centroid and the smallest eigenvector of the ellipsoid define an initial plane (surface) estimate for that grid cell. The errors of the points in the group to the surface of the plane (i.e., the distance between each point and the surface) are used to refine the plane's position and orientation as well as the trajectory of the sensor head of the scanner 105. As described in the Bosse et al paper cited above, the trajectory corrections are modelled by sub-sampling the trajectory, and linearly
interpolating the trajectory references between the temporally two nearest trajectory samples. The vector of unknowns (x) is comprised of the union of the trajectory subsample corrections and the surface model corrections. Each trajectory subsample correction has six degrees of freedom (three for translation and three for rotation) whereas the surface corrections have three degrees of freedom: one for translation along the surface normal, and two for rotations on axes perpendicular to the surface normal. However, unlike the process described in the Bosse et al paper, where each match constraint involves two trajectory references (from each matching ellipsoid), here each constraint involves one trajectory reference and one surface reference. There is one surface constraint for each valid laser point.
Smoothness and initial condition constraints can be defined in a similar way to the first method described above. The three types of constraints can be stacked to form a sparse system of linear constraints with a high level structure similar to that defined in Equation 5 above. (A difference is in the form of the Amatch matrix, and the contents of the x vector.)
The trajectory and surface corrections are solved from the linearised system of constraints in an iterative re-weighted least squares M-estimator framework, where the surface constraints are weighted based on a Cauchy distribution of the residuals r defined as:
Γ - ^match X ~^matd, (Ea, · 6) and the weights w, are based on each residual r, as follows: 1
Figure imgf000016_0001
rbar where rbar is a tunable parameter defining a soft outlier threshold on the error. The M-estimator framework is a standard statistical technique for robustly optimizing constraints in the presence of outliers. The optimization is terminated when the relative change in the sum of weights is below a threshold or when a fixed number of iterations have been completed. The full resolution trajectory corrections are interpolated from the sub-sampled corrections and the laser points are reprojected for the subsequent iterations and for the final solution.
Referring to FIG. 5, a general flow diagram illustrates a method of obtaining a three dimensional scan of an environment, according to an
embodiment of the present invention. At step 505 a ranging apparatus is connected to a first end of a reactive linkage mechanism. For example, the 2D laser beam scanner 105 is connected to the first end 115 of the coil spring 1 10.
At step 510, a second end of the reactive linkage mechanism is
connected to an object. For example, the second end 120 of the coil spring 1 10 is connected to the object 125.
At step 515, the object is moved through the environment, whereby acceleration of the object with respect to the environment is converted by the reactive linkage mechanism to motion of the ranging apparatus with respect to the object, which increases the field of view of the ranging apparatus with respect to the environment. For example, translational acceleration illustrated by the arrows 130 is converted by the coil spring 1 10 into rotational motion of the 2D laser beam scanner 105 as illustrated by the arrows 135.
At step 520, data is obtained by the ranging apparatus that defines the three dimensional scan of the environment. For example, lidar data from the beam 140 is collected from surfaces in the environment.
Optionally, at step 525, a computer system is operatively coupled to the ranging apparatus, wherein the computer system comprises a computer readable medium that stores program code components defining a registration algorithm. For example such a computer system is described in detail below.
Optionally, at step 530, the data is processed using the computer system, whereby the registration algorithm defines a 3D point cloud of the environment.
Referring to FIG. 6, a block diagram illustrates components of a system including a computer system 600 for defining a 3D point cloud, according to some embodiments of the present invention. The computer system 600 comprises user interfaces 605 operatively coupled to at least one processor 610. A memory 615 is also operatively coupled to the processor 610. The memory 615 stores an operating system 620, applications 625 and 3D point cloud data 630. The user interfaces 605 can be a combination of user interfaces including, for example, but not limited to a keypad and a graphical user interface (GUI) such as a computer display screen. A network interface card 640 enables the computer system 600 to be operatively coupled to an electronic communication network such as the Internet, or to the system 100 via a wired or wireless connection 645. It is to be understood that FIG. 6 is for illustrative purposes only and includes only some components of the computer system 600, in accordance with some embodiments of the present invention, and is not intended to be a complete schematic diagram of the various components and connections between components required for all devices that may implement various embodiments of the present invention.
The memory 615 also includes computer readable program code components 635 that define a registration algorithm. For example, when the computer readable program code components 635 are processed by the processor 610, the components 635 are configured to cause execution of step 530 of the method 500 for obtaining a 3D scan of an environment, as described above, according to some embodiments of the present invention.
Referring to FIG. 7, a schematic diagram illustrates a partial cutaway side view of a 3D scanning beam system 700, according to an alternative
embodiment of the present invention. The system 700 includes a ranging apparatus in the form of a 2D laser beam scanner 705, and a reactive linkage mechanism in the form of a float 710, a fluid 715, and a base 720. A first end 725 (in the form of a top end of the float 710) of the reactive linkage mechanism is connected to the 2D laser beam scanner 705. A second end 730 (in the form of the base 720) of the reactive linkage mechanism is connected to an object (not shown). A cover 735, such as an elastic membrane, can be used to both retain the fluid 715 inside the base 720, and anchor the float 710 in a centre of the base 720. As with the non-fluidic reactive linkage mechanisms described previously, according to the system 700 translational acceleration of the object (as illustrated by the arrows 740) is converted by the reactive linkage mechanism to rotational motion of the 2D laser beam scanner 105 (as illustrated by the arrows 745). A fluidic coupling between the base 720 and the scanner 705 therefore can provide an intended excitation of motion of the scanner 705 in multiple degrees of freedom. As will be understood by those having ordinary skill in the art, other accelerations of the base 720, including accelerations caused by up and down forces and twisting or turning torques, will also induce "sloshing" of the fluid 715 inside the base 720, and hence induce widely varied and quasi-random 3D motion of the scanner 105. Such 3D motion of the scanner 105, and an associated beam 750, then can be used to scan an environment.
It will be apparent to a person skilled in the art that some steps of methods of the present invention can be implemented in computer program code and that a variety of programming languages and coding implementations may be used to implement the methods described herein. Moreover, computer programs included in the software are not intended to be limited to the specific control flows described herein, and one or more of the steps of the computer programs may be performed in parallel or sequentially. One or more of the operations described in the context of a computer-program-controlled
implementation could alternatively be implemented as a hardware electronics component.
In summary, embodiments of the present invention can be used in various applications, including robotics, surveying, gaming, vehicle safety, object modelling, rock and soil analysis applications using ground penetrating radar, and first responder applications. Using systems of the present invention, functions such as mapping and/or localization, object detection, and imaging can be performed significantly more economically and efficiently.
The above description of various embodiments of the present invention is provided for purposes of description to one of ordinary skill in the related art. It is not intended to be exhaustive or to limit the invention to a single disclosed embodiment. As mentioned above, numerous alternatives and variations to the present invention will be apparent to those skilled in the art of the above teaching. Accordingly, while some alternative embodiments have been discussed specifically, other embodiments will be apparent or relatively easily developed by those of ordinary skill in the art. Accordingly, this patent specification is intended to embrace all alternatives, modifications and variations of the present invention that have been discussed herein, and other
embodiments that fall within the spirit and scope of the above described invention.
Limitations in the claims should be interpreted broadly based on the language used in the claims, and such limitations should not be limited to specific examples described herein. In this specification, the terminology "present invention" is used as a reference to one or more aspects within the present disclosure. The terminology "present invention" should not be improperly interpreted as an identification of critical elements, should not be improperly interpreted as applying to all aspects and embodiments, and should not be improperly interpreted as limiting the scope of the claims.

Claims

1. A three dimensional scanning beam system, comprising:
a ranging apparatus; and
a reactive linkage mechanism having a first end and a second end, wherein the first end is connected to the ranging apparatus and the second end is connected to an object that moves the system through an environment;
whereby in use acceleration of the object with respect to the environment is converted by the reactive linkage mechanism to motion of the ranging apparatus with respect to the object, which increases a field of view of the ranging apparatus with respect to the environment.
2. The system of claim 1 , further comprising an orientation sensor attached to the ranging apparatus.
3. The system of claim 1 , further comprising a computer system operatively coupled to the ranging apparatus, wherein the computer comprises a computer readable medium that stores program code components defining a registration algorithm, and wherein the registration algorithm processes data from the ranging apparatus to define a 3D point cloud of the environment.
4. The system of claim 1 , wherein the ranging apparatus comprises a laser.
5. The system of claim 4, wherein the laser comprises a two dimensional scanning beam laser.
6. The system of claim 3, wherein the 3D point cloud is defined in real time.
7. The system of claim 1 , wherein the ranging apparatus transmits and receives at least one of the following types of signals: light signals, acoustic signals, ultrasonic signals, radio frequency signals, gamma radiation signals, microwave signals.
8. The system of claim 1 , wherein the reactive linkage mechanism
comprises a spring.
9. The system of claim 2, wherein the orientation sensor comprises an inertial measurement unit (IMU).
10. The system of claim 1 , wherein a connection between the first end of the reactive linkage mechanism and the ranging apparatus is a fluidic coupling.
1 1 A method for obtaining a three dimensional scan of an environment, the method comprising:
connecting a ranging apparatus to a first end of a reactive linkage mechanism;
connecting a second end of the reactive linkage mechanism to an object; moving the object through the environment, whereby acceleration of the object is converted by the reactive linkage mechanism to motion of the ranging apparatus with respect to the object, which increases the field of view of the ranging apparatus with respect to the environment; and
obtaining data by the ranging apparatus that defines the three
dimensional scan of the environment.
12. The method of claim 11 , wherein an orientation sensor is attached to the ranging apparatus.
13. The method of claim 11 , further comprising:
operatively coupling a computer system to the ranging apparatus, wherein the computer system comprises a computer readable medium that stores program code components defining a registration algorithm; and
processing the data using the computer system, whereby the registration algorithm defines a 3D point cloud of the environment.
14. The method of claim 11 , wherein the ranging apparatus comprises a laser.
15. The method of claim 14, wherein the laser comprises a two dimensional scanning beam laser.
16. The method of claim 13, wherein the 3D point cloud is defined in real time.
17. The method of claim 11 , wherein the ranging apparatus transmits and receives at least one of the following types of signals: light signals, acoustic signals, ultrasonic signals, radio frequency signals, gamma radiation signals, microwave signals.
18. The method of claim 11 , wherein the reactive linkage mechanism comprises a spring.
19. The method of claim 12, wherein the orientation sensor comprises an inertial measurement unit (IMU).
20. The method of claim 11 , wherein the reactive linkage mechanism comprises a fluidic coupling.
PCT/AU2010/000939 2010-07-26 2010-07-26 Three dimensional scanning beam system and method WO2012012819A1 (en)

Priority Applications (9)

Application Number Priority Date Filing Date Title
PCT/AU2010/000939 WO2012012819A1 (en) 2010-07-26 2010-07-26 Three dimensional scanning beam system and method
EP10855130.0A EP2598964A4 (en) 2010-07-26 2010-07-26 Three dimensional scanning beam system and method
CN201080069024.2A CN103180794B (en) 2010-07-26 2010-07-26 Three dimensional scanning beam system and method
KR1020137004389A KR101698939B1 (en) 2010-07-26 2010-07-26 Three dimensional scanning beam system and method
JP2013520923A JP2013540985A (en) 2010-07-26 2010-07-26 Three-dimensional scanning beam system and method
AU2010358358A AU2010358358A1 (en) 2010-07-26 2010-07-26 Three dimensional scanning beam system and method
US13/811,982 US9146315B2 (en) 2010-07-26 2010-07-26 Three dimensional scanning beam system and method
ZA2013/00646A ZA201300646B (en) 2010-07-26 2013-01-24 Three dimensional scanning beam system and method
AU2016205004A AU2016205004B2 (en) 2010-07-26 2016-07-18 Three dimensional scanning beam system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/AU2010/000939 WO2012012819A1 (en) 2010-07-26 2010-07-26 Three dimensional scanning beam system and method

Publications (1)

Publication Number Publication Date
WO2012012819A1 true WO2012012819A1 (en) 2012-02-02

Family

ID=45529264

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU2010/000939 WO2012012819A1 (en) 2010-07-26 2010-07-26 Three dimensional scanning beam system and method

Country Status (8)

Country Link
US (1) US9146315B2 (en)
EP (1) EP2598964A4 (en)
JP (1) JP2013540985A (en)
KR (1) KR101698939B1 (en)
CN (1) CN103180794B (en)
AU (2) AU2010358358A1 (en)
WO (1) WO2012012819A1 (en)
ZA (1) ZA201300646B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013155564A1 (en) 2012-04-17 2013-10-24 Commonwealth Scientific And Industrial Research Organisation Three dimensional scanning beam and imaging system
JP2014055889A (en) * 2012-09-13 2014-03-27 Mitsubishi Electric Corp Wind measuring apparatus
CN107966702A (en) * 2017-11-21 2018-04-27 北京进化者机器人科技有限公司 The construction method and device of environmental map
CN109684267A (en) * 2016-11-03 2019-04-26 北京中科寒武纪科技有限公司 SLAM arithmetic unit and method
US10586385B2 (en) 2015-03-05 2020-03-10 Commonwealth Scientific And Industrial Research Organisation Structure modelling
US11288861B2 (en) 2019-12-20 2022-03-29 Zoox, Inc. Maps comprising covariances in multi-resolution voxels
US11430087B2 (en) 2019-12-20 2022-08-30 Zoox, Inc. Using maps comprising covariances in multi-resolution voxels

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130179119A1 (en) * 2011-12-21 2013-07-11 Robotics Paradigm Systems, LLC Data collection and point cloud generation system and method
US10481265B2 (en) * 2011-12-21 2019-11-19 Robotic paradigm Systems LLC Apparatus, systems and methods for point cloud generation and constantly tracking position
US9420265B2 (en) * 2012-06-29 2016-08-16 Mitsubishi Electric Research Laboratories, Inc. Tracking poses of 3D camera using points and planes
US9052721B1 (en) * 2012-08-28 2015-06-09 Google Inc. Method for correcting alignment of vehicle mounted laser scans with an elevation map for obstacle detection
US10185034B2 (en) * 2013-09-20 2019-01-22 Caterpillar Inc. Positioning system using radio frequency signals
JP2016085174A (en) * 2014-10-28 2016-05-19 株式会社日立産機システム Positioning signal transmitter for indoor positioning, and coordinate registration device of transmitter
KR102038965B1 (en) 2014-11-26 2019-10-31 삼성전자주식회사 Untrasound sensor and object detecting method thereof
KR20160084084A (en) * 2015-01-05 2016-07-13 한화테크윈 주식회사 Scanning radar apparatus
US9625582B2 (en) * 2015-03-25 2017-04-18 Google Inc. Vehicle with multiple light detection and ranging devices (LIDARs)
CN106249245B (en) * 2015-06-08 2021-03-09 江苏慧光电子科技有限公司 Laser ranging system and ranging method thereof
JP2016001182A (en) * 2015-07-21 2016-01-07 コモンウェルス サイエンティフィック アンド インダストリアル リサーチ オーガナイゼーション Three-dimensional scanning beam system and method
EP3332266A4 (en) * 2015-08-03 2019-04-17 Commonwealth Scientific and Industrial Research Organisation Monitoring systems and methods
CN106468542A (en) * 2015-08-22 2017-03-01 吴翔 A kind of employing CDMA and the 3-D scanning method of multi-antenna technology
CN106502241A (en) * 2015-09-07 2017-03-15 北醒(北京)光子科技有限公司 A kind of sweeping robot intelligent barrier avoiding and alignment system
US10220172B2 (en) 2015-11-25 2019-03-05 Resmed Limited Methods and systems for providing interface components for respiratory therapy
US10257505B2 (en) 2016-02-08 2019-04-09 Microsoft Technology Licensing, Llc Optimized object scanning using sensor fusion
US9855661B2 (en) 2016-03-29 2018-01-02 The Boeing Company Collision prevention in robotic manufacturing environments
CN105783798B (en) * 2016-05-04 2019-05-31 清华大学 Body structure surface DEFORMATION MONITORING SYSTEM and method
CN105973145B (en) * 2016-05-19 2021-02-05 深圳市速腾聚创科技有限公司 Mobile three-dimensional laser scanning system and mobile three-dimensional laser scanning method
WO2017204460A1 (en) * 2016-05-26 2017-11-30 (주) 정상라이다 Method and device for scanning particular area by means of optical module
AU2017294796B2 (en) 2016-07-15 2019-05-30 Fastbrick Ip Pty Ltd Brick/block laying machine incorporated in a vehicle
AU2017294795B2 (en) 2016-07-15 2019-06-13 Fastbrick Ip Pty Ltd Boom for material transport
US11314262B2 (en) 2016-08-29 2022-04-26 Trifo, Inc. Autonomous platform guidance systems with task planning and obstacle avoidance
US10534074B2 (en) * 2016-08-31 2020-01-14 Qualcomm Incorporated Hybrid scanning lidar systems
DE102016224764A1 (en) * 2016-12-13 2018-06-14 Robert Bosch Gmbh Method and device for operating a laser scanner and laser scanner
BR112019016646B1 (en) 2017-02-13 2023-10-17 Vale S.A. MULTI-GROUND ROBOTIC INSPECTION DEVICE AND METHOD FOR GUIDING THE MULTI-GROUND ROBOTIC INSPECTION DEVICE
US10282860B2 (en) * 2017-05-22 2019-05-07 Honda Motor Co., Ltd. Monocular localization in urban environments using road markings
US10444761B2 (en) * 2017-06-14 2019-10-15 Trifo, Inc. Monocular modes for autonomous platform guidance systems with auxiliary sensors
EP3649616A4 (en) 2017-07-05 2021-04-07 Fastbrick IP Pty Ltd Real time position and orientation tracker
WO2019032588A1 (en) * 2017-08-11 2019-02-14 Zoox, Inc. Vehicle sensor calibration and localization
US10983199B2 (en) 2017-08-11 2021-04-20 Zoox, Inc. Vehicle sensor calibration and localization
US11175132B2 (en) 2017-08-11 2021-11-16 Zoox, Inc. Sensor perturbation
CN111226090B (en) 2017-08-17 2023-05-23 快砖知识产权私人有限公司 Laser tracker with improved roll angle measurement
CN111246976B (en) 2017-08-17 2024-03-15 快砖知识产权私人有限公司 Interactive system configuration
WO2019071313A1 (en) 2017-10-11 2019-04-18 Fastbrick Ip Pty Ltd Machine for conveying objects and multi-bay carousel for use therewith
CN107765263A (en) * 2017-10-30 2018-03-06 武汉海达数云技术有限公司 Laser scanning device and traverse measurement system
US10825241B2 (en) 2018-03-16 2020-11-03 Microsoft Technology Licensing, Llc Using a one-dimensional ray sensor to map an environment
CN109559338B (en) * 2018-11-20 2020-10-27 西安交通大学 Three-dimensional point cloud registration method based on weighted principal component analysis method and M estimation
WO2020112469A1 (en) * 2018-11-30 2020-06-04 Corning Incorporated Batch mixtures containing pre-reacted inorganic particles and methods of manufacture of ceramic bodies therefrom
US11774983B1 (en) 2019-01-02 2023-10-03 Trifo, Inc. Autonomous platform guidance systems with unknown environment mapping

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6862084B2 (en) * 2002-09-09 2005-03-01 Fuji Photo Optical Co., Ltd. Laser range finder
EP2199828A2 (en) * 2008-11-26 2010-06-23 Riegl Lasermeasurement Systems GmbH Method for determining the position of a laser scanner relative to a reference system

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NO167334C (en) * 1989-06-22 1991-10-23 Tomra Systems As PROCEDURE AND APPARATUS FOR DIMENSION MEASUREMENT.
DE4016973C1 (en) * 1990-02-24 1991-06-13 Eltro Gmbh, Gesellschaft Fuer Strahlungstechnik, 6900 Heidelberg, De
CN2080164U (en) * 1990-11-10 1991-07-03 第一汽车制造厂车身装备厂 Laser contactless scanning detecting head
JPH04201697A (en) * 1990-11-30 1992-07-22 Mitsubishi Heavy Ind Ltd Sloshing damping device in liquid fuel rocket propellant tank
JPH06278555A (en) * 1993-03-26 1994-10-04 Mazda Motor Corp Outside detecting device for vehicle
JPH08123206A (en) 1994-10-19 1996-05-17 Ricoh Co Ltd Liquid developing device
AUPQ181699A0 (en) 1999-07-23 1999-08-19 Cmte Development Limited A system for relative vehicle navigation
JP4200649B2 (en) 2000-10-06 2008-12-24 株式会社明電舎 Automatic guided vehicle position detection device
JP3949098B2 (en) * 2003-10-27 2007-07-25 日本発条株式会社 Angle detection device and scan type actuator using the same
JP2006030147A (en) * 2004-07-22 2006-02-02 Hitachi Ltd Environment recognizing system and moving mechanism
JP2006119420A (en) * 2004-10-22 2006-05-11 Denso Corp Optical scanner
JP4251206B2 (en) * 2006-09-20 2009-04-08 セイコーエプソン株式会社 Actuator, optical scanner and image forming apparatus
JP2010510559A (en) * 2006-10-30 2010-04-02 テレ アトラス ベスローテン フエンノートシャップ Method and apparatus for detecting an object from ground mobile mapping data
WO2010032495A1 (en) * 2008-09-16 2010-03-25 株式会社アドイン研究所 Tree information measuring method, tree information measuring device, and program
JP2011186422A (en) * 2010-02-10 2011-09-22 Sanyo Electric Co Ltd Beam irradiation device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6862084B2 (en) * 2002-09-09 2005-03-01 Fuji Photo Optical Co., Ltd. Laser range finder
EP2199828A2 (en) * 2008-11-26 2010-06-23 Riegl Lasermeasurement Systems GmbH Method for determining the position of a laser scanner relative to a reference system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
RAYMOND SHEH ET AL.: "A Low-Cost, Compact, Lightweight 3D Range Sensor", PROC: 2006 AUSTRALASIAN CONFERENCE ON ROBOTICS AND AUTOMATION, 1 June 2006 (2006-06-01)
See also references of EP2598964A4

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9835717B2 (en) 2012-04-17 2017-12-05 Commonwealth Scientific And Industrial Research Organisation Three dimensional scanning beam and imaging system
CN104380133B (en) * 2012-04-17 2018-01-16 联邦科学和工业研究组织 3-D scanning beam and imaging system
CN104380133A (en) * 2012-04-17 2015-02-25 联邦科学和工业研究组织 Three dimensional scanning beam and imaging system
JP2015518566A (en) * 2012-04-17 2015-07-02 コモンウェルス サイエンティフィック アンド インダストリアル リサーチ オーガナイゼーション 3D scanning beam and imaging system
EP2839313A4 (en) * 2012-04-17 2015-12-23 Commw Scient Ind Res Org Three dimensional scanning beam and imaging system
AU2013248937B2 (en) * 2012-04-17 2016-10-06 Commonwealth Scientific And Industrial Research Organisation Three dimensional scanning beam and imaging system
WO2013155564A1 (en) 2012-04-17 2013-10-24 Commonwealth Scientific And Industrial Research Organisation Three dimensional scanning beam and imaging system
JP2014055889A (en) * 2012-09-13 2014-03-27 Mitsubishi Electric Corp Wind measuring apparatus
US10586385B2 (en) 2015-03-05 2020-03-10 Commonwealth Scientific And Industrial Research Organisation Structure modelling
CN109697184A (en) * 2016-11-03 2019-04-30 北京中科寒武纪科技有限公司 SLAM arithmetic unit and method
CN109684267A (en) * 2016-11-03 2019-04-26 北京中科寒武纪科技有限公司 SLAM arithmetic unit and method
CN107966702B (en) * 2017-11-21 2019-12-13 北京进化者机器人科技有限公司 construction method and device of environment map
CN107966702A (en) * 2017-11-21 2018-04-27 北京进化者机器人科技有限公司 The construction method and device of environmental map
US11288861B2 (en) 2019-12-20 2022-03-29 Zoox, Inc. Maps comprising covariances in multi-resolution voxels
US11430087B2 (en) 2019-12-20 2022-08-30 Zoox, Inc. Using maps comprising covariances in multi-resolution voxels

Also Published As

Publication number Publication date
AU2016205004A1 (en) 2016-08-04
AU2010358358A1 (en) 2013-02-14
CN103180794B (en) 2017-02-15
EP2598964A4 (en) 2016-08-03
EP2598964A1 (en) 2013-06-05
JP2013540985A (en) 2013-11-07
AU2016205004B2 (en) 2018-01-18
US9146315B2 (en) 2015-09-29
KR101698939B1 (en) 2017-01-23
ZA201300646B (en) 2013-09-25
US20130120736A1 (en) 2013-05-16
KR20130037722A (en) 2013-04-16
CN103180794A (en) 2013-06-26

Similar Documents

Publication Publication Date Title
AU2016205004B2 (en) Three dimensional scanning beam system and method
AU2013248937B2 (en) Three dimensional scanning beam and imaging system
Geneva et al. Lips: Lidar-inertial 3d plane slam
EP2718668B1 (en) Sensor positioning for 3d scanning
Schneider et al. Fast and effective online pose estimation and mapping for UAVs
CN104833354A (en) Multibasic multi-module network integration indoor personnel navigation positioning system and implementation method thereof
KR101715780B1 (en) Voxel Map generator And Method Thereof
CA2988326C (en) Automated mobile geotechnical mapping
Karam et al. Integrating a low-cost mems imu into a laser-based slam for indoor mobile mapping
Klingbeil et al. Towards autonomous navigation of an UAV-based mobile mapping system
Kaijaluoto Precise indoor localization for mobile laser scanner
JP2015227878A (en) Three-dimensional scanning beam system and method
JP2015206796A (en) Three dimensional scanning beam system and method
CN111679663A (en) Three-dimensional map construction method, sweeping robot and electronic equipment
Pugliese et al. LiDAR-aided relative and absolute localization for automated UAV-based inspection of aircraft fuselages
JP2017021035A (en) Three-dimensional scanning beam system and method
JP2016001182A (en) Three-dimensional scanning beam system and method
Grönwall et al. Two imaging systems for positioning and navigation
JP7125927B2 (en) Information terminal device, method and program
Taylor et al. Parameterless automatic extrinsic calibration of vehicle mounted lidar-camera systems
Wülfing et al. Towards real time robot 6d localization in a polygonal indoor map based on 3d tof camera data
Autera Study and development of calibration algorithms of multi-camera systems for precision agriculture robotics
Valdez-Rodríguez et al. Visual-Inertial Navigation Systems and Technologies
Chen Graphical SLAM for urban UAV navigation
Grzonka et al. Towards a fully autonomous indoor helicopter

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10855130

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2010855130

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 13811982

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2013520923

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2010358358

Country of ref document: AU

Date of ref document: 20100726

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 20137004389

Country of ref document: KR

Kind code of ref document: A