WO2013188598A2 - Fusion de données de capteurs et de cartes au moyen d'une optimisation basée sur une contrainte - Google Patents
Fusion de données de capteurs et de cartes au moyen d'une optimisation basée sur une contrainte Download PDFInfo
- Publication number
- WO2013188598A2 WO2013188598A2 PCT/US2013/045522 US2013045522W WO2013188598A2 WO 2013188598 A2 WO2013188598 A2 WO 2013188598A2 US 2013045522 W US2013045522 W US 2013045522W WO 2013188598 A2 WO2013188598 A2 WO 2013188598A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sensor
- data
- convex
- computing system
- constraint
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
- G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
- G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
- G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
- G01C21/165—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
- G01C21/1652—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments with ranging devices, e.g. LIDAR or RADAR
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
- G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
- G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
- G01C21/165—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
- G01C21/1654—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments with electromagnetic compass
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/20—Instruments for performing navigational calculations
- G01C21/206—Instruments for performing navigational calculations specially adapted for indoor navigation
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/01—Determining conditions which influence positioning, e.g. radio environment, state of motion or energy consumption
- G01S5/013—Identifying areas in a building
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/02—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
- G01S5/0257—Hybrid positioning
- G01S5/0263—Hybrid positioning by combining or switching between positions derived from two or more separate positioning systems
- G01S5/0264—Hybrid positioning by combining or switching between positions derived from two or more separate positioning systems at least one of the systems being a non-radio wave positioning system
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W64/00—Locating users or terminals or network equipment for network management purposes, e.g. mobility management
Definitions
- the technical field generally relates to a system and method for locating, tracking, and/or monitoring the status of personnel or assets, both indoors and outdoors.
- the user track and map information that is acquired by use of multiple sensors, is combined so that the map information can compensate for dead reckoning, e.g., inertial drift
- Detected map features and ranges can feed into simultaneous localization and mapping (SLAM) algorithms which provide corrections based on the information.
- SLAM algorithms are typically implemented using a version of Bayes filter such as a Kalman Filter.
- a computer-implemented method may include obtaining tracking data for a tracked subject, the tracking data including data from a dead reckoning sensor; obtaining constraint data for the tracked subject; and using a convex optimization method based on the tracking data and the constraint data to obtain a navigation solution.
- a computing system used to track a trackee may include a dead reckoning sensor, a processor in communication with the dead reckoning sensor, and a memory coupled to the processor, the memory having stored thereon executable instructions that when executed by the processor cause the processor to effectuate operations.
- the operations effectuated may include obtaining tracking data for a tracked subject, the tracking data including data from the dead reckoning sensor, obtaining constraint data for the tracked subject, and using a convex optimization method based on the tracking data and the constraint data to obtain a navigation solution.
- FIG. 1 is an exemplary illustration of a series of poses from the dead reckoning path with features and constraints linked to poses;
- FIG. 2 is an embodiment of a feature match corrected path of FIG. 1;
- FIG. 3 is an exemplary block diagram illustrating how convex SLAM may be used in the context of tracking a device
- FIG. 4 is an exemplary method for acquiring a navigation solution or enforcing constraints in Convex SLAM;
- FIG. 5 illustrates an error bound from a constraint, for example range or location, and that has been propagated by a motion velocity model
- FIG. 6 illustrates an error bounds propagated by a velocity model and propagated using path based bounds on heading and scale
- FIG. 7 illustrates the minimized error bound of a velocity error bound propagation and a path error bound propagation
- FIG. 8 is an exemplary illustration of a user with a tracking device as shown on a building floor plan
- FIG. 9 is an exemplary illustration of error propagation bounded by a building outline.
- FIG. 10 is an exemplary illustration of error propagation bounded by walls
- FIG. 1 1 shows an exemplary shape of the convex cost function where the cost is defined to be zero if the constraint is satisfied and can grow outside of that region;
- FIG. 12 is an exemplary block diagram representing a general purpose computer system in which aspects of the methods and systems disclosed herein or portions thereof may be incorporated.
- Inertial and other dead reckoning sensors are subject to drift and other errors and these are accounted for in the design and operation of navigation methods.
- a significant problem associated with derived relative motion information, which uses a dead reckoning process, is that it is subject to cumulative error.
- a tracking system relying on dead reckoning alone may have a continuous decrease in accuracy. Therefore, derived relative motion information may not be trustworthy over long periods of time. While improvements to sensor quality may help, even high quality sensors have limitations in long duration tracking. Methods for error reduction over relatively longer periods are disclosed.
- Magnetic sensors for example, are commonly used to aid inertial dead reckoning systems to improve heading.
- indoor environments and other environments where magnetic heading information is unreliable present a problem.
- aiding sensors have been considered including ranging (e.g., radio frequency (RF), acoustic, and LIDAR), optical, and inertial based feature based mapping systems, among other things.
- ranging e.g., radio frequency (RF), acoustic, and LIDAR
- optical e.g., optical
- inertial based feature based mapping systems e.g., inertial based feature based mapping systems.
- the benefit of the aforementioned aiding sensors is that their 3059655vl - 3 - information is stationary over time.
- Feature based systems may suffer from the perceptual aliasing problem, e.g., for a given sensor system, two distinct places (features/landmarks) in the environment may appear the same.
- the user track and map information is combined so that the map information can compensate for dead reckoning systems error accumulation while user motion/track information from the dead reckoning system can allow perceptually aliased feature information to be disambiguated.
- All of the detected map features and ranges can feed into simultaneous localization and mapping (SLAM) algorithms which provide corrections based on the information.
- SLAM simultaneous localization and mapping
- An unbiased map is needed for localization while an accurate pose estimate is needed to build that map. If at the next iteration of map building the measured distance and direction traveled has a budget of inaccuracies, driven by limited inherent precision of the dead reckoning sensors and additional ambient noise, then any features being added to the map will contain corresponding errors. Over time and motion, locating and mapping errors build cumulatively, grossly distorting the map.
- the solution to the SLAM problem requires the development of a way to update the uncertain geometric or topological environment model based on new observations that maintained consistent interpretation of relations between all of the uncertain features.
- the SLAM problem is typically solved using a Bayes filter implementation in a standard recursive two-step time-update (prediction), measurement-update form.
- the derivation of this and similarly many other recursive state estimation filters rely on the Markov assumption, which postulates that past and future data are independent given the current state.
- approximations are often made to control computational complexity, e.g. linearity of the state dynamics, Gaussian noise, etc.
- the resulting model inaccuracies may induce violations of the Markov assumption leading to a non- optimal solution.
- a Kalman filter and extended Kalman filters are special cases of a Bayesian filter.
- standard implementations often have fixed state vectors which limit the ability to add or drop sensors. They also have significant performance issues with respect to noise model mismatch. Many standard implementations are unable to handle non- Gaussian statistics or nonlinear measurement models in a near real time system.
- ranging sensors have non-Gaussian noise in indoor environments where they experience significant multipath and are often in non-line of sight conditions.
- Optical feature detection and ranging systems have error characteristics which vary nonlinearly as a function of distance.
- the aforementioned issues may be addressed by formulating the location and mapping problem as a constraint based convex optimization problem in which the feature locations and ranges place distance constraints on the path solution.
- the general approach in convex optimization is to define a convex objective function (i.e., cost) and to minimize the function while enforcing the associated constraints on the function variables.
- Convex optimization may include efficient methods to solve for the variables and the solution it yields is optimal with respect to the chosen objective function (i.e., cost).
- Sensor ranging data and location data may be handled as constraints on the subject's track.
- a ranging sensor provides a range to a known or estimated location and constrains the path to be within the provided range of the
- FIG. 2 is an exemplary illustration of a corrected path for FIG. 1. Examples of latency include latency communicating with a remote processor, local processing delay (which could be elective due to limited computing resources) or latency due to incomplete information.
- tracked subject A may get a range to tracked subject B, whose geo-referenced location is unknown when the range is taken; tracked subject B may later obtain data that allows them to accurately geo-reference their location and that new information can be used to determine where B was when they ranged to A. Providing this updated information to tracked subject A, even with the delay, may allow them to correct their historical path.
- Maintaining the entire path history instead of only the most recent pose has several benefits including providing a directed approach for actively correcting the map and the entire path history when corrections are indicated, for example when a feature is revisited. It also has the benefit of enabling recovery from erroneous corrections.
- a SLAM method (for reference purposes, hereinafter “convex SLAM”) has been created to handle pedestrian navigation. Though this SLAM method is also applicable to other platforms such as vehicles; in vehicle problems known dynamic models and control inputs are the norm and Bayesian Filtering methods have computationally efficient mechanism for including this prior known information into the estimate in the prediction step which is why they tend to be favored.
- FIG. 3 is an exemplary block diagram illustrating how convex SLAM may be used in the context of tracking a device (a trackee).
- appropriate local sensors for example: accelerometer, gyroscope, GPS receiver, magnetic field sensor, barometric pressure sensor, or ranging sensors
- sensor data is received and processed.
- features are detected (for example, inertial sensors could detect a stairwell or elevator) and constraints are resolved. With regard to resolved constraints, the bounds in which the path must lie are determined based on, for example, RF ranges, discovered features. Propagation of prior constraints based on motion models and limits to error propagation such as building information could also be completed. Also the convex cost functions are set up.
- the navigation solution is updated. This could be done using convex optimization (FIG. 4 breaks this out in more detail, the optimization steps 415 and 420 may include several iterations) or by simply appending a corrected inertial path based on parameters from a prior iteration of the solution.
- Block 305, 310, and 315 usually happen in real-time, which is why a fast inertial update may be considered if there is a lot of data to process. These blocks may process all of the path or only a small portion of the historical path in order to conserve computational resources. If only a portion of the path is processed, some state information may be preserved to maintain the continuity of the prior solution knowledge.
- the path state herein, the pose information (location and orientation), error bound of the break point and constraints on heading, drift, drift bounds, scale and scale bounds from prior computations (e.g. from block 320).
- the portion of the path to process can be determined, for example, based on a fixed processing time interval (e.g., 20 minutes), or adaptively, for example based on path or location confidence. It may be desirable, for example, to elect to break the path to save computation.
- the path may be broken if there is a very good location/path estimate and it provides tight constraints on the path state. At such time, accurately located features may be stored in a global map where these features may not be tied to a user path since the location error is small.
- the path may also be broken if the dead reckoning path confidence is very low for a period. At such time, the path may be broken and the system may attempt to globally reinitialize using other sensor data. For example, a trackee gets into a car and a pedometer system stops tracking, with GPS being used to track the user in the interim, and the system reinitializing the dead reckoning path when the trackee gets out of the car.
- Block 320 may process quality historical feature data and other appropriate information that may be based on data from this tracking device or other tracking devices that have traversed the same path. For example, a stairwell previously visited by this tracking device or other tracking devices may be determined to match the stairwell the trackee is currently in, then prior information on the stairwell may be used. When quality historical features are returned, constraints are added that connect the new feature location to the prior feature location. The portion of the path processed by these blocks is determined by the time interval since the feature was last seen. Block 320 runs navigation methods detailed in FIG. 4. As shown in FIG. 3 by line 322, Block 320 may send last pose, plus updated offset, rotation, scale, and drift parameters to Block 310. In an embodiment, Block 310 may apply it to the inertial path or to initialize optimization when a new constraint is processed. The constraint based optimization enforces the feature match and the intermediate path is corrected, an example is shown in FIG. 1 compared to FIG. 2.
- Block 315 may pass along updated navigation information, which may include pose or feature data (and the pose information (location and orientation), error bound of the first point and constraints on heading, drift, drift bounds, scale and scale bounds from prior computations) to block 320 (convex SLAM) for further processing.
- Block 320 may receive information from 315, historical data from previous processing that was stored in pose and feature storage 325, and historical data associated with other tracking devices from a global coordinate manager 340.
- Block 325 contains updated path (pose information) and related features.
- the loop-closing detector 330 applies confidence/quality requirements before information is passed back to block 320 from the feature storage block 325. At block 320, the information may be processed in near real time.
- the global coordinate manager manages the disbursement of updated or corrected navigation information to the convex SLAM algorithm at block 320, and to or from other tracking devices which may communicate via network 335.
- Network 335 may be a wireless network and include a mesh network.
- FIG. 1 is an exemplary illustration of an overview of how sensor data may be processed when using a convex SLAM method during tracking.
- block 305, block 310, and block 315 are usually the real-time operations.
- the sensor data processing and feature detection may be embedded code on the sensor platform, which could be for example, a purpose built worn tracking unit or a cell phone with embedded navigation sensors.
- the navigation algorithms receive sensor data and features and provide an update in real time.
- Map management and sharing of best quality features with other tracked subjects for sharing and asynchronously updating the global map
- loop closure e.g., block 330
- the loop-closing detector 330 and Global Coordinate manager 340 may have different confidence/quality requirements (likely the Global Coordinate manager 340 will have tighter requirements because trackee to trackee variation can cause matching errors whereas a single trackee path is more likely to have for example, consistent scale which helps when
- FIG. 4 is an exemplary method 400 for acquiring a navigation solution (e.g., block 315) or enforcing the constraints in Convex SLAM (e.g., block 320) .
- An overview of the method that may be used in solving for the navigation solution may include dead reckoning path acquisition at 405, parameter initialization at block 410, global optimization at block 415, local optimization at block 420, and ending with the final a navigation solution at block 425.
- the 3059655vl - 8 - method 400 shows a simplified structure and may have more complexity in the individual blocks, for example initialization step may include determining certain parameter bounds before global optimization to minimize computational cost.
- Prior constraints may be propagated based on motion models (for example, human max velocity) and propagation may be limited based on for example, building constraint information. Before any step a method may be used to eliminate constraints for example, because they are outliers or simply to reduce computation when there are many constraints.
- motion models for example, human max velocity
- propagation may be limited based on for example, building constraint information.
- a method may be used to eliminate constraints for example, because they are outliers or simply to reduce computation when there are many constraints.
- a dead reckoning path may be created from any of a variety of methods, for example, inertial, optic flow, Doppler velocimeter, or some combination of these.
- a pedometer based method is used for computation of an inertial path.
- a compass may be found to be reliable when it provides heading changes that match the rate information returned from a gyro. After the compass is found reliable it can be used to place bounds on the possible headings and to provide an initial drift estimate.
- New constraints based on for example, RF ranges, or discovered features are resolved to define the bounds in which the path must lie and the costs for violating those bounds, prior constraints are propagated based on motion models and the propagation is limited based on for example, information on a building outline or internal structure such as walls.
- Ranging and other path constraints may also be used to place bounds on heading and scaling. For example, a series of GPS constraints along a portion of a path (where the error bound received along with the GPS constraint is within a threshold level) may be used to bound the scale and the heading. Parameters obtained from prior iterations of this algorithm may be used as the initialization point when a new constraint is added.
- an inertial path is allowed to stretch or shrink in length between points with the cost increasing as a function of the change in length (linear spring constant) enforcing the goal of maintaining the length as close as possible to the original length.
- the angles between path points are tightly maintained (very high torsional spring constant). This restriction is based on the knowledge that the gyro heading is has low error over the short term so these heading angles should be essentially correct and therefore not distorted.
- the local optimization can be terminated when the constraints are all solved or when it reaches a limit on the number of iterations.
- a median (or other) filter may be used for removal of the outliers caused by sensor errors. If x is the amount by which the constraint is not satisfied, the median absolute deviation (MAD) is defined as the median of the absolute deviations from the median:
- MAD(X) median x-
- the median and MAD are typically not affected by outliers unless more than 50% of the data are outliers, whereas the mean and standard deviation may be affected by a single outlier.
- the filter excludes features outside some fixed number of MADs from the median. Theoretically, with any nicely distributed data, a single MAD away from the median in either direction will bound 50% of the data. With a Gaussian distribution, two MADs will bound about 82% of the data. Three MADs are nearly equivalent to two standard deviations under a Gaussian distribution, bounding about 95% of the data. In this embodiment, points within 1 MAD are considered.
- Ranging, GPS, given and discovered map features e.g. stairwells, elevators, and hallway intersections
- user corrections, check-ins, and other sensor and map information all place constraints on the path that are defined by a circle or polygon.
- the center of the circle or polygon is at the estimated location of the feature, range origin, or the like and has a radius defined by the error bound.
- Other map features such as hallways and walls provide a bound on the propagation of constraints over time that is described in more detail below.
- the error circles from various sensors may be combined to form polygons. This geometric representation allows intersections to be efficiently computed.
- the bounds created are a mechanism for constraining location error. This error bound may be combined with inertial path data to constrain the path.
- the estimated or known location of the ranging source defines the circle center and the constraint is obtained by adding the uncertainty in the location to the received range measurement.
- ranging measurements are greater than the actual measurement and not less. This is not true for all ranging sensors.
- GPS error bounds reported by sensors typically give an error standard deviation measure that indicates 67% of the time, it is expected that a tracked device is within the error bound relative to the reported location.
- Systems may also report a circular error probable (CEP) which gives a bound for only 50% of the time.
- CEP circular error probable
- three times the error bound may be used, which relies on the three-sigma rule which states that nearly all values lie within 3 standard deviations of the mean in a Gaussian distributed data set. GPS does not have a
- constraints may have error bounds defined by a user when the check-in are created.
- the constraint error bounds may be defined automatically based on the zoom level of the map in order to make corrections when the location of the user is indicated (e.g., selected on a map).
- the error bound may be defined by the size of the building feature and the accuracy with which the building feature location is known. If the building feature is discovered by the navigation system, then the error bound is a function of a location estimate of the person at the time the building feature was discovered.
- Error bounds may be propagated based on a model of human motion. For example, computing the maximum distance a user could have traveled since the range was received based on the assumption of a maximum velocity could be used to propagate the error bound in all directions.
- Another possible method would include combining human motion model with measured sensor data, for example, using a combination of the time elapsed assuming a maximum velocity and the computed distance traversed based on the inertial sensors. This bound would take into account the heading and scaling bounds similar to what is shown in FIG. 5. For example, in FIG. 3059655vl - 11 - 5, a tracked device may have an estimated initial point at circle 505 with an estimated velocity error bound by circle 510. In FIG. 6, additional information regarding the estimated inertial path error bound by shape 515. In FIG. 7, considering velocity error bound by circle 510 and inertial path bound by shape 515, the minimized error for the location of the tracked device is bound by shape 520.
- FIG. 8 is an exemplary illustration of a user with a tracked mobile device and an associated building floor plan.
- a tracked mobile device carried by a user has an estimated location of 805 and error circle of 810.
- the error circle 810 stretches beyond the indoor walls and the outline wall 812 that marks the outside of building 800.
- a tracked mobile device carried by a user has an estimated location of 905 and error boundary of 910.
- the error boundary 910 stretches beyond the indoor walls, but does not stretch beyond the outline wall 912 that marks the outside of building 900.
- step 415 of FIG 4 the constraints must be convex.
- the constraints By computing a convex hull, it is possible to use the building constraints to obtain a more precise bound, but the solution may not respect the walls that fall within the convex hull of the propagated bounds.
- step 420 of FIG 4 convex polygons are not required, so the local optimization will correct the solution to remain in the bounds.
- a tracked mobile device carried by a user has an estimated location of 1005 and shaded error boundary of 1010.
- the error boundary 1010 does not stretch beyond the outline wall 1012 that marks the outside of building 1000.
- the error boundary 1010 does not stretch over or through the indoor walls 1014, 1016, and 1018.
- a building can be a relatively large area, but using walls to restrict the propagation, forces a more complex representation of error bounds.
- the constraints must be convex.
- step 420 of FIG 4 convex polygons are not required so the local
- the proposed approach for bounding error by walls and using a convex hull allows new information to be ingested by a navigation system. While the necessary propagation may be performed directly on raster floor-plan images, such partial flood filling operation may not be performed efficiently.
- a more efficient mechanism for propagating the bounds may include a geometric representation of the building structure.
- the walls of the building may be represented as line segments and the intersections. Because the walls are uniformly presented as segments we are able to stored them in a standard linked data structure in a way that allows for quick traversal between edges and vertices due to the explicitly linked structure of the data storage.
- a range is defined as Center, Radius, Propagated Radius (C, R, PR), where the ranges are propagated similarly as discussed herein.
- the global optimization method includes computing the distance between dead reckoning path point and constraint for each point/constraint pair.
- the cost function is defined to 3059655vl - 13 - be zero when the constraints are met, and grow as a function of the distance from the constraint, in the embodiment described herein, distance squared is used.
- FIG. 11 shows an exemplary shape of the convex cost function where the cost is defined to be zero if the constraint is satisfied and can grow outside of that region.
- the optimization may be solved using an adaptive gradient descent method until the cost is zero, stops decreasing, or a max number of iterations have been completed.
- the parameters may be solved all at once or in a particular order, for example 1 - translation, 2 - rotation; and 3 - scale.
- each time cost is non-zero
- a derivative is computed with respect to each of four parameters: x translation, y translation, rotation, and scale.
- 2-D (x,y) offset can be solved and the elevation (z) offset may be solved for separately. Solving for the 3-D offset would be an extension of this method. See below for details of the 2-D derivations.
- Each parameter may be updated by weighted sum over all constraints of the derivatives for the respective parameter.
- the weights may reflect the adaptive step scale value or a confidence or priority measure on the constraint. For example, constraints created by GPS measurements may have a different weighting than user corrections.
- the derivatives calculation can be repeated until cost is zero, cost stops decreasing, or 1000 iterations, for example.
- the drift is a nonlinear parameter.
- the heading drift if stated typically in degrees (or radians) per second.
- the drift may be applied (or removed) from path data by rotating the path over each time step by the drift over that time step.
- the optimal drift is selected by computing the cost for a fixed number of drift values within the drift bounds set in the parameter initialization step. The minimum across these computed drift values is selected. If two drift values have the same cost, the drift with the least magnitude is selected. In this embodiment, 51 was selected as the fixed number of drift values to generally give adequate heading refinement from the compass initialized drift value which can be very noisy in buildings.
- Multiple methods may be created to eliminate constraints that do not provide information or provide marginal information. In an embodiment, this can be done by eliminating constraints that do not contribute to the final error bound polygon at a particular point. For example, if there 3059655vl - 15 - is a constraint of 1 meter from a ranging anchor and a GPS constraint of 10 meters at the same point, the GPS constraint becomes irrelevant. In another example, you may receive a GPS constraint once per second outside. If GPS is good, e.g., as it should be in a field, then you could walk the length of the field receiving a 2 meter constraint every second. Assuming the inertial path is good (you are not missing steps.), it is likely "good enough" to have a constraint at each end of the field. It is not necessary to keep using all the constraints, but just the first and last as the tracked subject moved along.
- a tracking device may include a ranging sensor.
- RF ranging sensors have highly non-Gaussian properties in harsh multipath environments which frustrates integration into filters that have Gaussian assumptions on error distributions.
- the constraint based optimization solution described herein does not make assumptions on the expected error distribution of the sensors. Instead it uses ranging sensors to impose constraints on the tracked subject's trajectory. Ranging constraints from single or multiple sources may provide frequent input to limit the solution space. Even tracking devices that are close together may receive varying ranging measurements due to multipath and signal blockage from others in the vicinity, the body of the person using the tracking device, or other carried equipment. This type of ranging error may be difficult to predict.
- the disclosed constraint based optimization solution is able to support collaborative navigation based on real-time ranging corrections (person to person, person to anchor/base station) using embedded chirp spread spectrum time of flight ranging (e.g., short range of approximately 50 meters) to significantly improve tracking performance.
- Ranging to fixed anchors and person to person i.e., tracking device to tracking device
- Person to person ranges provide continuous navigation corrections to keep team members together and improve the overall navigation solution and provide relative (person to person) location accuracy that usually does not degrades over time.
- a test course was traversed in a multi-story office building of steel and concrete construction with the system discovering map features as users walked, rode elevators, and traversed stairs— with no assistance from preinstalled infrastructure. Over several trials the tracked locations were on average accurate to within 3.5 meters throughout the entire course. The path, track, and elevation provided location information for personnel being tracked, and the system visually showed the location and tracked in 3 dimensional space.
- a mesh communications network 3059655vl - 16 - was set up using radios at multiple points.
- Navigation system initialization was performed automatically using a combination of GPS, which was available outside of the structure and ranging anchors, which where were placed at three known locations outside. Ranging anchors were "dropped" as part of the mission scenario at each of three key network points. The locations of interior points were unknown to the navigation system so the dropped ranging anchor locations were estimated by the navigation system.
- the techniques described above can be implemented on a computing device associated with a user (e.g., gyroscope and accelerometer sensors implemented on a device worn by the user), a plurality of computing devices associated with a plurality of users, a server in communication with the computing device(s) (e.g., a server configured to calibrate the gyroscope and accelerometer sensors of the device worn by the user), or a plurality of servers in
- FIG. 12 illustrates an exemplary block diagram of a computing system that includes hardware modules, software module, and a combination thereof and that can be implemented as the computing device and/or as the server.
- the computing system may include at least a processor, a system memory, a storage device, input/output peripherals, communication peripherals, and an interface bus.
- the interface bus is configured to communicate, transmit, and transfer data, controls, and commands between the various components of the electronic device.
- the system memory and the storage device comprise computer readable storage media, such as RAM, ROM, EEPROM, hard-drives, CD-ROMs, optical storage devices, magnetic storage devices, flash memory, and other tangible storage media. Any of such computer readable storage medium can be configured to store instructions or program codes embodying aspects of the disclosure.
- system memory comprises an operation system and applications.
- the processor is configured to execute the stored instructions and can comprise, for example, a logical processing unit, a microprocessor, a digital signal processor, and the like.
- the system memory and the storage device may also comprise computer readable signal media.
- a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein. Such a propagated signal may 3059655vl - 17 - take any of variety of forms including, but not limited to, electro-magnetic, optical, or any combination thereof.
- a computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use in connection with the computing system.
- the input and output peripherals include user interfaces such as a keyboard, screen, microphone, speaker, other input/output devices, and computing components such as digital-to-analog and analog-to-digital converters, graphical processing units, serial ports, parallel ports, and universal serial bus.
- the input/output peripherals may be connected to the processor through any of the ports coupled to the interface bus.
- the user interfaces can be configured to allow a user of the computing system to interact with the computing system.
- the computing system may include instructions that, when executed, cause the computing system to generate a user interface that the user can use to provide input to the computing system and to receive an output from the computing system.
- This user interface may be in the form of a graphical user interface that is rendered at the screen and that is coupled with audio transmitted on the speaker and microphone and input received at the keyboard.
- the user interface can be locally generated at the computing system.
- the user interface may be hosted on a remote computing system and rendered at the computing system.
- the server may generate the user interface and may transmit information related thereto to the computing device that, in turn, renders the user interface to the user.
- the computing device may, for example, execute a browser or an application that exposes an application program interface (API) at the server to access the user interface hosted on the server.
- API application program interface
- the communication peripherals of the computing system are configured to facilitate communication between the computing system and other computing systems (e.g., between the computing device and the server) over a communications network.
- communication peripherals include, for example, a network interface controller, modem, various modulators/demodulators and encoders/decoders, wireless and wired interface cards, antenna, and the like.
- the communication network includes a network of any type that is suitable for providing communications between the computing device and the server and may comprise a combination of discrete networks which may use different technologies.
- the communications network includes a cellular network, a WiFi/ broadband network, a local area network (LAN), a wide area network (WAN), a telephony network, a fiber-optic network, or 3059655vl - 18 - combinations thereof.
- the communication network includes the Internet and any networks adapted to communicate with the Internet.
- the communications network may be also configured as a means for transmitting data between the computing device and the server.
- the techniques described above may be embodied in, and fully or partially automated by, code modules executed by one or more computers or computer processors.
- the code modules may be stored on any type of non-transitory computer-readable medium or computer storage device, such as hard drives, solid state memory, optical disc, and/or the like.
- the processes and algorithms may be implemented partially or wholly in application-specific circuitry.
- the results of the disclosed processes and process steps may be stored, persistently or otherwise, in any type of non-transitory computer storage such as, e.g., volatile or non- volatile storage.
- Real-time refers to operations that usually occur in milliseconds, but not more than one second.
- the term near real-time refers to the time delay introduced by automated data processing or network transmission, between the occurrence of an event and the use of the processed data, such as for display or feedback and control purposes.
- a near-real-time display depicts an event or situation as it existed at the current time minus the processing time, as nearly the time of the live event. Near real-time events usually occur within seconds.
Landscapes
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Electromagnetism (AREA)
- Navigation (AREA)
- Position Fixing By Use Of Radio Waves (AREA)
- Optical Radar Systems And Details Thereof (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
Abstract
L'invention concerne des procédés et des systèmes pour fusionner des données de capteurs et de cartes en utilisant une optimisation basée sur une contrainte. Dans un mode de réalisation, un procédé mis en oeuvre par un ordinateur peut comprendre l'obtention de données de suivi pour un sujet suivi, les données de suivi comprenant des données provenant d'un capteur à l'estime; l'obtention de données de contrainte pour le sujet suivi; et l'utilisation d'un procédé d'optimisation convexe basé sur les données de suivi et les données de contrainte pour obtenir une solution de navigation. La solution de navigation peut être un trajet et le procédé peut comprendre en outre la propagation des données de contrainte par un modèle de mouvement pour produire des bonds d'erreur qui continuent de contraindre le trajet dans le temps. La propagation des données de contrainte peut être limitée par d'autres données de capteurs et/ou données structurelles de cartes.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201261658883P | 2012-06-12 | 2012-06-12 | |
US61/658,883 | 2012-06-12 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2013188598A2 true WO2013188598A2 (fr) | 2013-12-19 |
WO2013188598A3 WO2013188598A3 (fr) | 2015-06-25 |
Family
ID=49715707
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2013/045522 WO2013188598A2 (fr) | 2012-06-12 | 2013-06-12 | Fusion de données de capteurs et de cartes au moyen d'une optimisation basée sur une contrainte |
PCT/US2013/045488 WO2013188579A1 (fr) | 2012-06-12 | 2013-06-12 | Algorithmes de suivi améliorés par wi-fi |
PCT/US2013/045519 WO2013188597A2 (fr) | 2012-06-12 | 2013-06-12 | Mappage de caractéristiques irrégulières |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2013/045488 WO2013188579A1 (fr) | 2012-06-12 | 2013-06-12 | Algorithmes de suivi améliorés par wi-fi |
PCT/US2013/045519 WO2013188597A2 (fr) | 2012-06-12 | 2013-06-12 | Mappage de caractéristiques irrégulières |
Country Status (2)
Country | Link |
---|---|
US (5) | US9441973B2 (fr) |
WO (3) | WO2013188598A2 (fr) |
Families Citing this family (72)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9395190B1 (en) | 2007-05-31 | 2016-07-19 | Trx Systems, Inc. | Crowd sourced mapping with robust structural features |
US20130155102A1 (en) * | 2011-12-20 | 2013-06-20 | Honeywell International Inc. | Systems and methods of accuracy mapping in a location tracking system |
WO2013188598A2 (fr) | 2012-06-12 | 2013-12-19 | Trx Systems, Inc. | Fusion de données de capteurs et de cartes au moyen d'une optimisation basée sur une contrainte |
US9615172B2 (en) * | 2012-10-04 | 2017-04-04 | Siemens Aktiengesellschaft | Broadband sensor location selection using convex optimization in very large scale arrays |
US8825373B1 (en) * | 2012-12-05 | 2014-09-02 | Google Inc. | Correcting path errors for vehicle navigation |
US11268818B2 (en) | 2013-03-14 | 2022-03-08 | Trx Systems, Inc. | Crowd sourced mapping with robust structural features |
US11156464B2 (en) | 2013-03-14 | 2021-10-26 | Trx Systems, Inc. | Crowd sourced mapping with robust structural features |
US10495464B2 (en) | 2013-12-02 | 2019-12-03 | The Regents Of The University Of California | Systems and methods for GNSS SNR probabilistic localization and 3-D mapping |
EP2881875B1 (fr) * | 2013-12-03 | 2019-05-22 | Micrel Medical Devices S.A. | Dispositif ou système permettant de localiser et d'utiliser un dispositif médical |
US20150160838A1 (en) * | 2013-12-06 | 2015-06-11 | Takeshi SHIRABE | Method and apparatus for automatic graphic editing with map-dependent constraints |
US9747778B2 (en) * | 2013-12-17 | 2017-08-29 | Samsung Electronics Co. Ltd. | Context-aware compliance monitoring |
US9881480B2 (en) * | 2013-12-20 | 2018-01-30 | International Business Machines Corporation | Mobile device loss prevention |
DE102014200701A1 (de) * | 2014-01-16 | 2015-07-16 | Bayerische Motoren Werke Aktiengesellschaft | Verfahren und Vorrichtung zum Bereitstellen eines Rohkartografierungsdatenpakets für ein Gebäude und Verfahren und Vorrichtung zum Erstellen einer digitalen Karte für ein Gebäude |
EP2911119A1 (fr) * | 2014-02-24 | 2015-08-26 | Dassault Systèmes | Procédé de conception d'un objet modélisé en trois dimensions dans une scène tridimensionnelle par extrusion d'une courbe |
US10466056B2 (en) * | 2014-04-25 | 2019-11-05 | Samsung Electronics Co., Ltd. | Trajectory matching using ambient signals |
US9510154B2 (en) | 2014-04-28 | 2016-11-29 | Samsung Electronics Co., Ltd | Location determination, mapping, and data management through crowdsourcing |
DE102014211175A1 (de) * | 2014-06-11 | 2015-12-17 | Continental Teves Ag & Co. Ohg | Verfahren und System zur Initialisierung eines Sensorfusionssystems |
US10518879B1 (en) * | 2014-07-10 | 2019-12-31 | Hrl Laboratories, Llc | System and method for drift-free global trajectory estimation of a mobile platform |
GB201500411D0 (en) | 2014-09-15 | 2015-02-25 | Isis Innovation | Determining the position of a mobile device in a geographical area |
WO2016048344A1 (fr) * | 2014-09-26 | 2016-03-31 | Hewlett Packard Enterprise Development Lp | Nœuds de cache |
US9759561B2 (en) | 2015-01-06 | 2017-09-12 | Trx Systems, Inc. | Heading constraints in a particle filter |
EP3259609B1 (fr) | 2015-02-16 | 2023-12-20 | HERE Global B.V. | Fourniture d'indication de cap de dispositif mobile |
US10656282B2 (en) | 2015-07-17 | 2020-05-19 | The Regents Of The University Of California | System and method for localization and tracking using GNSS location estimates, satellite SNR data and 3D maps |
US9945956B2 (en) * | 2015-09-08 | 2018-04-17 | Apple Inc. | GNSS positioning using three-dimensional building models |
KR20180052636A (ko) * | 2015-09-10 | 2018-05-18 | 오리엔트 뉴 미디어 엘티디. | 자동 맵 생성으로 gps 거부 지역이나 부정확 지역에서에서 모바일기기 내비게이션, 추적 및 포지셔닝 |
US10386493B2 (en) | 2015-10-01 | 2019-08-20 | The Regents Of The University Of California | System and method for localization and tracking |
EP3165877B1 (fr) * | 2015-11-04 | 2020-03-25 | Tata Consultancy Services Limited | Systèmes et procédés de fusion de données de capteur inertiel et bluetooth à faible énergie pour la localisation |
US10241514B2 (en) | 2016-05-11 | 2019-03-26 | Brain Corporation | Systems and methods for initializing a robot to autonomously travel a trained route |
KR102372669B1 (ko) * | 2016-06-08 | 2022-03-10 | 삼성전자주식회사 | 전자 장치, 외부 서버 및 그 제어 방법 |
US9987752B2 (en) | 2016-06-10 | 2018-06-05 | Brain Corporation | Systems and methods for automatic detection of spills |
US10282849B2 (en) | 2016-06-17 | 2019-05-07 | Brain Corporation | Systems and methods for predictive/reconstructive visual object tracker |
US9661473B1 (en) | 2016-06-17 | 2017-05-23 | Qualcomm Incorporated | Methods and apparatus for determining locations of devices in confined spaces |
US9820100B1 (en) * | 2016-06-17 | 2017-11-14 | Qualcomm Incorporated | Multi-source positioning |
US10016896B2 (en) | 2016-06-30 | 2018-07-10 | Brain Corporation | Systems and methods for robotic behavior around moving bodies |
US10075818B2 (en) * | 2016-09-13 | 2018-09-11 | Google Llc | Systems and methods for graph-based localization and mapping |
US10274325B2 (en) * | 2016-11-01 | 2019-04-30 | Brain Corporation | Systems and methods for robotic mapping |
US10723018B2 (en) | 2016-11-28 | 2020-07-28 | Brain Corporation | Systems and methods for remote operating and/or monitoring of a robot |
US10694325B2 (en) | 2016-12-31 | 2020-06-23 | Google Llc | Determining position of a device in three-dimensional space and corresponding calibration techniques |
US10511951B2 (en) | 2017-01-17 | 2019-12-17 | 3AM Innovations LLC | Tracking and accountability device and system |
US9858791B1 (en) | 2017-01-17 | 2018-01-02 | 3AM Innovations LLC | Tracking and accountability device and system |
WO2018139773A1 (fr) * | 2017-01-25 | 2018-08-02 | 한국과학기술연구원 | Procédé et dispositif slam résistants aux changements dans un environnement sans fil |
US10852730B2 (en) | 2017-02-08 | 2020-12-01 | Brain Corporation | Systems and methods for robotic mobile platforms |
CN108454652B (zh) * | 2017-02-22 | 2019-11-19 | 中车株洲电力机车研究所有限公司 | 一种安全可靠的实时测速和连续定位的方法、装置及系统 |
FR3065083A1 (fr) * | 2017-04-05 | 2018-10-12 | Thales | Procede de determination de niveaux de protection de solutions de navigation, produit programme d'ordinateur et recepteur associes |
US10048753B1 (en) * | 2017-04-20 | 2018-08-14 | Robert C. Brooks | Perspective or gaze based visual identification and location system |
CA3062312C (fr) * | 2017-05-04 | 2022-06-14 | Mim Software, Inc. | Systeme et procede de fusion predictive |
US10545026B1 (en) | 2017-06-05 | 2020-01-28 | Philip Raymond Schaefer | System and method for tracking the position of a person and providing navigation assistance |
US10650586B2 (en) * | 2017-08-10 | 2020-05-12 | Outward, Inc. | Automated mesh generation |
CN109558470B (zh) * | 2017-09-27 | 2021-06-15 | 方正国际软件(北京)有限公司 | 一种轨迹数据可视化方法及装置 |
CN107976190A (zh) * | 2017-11-10 | 2018-05-01 | 北京金坤科创技术有限公司 | 一种室内定位导航方法与智能无人值守前台系统 |
CN109959376B (zh) * | 2017-12-14 | 2021-11-16 | 腾讯科技(北京)有限公司 | 轨迹纠正方法、涉及室内路线的导航路线绘制方法和装置 |
CN108344416B (zh) * | 2018-02-01 | 2021-06-01 | 感知智能科技新加坡有限公司 | 一种基于地图信息自动匹配目标的定位方法 |
US10861598B2 (en) * | 2018-02-14 | 2020-12-08 | Hill-Rom Services, Inc. | Historical identification and accuracy compensation for problem areas in a locating system |
FR3079618B1 (fr) * | 2018-03-29 | 2020-04-10 | Compagnie Generale Des Etablissements Michelin | Procede et systeme d'evaluation de la trajectoire d'un operateur dans un atelier |
CN108388135B (zh) * | 2018-03-30 | 2020-11-10 | 上海交通大学 | 一种基于凸优化的火星着陆轨迹优化控制方法 |
CN108983254A (zh) * | 2018-08-08 | 2018-12-11 | 中国科学院电子学研究所 | 基于光流传感器的二维测距装置及测距方法 |
CN109412883B (zh) * | 2018-08-14 | 2021-12-03 | 阿里巴巴(中国)有限公司 | 推荐路径追踪方法、装置和系统 |
CN109064482B (zh) * | 2018-08-16 | 2021-10-22 | 武大吉奥信息技术有限公司 | 一种三维倾斜摄影场景中自动获取房屋轮廓的方法及装置 |
CN109357686A (zh) * | 2018-11-19 | 2019-02-19 | 北京金州世纪信息技术有限公司 | 一种车辆行驶路径确定方法及装置 |
US11519974B1 (en) | 2019-06-11 | 2022-12-06 | ArcSecond, Inc. | Systems and methods for improving orientation measurements |
GB2585087B (en) | 2019-06-28 | 2022-05-04 | Raytheon Systems Ltd | Positioning system and method |
US11435376B2 (en) * | 2019-06-28 | 2022-09-06 | Sstatzz Oy | Method for determining a direction of a spin axis of a rotating apparatus |
GB2585191B (en) | 2019-06-28 | 2022-05-04 | Raytheon Systems Ltd | Positioning system and method with inertial navigation and position estimate |
CN110632941B (zh) * | 2019-09-25 | 2020-12-15 | 北京理工大学 | 一种复杂环境下无人机目标跟踪的轨迹生成方法 |
US11443455B2 (en) * | 2019-10-24 | 2022-09-13 | Microsoft Technology Licensing, Llc | Prior informed pose and scale estimation |
US11675366B2 (en) | 2019-12-27 | 2023-06-13 | Motional Ad Llc | Long-term object tracking supporting autonomous vehicle navigation |
US11527109B1 (en) | 2020-01-07 | 2022-12-13 | ArcSecond, Inc. | Form analysis system |
CN111417069A (zh) * | 2020-03-27 | 2020-07-14 | 安徽理工大学 | 轮式里程计和uwb融合的煤矿井下运输机器人定位装置及方法 |
CN111780756A (zh) * | 2020-07-20 | 2020-10-16 | 北京百度网讯科技有限公司 | 车辆航位推算方法、装置、设备以及存储介质 |
CN112272406A (zh) * | 2020-10-29 | 2021-01-26 | 武汉理工大学 | 一种基于多普勒频移提取的船舶驾驶人员巡逻检测方法 |
CN112492523B (zh) * | 2020-11-05 | 2021-09-14 | 南京大学 | 一种基于超宽带实时定位的轨迹约束方法 |
CN112556696B (zh) * | 2020-12-03 | 2022-01-07 | 腾讯科技(深圳)有限公司 | 一种对象定位方法、装置、计算机设备以及存储介质 |
Family Cites Families (78)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4939663A (en) | 1988-04-04 | 1990-07-03 | Harris Corporation | Elevation map-referenced mechanism for updating vehicle navigation system estimates |
US6031892A (en) | 1989-12-05 | 2000-02-29 | University Of Massachusetts Medical Center | System for quantitative radiographic imaging |
US5774591A (en) | 1995-12-15 | 1998-06-30 | Xerox Corporation | Apparatus and method for recognizing facial expressions and facial gestures in a sequence of images |
US7728845B2 (en) | 1996-02-26 | 2010-06-01 | Rah Color Technologies Llc | Color calibration of color image rendering devices |
US7764231B1 (en) | 1996-09-09 | 2010-07-27 | Tracbeam Llc | Wireless location using multiple mobile station location techniques |
US5818463A (en) | 1997-02-13 | 1998-10-06 | Rockwell Science Center, Inc. | Data compression for animated three dimensional objects |
US6024655A (en) | 1997-03-31 | 2000-02-15 | Leading Edge Technologies, Inc. | Map-matching golf navigation system |
US6072496A (en) | 1998-06-08 | 2000-06-06 | Microsoft Corporation | Method and system for capturing and representing 3D geometry, color and shading of facial expressions and other animated objects |
US6415227B1 (en) * | 1999-04-21 | 2002-07-02 | American Gnc Corporation | Enhanced global positioning system and map navigation process |
JP2003536096A (ja) * | 2000-06-08 | 2003-12-02 | オートモーティブ システムズ ラボラトリー インコーポレーテッド | 追跡マップジェネレータ |
US7304571B2 (en) | 2000-10-18 | 2007-12-04 | Information Systems Laboratories, Inc. | Firefighter locator with activator |
TW499349B (en) | 2000-11-17 | 2002-08-21 | Sony Corp | Legged mobile robot, leg structure of legged mobile robot, and mobile leg unit for legged mobile robot |
US6581005B2 (en) * | 2000-11-30 | 2003-06-17 | Nissan Motor Co., Ltd. | Vehicle position calculation apparatus and method |
US6560531B1 (en) | 2001-05-22 | 2003-05-06 | Navigation Technologies Corporation | Multi-resolution trend metric for shape comparison and applications thereof |
US20040021569A1 (en) | 2001-11-21 | 2004-02-05 | Robert Lepkofker | Personnel and resource tracking method and system for enclosed spaces |
AU2003300959A1 (en) | 2002-12-17 | 2004-07-22 | Evolution Robotics, Inc. | Systems and methods for visual simultaneous localization and mapping |
US7546156B2 (en) | 2003-05-09 | 2009-06-09 | University Of Rochester Medical Center | Method of indexing biological imaging data using a three-dimensional body representation |
US20090321094A1 (en) | 2003-07-31 | 2009-12-31 | Michael Steven Thomas | Fire suppression delivery system |
US7425829B2 (en) | 2003-10-14 | 2008-09-16 | Merlin Technology, Inc. | Tracking positions of personnel, vehicles, and inanimate objects |
US8289274B2 (en) | 2004-01-13 | 2012-10-16 | Sliwa John W | Microdroplet-based 3-D volumetric displays utilizing emitted and moving droplet projection screens |
US7379623B2 (en) | 2004-04-30 | 2008-05-27 | Microsoft Corporation | Method to quickly warp a 2-D image using only integer math |
US7373012B2 (en) | 2005-02-01 | 2008-05-13 | Mitsubishi Electric Research Laboratories, Inc. | Detecting moving objects in videos with corner-based background model |
US7299056B2 (en) | 2005-02-23 | 2007-11-20 | Deere & Company | Vehicular navigation based on site specific sensor quality data |
US9037098B2 (en) | 2007-08-30 | 2015-05-19 | Binj Laboratories, Inc. | System and method for wrist band transmitter and system thereof |
US20070032748A1 (en) | 2005-07-28 | 2007-02-08 | 608442 Bc Ltd. | System for detecting and analyzing body motion |
EP1770368B1 (fr) | 2005-10-03 | 2009-05-27 | STMicroelectronics S.r.l. | Pédomètre et méthode de détection de l'avancement à l'aide d'un algorithme pour le calcul auto-adaptatif de valeurs limites d'accélération. |
US9042917B2 (en) | 2005-11-07 | 2015-05-26 | Qualcomm Incorporated | Positioning for WLANS and other wireless networks |
JP4192940B2 (ja) | 2005-11-18 | 2008-12-10 | トヨタ自動車株式会社 | 移動体用位置推定装置 |
EP1804154A3 (fr) | 2005-12-27 | 2012-08-08 | Poston Timothy | Dispositif de saisie informatique permettant trois degrés de liberté et procédés de saisie et de retour associés |
JP2009533786A (ja) | 2006-04-10 | 2009-09-17 | アヴァワークス インコーポレーテッド | 自分でできるフォトリアリスティックなトーキングヘッド作成システム及び方法 |
WO2008108788A2 (fr) | 2006-05-31 | 2008-09-12 | Trx Systems, Inc. | Procédé et système permettant la localisation et la surveillance de premiers intervenants |
US7925049B2 (en) | 2006-08-15 | 2011-04-12 | Sri International | Stereo-based visual odometry method and system |
US8128410B2 (en) | 2006-09-29 | 2012-03-06 | Nike, Inc. | Multi-mode acceleration-based athleticism measurement system |
JP4830789B2 (ja) | 2006-10-30 | 2011-12-07 | オムロンヘルスケア株式会社 | 体動検出装置、情報送信装置、ノルディックウォーキング用ストック、および歩行運動量算出システム |
US7778769B2 (en) | 2006-11-27 | 2010-08-17 | International Business Machines Corporation | Method and system for calculating least-cost routes based on historical fuel efficiency, street mapping and location based services |
WO2008073962A2 (fr) | 2006-12-12 | 2008-06-19 | Rutgers, The State University Of New Jersey | Système et procédé de détection et de suivi de particularités dans les images |
WO2008097694A1 (fr) | 2007-02-05 | 2008-08-14 | Andrew Corporation | Système et procédé pour optimiser l'estimation de position d'une unité mobile |
JP4989532B2 (ja) * | 2007-03-30 | 2012-08-01 | 成均館大学校産学協力団 | 移動サービスロボットの中央情報処理システム、移動サービスロボットの情報処理方法及び移動サービスロボットの情報処理方法を記録したコンピュータで読み取り可能な記録媒体 |
US7961936B2 (en) | 2007-03-30 | 2011-06-14 | Intel Corporation | Non-overlap region based automatic global alignment for ring camera image mosaic |
US8364242B2 (en) | 2007-05-17 | 2013-01-29 | General Electric Company | System and method of combining ultrasound image acquisition with fluoroscopic image acquisition |
US8751151B2 (en) | 2012-06-12 | 2014-06-10 | Trx Systems, Inc. | System and method for localizing a trackee at a location and mapping the location using inertial sensor information |
WO2008157622A1 (fr) | 2007-06-18 | 2008-12-24 | University Of Pittsburgh-Of The Commonwealth System Of Higher Education | Procédé, appareil et système pour prise alimentaire et évaluation de l'activité physique |
FR2918745B1 (fr) * | 2007-07-12 | 2009-09-18 | Commissariat Energie Atomique | Dispositif d'assistance a la navigation d'une personne |
SG183690A1 (en) * | 2007-08-06 | 2012-09-27 | Trx Systems Inc | Locating, tracking, and/or monitoring personnel and/or assets both indoors and outdoors |
US8331335B2 (en) * | 2007-10-22 | 2012-12-11 | Marvell World Trade Ltd. | Location aware background access point scanning for WLAN |
US9062971B2 (en) | 2008-03-06 | 2015-06-23 | Texas Instruments Incorporated | E-compass, tilt sensor, memory and processor with coarse detilting procedure |
US20090235608A1 (en) | 2008-03-19 | 2009-09-24 | Jan Kosny | Support structures formed from triangular elements |
US7890262B2 (en) * | 2008-03-31 | 2011-02-15 | Honeywell International Inc. | Position estimation for navigation devices |
US20090262974A1 (en) | 2008-04-18 | 2009-10-22 | Erik Lithopoulos | System and method for obtaining georeferenced mapping data |
GB0808081D0 (en) | 2008-05-02 | 2008-06-11 | In2Games Ltd | Bridging ultrasonic position with accelerometer/gyroscope inertial guidance |
EP2283641B1 (fr) * | 2008-06-06 | 2020-08-12 | Skyhook Wireless, Inc. | Procédé et système pour déterminer l'emplacement utilisant un satellite hybride et un système de positionnement wlan par sélection de la meilleure solution wlan-ps |
WO2010005731A1 (fr) | 2008-06-16 | 2010-01-14 | Skyhook Wireless, Inc. | Procédés et systèmes permettant de déterminer un emplacement au moyen d’un système de positionnement cellulaire et wlan en sélectionnant la meilleure solution wlan ps |
US7990314B2 (en) | 2008-06-30 | 2011-08-02 | Liao Henry H | Method and system for locating a geographical position using broadcast frequency modulation signals |
US8804551B2 (en) | 2008-08-06 | 2014-08-12 | U-Blox Ag | Location estimation by observing wireless signals |
GB2465793A (en) | 2008-11-28 | 2010-06-02 | Sony Corp | Estimating camera angle using extrapolated corner locations from a calibration pattern |
US8265818B2 (en) * | 2009-06-04 | 2012-09-11 | Defense Technologies, Inc. | Open architecture command system |
US8473241B2 (en) | 2009-08-03 | 2013-06-25 | Thales Visionix, Inc. | Navigation trajectory matching |
WO2011046135A1 (fr) * | 2009-10-14 | 2011-04-21 | 株式会社エヌ・ティ・ティ・ドコモ | Dispositif d'analyse d'information de position et procédé d'analyse d'information de position |
EP2491343A1 (fr) | 2009-10-23 | 2012-08-29 | Mine Safety Appliances Company | Système, procédé et agencement d'initialisation de système de navigation |
US20110117924A1 (en) | 2009-11-18 | 2011-05-19 | Qualcomm Incorporated | Position determination using a wireless signal |
US9157745B2 (en) | 2010-01-14 | 2015-10-13 | Qualcomm Incorporated | Scalable routing for mobile station navigation with location context identifier |
CA2787646C (fr) | 2010-02-05 | 2016-12-13 | Trimble Navigation Limited | Systemes et procedes de traitement des donnees de cartographie et de modelisation |
US20110238308A1 (en) | 2010-03-26 | 2011-09-29 | Isaac Thomas Miller | Pedal navigation using leo signals and body-mounted sensors |
US9610063B2 (en) | 2010-03-26 | 2017-04-04 | The Johns Hopkins University | Methods and apparatus for ultrasound strain imaging |
US8718963B2 (en) | 2010-04-27 | 2014-05-06 | Memsic, Inc. | System and method for calibrating a three-axis accelerometer |
US8538687B2 (en) | 2010-05-04 | 2013-09-17 | Honeywell International Inc. | System for guidance and navigation in a building |
US20120021764A1 (en) | 2010-07-23 | 2012-01-26 | Quantum Dimension Inc. | System and Method for Robust Navigation and Communication Via A Cooperative Ad-hoc Network |
US8594971B2 (en) | 2010-09-22 | 2013-11-26 | Invensense, Inc. | Deduced reckoning navigation without a constraint relationship between orientation of a sensor platform and a direction of travel of an object |
CA2812950A1 (fr) | 2010-09-29 | 2012-04-19 | University Of Virginia Patent Foundation | Procede, systeme et produit programme d'ordinateur pour optimiser les cartes numeriques de planification d'itineraires |
US20120143495A1 (en) | 2010-10-14 | 2012-06-07 | The University Of North Texas | Methods and systems for indoor navigation |
US8694251B2 (en) | 2010-11-25 | 2014-04-08 | Texas Instruments Incorporated | Attitude estimation for pedestrian navigation using low cost mems accelerometer in mobile applications, and processing methods, apparatus and systems |
EP2646775B1 (fr) | 2010-12-01 | 2015-10-14 | Commissariat à l'Énergie Atomique et aux Énergies Alternatives | Procede et systeme d'estimation d'une trajectoire d'un element ou corps mobile |
US8810640B2 (en) | 2011-05-16 | 2014-08-19 | Ut-Battelle, Llc | Intrinsic feature-based pose measurement for imaging motion compensation |
US9196087B2 (en) * | 2012-04-20 | 2015-11-24 | Here Global B.V. | Method and apparatus for presenting geo-traces using a reduced set of points based on an available display area |
US9103916B2 (en) * | 2012-05-02 | 2015-08-11 | Texas Instruments Incorporated | Apparatus and method for indoor positioning |
US10215587B2 (en) | 2012-05-18 | 2019-02-26 | Trx Systems, Inc. | Method for step detection and gait direction estimation |
US9014903B1 (en) | 2012-05-22 | 2015-04-21 | Google Inc. | Determination of object heading based on point cloud |
WO2013188598A2 (fr) | 2012-06-12 | 2013-12-19 | Trx Systems, Inc. | Fusion de données de capteurs et de cartes au moyen d'une optimisation basée sur une contrainte |
-
2013
- 2013-06-12 WO PCT/US2013/045522 patent/WO2013188598A2/fr active Application Filing
- 2013-06-12 US US13/916,487 patent/US9441973B2/en active Active
- 2013-06-12 US US13/916,390 patent/US9297658B2/en active Active
- 2013-06-12 WO PCT/US2013/045488 patent/WO2013188579A1/fr active Application Filing
- 2013-06-12 WO PCT/US2013/045519 patent/WO2013188597A2/fr active Application Filing
- 2013-06-12 US US13/916,479 patent/US9746327B2/en active Active
-
2016
- 2016-08-16 US US15/238,596 patent/US9778044B2/en active Active
-
2017
- 2017-08-07 US US15/670,881 patent/US10571270B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
US20150354965A1 (en) | 2015-12-10 |
US20130332065A1 (en) | 2013-12-12 |
US20170363426A1 (en) | 2017-12-21 |
US9778044B2 (en) | 2017-10-03 |
US9746327B2 (en) | 2017-08-29 |
US20170153111A1 (en) | 2017-06-01 |
US20130331121A1 (en) | 2013-12-12 |
US10571270B2 (en) | 2020-02-25 |
WO2013188598A3 (fr) | 2015-06-25 |
US9297658B2 (en) | 2016-03-29 |
WO2013188597A3 (fr) | 2014-04-17 |
WO2013188579A1 (fr) | 2013-12-19 |
WO2013188597A2 (fr) | 2013-12-19 |
US9441973B2 (en) | 2016-09-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10571270B2 (en) | Fusion of sensor and map data using constraint based optimization | |
CN108700421B (zh) | 使用离线地图信息辅助增强的便携式导航的方法和系统 | |
US20190242713A1 (en) | Determining the position of a mobile device in a geographical area | |
US10281279B2 (en) | Method and system for global shape matching a trajectory | |
US8751151B2 (en) | System and method for localizing a trackee at a location and mapping the location using inertial sensor information | |
CN106031263B (zh) | 用于位置估计的方法及系统 | |
JP6400128B2 (ja) | 目標の実時間測位と地図構築の方法及び装置 | |
CN110849374A (zh) | 地下环境定位方法、装置、设备及存储介质 | |
US10677883B2 (en) | System and method for automating beacon location map generation using sensor fusion and simultaneous localization and mapping | |
CN105737826B (zh) | 行人室内定位方法 | |
US10088313B2 (en) | Particle filter based heading correction | |
KR20150074124A (ko) | 모바일 디바이스들의 맵-지원 센서-기반 포지셔닝 | |
AU2016202042B2 (en) | Backtracking indoor trajectories using mobile sensors | |
Herath et al. | Fusion-dhl: Wifi, imu, and floorplan fusion for dense history of locations in indoor environments | |
CN110989619A (zh) | 用于定位对象的方法、装置、设备和存储介质 | |
JP2024519424A (ja) | 複数の磁気ナビゲーションデバイスからのオーバーラップする磁気測定データの相関付け及びこのデータによる地磁気マップの更新 | |
Koroglu et al. | Pedestrian inertial navigation with building floor plans for indoor environments via non-recursive Bayesian filtering | |
JP7125927B2 (ja) | 情報端末装置、方法及びプログラム | |
JP7238305B2 (ja) | パーティクルフィルタを使用した位置特定のために、事前分布としてグラフベースのマップ情報を利用するシステム及び方法、コンピュータ実施方法、プログラム、及びシステム | |
WO2023057780A1 (fr) | Estime fondée sur une imu à modèle de mouvement appris |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13804497 Country of ref document: EP Kind code of ref document: A2 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
122 | Ep: pct application non-entry in european phase |
Ref document number: 13804497 Country of ref document: EP Kind code of ref document: A2 |