EP3137923A1 - Dead reckoning system based on locally measured movement - Google Patents

Dead reckoning system based on locally measured movement

Info

Publication number
EP3137923A1
EP3137923A1 EP15721983.3A EP15721983A EP3137923A1 EP 3137923 A1 EP3137923 A1 EP 3137923A1 EP 15721983 A EP15721983 A EP 15721983A EP 3137923 A1 EP3137923 A1 EP 3137923A1
Authority
EP
European Patent Office
Prior art keywords
cellular device
information
logic
position fix
carrier phase
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP15721983.3A
Other languages
German (de)
French (fr)
Other versions
EP3137923B1 (en
Inventor
Richard Rudow
Robert Wold
Venkateswaran KASIRAJAN
Nicholas C. Talbot
Peter Loomis
Shawn Weisenburger
James M. Janky
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Trimble Inc
Original Assignee
Trimble Navigation Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/268,993 external-priority patent/US9602974B2/en
Application filed by Trimble Navigation Ltd filed Critical Trimble Navigation Ltd
Publication of EP3137923A1 publication Critical patent/EP3137923A1/en
Application granted granted Critical
Publication of EP3137923B1 publication Critical patent/EP3137923B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00—Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/38—Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system
    • G01S19/39—Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system the satellite radio beacon positioning system transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • G01S19/42—Determining position
    • G01S19/48—Determining position by combining or switching between position solutions derived from the satellite radio beacon positioning system and position solutions derived from a further system
    • G01S19/49—Determining position by combining or switching between position solutions derived from the satellite radio beacon positioning system and position solutions derived from a further system whereby the further system is an inertial position system, e.g. loosely-coupled
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00—Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/38—Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system
    • G01S19/39—Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system the satellite radio beacon positioning system transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • G01S19/396—Determining accuracy or reliability of position or pseudorange measurements
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00—Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/38—Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system
    • G01S19/39—Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system the satellite radio beacon positioning system transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • G01S19/42—Determining position
    • G01S19/48—Determining position by combining or switching between position solutions derived from the satellite radio beacon positioning system and position solutions derived from a further system
    • G01S19/485—Determining position by combining or switching between position solutions derived from the satellite radio beacon positioning system and position solutions derived from a further system whereby the further system is an optical system or imaging system

Definitions

  • U.S. Patent Application No. 14/035,884 claimed priority to and benefit of then copending U.S. Provisional Patent Application No. 61/746,916, filed on December 28, 2012 entitled, "IMPROVED GPS/GNSS ACCURACY FOR A CELL PHONE" by Rudow et al., having Attorney Docket No. TRMB-3172.PRO, and assigned to the assignee of the present application.
  • GPS Global Positioning System
  • GNSS Global Navigation Satellite Systems
  • cellular devices typically include highly integrated GNSS chipsets that are designed to work with the E-91 1 service primarily, and are not designed to provide anywhere near a full range of features and outputs. They do provide a position fix, but are not designed to make available very many other parameters of interest. All GNSS receivers must acquire, track and decode a data message that conveys information about the location of the satellites in space, and time information. The principal additional parameter obtained is the "pseudorange.” However, conventionally, this set of data is not available as an output from the cellular device's GNSS chipsets for use by the cellular device itself. Conventionally, in circumstances where it is available, it is under access control by the vendor.
  • Figure 1A depicts a block diagram of a cellular device for extracting pseudorange information, according to one embodiment.
  • Figure 1 B depicts a block diagram of a cellular device for extracting and processing pseudorange information, according to one embodiment.
  • Figure 1 C depicts decision logic for determining whether to apply WAAS (Wide Area Augmentation System) corrections or DGPS (Differential Global Positioning System) corrections, according to one embodiment.
  • WAAS Wide Area Augmentation System
  • DGPS Different Global Positioning System
  • Figure 1 D depicts a block diagram of a cellular device for extracting pseudorange information, according to one embodiment.
  • Figure 2 depicts a block diagram of multiple sources for providing positioning correction information to a cellular device for processing pseudorange information, according to one embodiment.
  • Figure 3 depicts a conceptual view of pseudorange measurements, according to various embodiments.
  • Figure 4 depicts a flowchart for determining an RTK (Real Time Kinematic) position solution, according to one embodiment.
  • Figure 5A is a flowchart of a method for performing a carrier phase smoothing operation using real carrier phase information, according to one embodiment.
  • Figure 5B is a flowchart of a method for generating reconstructed carrier phase information based on Doppler shift, according to one embodiment.
  • Figure 6 depicts a flowchart of a method of extracting pseudorange information using a cellular device, according to one embodiment.
  • Figures 7A-10 depict flowcharts of methods of improving the position accuracy using one or more position accuracy improvements, according to various embodiments.
  • Figure 1 1 depicts a flowchart a method of accessing and processing extracted pseudorange information, according to one embodiment.
  • Figure 12 depicts a block diagram of a GNSS receiver, according to one
  • Figure 13 depicts an example Kalman Filtering process, according to some embodiments.
  • Figure 14 depicts a flow chart with at least two processes executing concurrently for providing position fix(es), according to various embodiments.
  • Figures 15A-15J depict block diagrams of a cellular device and various portions of the cellular device for providing improved position fix determination, according to one embodiment.
  • Figure 16 depicts a block diagram of a cellular device for providing improved position fix determination, according to one embodiment.
  • Figure 17 depicts a block diagram of a cellular device and multiple sources for providing positioning correction information to the cellular device for processing
  • pseudorange information according to one embodiment.
  • Figures 18A-18D depict diagrams of patterns where locally measured movement information is used to improve position fix determination, according to various embodiments.
  • Figure 18E depicts various graphs for estimating a new position fix when a GNSS position fix is an outlier, according to various embodiments.
  • Figure 19 depicts an example of Kalman Filter processing, according to some embodiments.
  • Figures 20a-26G depict flowcharts of methods for improving position determination of a cellular device using locally measured movement, according to one embodiment.
  • Figures 27A-27C are example timelines that demonstrate techniques for using various combinations of sensors and/or carrier phase smoothing concurrently over time for improving position determination of a cellular device using locally measured movement information, according to various embodiments.
  • Figure 28 illustrates a frame from the 720 p video (1280 x 720) sequence taken at 25 frames per second by Nikon D 800 camera using 35 mm lens, according to one
  • Figure 29 depicts light beams passing through the pinhole of a pinhole camera, according to one embodiment.
  • Figure 30 illustrates x- and z-coordinates of the 2-D projection of a 3-D point through a projection center of a pinhole camera, according to one embodiment.
  • Figure 31 depicts an image including a number of segments, each segment including a minimum number of tracked features, according to one embodiment.
  • Figure 32 shows the sequential update in estimation of camera positions and orientation from the initial N frames to the subsequent (N+1 ) frames while using the sequential rolling bundle adjustment algorithm, according to one embodiment.
  • Figure 33 illustrates the solution of collinearity equations utilized for estimation of camera position and orientation for each frame and for estimating 3-D coordinates of the tracked key-points system, according to one embodiment.
  • deactivating refers to the actions and processes of a computer system, data storage system, storage system controller, microcontroller, hardware processor, or similar electronic computing device or combination of such electronic computing devices.
  • the computer system or similar electronic computing device manipulates and transforms data represented as physical (electronic) quantities within the computer system's/device's registers and memories into other data similarly represented as physical quantities within the computer system's/device's memories or registers or other such information storage, transmission, or display devices.
  • Cellular devices such as cell phones and non-voice enabled cellular devices, possesses pseudorange information that can be used in surveying and other positioning operations.
  • the pseudorange information from cellular device chipsets are only available under a limited set of conditions, usually only when performing a E-91 1 service call, and then only for use by the Assisted GPS service located in conjunction with the E-91 1 service facility. Therefore, according to one embodiment, an embedded GNSS chipset is employed with in a cellular device, which: a) calculates pseudorange information for use by the GNSS chipset; and b) permits extraction of this pseudorange information by the cellular device in which it is embedded. As will be discussed, the pseudorange information from the GNSS chipset is extracted for use elsewhere in the cellular device outside of the GNSS chipset.
  • Figure 1A depicts a block diagram of a cellular device 100 for extracting
  • Examples of a cellular device 100 include a cell phone, a non-voice enabled cellular device, and a mobile hand-held GNSS receiver.
  • the cellular device may be mobile or stationary.
  • the cellular device may be hand- holdable or incorporated as a portion of a system which is not hand-holdable.
  • a cellular device, such as cellular device 100 may be utilized as a portion of a navigation system, security system, safety system, telematics device/box, or the like.
  • cellular device 100 may be utilized as sub-system of the vehicle mounted portion of a vehicle safety system, security system, and/or navigation system.
  • the vehicle mounted portion of the OnStar® vehicle safety, vehicle security, and vehicle navigation system that is utilized in many vehicles is one non-limiting example of a system which may include cellular device 100.
  • the cellular device 100 includes a GNSS chipset 170, a GNSS receiver 107, a processor 172 that is part of the GNSS receiver 107, a chipset accessor logic 141 , a pseudorange information extractor logic 142, an improved accuracy Secure User Platform Location (SUPL) client 101 , a pseudorange information bridger logic 143, a pseudorange information processing logic 150, an operating system 160, a location manager logic 161 , a location displayer logic 162, hardware 180 that is outside of the GNSS receiver 107.
  • the chipset accessor logic 141 the chipset accessor logic 141 , the
  • the hardware 180 includes a hardware processor 109 and memory 210.
  • An example of a hardware processor 109 is a central processing unit.
  • An example of hardware memory 210 is computer readable storage, such as, but not limited to, a disk, a compact disk (CD), a digital versatile device (DVD), random access memory (RAM) or read only memory (ROM).
  • the hardware memory 210 is physical and, therefore, tangible, according to one embodiment.
  • the hardware memory 210 is non-transitory.
  • the processor 172 and the GNSS receiver 107 are a part of the GNSS chipset 170.
  • the chipset accessor logic 141 , pseudorange information extractor logic 142, the pseudorange information bridger logic 143, the improved accuracy SUPL client 101 , the operating system 160, and the processor 109 are located in a portion of the cellular device 100 that is outside of the GNSS chipset 170.
  • the location manager logic 161 can be a part of the operating system 160 and external to the GNSS chipset 170.
  • the location displayer logic 162 is a part of the location manager logic 161.
  • the chipset accessor logic 141 , pseudorange information extractor logic 142, the pseudorange information processing logic 150, pseudorange information bridger logic 143, and improved accuracy SUPL client 101 are application programming interfaces (API) function
  • the GNSS receiver 107 is capable of receiving signals from GPS satellites, GLONASS satellites, or from a combination of satellites from different constellations.
  • the GNSS receiver 107 can perform GPS measurements to derive raw measurement data for a position of the cellular device 100.
  • the raw measurement data can provide an instant location of the cellular device 100.
  • the raw measurement data is the pseudorange information that is extracted (also referred to as "extracted pseudorange information"). Examples of the extracted pseudorange information are uncorrected pseudorange information, observed pseudorange information, or unsmoothed pseudorange information, or a combination thereof.
  • the raw measurement data is only for use by the GNSS chipset 170 and the GNSS chipset 170 calculates pseudorange information that is only for use by the GNSS chipset 170.
  • Examples of pseudorange information are uncorrected pseudorange information, smoothed pseudoranges, and corrected pseudoranges.
  • Examples of corrections used to improve accuracy of a position fix include differential GNSS corrections (DGPS), high precision GNSS satellite orbital data, GNSS satellite broadcast ephemeris data, and ionospheric and tropospheric error corrections and error projections based on location.
  • DGPS differential GNSS corrections
  • high precision GNSS satellite orbital data high precision GNSS satellite orbital data
  • GNSS satellite broadcast ephemeris data ionospheric and tropospheric error corrections and error projections based on location.
  • the GNSS chipset 170 has a processor 172 and, therefore, is capable of processing information, such as pseudorange information, itself. However, according to various embodiments, information that the GNSS chipset 170 has can be extracted from the GNSS chipset 170 and processed outside of the GNSS chipset 170 instead of by the GNSS chipset 170 using its own processor 172, in order to provide an improved accuracy position fix.
  • the chipset accessor logic 141 is configured for accessing the GNSS chipset 170.
  • the pseudorange information extractor logic 142 is configured for extracting the
  • the pseudorange information bridger logic 143 is configured for bridging the pseudorange information from the GNSS chipset 170 to the location manager logic 161 that resides in the operating system 160 of the cellular device 100.
  • the chipset accessor logic 141 , the pseudorange information extractor logic 142, the pseudorange information processing logic 150 and pseudorange information bridger logic 143 are a part of an improved accuracy SUPL client 101.
  • the SUPL client 101 can interface between the GNSS chipset 170 and the location manager logic 161 , which resides in the operating system 160.
  • the pseudorange information can be obtained from the processor 172 of the GNSS receiver 107.
  • the GNSS chipset 170 may be designed, for example, by the manufacturer of the GNSS chipset 170, to provide requested information, such as pseudorange information, in response to receiving the command.
  • the pseudorange information may be extracted from the GNSS chipset 170 using the command that the manufacturer has designed the GNSS chipset 170 with.
  • the GNSS chipset 170 is accessed using an operation that is a session started with a message that is an improved accuracy Secure User Platform Location (SUPL) start message or a high precision SUPL INIT message.
  • the message is a custom command that is specific to the GNSS chipset 170 (also referred to as "a GNSS chipset custom command") and by which the improved accuracy SUPL client 101 can gain access to the raw
  • Access may be controlled by the chipset manufacturer and a suitable key made available for use in the SUPL for obtaining access to the pseudoranges.
  • a suitable key is an example of a "custom command.”
  • a worker thread associated with the SUPL client 101 can monitor the raw
  • the pseudorange information extractor logic 142 and the pseudorange information processing logic 150 can be associated with the worker thread.
  • the pseudorange information extractor logic 142 can cache the raw measurements and the pseudorange information processing logic 150 can determine the location.
  • a worker thread is a light weight process that executes a specific sequence of tasks in the background.
  • the tasks can be of long term and/or at times periodic in nature.
  • the worker thread can assist in helping the main thread, which may also be referred to as the main program or main task, with specific functions.
  • Worker threads can be started when these functions of the sequence of tasks are to be executed.
  • a worker thread can remain in the active state as long as its respective functions are being executed.
  • a worker thread may terminate itself, when it completes its functions or when it reaches a point where it can no longer continue to function, for example, due to an irrecoverable error.
  • a worker thread can post its status to the main thread when it ends. Examples of posted status are completion or termination.
  • a worker thread may also post to the main thread the level of progress of its functions periodically. At a given point in time, there may be many such worker threads in progress at the same time. Worker threads may maintain some sort of synchronization amongst themselves depending upon the tasks they are intended for. The main thread may terminate a worker thread, for example, when the functions of that worker thread are no longer needed or due to other execution changes in the system.
  • the cellular device 100 can improve the accuracy of the extracted pseudorange information.
  • the pseudorange information processing logic 150 can improve the accuracy of the extracted pseudorange information, as will become more evident.
  • the output of the pseudorange information processing logic 150 can be used for determining the location of the cellular device 100. For example, a latitude, longitude and altitude can be determined based on the output of the pseudorange information processing logic 150, which can be displayed by the location displayer logic 162. [0055] According to one embodiment, the pseudorange information bridger logic 143 communicates the output from the pseudorange information processing logic 150 to the location manager logic 161 in the operating system 160. According to one embodiment, the output of the pseudorange information processing logic 150 is a location that is defined in terms of latitude, longitude, and altitude. The methods are well-known in the GPS arts. The pseudoranges are used to first determine a location the WGS-84 coordinate system of the Global Positioning System, and then converted into latitude, longitude, and elevation.
  • the location displayer logic 162 can display the location with respect to a digital representation of a map available, for example, from third parties via download to the cellular device.
  • Figure 1 B depicts a block diagram of a portion of a cellular device 100, 100D for extracting pseudorange information, according to one embodiment.
  • the cellular device 100, 100D includes accessing-logic 1 10B and processing logic 150.
  • the accessing logic 1 10B includes extracting logid 12B and receiving logic 1 14B.
  • the extracting logic 1 12B includes pseudorange information extracting logic 142, satellite-based augmentation system (SBAS), extracting logic 1 12B-5, WAAS extracting logic 1 12B-2, Doppler shift extracting logic 1 12B- 3, and carrier phase measurement extracting logic 1 12B-4.
  • WAAS is an example of SBAS.
  • SBAS extracting logic 1 12B- 5 includes WAAS extracting logic 1 12B-2.
  • SBAS satellite-based augmentation system
  • GAGAN Indian GPS aided Geo Augmented Navigation System
  • EGNOS European Geostationary Navigation Overlay Service
  • MSAS Japanese Multi-functional Satellite Augmentation System
  • WAAS Trimble's OmniStar
  • the pseudorange information processing logic 150 includes pseudorange-correction-logic 151 , pseudorange-carrier-phase-smoothing-logic 152, position accuracy improvement determination logic 180B and determining position fix logic 170B. Examples of “improving” are “smoothing” or “correcting,” or a combination thereof.
  • the pseudorange-correction-logic 151 includes WAAS logic 151 A, DGPS logic 151 B, Precise Point Positioning (PPP) logic 151 C, RTK logic 151 D, VRS (Virtual Reference Station) logic 151 E, and RTX logic 151 F.
  • the pseudorange-carrier-phase-smoothing-logic 152 includes real carrier phase logic 152A and reconstructed carrier phase logic 152B. According to one embodiment, the accessing-logic 1 10B and the processing logic 150 reside in the improved accuracy SUPL client 101 .
  • Examples of pseudorange information are extracted pseudoranges, corrected pseudoranges, smoothed pseudoranges, or a combination thereof, among other things.
  • Examples of pseudorange corrections include Wide Area Augmentation System (WAAS) corrections, Differential Global Positioning System (DGPS) corrections, Precise Point Positioning (PPP) corrections, Real Time Kinematic (RTK) corrections, and Virtual
  • WAAS Wide Area Augmentation System
  • DGPS Differential Global Positioning System
  • PPP Precise Point Positioning
  • RTK Real Time Kinematic
  • Reference Station VRS
  • carrier phase information include real carrier phase and reconstructed carrier phase information.
  • the extracting logic 1 12B can extract various types of information from the GNSS chipset 170, as discussed herein.
  • the extracting logic 1 12B includes pseudorange information extracting logic 142, WAAS extracting logic 1 12B-2, Doppler extracting logic 1 12B-3, and carrier phase measurement extracting logic 1 12B-4.
  • the extracting logic 1 12B can be used to extract these various types of information from the GNSS chipset 170 in a similar manner that the pseudorange information extractor logic 142 extracts pseudorange information from the GNSS chipset 170, for example, using an SUPL Client 101 that employs a command designed or provided by the manufacturer of the GNSS chipset 170, as described herein.
  • the WAAS extracting logic 1 12B-2, the Doppler extracting logic 1 12B-3, and carrier phase measurement extracting logic 1 12B-4 can employ commands designed or provided by the manufacturer of the GNSS chipset 170 to extract respectively WAAS, Doppler information, and carrier phase measurements for real carrier phase information.
  • the receiving logic 1 14B receives other types of information that are not extracted from the GNSS chipset 170.
  • the receiving logic 1 14B can receive the information in response to a request (also commonly known as “pulling") or receive the information without the information being requested (also commonly known as “pushing”).
  • a request also commonly known as "pulling”
  • pump receives the information without the information being requested
  • Table 1 depicts the types of information that are extracted from the GNSS chipset or received without extraction, as discussed herein, according to various embodiments.
  • Table 1 Types of Information that are Extracted from the GNSS Chipset or Received without Extraction Extracted Received
  • the information depicted in the extracted column can be extracted from the GNSS chipset 170 using the SUPL client 101 in a manner similar to extracting pseudorange information, as discussed herein.
  • WAAS may be extracted or received, for example, over the Internet.
  • the extracted Doppler shift information can be integrated by processor 109, for example, to reconstruct carrier phase information.
  • Techniques for reconstructing carrier phase information from Doppler shift information are well known in the art. Any one or more of the information depicted in Table 1 can be processed by the cellular device 100, for example, using the processor 109 that is outside of the GNSS chipset 170.
  • the pseudorange-carrier-phase-smoothing-logic 152 can smooth pseudorange information by applying carrier phase information to the pseudorange information.
  • the pseudorange-carrier-phase-smoothing-logic 152 receives raw pseudorange information from the accessing logic 1 10B.
  • the carrier phase information may be reconstructed carrier phase information or real carrier phase information.
  • the pseudorange-correction-logic 151 can correct pseudorange information.
  • the pseudorange-correction-logic 151 can receive pseudorange information and apply pseudorange corrections to the pseudorange information.
  • Examples of the pseudorange information received by the pseudorange-correction-logic 151 include extracted pseudorange information, DGPS corrected pseudoranges, and smoothed pseudoranges that were smoothed, for example, using either real carrier phase information or reconstructed carrier phase information.
  • Examples of pseudorange corrections that can be applied to the received pseudorange information are WAAS corrections, DGPS corrections, PPP corrections, RTK corrections and VRS corrections.
  • the PPP logic 151 C performs Precise Point Positioning (PPP) processing on pseudorange information.
  • PPP Precise Point Positioning
  • RTXTM is proprietary form of PPP developed by Trimble Navigation Limited. It should be appreciated that there are other forms of Precise Point Positioning which may operate using similar principles.
  • the pseudorange information processing logic 150 may also include a determining position fix logic 170B that performs, for example, a least squares solution 171 B can be performed after the extracted pseudorange information is improved by the pseudorange- correction-logic 151 or the pseudorange-carrier-phase-smoothing-logic 152, or a
  • the determining position fix logic 170B resides in the processing logic 150.
  • Least-squares solution methods are well-known in the position determination arts.
  • extracted pseudorange information is passed from the extracting pseudorange information logic 142 to the smoothing logic 152 where it is smoothed at either real carrier phase logic 152A or reconstructed carrier phase logic 152B.
  • the smoothed pseudorange information is communicated from the smoothing logic 152 to the correcting logic 151 for further correction, where one or more corrections may be performed. If a plurality of corrections is performed, they can be performed in various combinations. If carrier phase smoothing is not possible, the extracted pseudorange information can be communicated from extracting pseudorange information logic 142 to correction logic 151.
  • One or more of the logics 152A, 152B, 151 A, 151 E, 151 F in the processing logic 150 can communicate with any one or more of the logics 152A, 152B, 151A, 151 E 151 F in various orders and combinations. Various embodiments are not limited to just the combinations and orders that are described herein. According to one embodiment, extracted pseudorange information may not be smoothed or corrected. In this case, unsmoothed uncorrected pseudorange information can be communicated from logic 142 to logic 170B.
  • the cellular device 100 may also include a position-accuracy-improvement- determination-logic 180B for determining whether to apply any improvements and if so, the one or more position accuracy improvements to apply to the extracted pseudorange information.
  • the cellular device 100 may be preconfigured based on the signals that are available to the cellular device 100 or a user of the cellular device 100 may manually configure the cellular device 100.
  • the cellular device 100 can display the signals that are available to the user and the user can select which signals they desire from the displayed list of signals.
  • the configuration information, whether preconfigured or manually configured by the user can be stored for example, in a look up table in the cellular device 100.
  • position improvements that can be determined by the position accuracy improvement determination logic 180B are real carrier phase information, reconstructed carrier phase information, WAAS, DGPS, PPP, RTXTM, RTK and VRS.
  • the position accuracy improvement determination logic 180B can be used to determine to reconstruct carrier phase information based on Doppler shift if real carrier phase information is not available, for example.
  • the position-accuracy-improvement-determination-logic 180B is a part of the SUPL client 101 .
  • Extracted pseudorange information without any additional improvements provides 4- 5 meters of accuracy.
  • Various combinations of position accuracy improvements can be applied to extracted pseudorange information (EPI) according to various embodiments, where examples of position accuracy improvements include, but are not limited to, Wide Area Augmentation System (WAAS) pseudorange corrections, Differential GPS (DGPS) pseudorange corrections, Precise Point Positioning (PPP) processing, RTXTM, Real Time Kinematic (RTK), Virtual Reference Station (VRS) corrections, real carrier phase information (real CPI) smoothing, and reconstructed carrier phase information (reconstructed CPI) smoothing.
  • WAAS Wide Area Augmentation System
  • DGPS Differential GPS
  • PPP Precise Point Positioning
  • RTXTM Real Time Kinematic
  • VRS Virtual Reference Station
  • One or more of the logics 1 10B, 1 12B, 1 14B, 142, 1 12B-2, 1 12B-3, 180B, 152, 152A, 152B, 151 , 151 Aj-151 F, 170B, 171 B ean be executed, for example, by the processor 109 of the cellular device 100 that is located outside of the GNSS chipset 170.
  • Table 2 depicts combinations of information that result in a position fix 172B, according to various embodiments. However, various embodiments are not limited to the combinations depicted in Table 2.
  • Figure 1 C depicts decision logic 151 H for determining whether to apply SBAS corrections 151 G, WAAS corrections 151 A, PPP corrections 151 C, RTXTM corrections 151 F or DGPS corrections 151 B, according to one embodiment.
  • the SBAS corrections that are applied are WAAS corrections.
  • the decision logic 151 H is located in the position accuracy improvement determination logic 180B or the correction logic 151.
  • a first position is determined by an available means.
  • the first position may be based on uncorrected unsmoothed extracted pseudorange information, cellular tower triangulation, WiFi triangulation or other means.
  • a level of precision may be selected, for example, by a user or preconfigured into the cellular device, where DGPS or one or more of SBAS, WAAS, RTXTM, PPP would be used to achieve that level of precision.
  • the decision logic 151 H can access the level of precision and receive two or more reference station locations by sending a message to a database enquiring about nearby reference stations for DGPS.
  • the decision logic 151 H can determine the distance between the cellular device 100 and the nearest reference station.
  • a range for a distance threshold is approximately 20 to 60 miles. According to one embodiment, the distance threshold is approximately 60 miles.
  • the cellular device 100 may be configured with the distance threshold, for example, by the manufacturer of the cellular device 100 or by a user of the cellular device 100.
  • the cellular device 100 may be configured with the distance threshold through service that is remote with respect to the cellular device 100 or may be configured locally. The distance threshold can be selected based on a degree of position accuracy that is desired.
  • Figure 1 D depicts a block diagram of a cellular device 100D for extracting pseudorange information, according to one embodiment.
  • the GNSS chipset 170 is located on a system on a chip (SOC) substrate (SOCS) 190.
  • SOC system on a chip
  • SOCS system on a chip
  • GNSS receiver 1 130 various information can be extracted from the GNSS receiver 1 130, such as pseudorange information, Doppler Shift Information, Real Carrier Phase Measurement, WAAS and SBAS. Other types of processing information output by the GNSS receiver 1 130 can be ignored.
  • a Cell device 100D's hardware architecture includes discreet physical layout and interconnection of multiple chipsets for processing and for special purposes such as a GNSS chipset 170.
  • newer architectures involve further integration of chipsets in the "system on a chip" (SoC) configuration.
  • SoC system on a chip
  • the GNSS chipset 170 can still be a complete element capable of delivering a PVT (position velocity and time) solution.
  • the pseudorange information, carrier phase, and/or Doppler measurements, along with WAAS corrections if available are extracted prior to further signal processing in the GNSS chipset 170 and are processed using different algorithms and corrections data for developing an improved accuracy PVT solution. In so doing the deleterious effects of multipath and other error sources may be
  • GNSS chipset 170 outputs are ignored and not displayed when the external processing is employed and the higher-accuracy PVT data is available.
  • Figure 2 depicts a block diagram of a set of correction delivery options for providing positioning information to a cellular device for extracting pseudorange information, according to one embodiment.
  • a cellular device 200 include a cell phone, a non-voice enabled cellular device, and a mobile hand-held GNSS receiver.
  • the cellular device may be mobile or stationary.
  • the cellular device 200 includes a bus 216, a satellite receiver 206, a GNSS receiver 107, an FM radio receiver 208, a processor 109, memory 210, a cellular transceiver 21 1 , a display 212, audio 213, Wi-Fi transceiver 214, IMU 215, image capturing device 240, and operating system 160.
  • Components 206, 107, 208, 109, 210, 21 1 , 212, 213, 214, 215, and 240 are all connected with the buss 216.
  • a plurality of broadcast sources is used to convey data and media to a cellular device 200.
  • cellular device 200 can receive broadcast signals from communication satellites 201 (e.g., two-way radio, satellite-based cellular such as the Inmarsat or Iridium communication networks, etc.), global navigation satellites 202 which provide radio navigation signals (e.g., the GPS, GNSS, GLONASS, GALILEO, BeiDou, Compass, etc.), and terrestrial radio broadcast (e.g., FM radio, AM radio, shortwave radio, etc.)
  • communication satellites 201 e.g., two-way radio, satellite-based cellular such as the Inmarsat or Iridium communication networks, etc.
  • global navigation satellites 202 which provide radio navigation signals
  • radio navigation signals e.g., the GPS, GNSS, GLONASS, GALILEO, BeiDou, Compass, etc.
  • terrestrial radio broadcast e.g., FM radio, AM radio, shortwave radio, etc.
  • a cellular device 200 can be configured with a satellite radio receiver 206 coupled with a communication bus 216 for receiving signals from communication satellites 201 , a GNSS receiver 107 coupled with bus 216 for receiving radio navigation signals from global navigation satellites 202 and for deriving a position of cellular device 200 based thereon.
  • Cellular device 200 further comprises an FM radio receiver 208 coupled with bus 216 for receiving broadcast signals from terrestrial radio broadcast 203.
  • Other components of cellular device 200 comprise a processor 109 coupled with bus 216 for processing information and instructions, a memory 210 coupled with bus 216 for storing information and instructions for processor 109. It is noted that memory 210 can comprise volatile memory and non-volatile memory, as well as removable data storage media in accordance with various embodiments.
  • Cellular device 200 further comprises a cellular transceiver 21 1 coupled with bus 216 for communicating via cellular network 222.
  • Examples of cellular networks used by cellular device 200 include, but are not limited to GSM: cellular networks, GPRS cellular networks, GDMA cellular networks, and EDGE cellular networks.
  • Cellular device 200 further comprises a display 212 coupled with bus 216. Examples of devices which can be used as display 212 include, but are not limited to, liquid crystal displays, LED- based displays, and the like. It is noted that display 212 can be configured as a touch screen device (e.g., a capacitive touch screen display) for receiving inputs from a user as well as displaying data.
  • a touch screen device e.g., a capacitive touch screen display
  • Cellular device 200 further comprises an audio output 213 coupled with bus 216 for conveying audio information to a user.
  • Cellular device 200 further comprises a Wi-Fi transceiver 214 and an inertial measurement unit (IMU) 215 coupled with bus 216.
  • Wi-Fi transceiver 1 14 may be configured to operate on any suitable wireless communication protocol including, but not limited to WiFi, WiMAX, implementations of the IEEE 802.1 1 specification, implementations of the IEEE 802.15.4 specification for personal area networks, and a short range wireless connection operating in the Instrument Scientific and Medical (ISM) band of the radio frequency spectrum in the 2400-2484 MHz range (e.g., implementations of the Bluetooth® standard).
  • ISM Instrument Scientific and Medical
  • Improvements in GNSS/GPS positioning may be obtained by using reference stations with a fixed receiver system to calculate corrections to the measured pseudoranges in a given geographical region. Since the reference station is located in a fixed environment and its location can be determined very precisely via ordinary survey methods, a processor associated with the Reference Station GNSS/GPS receivers can determine more precisely what the true pseudoranges should be to each satellite in view, based on geometrical considerations. Knowing the orbital positions via the GPS almanac as a function of time enables this process, first proposed in 1983, and widely adopted ever since. The difference between the observed pseudorange and the calculated pseudorange for a given Reference station is called the pseudorange correction.
  • a set of corrections for all the global navigation satellites 202 in view is created second by second, and stored, and made available as a service, utilizing GPS/GNSS reference stations 220 and correction services 221 .
  • the pseudoranges at both the cellular device 200 GPS receiver 107 and those at the reference stations 220 are time-tagged, so the corrections for each and every pseudorange measurement can be matched to the local cell phone pseudoranges.
  • the overall service is often referred to as Differential GPS, or DGPS. Without any corrections, GNSS/GPS receivers produce position fixes with absolute errors in position on the order of 4.5 to 5.5 m per the GPS SPS Performance Standard, 4 th Ed. 2008.
  • one or more correction services 221 convey these corrections via a cellular network 222, or the Internet 223.
  • Internet 223 is in turn coupled with a local Wi-Fi network 224 which can convey the corrections to cellular device 200 via Wi-Fi transceiver 214.
  • cellular network 222 can convey the corrections to cellular device 200 via cellular transceiver 21 1.
  • correction services 221 are also coupled with a distribution service 225 which conveys the corrections to an FM radio distributor 226.
  • FM radio distributor 226 can broadcast corrections as a terrestrial radio broadcast 103. It should be appreciated that an FM signal is being described as a subset of possible terrestrial radio broadcasts which may be in a variety of bands and modulated in a variety of manners.
  • cellular device 200 includes one or more integral terrestrial radio antennas associated with integrated terrestrial receivers; FM radio receiver 208 is one example of such a terrestrial receiver which would employ an integrated antenna designed to operate in the correct frequency band for receiving a terrestrial radio broadcast 103. In this manner, in some embodiments, cellular device 200 can receive the corrections via FM radio receiver 208 (or other applicable type of integrated terrestrial radio receiver). In some embodiments, correction services 221 are also coupled with a distribution service 225 which conveys the corrections to a satellite radio distributor 227. Satellite radio distributor 227 can broadcast corrections as a broadcast from one or more communications satellites 201. In some embodiments, cellular device 200 includes one or more integral satellite radio antennas associated with integrated satellite radio receivers 206.
  • Satellite radio receiver 206 is one example of such a satellite receiver which would employ an integrated antenna designed to operate in the correct frequency band for receiving a corrections or other information broadcast from communication satellites 201 . In this manner, in some embodiments, cellular device 200 can receive the corrections via satellite radio receiver 206.
  • Examples of a correction source that provides pseudorange corrections are at least correction service 221 , FM radio distribution 226, or satellite radio distributor 227, or a combination thereof. According to one embodiment, a correction source is located outside of the cellular device 200.
  • Examples of image capturing device 240 are a camera, a video camera, a digital camera, a digital video camera, a digital camcorder, a stereo digital camera, a stereo video camera, a motion picture camera, and a television camera.
  • the image capturing device 240 may use a lens or be a pinhole type device.
  • a cellular device 100, 200 ( Figures 1A-3) can be implemented using software, hardware, hardware and software, hardware and firmware, or a combination thereof. Further, unless specified otherwise, various embodiments that are described as being a part of the cellular device 100, 200, whether depicted as a part of the cellular device 100, 200 or not, can be implemented using software, hardware, hardware and software, hardware and firmware, software and firmware, or a combination thereof.
  • FIG. 1A-2 refer to features that are logic, such as but not limited to, 150, 180B, 152, 152A, 152B, 151 , 151A-151 G, 170B, which can be ;implemented using software, hardware, hardware and software, hardware and firmware, software and firmware, or a combination thereof.
  • the cellular device 100, 200 includes hardware, such as the processor 109, memory 210, and the GNSS chipset 170.
  • An example of hardware memory 210 is a physically tangible computer readable storage medium, such as, but not limited to a disk, a compact disk (CD), a digital versatile device (DVD), random access memory (RAM) or read only memory (ROM) for storing instructions.
  • An example of a hardware processor 109 for executing instructions is a central processing unit. Examples of instructions are computer readable instructions for implementing at least the SUPL Client 101 that can be stored on a hardware memory 210 and that can be executed, for example, by the hardware processor 109.
  • the SUPL client 101 may be implemented as computer readable instructions, firmware or hardware, such as circuitry, or a combination thereof.
  • a GNSS receiver 107 (also referred to as a "receiver"), according to various embodiments, makes a basic measurement that is the apparent transit time of the signal from a satellite to the receiver, which can be defined as the difference between signal reception time, as determined by the receiver's clock, and the transmission time at the satellite, as marked in the signal.
  • This basic measurement can be measured as the amount of time shift required to align the C/A-code replica generated at the receiver with the signal received from the satellite. This measurement may be biased due to a lack of
  • each satellite generates a respective signal in accordance using a clock on board.
  • the receiver generates a replica of each signal using its own clock.
  • corresponding biased range also known as a pseudorange
  • a pseudorange can be defined as the transit time so measured multiplied by the speed of light in a vacuum.
  • time scales There are three time scales, according to one embodiment. Two of the time scales are the times kept by the satellite and receiver clocks. A third time scale is a common time reference, GPS Time (GPST), also known as a composite time scale that can be derived from the times kept by clocks at GPS monitor stations and aboard the satellites.
  • GPS Time also known as a composite time scale that can be derived from the times kept by clocks at GPS monitor stations and aboard the satellites.
  • T be the transit time associated with a specific code transition of the signal from a satellite received at time t per GPST.
  • receiver clock error represents the receiver 304's clock bias 303 and satellite clock error represents the bias 301 in the satellite 305's clock, and both the receiver clock and the satellite clock are measured relative to GPST 302, as shown in Figure 3.
  • Receiver clock error and satellite clock error represent the amounts by which the satellite 305 and receiver 304 clocks are advanced in relation to GPST.
  • the satellite clock error 301 is estimated by the Control Segment and specified in terms of the coefficients of a quadratic polynomial in time. The values of these coefficients can be broadcast in the navigation message.
  • PR (t) c[t + receiver clock error at (t) - (t - ⁇ + satellite clock error at (t- ⁇ ))] +
  • miscellaneous errors at (t) c ⁇ + c[receiver clock errors at (t) - satellite clock error at (t- ⁇ )] + miscellaneous errors at (t) eq. 4 where miscellaneous errors represent unmodeled effects, modeling error, and measurement error.
  • the transmit time multiplied by the speed of light in a vacuum can be modeled as satellite position at (t- ⁇ ).
  • Ionosphere error and troposphere error reflect the delays associated with the transmission of the signal respectively through the ionosphere and the troposphere. Both ionosphere error and troposphere error are positive.
  • PR r +[receiver clock error - satellite clock error] + ionosphere error + troposphere error + miscellaneous errors eq. 5
  • PR the measured pseudorange
  • r the true range from the receiver to the satellite
  • receiver clock error is the difference between the receiver clock and the GPSTIME
  • satellite clock error is the difference between the satellite clock and GPSTIME
  • GPSTIME is ultimately determined at the receiver as part of the least squared solution determined by the least squares solution 171 B so that all clock errors can be resolved to some level of accuracy as part of the position determination process
  • miscellaneous errors include receiver noise, multipath and the like.
  • At least one source of error is associated with satellite positions in space.
  • the navigation message in the GPS signal contains Keplerian parameters which define orbital mechanics mathematics and, thus, the positions of the satellites as a function of time.
  • One component of WAAS and RTXTM contains adjustments to these parameters, which form part of the constants used in solving for the position fix at a given time. Taking account of the corrections is well-known in the GPS position determining arts.
  • the true range r to the satellite is measured. Instead, what is available is PR, the pseudorange, which is a biased and noisy measurement of r. The accuracy of an estimated position, velocity, or time, which is obtained from these measurements, depends upon the ability to compensate for, or eliminate, the biases and errors.
  • the range to a satellite is approximately 20,000 kilometers (km) when the satellite is overhead, and approximately 26,000 km when the satellite is rising or setting.
  • the signal transit time varies between about 70 millisecond (ms) and 90 ms.
  • the C/A-code repeats each millisecond, and the code correlation process essentially provides a measurement of pseudo-transmit time modulo 1 ms.
  • the measurement can be ambiguous in whole milliseconds. This ambiguity, however, is easily resolved if the user has a rough idea of his location within hundreds of kilometers.
  • the week-long P(Y)-code provides unambiguous pseudoranges.
  • the receiver clocks are generally basic quartz crystal oscillators and tend to drift.
  • the receiver manufacturers attempt to limit the deviation of the receiver clock from GPST, and schedule the typical once-per-second measurements at epochs that are within plus or minus 1 millisecond (ms) of the GPST seconds.
  • One approach to maintaining the receiver clock within a certain range of GPST is to steer the receiver clock 'continuously.' The steering can be implemented with software.
  • the second approach is to let the clock drift until it reaches a certain threshold (typically 1 ms), and then reset it with a jump to return the bias to zero.
  • An example of pseudorange measurements with a receiver using the second approach shall now be described in more detail. Assume that there are pseudorange measurements from three satellites which rose about the same time but were in different orbits. Assume that one comes overhead and stays in view for almost seven hours.
  • the pseudorange information processing logic 150 can include various types of logic for improving the position accuracy of the extracted pseudorange information, as described herein.
  • Table 2 as described herein, depicts various combinations of position accuracy improvements for improving extracted pseudorange information, according to various embodiments.
  • Table 3 also depicts various combinations of position accuracy improvements for improving extracted pseudorange information, according to various embodiments.
  • Table 3 includes columns for combination identifier, operation, description, and accuracy.
  • the combination identifier column indicates an identifier for each
  • the operation column specifies operations of various flowcharts in Figures 6-10 for the corresponding combination.
  • the description column specifies various combinations of position accuracy improvements that can be applied to extracted pseudorange information (EPI) according to various embodiments, where examples of position accuracy improvements include, but are not limited to, Wide Area Augmentation System (WAAS) pseudorange corrections, real carrier phase smoothing (real CPI) information, reconstructed carrier phase smoothing information (reconstructed CPI), Differential GPS (DGPS) pseudorange corrections, and Precise Point Positioning (PPP) processing.
  • WAAS Wide Area Augmentation System
  • real CPI real carrier phase smoothing
  • reconstructed CPI reconstructed carrier phase smoothing information
  • DGPS Differential GPS
  • PPP Precise Point Positioning
  • the accuracy column specifies levels of accuracy provided by the
  • Combination 1 is extracted pseudorange information without any additional improvements, which provides 4-5 meters of accuracy. Combination 1 is described in Table 3 to provide a comparison with the other combinations 2-13.
  • the SUPL client 101 can also include a position-accuracy-improvement-determination-logic 180B for determining the one or more position accuracy improvements to apply to the extracted pseudorange information based on one or more factors such as cost, quality of service, and one or more characteristics of the cellular device. For example, different costs are associated with different position accuracy improvements. More specifically, extracted pseudorange information, WAAS and Doppler information are typically free. There is a low cost typically associated with DGPS and real carrier phase information. There is typically a higher cost associated with PPP. Therefore, referring to Table 3, according to one embodiment, combinations 1 , 2, and 3 are typically free, combinations 4-7 typically are low cost, and combinations 8-12 are typically higher cost.
  • Various cellular devices have different characteristics that make them capable of providing different types of position accuracy improvements.
  • one type of cellular device may be capable of providing WAAS but not be capable of providing Doppler information.
  • some types of cellular devices may be capable of providing DGPS but not capable of providing PPP.
  • different activities may require different levels of improvement. For example, some activities and/or people may be satisfied with 4-5 meters, others may be satisfied with 1.7 meters. Yet others may be satisfied with less than 1 meter, and still others may only be satisfied with 2 centimeters. Therefore, different users may request different levels of accuracy.
  • Table 4 depicts sources of the various position accuracy improvements, according to various embodiments.
  • the first column of Table 4 provides the name of the position accuracy improvement.
  • the second column of Table 4 specifies the source for the corresponding position accuracy improvement.
  • a cellular device 100, 200 can initially provide a position that is within 4-5 meters using, for example, unimproved extracted pseudorange information and the position can continually be improved, using various position accuracy improvements as described herein, as long as the antennae of the cellular device 100, 200 is clear of obstructions to receive various position accuracy improvements.
  • a Global Navigation Satellite System is a navigation system that makes use of a constellation of satellites orbiting the earth to provide signals to a receiver, such as GNSS receiver 107, which estimates its position relative to the earth from those signals.
  • GNSS Global Navigation Satellite System
  • Examples of such satellite systems are the NAVSTAR Global Positioning System (GPS) deployed and maintained by the United States, the GLObal NAvigation Satellite System (GLONASS) deployed by the Soviet Union and maintained by the Russian
  • Each GPS satellite transmits continuously using two radio frequencies in the L-band, referred to as L1 and L2, at respective frequencies of 1575.41 MHz and 1227.60 MHz.
  • Two signals are transmitted on L1 , one for civil users and the other for users authorized by the Unites States Department of Defense (DoD).
  • DoD Unites States Department of Defense
  • One signal is transmitted on L2, intended only for DoD-authorized users.
  • Each GPS signal has a carrier at the L1 and L2 frequencies, a pseudo-random number (PRN) code, and satellite navigation data.
  • PRN pseudo-random number
  • a receiver such as GNSS receiver 107, designed for precision positioning contains multiple channels, each of which can track the signals on both L1 and L2 frequencies from a GPS satellite in view above the horizon at the receiver antenna, and from these computes the observables for that satellite comprising the L1 pseudorange, possibly the L2 pseudorange and the coherent L1 and L2 carrier phases.
  • Coherent phase tracking implies that the carrier phases from two channels assigned to the same satellite and frequency will differ only by an integer number of cycles.
  • Each GLONASS satellite transmits continuously using two radio frequency bands in the L-band, also referred to as L1 and L2. Each satellite transmits on one of multiple frequencies within the L1 and L2 bands respectively centered at frequencies of 1602.0 MHz and 1246.0 MHz.
  • the code and carrier signal structure is similar to that of NAVSTAR.
  • a GNSS receiver designed for precision positioning contains multiple channels each of which can track the signals from both GPS and GLONASS satellites on their respective L1 and L2 frequencies, and generate pseudorange and carrier phase
  • Future generations of GNSS receivers will include the ability to track signals from all deployed GNSSs.
  • DGPS Differential Global Positioning System
  • Differential GPS utilizes a reference station which is located at a surveyed position to gather data and deduce corrections for the various error contributions which reduce the precision of determining a position fix. For example, as the GPS signals pass through the ionosphere and troposphere, propagation delays may occur. Other factors which may reduce the precision of determining a position fix may include satellite clock errors, GPS receiver clock errors, and satellite position errors (ephemerides).
  • the reference station receives essentially the same GPS signals as cellular devices 100, 200 which may also be operating in the area. However, instead of using the timing signals from the GPS satellites to calculate its position, it uses its known position to calculate timing.
  • the reference station determines what the timing signals from the GPS satellites should be in order to calculate the position at which the reference station is known to be.
  • the difference in timing can be expressed in terms of pseudorange lengths, in meters.
  • the difference between the received GPS signals and what they optimally should be is used as an error correction factor for other GPS receivers in the area.
  • the reference station broadcasts the error correction to, for example, a cellular device 100, 200 which uses this data to determine its position more precisely.
  • the error corrections may be stored for later retrieval and correction via post-processing techniques.
  • DGPS corrections cover errors caused by satellite clocks, ephemeris, and the atmosphere in the form of ionosphere errors and troposphere errors. The nearer a DGPS reference station is to the receiver 107 the more useful the DGPS corrections from that reference station will be.
  • the system is called DGPS when GPS is the only constellation used for Differential GNSS.
  • DGPS provides an accuracy on the order of 1 meter or 1 sigma for users in a range that is approximately in a few tens of kilometers (kms) from the reference station and growing at the rate of 1 m per 150 km of separation.
  • DGPS is one type of Differential GNSS (DGNSS) technique.
  • DGNSS techniques such as RTK and Wide Area RTK (WARTK), that can be used by high-precision applications for navigation or surveying that can be based on using carrier phase measurements. It should be
  • DGNSS which may utilize signals from other constellations besides the GPS constellation or from combinations of constellations.
  • Embodiments described herein may be employed with other DGNSS techniques besides DGPS.
  • DGNSS corrections are broadcast over an FM subcarrier.
  • U.S. Patent No. 5,477,228 by Tiwari et al. describes a system for delivering differential corrections via FM subcarrier broadcast method, the contents of which are incorporated herein by reference.
  • RTK Real-time Kinematic
  • the RTK method utilizes a reference station located at determined or surveyed point.
  • the reference station collects data from the same set of satellites in view by the cellular device 100, 200 in the area. Measurements of GPS signal errors taken at the reference station (e.g., dual-frequency code and carrier phase signal errors) and broadcast to one or more cellular devices 100, 200 working in the area.
  • the one or more cellular devices 100, 200 combine the reference station data with locally collected position measurements to estimate local carrier-phase ambiguities, thus allowing a more precise determination of the cellular device 100, 200's position.
  • the RTK method is different from DGPS methods in that the vector from a reference station to a cellular device 100, 200 is determined (e.g., using the double differences method).
  • DGPS methods reference stations are used to calculate the changes needed in each pseudorange for a given satellite in view of the reference station, and the cellular device 100, 200, to correct for the various error contributions.
  • DGPS systems broadcast pseudorange correction numbers second-by-second for each satellite in view, or store the data for later retrieval as described above.
  • RTK allows surveyors to determine a true surveyed data point in real time, while taking the data.
  • the range of useful corrections with a single reference station is typically limited to about 70 km because the variable in propagation delay
  • FIG. 4 depicts a flowchart 400 for determining an RTK position solution, according to one embodiment.
  • the method begins.
  • the inputs to the method are reference station network or VRS corrections 412 and GNSS pseudorange plus carrier phase information from the cellular device 414.
  • reference corrections and cellular device data are synchronized and corrections are applied to the GNSS data for atmospheric models and so on.
  • the output of 420 is synchronized GNSS data 422, which is received by operation 430.
  • position, carrier phase ambiguities in floating point, and nuisance parameters are estimated.
  • the output 432 of 430 is user position plus carrier phase ambiguities in floating point.
  • Operation 440 receives the output 432 and produces improved user-position estimates using the integer-nature of carrier phase ambiguities.
  • the output 442 of 440 is an RTK position solution, which can be used according to various
  • the method ends at 450.
  • Network RTK typically uses three or more GPS reference stations to collect GPS data and extract information about the atmospheric and satellite ephemeris errors affecting signals within the network coverage region. Data from all the various reference stations is transmitted to a central processing facility, or control center for Network RTK. Suitable software at the control center processes the reference station data to infer how atmospheric and/or satellite ephemeris errors vary over the region covered by the network.
  • the control center computer processor then applies a process which interpolates the atmospheric and/or satellite ephemeris errors at any given point within the network coverage area and generates a pseudo range correction comprising the actual pseudo ranges that can be used to create a virtual reference station.
  • the control center then performs a series of calculations and creates a set of correction models that provide the cellular device 100, 200 with the means to estimate the ionospheric path delay from each satellite in view from the cellular device 100, 200, and to take account other error contributions for those same satellites at the current instant in time for the cellular device 100, 200's location.
  • the cellular device 100, 200 is configured to couple a data-capable cellular telephone to its internal signal processing system.
  • the user operating the cellular device 100, 200 determines that he needs to activate the VRS process and initiates a call to the control center to make a connection with the processing computer.
  • the cellular device 100, 200 sends its approximate position, based on raw GPS data from the satellites in view without any corrections, to the control center. Typically, this approximate position is accurate to approximately 4-7 meters.
  • the user requests a set of "modeled observables" for the specific location of the cellular device 100, 200.
  • the control center performs a series of calculations and creates a set of correction models that provide the cellular device 100, 200 with the means to estimate the ionospheric path delay from each satellite in view from the cellular device 100, 200, and to take into account other error contributions for those same satellites at the current instant in time for the cellular device 100, 200's location.
  • the corrections for a specific cellular device 100, 200 at a specific location are determined on command by the central processor at the control center and a corrected data stream is sent from the control center to the cellular device 100, 200.
  • the control center may instead send atmospheric and ephemeris corrections to the cellular device 100, 200 which then uses that information to determine its position more precisely.
  • the Virtual Reference Station method extends the allowable distance from any reference station to the cellular devices 100, 200. Reference stations may now be located hundreds of miles apart, and corrections can be generated for any point within an area surrounded by reference stations. However, there are many construction projects where cellular coverage is not available over the entire physical area under construction and survey.
  • the most accurate known method uses relative GNSS carrier phase interferometry between the GNSS cellular device 100, 200's receiver and GNSS reference receiver antennas plus resolution of integer wavelength ambiguities in the differential phases to achieve centimeter-level positioning accuracies.
  • These differential GNSS methods are predicated on the near exact correlation of several common errors in the cellular device 100, 200 and reference observables. They include ionosphere and troposphere signal delay errors, satellite orbit and clock errors, and receiver clock errors.
  • a network GNSS method computes the estimated position of a cellular device 100, 200's receiver using reference observables from three or more reference receivers that approximately surround the cellular device 100, 200's receiver trajectory. This implies that the cellular device 100, 200's receiver trajectory is mostly contained by a closed polygon whose vertices are the reference receiver antennas. The cellular device 100, 200's receiver 107 can move a few kilometers outside this polygon without significant loss of positioning accuracy.
  • a network GNSS algorithm calibrates the ionosphere and troposphere signal delays at each reference receiver position and then interpolates and possibly extrapolates these to the cellular device 100, 200's position to achieve better signal delay cancellation on long baselines than could be had with a single reference receiver. Various methods of signal processing can be used, however they all yield essentially the same performance improvement on long baselines.
  • KAR Kinematic ambiguity resolution
  • satellite navigation is a technique used in numerous applications requiring high position accuracy.
  • KAR is based on the use of carrier phase measurements of satellite positioning system signals, where a single reference station provides the real-time corrections with high accuracy.
  • KAR combines the L1 and L2 carrier phases from the cellular device 100, 200 and reference receivers so as to establish a relative phase interferometry position of the cellular device 100, 200's antenna with respect to the reference antenna.
  • a coherent L1 or L2 carrier phase observable can be represented as a precise pseudorange scaled by the carrier wavelength and biased by an integer number of unknown cycles known as cycle ambiguities.
  • An ambiguity resolution algorithm uses redundant carrier phase observables from the cellular device 100, 200 and reference receivers, and the known reference antenna position, to estimate and thereby resolve these ambiguities.
  • the cellular device 100, 200's receiver 107 can compute its antenna position with accuracies generally on the order of a few centimeters, provided that the cellular device 100, 200 and reference antennas are not separated by more than 10 kilometers.
  • This method of precise positioning performed in real-time is commonly referred to as real-time kinematic (RTK) positioning.
  • RTK real-time kinematic
  • the separation between a cellular device 100, 200 and reference antennas shall be referred to as "cellular device reference separation.”
  • the reason for the cellular device-reference separation constraint is that KAR positioning relies on near exact correlation of atmospheric signal delay errors between the cellular device 100, 200 and reference receiver observables, so that they cancel in the cellular device 100, 200's reference observables combinations (for example, differences between cellular device 100, 200 and reference observables per satellite).
  • the largest error in carrier-phase positioning solutions is introduced by the ionosphere, a layer of charged gases surrounding the earth. When the signals radiated from the satellites penetrate the ionosphere on their way to the ground-based receivers, they experience delays in their signal travel times and shifts in their carrier phases. A second significant source of error is the troposphere delay.
  • the cellular device 100, 200's reference separation constraint has made KAR positioning with a single reference receiver unsuitable for certain mobile positioning applications where the mission of the mobile platform of the cellular device 100, 200 will typically exceed this constraint.
  • One solution is to set up multiple reference receivers along the mobile platform's path so that at least one reference receiver falls within a 10 km radius of the mobile platform's estimated position.
  • Network GNSS methods using multiple reference stations of known location allow correction terms to be extracted from the signal measurements. Those corrections can be interpolated to all locations within the network.
  • Network KAR is a technique that can achieve centimeter-level positioning accuracy on large project areas using a network of reference GNSS receivers. This technique operated in real-time is commonly referred to as network RTK.
  • the network KAR algorithm combines the pseudorange and carrier phase observables from the reference receivers as well as their known positions to compute calibrated spatial and temporal models of the ionosphere and troposphere signal delays over the project area.
  • calibrated models provide corrections to the observables from the cellular device 100, 200's receiver, so that the cellular device 100, 200's receiver 107 can perform reliable ambiguity resolution on combinations of carrier phase observables from the cellular device 100, 200 and some or all reference receivers.
  • the number of reference receivers required to instrument a large project area is significantly less than what would be required to compute reliable single baseline KAR solutions at any point in the project area. See, for example, U.S. Pat. No. 5,477,458, "Network for Carrier Phase Differential GPS Corrections," and U.S. Pat. No. 5,899,957, "Carrier Phase Differential GPS Corrections Network”.
  • a virtual reference station (VRS) network method is a particular
  • a VRS network method comprises a VRS corrections generator and a single- baseline differential GNSS position generator such as a GNSS receiver 107 with differential GNSS capability.
  • the VRS corrections generator has as input data the pseudorange and carrier phase observables on two or more frequencies from N reference receivers, each tracking signals from M GNSS satellites.
  • the VRS corrections generator outputs a single set of M pseudorange and carrier phase observables that appear to originate from a virtual reference receiver at a specified position (hereafter called the VRS position) within the boundaries of the network defined by a polygon (or projected polygon) having all or some of the N reference receivers as vertices.
  • the dominant observables errors comprising a receiver clock error, satellite clock errors, ionosphere and troposphere signal delay errors and noise all appear to be consistent with the VRS position.
  • the single-baseline differential GNSS position generator implements a single-baseline differential GNSS position algorithm, of which numerous examples have been described in the literature. B.
  • Hofmann-Wellenhof et al. Global Positioning System: Theory and Practice, 5th Edition, 1001 (hereinafter "Hofmann-Wellenhof [1001]”), gives comprehensive descriptions of different methods of differential GNSS position computation, ranging in accuracies from one meter to a few centimeters.
  • the single-baseline differential GNSS position algorithm typically computes differences between the cellular device 100, 200 and reference receiver observables to cancel atmospheric delay errors and other common mode errors such as orbital and satellite clock errors.
  • the VRS position is usually specified to be close to or the same as the roving receiver's estimated position so that the actual atmospheric errors in the cellular device 100, 200 receiver 107's observables approximately cancel the estimated atmospheric errors in the VRS observables in the cellular device 100, 200's reference observables differences.
  • the VRS corrections generator computes the synthetic observables at each sampling epoch (typically once per second) from the geometric ranges between the VRS position and the M satellite positions as computed using well-known algorithms such as those given in IS-GPS-200G interface specification tilted "Navstar GPS Space
  • a network RTK system operated in real time requires each GNSS reference receiver to transmit its observables to a network server computer that computes and transmits the corrections and other relevant data to the GNSS cellular device 100, 200's receiver 107.
  • the GNSS reference receivers, plus hardware to assemble and broadcast observables, are typically designed for this purpose and are installed specifically for the purpose of implementing the network. Consequently, those receivers are called dedicated (network) reference receivers.
  • VRS network An example of a VRS network is designed and manufactured by Trimble Navigation Limited, of Sunnyvale, California.
  • the VRS network as delivered by Trimble includes a number of dedicated reference stations, a VRS server, multiple server-reference receiver bi-directional communication channels, and multiple server-cellular-device-bidirectional data communication channels.
  • Each server-cellular device bi-directional communication channel serves one cellular device 100, 200.
  • the reference stations provide their observables to the VRS server via the server-reference receiver bi-directional communication channels. These channels can be implemented by a public network such as the Internet.
  • the bi-directional server-cellular-device communication channels can be radio modems or cellular telephone links, depending on the location of the server with respect to the cellular device 100, 200.
  • the VRS server combines the observables from the dedicated reference receivers to compute a set of synthetic observables at the VRS position and broadcasts these plus the VRS position in a standard differential GNSS (DGNSS) message format, such as one of the RTCM (Radio Technical Commission for Maritime Services) formats, an RTCA (Radio Technical Commission for Aeronautics) format or a proprietary format such as the CMR (Compact Measurement Report) or CMR+ format which are messaging system communication formats employed by Trimble Navigation Limited. Descriptions for numerous of such formats are widely available.
  • DGNSS differential GNSS
  • RTCM Standard 10403.1 for DGNSS Services - Version 3, published October 26, 2006 (and Amendment 2 to the same, published August 31 , 2007) is available from the Radio Technical Commission for Maritime Services, 1800 N. Kent St., Suite 1060, Arlington, Virginia 22209.
  • observables are the observables that a reference receiver located at the VRS position would measure.
  • the VRS position is selected to be close to the cellular device 100, 200's estimated position so that the cellular device 100, 200's VRS separation is less than a maximum separation considered acceptable for the application. Consequently, the cellular device 100, 200 receiver 107 must periodically transmit its approximate position to the VRS server.
  • the main reason for this particular implementation of a real-time network RTK system is compatibility with RTK survey GNSS receivers that are designed to operate with a single reference receiver.
  • VRS as used henceforth in this document, is used as shorthand to refer to any system or technique which has the characteristics and functionality of VRS described or referenced herein and is not necessarily limited to a system from Trimble Navigation Ltd. Hence, the term “VRS” is used in this document merely to facilitate description and is used without derogation to any trademark rights of Trimble Navigation Ltd. or any subsidiary thereof or other related entity.
  • PPP Precise Positioning Point
  • PPP corrections can be any collection of data that provides corrections from a satellite in space, clock errors, ionosphere or troposphere, or a combination thereof. According to one embodiment, PPP corrections can be used in instead of WAAS or RTXTM.
  • PPP Precise Point Positioning
  • a correction stream is produced by the central location; the correction stream contains the orbit and clock information.
  • This correction stream is broadcast or otherwise provided to GNSS receivers, such as a GNSS receiver 107, in the field (conventionally by satellite service or cellular link).
  • Corrections processors in the GNSS receivers utilize the corrections to produce centimeter level positions after a short convergence time (e.g., less than 30 minutes).
  • a main difference between PPP and VRS is that PPP networks of reference receivers are typically global while VRS networks may be regional or localized with shorter spacing between the reference stations in a VRS network.
  • WAAS Wide Area Augmentation System
  • WAAS Wide Area Augmentation System
  • WAAS Global System for Mobile Communications
  • WAAS includes a network of reference stations that are on the ground located in North America and Hawaii.
  • the reference stations transmit their respective measurements to master stations which queue their respective received measurements.
  • the master stations transmit WAAS corrections to geostationary WAAS satellites, which in turn broadcast the WAAS corrections back to earth where cellular devices 100, 200 that include WAAS-enabled GPS receivers can receive the broadcasted WAAS corrections.
  • the GNSS receiver 107 is a WAAS- enabled GPS receiver.
  • the WAAS corrections can be used to improve the accuracy of the respective cellular devices 100, 200' positions, for example, by applying the WAAS corrections to extracted pseudoranges.
  • WAAS operation and implementation is well known in the art.
  • a GNSS chipset 170 provides real carrier phase information (also referred to as "actual carrier phase information").
  • the cellular device 100, 200 can extract real carrier phase information from the GNSS chipset 170 in a manner similar to extracting pseudorange information from the GNSS chipset 170, where the extracted carrier phase information is for use elsewhere in the cellular device 100, 200 outside of the GNSS chipset 170 as described herein, for example, with flowchart 600 of Figure 6.
  • FIG. 5A is a flowchart 500A of a method for performing a carrier phase smoothing operation using real carrier phase information, according to one embodiment.
  • carrier phase smoothing logic 152 may be implemented by either a range domain hatch filter, or a position domain hatch filter, or by any of other
  • the filtering/processing described herein lies in the family of errors in pseudorange processing that affect code and carrier measurements in the same way.
  • the code phase pseudorange measurements are "disciplined” by subtracting out a more constant equivalent pseudorange-like distance measurement derived from the carrier phase.
  • a filtering on the net subtracted signal is performed which allows various embodiments to eliminate multipath induced errors in the raw, and corrected, pseudorange data. This method does not deal with ionospheric effects, according to one embodiment.
  • extracted pseudorange information and carrier phases for a first epoch are collected.
  • these extracted pseudorange information and carrier phases are received at carrier phase smoothing logic 152 from the GNSS receiver 107.
  • pseudorange corrections are collected and applied to the first set of extracted pseudoranges collected in operation 501 A.
  • these corrections themselves may be smoothed at the reference receiver (e.g., at GPS/GNSS reference stations 220) so that the delivered pseudorange corrections themselves are less noisy. Smoothing the pseudorange corrections derived at the reference receiver (e.g., at GPS/GNSS reference stations 220) so that the delivered pseudorange corrections themselves are less noisy. Smoothing the pseudorange corrections derived at the reference receiver (e.g., at GPS/GNSS reference stations 220) so that the delivered pseudorange corrections themselves are less noisy. Smoothing the pseudorange corrections derived at the reference receiver (e.g., at GPS/GNSS reference stations 220) so that the delivered pseudorange corrections themselves are less noisy. Smoothing the pseudorange corrections derived at the reference receiver (e.g., at GPS/GNSS reference stations 220) so that the delivered pseudorange corrections themselves are less noisy. Smoothing the pseudorange corrections derived at the reference receiver (e.g.
  • GPS/GNSS reference stations 220 using the same carrier phase method of flowchart 500A can vastly improve the quality of the delivered pseudorange corrections delivered to cellular device 100, 200 for use by a position determination processor (e.g., GNSS receiver 107 or pseudorange information processing logic 150). Such corrected pseudoranges that are also smoothed may be used by the cellular device 100, 200 and fetched if available.
  • a position determination processor e.g., GNSS receiver 107 or pseudorange information processing logic 150.
  • Such corrected pseudoranges that are also smoothed may be used by the cellular device 100, 200 and fetched if available.
  • delta carrier phase measurements for the same epoch are created using real carrier phase information. In accordance with various embodiments, this replicates creating a second distance measurement, similar to the reconstructed carrier phase information, based on integrated Doppler Shift.
  • the delta carrier phase measurements are subtracted from the corrected extracted pseudoranges.
  • this provides a fairly constant signal for that epoch and is equivalent to the corrected extracted pseudorange at the start of the integration interval.
  • this is referred to as a "disciplining" step that smoothes out the corrected extracted pseudorange signal and therefore reduces the instant errors in the later- computed position fixes.
  • the signal is filtered after the subtraction of operation 504A to reduce noise. In accordance with one embodiment, this is performed by averaging the carrier phase "yardsticks" over a series of epochs.
  • the new filtered and corrected extracted pseudorange signal is processed, for example, at the pseudorange information processing logic 150, to derive a position fix 172B.
  • Carrier Phase Information can be reconstructed (referred to herein as "reconstructed carrier phase") based on Doppler Shift.
  • Doppler Shift is the change in frequency of a periodic event (also known as a "wave") perceived by an observer that is moving relative to a source of the periodic event.
  • Doppler shift refers to the change in apparent received satellite signal frequency caused by the relative motion of the satellites as they either approach the cellular device 100, 200 or recede from it.
  • any measurement of Doppler frequency change is similar to differentiating carrier phase. It is therefore possible to reconstruct the carrier phase by integrating the Doppler shift data.
  • the GNSS chipset 170 of GNSS receiver 107 may provide Doppler information it determines through other means.
  • This Doppler frequency shift information or "Doppler” may be collected at each GPS timing epoch (e.g., one second) and integrated over a sequence of the one-second epochs, to produce a model of carrier phase.
  • This Doppler-derived carrier phase model may be substituted for the real carrier phase data, and used in the same manner as shown in the flow chart for carrier phase smoothing of Figure 5A.
  • Doppler Shift signal processing is well known in the art.
  • Figure 5B is a flowchart 500B of a method for generating reconstructed carrier phase information (also referred to as a "Doppler-derived carrier phase model”) based on Doppler Shift, according to one embodiment.
  • reconstructed carrier phase information also referred to as a "Doppler-derived carrier phase model”
  • method of flowchart 500Bis implemented at GPS/GNSS reference stations and the modeled carrier phase is provided to cellular device 100, 200 via one of the communication networks described above.
  • Doppler information from a GNSS receiver 107 of a GNSS chipset 170 is received by pseudorange-carrier-phase-smoothing-logic 152.
  • Doppler frequency shift information may be collected at each GPS timing epoch (e.g., one second) and stored for use in producing a model of carrier phase.
  • a model of carrier phase is created based on integrated Doppler information. As discussed above with reference to operation 502B, a series of Doppler information for a plurality of timing epochs is integrated. In one
  • this Doppler information is integrated over a sequence of the one-second epochs, to produce a model of carrier phase.
  • the sequence may include 10-100 epochs, or seconds.
  • the model of carrier phase smoothing is used as the reconstructed carrier phase information.
  • the modeled carrier phase which is also referred to as "reconstructed carrier phase information" is supplied to pseudorange-carrier- phase-smoothing-logic 152.
  • method of flowchart 500B can be implemented at GPS/GNSS reference stations 220 and the reconstructed carrier phase information can then be broadcast to cellular device 100, 200.
  • Figure 6 depicts a flowchart 600 of a method of extracting pseudorange information using a cellular device, according to one embodiment.
  • the cellular device 100, 200 accesses the GNSS chipset 170 embedded within the cellular device 100, 200 where the GNSS chipset 170 calculates pseudorange information for use by the GNSS chipset 170.
  • the GNSS receiver 107 can perform GPS measurements to derive raw measurement data for a position of the cellular device 100.
  • the raw measurement data provides an instant location of the cellular device 100.
  • the GNSS chipset 170 calculates pseudorange information that is for use by the GNSS chipset 170.
  • the raw measurement data is the pseudorange information that will be extracted. Examples of pseudorange information are uncorrected pseudorange information, differential GNSS corrections, high precision GNSS satellite orbital data, GNSS satellite broadcast ephemeris data, and ionospheric projections.
  • a chipset accessor logic 141 is configured for accessing the GNSS chipset 170.
  • the chipset accessor logic 141 is a part of an SUPL client 101.
  • the pseudorange information can be obtained from the processor 172 of the GNSS receiver 107 using a command.
  • the GNSS chipset 170 may be designed, for example, by the manufacturer of the GNSS chipset 170, to provide requested information, such as pseudorange information, in response to receiving the command.
  • pseudorange information may be extracted from the GNSS chipset 170 using the command that the manufacturer has designed the GNSS chipset 170 with.
  • the GNSS chipset 170 is accessed using an operation that is a session started with a message that is an improved accuracy Secure User Platform Location (SUPL) start message or a high precision SUPL INIT message.
  • the message is a custom command that is specific to the GNSS chipset 170 (also referred to as "a GNSS chipset custom command") and the improved accuracy SUPL client 101 can access to the raw measurements of the GNSS chipset 170.
  • chipset manufacturers include Qualcomm, Texas Instruments, FastraX, Marvel, SIRF, Trimble, SONY, Furuno, Nemerix, Phillips, and XEMICS, to name a few.
  • the cellular device 100, 200 extracts the pseudorange information from the GNSS chipset 170 for use elsewhere in the cellular device 100, 200 outside of the GNSS chipset 170.
  • pseudorange information extractor logic 142 may be associated with a worker thread of the SUPL client 101 .
  • the worker thread associated with the SUPL client 101 can monitor the raw measurements delivered by the GNSS chipset 170 into the GNSS chipset 170's memory buffers, cache the raw measurements and use the raw measurements to determine a position fix.
  • the pseudorange information extractor logic 142 and the pseudorange information processing logic 150 can be associated with the worker thread.
  • the pseudorange information extractor logic 142 can cache the raw measurements and the pseudorange information processing logic 150 can determine the location.
  • the raw measurement data is the pseudorange information that is extracted.
  • the raw measurement data is pseudorange information that is calculated by the GNSS chipset 170 and is only for use by the GNSS chipset 170.
  • a determining position fix logic 170B may perform a least squares solution171 B on the extracted pseudorange information prior to transmitting the output to the pseudorange information bridger logic 143.
  • the extracted pseudorange information is improved using various embodiments described in Figures 7A-10 prior to performing a least squares solution171 B, as will be described herein.
  • the extracted pseudorange information without further improvements can be used to provide an instant location, as described herein.
  • the extracted pseudorange information can be improved by applying position accuracy improvements that include, but are not limited to, those depicted in Tables 2 and 3.
  • the instant location or the improved location can be communicated to location manager logic 161 , as discussed herein, that displays the instant location or the improved location with respect to a map.
  • Figure 7A depicts a flowchart 700A of a method of improving the position accuracy using one or more position accuracy improvements, according to one
  • the pseudorange-correction-logic 151 provides Wide Area
  • the pseudorange-correction-logic 151 receives the extracted pseudorange information that was extracted from the GNSS chipset 170 at 630 of Figure 6.
  • the cellular device 100, 200 receives the WAAS corrections, as described herein, and provides the WAAS corrections to the pseudorange-correction-logic 151.
  • the pseudorange-correction-logic 151 provides Wide Area Augmentation System (WAAS) corrected pseudoranges by applying the received WAAS corrections to the extracted pseudorange information.
  • WAAS Wide Area Augmentation System
  • Figure 7B depicts a flowchart 700B of a method of improving the position accuracy using one or more position accuracy improvements, according to one
  • the pseudorange-carrier-phase-smoothing-logic 152 provides smoothed pseudorange information by performing pseudorange smoothing on the extracted pseudorange information based on carrier phase information. For example, if real carrier phase information is available, the cellular device 100, 200 can extract it as discussed herein. Otherwise, the cellular device 100, 200 can derive reconstructed carrier phase information as described herein and provide the reconstructed carrier phase information to the pseudorange-carrier-phase-smoothing-logic 152.
  • the pseudorange-carrier-phase- smoothing-logic 152 can receive the extracted pseudorange information that was extracted from the GNSS chipset 170 at 630 of Figure 6.
  • the pseudorange -carrier-phase-smoothing- logic 152 can apply either the real carrier phase information or the real carrier phase information to the extracted pseudorange information to provide smoothed pseudorange information.
  • a position fix is determined based on the smoothed pseudorange information and WAAS pseudorange corrections.
  • the pseudorange- correction-logic 151 receives the smoothed pseudorange information and receives WAAS pseudorange corrections and determines a position fix based on the smoothed pseudorange information and the WAAS pseudorange corrections.
  • a determining position fix logic 170B may perform a least squares solution 171 B on the output of flowchart 700A and 700B prior to transmitting the output to the pseudorange information bridger logic 143.
  • Figure 8A depicts a flowchart 800A of a method of improving the position accuracy using one or more position accuracy improvements, according to one
  • the pseudorange-correction-logic 151 provides Differential Global Positioning System (DGPS) corrected pseudoranges by applying DGPS corrections to the extracted pseudorange information.
  • DGPS Differential Global Positioning System
  • the pseudorange-correction-logic 151 receives the extracted pseudorange information that was extracted from the GNSS chipset 170 at 630 of Figure 6.
  • the cellular device 100, 200 receives the DGPS corrections as described herein and provides the DGPS corrections to the pseudorange-correction-logic 151.
  • the pseudorange- correction-logic 151 provides Differential Global Positioning System (DGPS) corrected pseudoranges by applying the received DGPS corrections to the extracted pseudorange information.
  • DGPS Differential Global Positioning System
  • the pseudorange-correction-logic 151 provides WAAS-DGPS corrected pseudoranges by applying Wide Area Augmentation System (WAAS) to the DGPS corrected pseudoranges.
  • WAAS Wide Area Augmentation System
  • the pseudorange-correction-logic 151 accesses the DGPS corrected pseudoranges determined at 820A of Figure 8A.
  • the cellular device 100, 200 receives the WAAS corrections as described herein and provides the WAAS corrections to the pseudorange-correction-logic 151 .
  • the pseudorange-correction-logic 151 provides WAAS-DGPS corrected pseudoranges by applying Wide Area Augmentation System (WAAS) to the DGPS corrected pseudoranges.
  • WAAS Wide Area Augmentation System
  • Figure 8B depicts a flowchart 800B of a method of improving the position accuracy using one or more position accuracy improvements, according to one
  • a position determination decision is made as to whether to proceed to 822B or 824B.
  • the position accuracy improvement determination logic 180B can determine whether to proceed to 822B or 824B as discussed herein.
  • DGPS corrected smoothed pseudoranges are provided by applying corrections to the smoothed pseudorange information.
  • the pseudorange- correction-logic 151 can provide DGPS corrected smoothed pseudoranges by applying DGPS corrections to the smoothed pseudoranges determined at either 822B or 824B.
  • WAAS-DGPS corrected smoothed pseudoranges are provided by applying WAAS to the DGPS corrected smoothed pseudoranges.
  • the pseudorange-correction-logic 151 can provide WAAS-DGPS corrected smoothed pseudoranges by applying WAAS corrections to the DGPS corrected smoothed
  • a determining position fix logic 170B may perform a least squares solution 171 B on the output of flowcharts 800A or 800B prior to transmitting the output to the pseudorange information bridger logic 143.
  • Figure 9A depicts a flowchart 900A of a method of improving the position accuracy using one or more position accuracy improvements, according to one
  • DGPS corrected pseudoranges are determined by applying DGPS pseudorange corrections to extracted pseudorange information.
  • the pseudorange-correction-logic 151 receives extracted pseudorange information from the pseudorange information extractor logic 142 and applies the DGPS pseudorange corrections to the extracted pseudorange information.
  • the pseudorange-correction-logic 151 can determine a position fix based on the DGPS corrected pseudoranges and PPP corrections.
  • Figure 9B depicts a flowchart 900B of a method of improving the position accuracy using one or more position accuracy improvements, according to one
  • smoothed pseudorange information is provided by performing pseudorange smoothing on the extracted pseudorange information using carrier phase information.
  • the pseudorange-carrier-phase-smoothing-logic 152 provides smoothed pseudorange information by performing pseudorange smoothing on the extracted pseudorange information, which can be obtained as discussed herein, based on carrier phase information. If real carrier phase information is available, the cellular device 100, 200 can extract the real carrier phase information, as discussed herein. Otherwise, the cellular device 100, 200 can derive reconstructed carrier phase information, as described herein, and provide the reconstructed carrier phase information to the pseudorange-carrier-phase- smoothing-logic 152.
  • DGPS corrected smoothed pseudoranges are provided by applying DGPS pseudorange corrections to the smoothed pseudorange information.
  • the pseudorange-correction-logic 151 can receive the smoothed pseudorange information from the pseudorange-carrier-phase-smoothing-logic 152.
  • the pseudorange-correction- logic 151 can determine the corrected smoothed pseudoranges by applying DGPS pseudorange corrections to the smoothed pseudorange information.
  • a position fix can be determined based on the DGPS corrected smoothed pseudoranges and PPP corrections.
  • the pseudorange-correction- logic 151 can determine a position fix based on the DGPS corrected smoothed
  • a determining position fix logic 170B may perform a least squares solution 171 B on the output of flowcharts 900A and 900B prior to transmitting the output to the pseudorange information bridger logic 143.
  • Figure 10 depicts a flowchart 1000 of a method of improving the position accuracy using one or more position accuracy improvements, according to one
  • the pseudorange-carrier-phase-smoothing-logic 152 smoothes the extracted pseudorange information based on carrier phase smoothing.
  • the pseudorange-carrier-phase-smoothing-logic 152 receives extracted pseudorange information from the pseudorange information extractor logic 142 and receives carrier phase information, which may be either real carrier phase information or reconstructed carrier phase information, as described herein.
  • the pseudorange-carrier-phase-smoothing-logic 152 smoothes the extracted pseudorange information based on carrier phase smoothing.
  • the PPP logic 151 C provides a smoothed improved accuracy position fix by performing Precise Point Positioning (PPP) processing on the smoothed extracted pseudorange information.
  • PPP Precise Point Positioning
  • the PPP logic 151 C receives the smoothed extracted pseudorange information provided by the pseudorange-carrier-phase- smoothing-logic 152 at 1020.
  • the PPP logic 151 C provides a smoothed improved accuracy position fix by performing Precise Point Positioning (PPP) processing on the smoothed extracted pseudorange information
  • the pseudorange-correction-logic 151 can optionally correct the smoothed improved accuracy position fix by applying Differential Global Positioning System (DGPS) corrections to the smoothed improved accuracy position fix.
  • DGPS Differential Global Positioning System
  • pseudorange-correction-logic 151 receives the smoothed improved accuracy position fix provided by the PPP logic 151 C at 1030.
  • the pseudorange-correction-logic 151 receives DGPS corrections as described herein.
  • the pseudorange-correction-logic 151 corrects the smoothed improved accuracy position fix by applying Differential Global Positioning System (DGPS) corrections to the smoothed improved accuracy position fix, thus, providing a corrected smoothed improved accuracy position fix.
  • Operation 1040 is optional, according to one embodiment.
  • a determining position fix logic 170B may perform a least squares solution 171 B on the output of flowchart 1000 prior to transmitting the output to the pseudorange information bridger logic 143.
  • Figure 1 1 depicts a flowchart 1 100 of a method of accessing and processing extracted pseudorange information, according to one embodiment.
  • various types of information can be accessed. Examples of accessing are extracting 1 1 12 information and receiving 1 1 14 information. Unsmoothed uncorrected pseudorange information can be extracted at 1 1 12A, WAAS corrections can be extracted at 1 1 12B, SBAS corrections can be extracted at 1 1 12E, Doppler shift can be extracted at 1 1 12C, and carrier phase measurements can be extracted at 1 1 12D.
  • Table 1 depicts types of information that can be extracted at operation 1 1 12 from the GNSS chipset 170 and types of information that are received at operation 1 1 14 instead of being extracted. However, various embodiments are not limited to the types of information that can be extracted or received depicted in Table 1.
  • the received or extracted information or a combination thereof can be processed at 1 120.
  • What or whether to apply position accuracy improvements can be determined at 1 160, for example, by the position accuracy improvement determination logic 180B.
  • the determination logic 180B can determine whether one or more and in what order logics 152A, 152B, 151A-151 F are performed, according to one embodiment.
  • Tables 2 and 3 are examples of carrier phase information or corrections or a combination thereof, that the position accuracy improvement determination logic 180B may determine, as discussed herein.
  • the information can be smoothed at 1 130.
  • smoothing 1 130 are real carrier phase smoothing 1 132 and reconstructed carrier phase smoothing 1 134.
  • Either unsmoothed information or smoothed information can be corrected at 1 140.
  • unsmoothed information from 1 1 10 or smoothed information from 1 130 can be corrected at 1 140.
  • Examples of correcting are SBAS correcting 1 140G, WAAS correcting 1140A, DGPS correcting 1140B, PPP correcting 1140C, RTK correcting 1140D, VRS correcting 1140E, and RTX correcting 1140F.
  • the smoothed information or unsmoothed information can be corrected using one or more of operations 1140A-1140G.
  • WAAS correcting 1140A is an example of SBAS correcting 1140G.
  • Unsmoothed information from 1110, smoothed information from 1112, corrected unsmoothed information from 1140 or corrected smoothed information from 1140 can be used to determine a position fix 172B at 1150, for example, by performing a least squares solution 171 B at 1152.
  • the output of flowchart 1100 is a position fix 172B.
  • Table 2 and Table 3 depict combinations of information that result in a position fix 172B, according to various embodiments.
  • accessing 1110, extracting 1112, extracting pseudorange information 1112A, extracting SBAS 1112E, extracting WAAS 1112B, extracting Doppler 1112C, extracting carrier phase measurement 1112D, receiving 1114, smoothing 1130, correcting 1140, determining a position fix 1150, and performing a least squares solution 1152 can be performed respectively by logic 110B, 142, 112B-5, 112B-2, 112B-3, 112B-4, 114B, 150, 152, 151, and 170B.
  • Real carrier phase smoothing 1132, reconstructed carrier phase smoothing 1134, correcting 1140A-1140G can be performed respectively by logic 152A, 152B, 151A-151E, 151 F, 151G.
  • Any one or more of 1112, 1112A-1112E, 1132, 1134, 1140A-1140G can be performed. Further, any one or more of 1112, 1112A-1112E, 1112B, 1112C, 1112E, 1132, 1134, 1140A-1140G can be performed in various orders. Various embodiments are not limited to just the combinations that are described herein.
  • a Global Navigation Satellite System (GNSS) chipset embedded within the cellular device is accessed at 620 ( Figure 6) where the GNSS chipset calculates pseudorange information for use by the GNSS chipset.
  • the pseudorange information is extracted at 640 ( Figure 6), 112 ( Figure 11 ) from the GNSS chipset for use elsewhere in the cellular device outside of the GNSS chipset.
  • the accessing 620 and the extracting 640, 1112A can be performed by the cellular device 100, 200 that includes hardware 180.
  • the extracted pseudorange information can be smoothed at 1130.
  • the smoothing 1130 can be based on reconstructed carrier phase information or real carrier phase information.
  • the smoothed pseudorange information can be corrected at 1 140.
  • corrected pseudoranges examples include Wide Area Augmentation System (WAAS), Differential Global Positioning System (DGPS), Precise Point Positioning (PPP), and Real Time Kinematic (RTK).
  • WAAS Wide Area Augmentation System
  • DGPS Differential Global Positioning System
  • PPP Precise Point Positioning
  • RTK Real Time Kinematic
  • Pseudorange corrections can be accessed 1 1 10.
  • the corrected pseudorange information can be derived, for example at 1 140, by applying the pseudorange corrections to the extracted pseudorange information.
  • Figures 4-1 1 depict flowcharts 400-1 100, according to one embodiment. Although specific operations are disclosed in flowcharts 400-1 100, such operations are exemplary. That is, embodiments of the present invention are well suited to performing various other operations or variations of the operations recited in flowcharts 400-1 100. It is appreciated that the operations in flowcharts 400-1 100 may be performed in an order different than presented, and that not all of the operations in flowcharts 400-1 100 may be performed.
  • the operations depicted in Figures 4-1 1 transform data or modify data to transform the state of a cellular device 100, 200. For example, by extracting pseudorange information from a GNSS chipset 170 for use elsewhere, the state of the cellular device 100, 200 is transformed from a cellular device that is not capable of determining a position fix itself into a cellular device that is capable of determining a position fix itself.
  • operations depicted in flowcharts 400-1 100 transform the state of a cellular device 100, 200 from not being capable of providing an improved accuracy position fix to be capable of providing an improved accuracy position fix.
  • FIG. 4-1 1 The operations depicted in Figures 4-1 1 can be implemented as computer readable instructions, hardware or firmware. According to one embodiment, hardware associated with a cellular device 100, 200 can perform one or more of the operations depicted in Figures 4-1 1 .
  • FIG. 12 illustrates a block diagram of a GNSS receiver in the form of a general purpose GPS receiver 1230 capable of demodulation of the L1 and/or L2 signal(s) received from one or more GPS satellites.
  • GPS receiver 1230 A more detailed discussion of the function of a receiver such as GPS receiver 1230 can be found in U.S. Patent Number 5,621 ,416, by Gary R. Lennen, is titled Optimized processing of signals for enhanced cross-correlation in a satellite positioning system receiver," and includes a GPS receiver very similar to GPS receiver 1230 of Figure 12.
  • received L1 and L2 signals are generated by at least one GPS satellite. Each GPS satellite generates different signal L1 and L2 signals and they are processed by different digital channel processors 1252 which operate in the same way as one another.
  • Antenna 1232 may be a magnetically mountable model commercially available from Trimble Navigation of
  • Master oscillator 1248 provides the reference oscillator which drives all other clocks in the system.
  • Frequency synthesizer 1238 takes the output of master oscillator 1248 and generates important clock and local oscillator frequencies used throughout the system. For example, in one embodiment frequency synthesizer 1238 generates several timing signals such as a 1 st (local oscillator) signal L01 at 1400 MHz, a 2nd local oscillator signal L02 at 175 MHz, an SCLK (sampling clock) signal at 25 MHz, and a MSEC
  • a filter/LNA (Low Noise Amplifier) 1234 performs filtering and low noise amplification of both L1 and L2 signals.
  • the noise figure of GPS receiver 1230 is dictated by the performance of the filter/LNA combination.
  • the downconvertor 1236 mixes both L1 and L2 signals in frequency down to approximately 175 MHz and outputs the analogue L1 and L2 signals into an IF (intermediate frequency) processor 1250.
  • IF processor 1250 takes the analog L1 and L2 signals at approximately 175 MHz and converts them into digitally sampled L1 and L2 inphase (L1 I and L2 I) and quadrature signals (L1 Q and L2 Q) at carrier frequencies 420 KHz for L1 and at 2.6 MHz for L2 signals respectively.
  • At least one digital channel processor 1252 inputs the digitally sampled L1 and L2 inphase and quadrature signals. All digital channel processors 1252 are typically are identical by design and typically operate on identical input samples. Each digital channel processor 1252 is designed to digitally track the L1 and L2 signals produced by one satellite by tracking code and carrier signals and to from code and carrier phase measurements in conjunction with the GNSS microprocessor system 1254. One digital channel processor 1252 is capable of tracking one satellite in both L1 and L2 channels. Microprocessor system 1254 is a general purpose computing device (such as computer system 1000 of Figure 10) which facilitates tracking and measurements processes, providing pseudorange and carrier phase measurements for a determining position fix logic 1258.
  • microprocessor system 1254 provides signals to control the operation of one or more digital channel processors 1252.
  • the GNSS microprocessor system 1254 provides one or more of pseudorange information 1272, Doppler Shift information 1274, and real Carrier Phase Information 1276 to the determining position fix logic 1258.
  • pseudorange information 1272, Doppler Shift information 1274, and real Carrier Phase Information 1276 can also be obtained from storage 1260.
  • One or more of the signals 1272, 1274, 1276 can be conveyed to the cellular device's processor, such as processor 109 ( Figure 1A) that is external to the GNSS chipset 170 ( Figure 1A).
  • Determining position fix logic 1258 performs the higher level function of combining measurements in such a way as to produce position, velocity and time information for the differential and surveying functions, for example, in the form of a position fix 1280.
  • Storage 1260 is coupled with determining position fix logic 1258 and
  • determining position fix logic 1258 performs one or more of the methods of position correction described herein.
  • microprocessor 1254 and/or determining position fix logic 1258 receive additional inputs for use in receiving corrections information.
  • an example of the corrections information is WAAS corrections.
  • examples of corrections information are differential GPS corrections, RTK corrections, signals used by the previously referenced Enge-Talbot method, and wide area augmentation system (WAAS) corrections among others.
  • WAAS wide area augmentation system
  • Figure 12 depicts a GNSS receiver 1 130 with navigation signals L1 I, L1 Q, L2I, L2Q
  • various embodiments are well suited different combinations of navigational signals.
  • the GNSS receiver 1 130 may only have an L1 1 navigational signal.
  • the GNSS receiver 1 130 may only have L1 I, L1 Q and L2I.
  • either or both of the accessing logic 1 10B and the processing logic 150 reside at either or both of the storage 1260 and GNSS
  • microprocessor system 1254 The microprocessor system 1254.
  • the GNSS receiver 1230 is an example of a GNSS receiver 107 (see e.g., Figure 1A and Figure 1 D).
  • the determining position fix logic 1258 is an example of determining position fix logic 170B ( Figure 1 B).
  • position fix 1280 is an example of a position fix 172B ( Figure 1 B).
  • Figure 13 depicts an example Kalman filtering process 1300, according to some embodiments. It should be appreciated that Kalman filtering is well known. As such, Figure 13 and the associated discussion are utilized only to provide a high-level general description. Variations in the described procedures will occur during specific
  • Kalman filtering is a basic two-step predictor/corrector modeling process that is commonly used model dynamic systems. A dynamic system will often be described with a series of mathematical models. Models describing satellites in a Global Navigation Satellite System (GNSS) are one example of a dynamic system.
  • GNSS Global Navigation Satellite System
  • Kalman filtering can be used in determining positions of the satellites.
  • a basic Kalman filter implemented using Kalman filtering process 1300 typically has at least two major components 1310: states 131 1 and covariances 1312.
  • States 131 1 represent variables that are used to describe a system being modeled, at a particular moment in time.
  • Covariances 1312 are represented in a covariance matrix that describes uncertainty, or lack of confidence, of states 131 1 with respect to each other at that same moment in time.
  • Kalman filtering process 1300 also handles noise, or unpredictable variability, in the model.
  • a Kalman filter may handle additional noise types, in some
  • Process noise 1321 describes noise of the states 131 1 as a function of time.
  • Observation noise 1341 is noise that relates to the actual observation(s) 1340 (e.g., observed measurements) that are used as an input/update to Kalman filtering process1300.
  • a prediction phase 1320 is the first phase of Kalman filtering process 1300.
  • Prediction phase 1320 uses predictive models to propagate states 131 1 to the time of an actual observation(s) 1340.
  • Prediction phase 1320 also uses process noise 1321 and predictive models to propagate the covariances 1312 to time of the actual observation(s) 1340 as well.
  • the propagated states 131 1 are used to make predicted observation(s) 1322 for the time of actual observation(s) 1340.
  • a correction phase 1330 is the second phase in the Kalman filtering process 1300.
  • Kalman filtering process 1300 uses the difference between the predicted observation(s) 1322 and the actual observation(s) 1340 to create an observation measurement residual 1331 , which may commonly be called the "measurement residual.”
  • Observation noise 1341 can be noise in actual observation(s) 1340 and/or noise that occurs in the process of taking the actual observation(s) 1340.
  • a Kalman gain 1332 is calculated using both the covariances 1312 and the observation noise 1341 .
  • the states 131 1 are then updated using the Kalman Gain 1332 multiplied by the observation measurement residual 1331.
  • the covariances 1312 are also updated using a function related to the Kalman gain 1332; for example, in one embodiment where Kalman gain is limited to a value between 0 and 1 , this function may be 1 minus the Kalman gain. This updating is sometimes referred to as the "covariance update.”
  • Kalman filtering process 1300 can simply skip correction phase 1330 and update the states 131 1 and covariances 1312 using only the information from prediction phase 1320, and then begin again. Using the new definitions of the states 131 1 and covariances 1312, Kalman filtering process 1300 is ready to begin again and/or to be iteratively accomplished.
  • any one or more of the embodiments described herein can be implemented using non-transitory computer readable storage medium and computer readable instructions which reside, for example, in computer-readable storage medium of a computer system or like device.
  • the non-transitory computer readable storage medium can be any kind of physical memory that instructions can be stored on. Examples of the non-transitory computer readable storage medium include but are not limited to a disk, a compact disk (CD), a digital versatile device (DVD), read only memory (ROM), flash, and so on.
  • certain processes and operations of various embodiments of the present invention are realized, in one embodiment, as a series of computer readable instructions (e.g., software program) that reside within non-transitory computer readable storage memory of a cellular device 100, 200 ( Figures 1A-2) and are executed by a hardware processor of the cellular device 100, 200.
  • the instructions When executed, the instructions cause a computer system to implement the functionality of various embodiments of the present invention.
  • the instructions can be executed by a central processing unit associated with the cellular device 100, 200.
  • the non- transitory computer readable storage medium is tangible.
  • one or more of the various embodiments described herein can be implemented as hardware, such as circuitry, firmware, or computer readable instructions that are stored on non-transitory computer readable storage medium.
  • the computer readable instructions of the various embodiments described herein can be executed by a hardware processor, such as central processing unit, to cause the cellular device 100, 200 to implement the functionality of various embodiments.
  • a hardware processor such as central processing unit
  • the SUPL client 101 and the operations of the flowcharts 400-1 100 depicted in Figures 4-1 1 are implemented with computer readable instructions that are stored on computer readable storage medium, which can be tangible or non- transitory or a combination thereof, and can be executed by a hardware processor 109 of a cellular device 100, 200..
  • a current position fix can differ significantly from one or more previous position fixes or succeeding position fixes, or a combination of previous position fixes and succeeding position fixes.
  • a position fix that differs significantly from one or more previous position fixes or succeeding position fixes, or a combination thereof, is referred to as an "outlier.”
  • locally measured movement information obtained, for example, from hardware, such as an accelerometer or an image capturing device, may be used to validate the accuracy of a position fix, to discard a position fix that is an "outlier," or to calculate a new position fix that can replace the discarded position fix, or a combination there of.
  • a position fix may be determined to be an "outlier" based on the accuracy of that position fix.
  • Validating accuracy of a position fix, discarding a position fix that is an "outlier," and calculating a new position fix to replace a discarded position fix based on locally measured movement information are each examples of improving position determine of a cellular device using locally measured movement information.
  • a filter can be used to perform one or more of the validating of the accuracy of a position fix, the discarding of the position fix, the calculating of a new position fix and the replacing of the discarded position fix.
  • the locally measured movement information that is used to determine to remove a position fix or to calculate a new position fix that will replace the removed position fix can be from dissimilar kinds of sensors.
  • An accelerometer and an image capturing device are examples of sensors that are dissimilar with respect to each other.
  • a filter can be used to integrate (also known as "blend") the locally measured movement information from the dissimilar sensors together, for example, using weighting factors, as discussed herein.
  • Locally measured movement information is information that includes measurements of movement where the movement and the measurements of the movement occur locally with respect to a cellular device.
  • a cellular device For example, an accelerometer that is attached or part of a cellular device can be used to measurement the distance that the cellular device has moved.
  • one or more images obtained with an image capturing device that is attached or part of the cellular device can be used to measure the distance the cellular device has moved.
  • the first process extracts raw pseudorange information, which is uncorrected and unsmoothed, from a GNSS chipset embedded in the cellular device, determines position fix(es) based on the extracted raw pseudoranges and optionally smoothes, for example, by discarding one or more of the position fix(es) using locally measured movement (LMM) information.
  • the extracted raw pseudoranges may be corrected based on external corrections prior to determining the position fix(es). Examples of external corrections include WAAS, SBAS, DGPS, PPP, RTK, VRS and RTX corrections. External corrections are obtained from sources that are external to the cellular device.
  • the second process extracts raw pseudorange information, smoothes the extracted raw pseudorange information using carrier phase information, which may be either real or reconstructed carrier phase information, determines one or more position fixes based on the smoothed pseudorange information, and optionally performs additional smoothing by applying locally measured movement (LMM) information to one or more position fix(es).
  • LMM locally measured movement
  • real carrier phase information is preferred over reconstructed carrier phase information.
  • the smoothed pseudoranges (also referred to as "carrier phase smoothed pseudoranges”) may be corrected based on external corrections prior to determining a position fix.
  • Carrier phase smoothing can be used to discard pseudoranges with larger changes in apparent size than might be expected, due to a variety of impairments, well- known in the Global Positioning arts.
  • Locally measured movement (LMM) information can be used for determining which of the position fix(es) exhibit unexpected and unwanted changes.
  • a position fix that exhibits unexpected or unwanted changes is an "outlier.”
  • the process of filtering (also known as “smoothing") position fixes involves, according to one embodiment, examining position fixes to determine which position fixes are "outliers," and discarding position fixes that are "outliers.”
  • Position fixes are smoothed as a part of applying locally measured movement (LMM) information to position fixes, according to one embodiment.
  • one or more position fixes may be provided using the first process while waiting for the second process to be capable of providing a position fix. Further, if carrier phase smoothing becomes unavailable or unreliable while using the second process, subsequent position fix(es) can be provided to the user from the first process instead of the second process. If carrier phase smoothing becomes available and reliable while using the first process to provide position fix(es), subsequent position fix(es) can be provided to the user from the second process instead of the first process. Thus, the providing of position fix(es) to a user can be switched between the two processes depending, for example, on whether carrier phase information is available and reliable.
  • the first process determines a first set of one or more position fixes based on the extracted raw pseudorange information and the second process determines carrier phase smoothed pseudoranges by smoothing the extracted raw pseudorange information based on carrier phase information, while the first process and the second process are executing concurrently.
  • a preference hierarchy of options is used as follows where the hierarchy is ordered from highest preference to least preference: (1 ) smoothed corrected pseudoranges that were smoothed based on real carrier phase information, (2) smoothed corrected pseudoranges that were smoothed based on reconstructed carrier phase information, (3) unsmoothed corrected pseudoranges, and (4) unsmoothed uncorrected pseudoranges.
  • the particular option that is used depends, for example, on what information is available. For example, real carrier phase information will be used if it is available. If it is not available, but Doppler Shift Information is available, then reconstructed carrier phase information will be used. If external corrections are available, the pseudoranges might be corrected. If external corrections are not available, the pseudoranges will not be corrected.
  • Figure 14 depicts a flow chart 1400 with at least two processes executing concurrently for providing position fix(es), according to various embodiments.
  • an example of a first process includes one or more of operations 1413, 1416, 1418, optionally 1424, 1423, and 1426.
  • One example of a second process includes one or more of operations 1413, 1416, 1415, 1428, optionally 1424, 1423, 1418, 1417, 1427, 1421 , optionally 1424, 1423, and 1426.
  • Examples of raw observables are raw pseudoranges, real carrier phase information and Doppler Shift Information.
  • the raw pseudoranges are smoothed using real carrier phase information if real carrier phase information is available. If real carrier phase information is not available and Doppler Shift Information is available, the raw pseudoranges are smoothed using reconstructed carrier phase information that was reconstructed using Doppler Shift Information. If neither Real Carrier Phase Information nor Doppler Shift Information is available, then the raw
  • pseudoranges may be corrected from external correction data sources, a position fix determined, and then the position fix can be smoothed using locally measured movement information.
  • Flow chart 1400 includes two major operations 1410 and 1420.
  • the first major operation is 1410 where raw observables are obtained and stored.
  • the obtained raw observables can be stored in memory 210.
  • Processing proceeds to the second major operation 1420.
  • the second major operation processes raw observables 1420.
  • the two major operations 1410 and 1420 each include additional operations, according to various embodiments. For example, obtaining and storing raw observables 1410 includes operations 141 1-1418 and processing raw observables 1420 includes operations 1421 -1428.
  • Processing of 1400 starts at 1405 and proceeds to 1412.
  • raw pseudoranges can be obtained and stored. The raw pseudoranges can be obtained by extracting them from a GNSS receiver. The obtained raw pseudoranges can be stored in memory 210.
  • a determination can be made as to whether real carrier phase information is available from the cellular device. The real carrier phase information can be obtained by extracting it from a GNSS receiver. The obtained real carrier phase information can be stored in memory 210. If the cellular device is capable of providing real carrier phase information, processing can proceed to 1415; otherwise, processing can proceed to 1418.
  • Doppler shift information can be obtained by extracting it from a GNSS receiver. The obtained Doppler Shift Information can be stored in memory 210. If Doppler Shift
  • processing proceeds to 1424, which is a part of processing raw extracted observables 1420.
  • Obtaining and processing raw extracted observables 1410 includes 141 1- 1418. After processing 1415, 1417, and 1418, the raw extracted observables have been obtained and stored 1410. The raw extracted observables are processed at 1420, upon proceeding to 1427, 1428 and 1424.
  • the raw pseudoranges obtained at 1413 are smoothed with the real carrier phase information that were obtained at 1415, according to one embodiment.
  • the Doppler Shift Information obtained at 1417 is used to provide reconstructed carrier phase information. Processing proceeds to 1421.
  • a position fix is calculated based on the pseudoranges, which are any one of unsmoothed uncorrected pseudoranges from 1418, smoothed uncorrected pseudoranges from 1421 or 1428, unsmoothed corrected pseudoranges from 1424 when 1424 is proceeded by either 1417 or 1418, and smoothed corrected pseudoranges from 1424 when 1424 is proceeded by either 1428 or 1421 .
  • Raw observables can be or can become unreliable or unavailable for many reasons, such as the cellular device being obstructed from receiving the GNSS signals containing the raw observables because it is under a tree, a structure or obscured by surroundings. However, there are other reasons why the raw observables may be or may become unreliable or unavailable.
  • a time threshold can be used to determine when enough, such as a predetermined amount, data has been received, for example, at 1415 and 1416 as a measure of reliability and availability, according to various embodiments. However, various embodiments are well suited to using other metrics for determining reliability and availability such as consistency of signal to noise ratio (SNR) and other metrics such as dilution of precision (DOP).
  • SNR signal to noise ratio
  • DOP dilution of precision
  • the raw pseudoranges are smoothed (1421 ) using real carrier phase information if enough, such as a predetermined amount, real carrier phase information is available (1416, 1415).
  • the result of smoothing based on real carrier phase information, smoothing based on reconstructed carrier phase information or neither can be used to determine a position fix (1423), optionally corrected by applying external corrections (1424), optionally smoothed using locally measured movement information (1425) to provide a position fix or an improved position fix (1426).
  • a position fix may be determined based on the raw pseudoranges using the path 1413, 1416, 1418, skip 1424, 1423, a position fix may be determined based on smoothed pseudoranges that were smoothed based on real carrier phase information using the path 1413, 1416, 1415, 1428, optionally 1424, 1423, a position fix may be determined based on smoothed pseudoranges that were smoothed based on reconstructed carrier phase information using the path 1413, 1416, 1418, 1417, 1427, 1421 , optionally 1424, 1423.
  • a position fix may be determined based on corrected pseudoranges, uncorrected pseudoranges, unsmoothed pseudoranges, smoothed pseudoranges, or a combination thereof.
  • the position fix that is output at 1425, is a locally measured movement smoothed position fix.
  • smoothed pseudoranges are determined at 1428 by applying carrier phase information to the raw pseudoranges.
  • a carrier phase smoothed position fix is determined at 1423 based on the smoothed pseudoranges.
  • operation 1425 performs processing the position fix based on the locally measured cellular device movement information.
  • processing can switch between the first process and the second process, as discussed herein.
  • the first process can provide a quicker and less expensive position fix than the second process because, for example, it uses less processing power.
  • the second process can provide a higher accuracy position fix, for example, because the raw position fixes are smoothed with carrier phase information. Further, either one of the first process or the second process can be turned off, for example, when it is not being used to save power.
  • Figure 15A depicts a block diagram of a cellular device 1500A for providing improved position fix determination, according to one embodiment.
  • a cellular device 1500A include a cell phone, a non-voice enabled cellular device, a tablet computer, and a mobile hand-held GNSS receiver.
  • the cellular device 1500A may be mobile or stationary. Examples of a tablet computer are Microsoft Surface, Apple iPads, Apple iPad mini, Samsung Galaxy Tab families.
  • a cellular device is a mobile communications device (MCD) with cellular communications capabilities (also referred to as a "cellular communication enabled mobile communications device").
  • MCD mobile communications device
  • cellular communications capabilities also referred to as a "cellular communication enabled mobile communications device”
  • a mobile communications device has communications capabilities, such as Wi-Fi or Bluetooth, or a combination thereof.
  • a mobile communications device includes or communicates with one or more of a camera, compass, and accelerometer. Examples of a mobile communications device are tablet computers, laptops with detachable tablets, personal digital assistants, Trimble Juno, and similar devices.
  • the cellular device 1500A includes a GNSS chipset 170, a GNSS receiver 107, a processor 172 that is part of the GNSS receiver 107, a chipset accessor 141 , accessing logic 1510A, accessing logic 1 10B, pseudorange information extractor logic 142, an improved accuracy Secure User Platform Location (SUPL) client 1501A, a pseudorange information bridger logic 143, control logic 1520A, a pseudorange information processing logic 1550A, an operating system 160, a location manager logic 161 , a location displayer logic 162, hardware 1580A that is outside of the GNSS receiver 107.
  • SUPL Secure User Platform Location
  • the hardware 1580A includes a hardware processor 109, hardware memory 210, accelerometer 1502A, and image capturing device 1540G.
  • Raw observables such as raw pseudoranges, real carrier phase information, Doppler Shift Information, data, such as corrected pseudoranges, uncorrected
  • pseudoranges, smoothed pseudoranges, unsmoothed pseudoranges, or a combination thereof can be stored in memory 210 and processed using one or more hardware processors 109.
  • the cellular device includes at least one hardware processor 109.
  • the cellular device includes at least one hardware sensor, such as 1502A, 1540G.
  • Examples of an image capturing device 1540G are a camera, a video camera, a digital camera, a digital video camera, a digital camcorder, a stereo digital camera, a stereo video camera, a motion picture camera, and a television camera.
  • the image capturing device 1540G most often will use a lens, although use of a pinhole type device is feasible.
  • the image capture device may also be a separate unit not embedded in the cellular device's body. Such a unit may be coupled to the cellular device's electronics via a cable or via a Bluetooth wireless link.
  • Cellular devices such as cell phones, have a multi-purpose connector for recharging the battery and for inputting or exporting data of many kinds to and from the cellular device's processor and memory.
  • the images may or may not have been obtained with an image capturing device that is a video device. Therefore, the images may be individual images taken with a non-video device or may be frames of a video taken with a video device.
  • Examples of an accelerometer 1502A are an ADXL330/335 chipset accelerometer made by Analog Devices Inc. and a LIS3LV02DQ made by
  • the processor 172 and the GNSS receiver 107 are a part of the GNSS chipset 170.
  • the chipset accessor 141 , the accessing logic 1510A, the accessing logic 1 10B, pseudorange information extractor logic 142, the pseudorange information bridger logic 143, the improved accuracy SUPL client 1501 A, the operating system 160, and the hardware 1580A are located in a portion of the cellular device 1500A that is outside of the GNSS chipset 170.
  • the location manager logic 161 can be a part of the operating system 160 and external to the GNSS chipset 170.
  • the location displayer logic 162 is a part of the location manager logic 161.
  • the chipset accessor 141 , the accessing logic 151 OA, the accessing logic 1 10B, pseudorange information extractor logic 142, the control logic 1520A, the pseudorange information processing logic 1550A, pseudorange information bridger logic 143, and improved accuracy SUPL client 1501A are application programming interfaces (API) function applications that reside in memory of the cellular device 1500A and are executed by a processor 109 of the cellular device 1500A.
  • API application programming interfaces
  • the chipset accessor 141 , the accessing logic 1510A, the accessing logic 1 10B, the pseudorange information extractor logic 142, the control logic 1520A, the pseudorange information processing logic 1550A and pseudorange information bridger logic 143 are a part of an improved accuracy SUPL client1501A.
  • the SUPL client 1501A can interface between the GNSS chipset 170 and the location manager logic 161 , which resides in the operating system 160.
  • the Improved Accuracy SUPL Client 1501 A can extract pseudorange information from the GNSS chipset 170 in a similar manner that the improved Accuracy SUPL client 101 can extract pseudorange information.
  • the pseudorange information processing logic 1550A provides improved position fix determination by performing one or more of determining the accuracy of a position fix, removing a position fix that is an "outlier,” (also referred to as “filtering"), calculating a new position fix to replace the removed position fix.
  • the determination of the accuracy of a position fix, the removal of a position fix that is an "outlier,” and the calculation of a new position to replace a removed position fix are each performed based on locally measured movement (LMM) that is measured by hardware 1502A, 1540G coupled with the cellular device 1500A, according to various embodiments.
  • the output of the processing logic 1550A includes one or more position fix(es) 1560C.
  • control logic 1520A controls the improving of the position fix determination using locally measured movement information.
  • the control logic 1520A can provide the processing directly itself or may communicate with other entities, such as the chipset accessor 141 , the accessing logic 151 OA, the pseudorange information processing logic 1550A, associated with the cellular device 1500A to provide the processing.
  • incidental errors in true, world position or location in one or more of x, y, z, latitude, longitude, and altitude can be corrected with data from an accelerometer 1502A.
  • an image capturing device 1540G can provide position shift information as the image capturing device 1540G is moved.
  • the information from the image capturing device 1540G accumulates errors more slowly than information from the accelerometer 1502A. Errors in position shift information from the image capturing device occur due to extent of motion experienced, or distance traveled, as well as over time. For continuous travel, or constant motion, time passed is a viable metric for estimating error buildup. When distance travelled is small, as when a user is standing around, executing some movement of the cellular device 1500A but over limited distance range, the time-out period for declaring a specific error buildup for the image capturing device 1540G can be extended by a factor that ranges from 2-5-10. In an embodiment, integrating the use of the image capturing device 1540G and accelerometer 1502A may provide extended operational correction time durations.
  • the accessing logic 151 OA ( Figure 15a) performs the operation 1410 ( Figure 14) of obtaining and storing raw observables.
  • the pseudorange information processing logic 1550A ( Figure 15a) performs the operation 1420 ( Figure 14) of processing raw observables.
  • a system comprising one or more hardware processors 109 located in the cellular device 1500A and outside of a Global Navigation Satellite System (GNSS) chipset 170 embedded within the cellular device 1500A.
  • the cellular device 1500A includes accessing logic 1 10B that accesses the Global Navigation Satellite System (GNSS) chipset embedded within the cellular device, wherein the GNSS chipset calculates raw observables that include raw pseudoranges and either Doppler shift information or real carrier phase information.
  • the cellular device 1500A includes extracting logic 1 12B that extracts the raw observables from the GNSS chipset for processing elsewhere in the cellular device outside of the GNSS chipset.
  • the cellular device 1500A includes position fix determining based on raw observables logic 170B that determines a position fix based on the raw observables.
  • the cellular device 1500A includes locally measured movement information accessing logic 1510B that obtains locally measured cellular device movement information from at least one sensor that has a known physical relationship with the cellular device.
  • the cellular device 1500A includes processing logic 1550A that applies the locally measured cellular device movement information to the position fix.
  • the accessing logic 1 1 OB, the extracting logic 1 12B, the position fix determining based on raw observables logic 170B, the locally measured movement information accessing logic 151 OB, the processing logic 1550A are executed by the one or more processor 109.
  • Figures 15B-15H depict portions of a cellular device 1500A for providing improved position fix determination based on locally measured movement information, according to one embodiment.
  • the cellular device 1500A includes accessing logic 151 OA.
  • the accessing logic 151 OA includes locally measured movement information accessing logic 1510B.
  • the accessing logic 151 OA includes accessing logic 1 10B.
  • accessing logic 1 10B includes extracting logic 1 12B and receiving logic 1 14B.
  • the movement information accessing logic 1510B includes accelerometer movement information accessing logic 1512A and image capturing device (ICD) movement information accessing logic 1512B.
  • ICD image capturing device
  • FIG. 15C depicts processing logic 1550A, according to one embodiment.
  • the processing logic 1550A includes determining position fix logic 170B, carrier phase reconstructing logic 1520C, raw pseudorange smoothing based on CPI logic 1530C, limiting factor logic 1540C, and movement sensor smoothing logic 1510C.
  • the processing logic 1550A includes processing logic 150.
  • the limiting factor logic 1540C includes accelerometer limiting factor logic 1542C and ICD limiting factor logic 1544C.
  • the movement sensor smoothing logic 1510C includes accelerometer smoothing logic 1512C and ICD smoothing logic 1514C.
  • the output of the processing logic 1550A is a position fix 1560C.
  • the processing logic 1550A provides provided pseudoranges that is one of smoothed uncorrected pseudoranges, smoothed corrected pseudoranges, unsmoothed corrected pseudoranges, and raw pseudoranges.
  • determining position fix logic 170B (also referred to as "position determination logic") determines a position fix based on the provided
  • the extracting logic 1 12b extracts additional raw pseudoranges from the GNSS chipset for processing elsewhere in the cellular device outside of the GNSS chipset; the position fix determining logic 170B further determines an additional position fix based on the additional raw pseudoranges; the locally measured movement information accessing logic 151 OB further obtains additional locally measured cellular device movement information from the at least one sensor; and the movement sensor position fix smoothing logic 1510C of the processing logic 1550A further applies the additional locally measured cellular device movement information to the additional position fix if a limiting factor is not exceeded.
  • Figure 15D depicts carrier phase reconstructing logic 1520C, according to one embodiment.
  • the carrier phase reconstructing logic 1520C can be implemented with integration logic 1522D or filter 1524D, or both.
  • integration logic 1522D or filter 1524D or both.
  • reconstructing logic 1520C can be extracted Doppler shift information 1501 D.
  • the output of the carrier phase reconstructing logic 1520C can be reconstructed carrier phase information 1502D.
  • Either the integration logic 1522D or the filter 1524D can receive the extracted Doppler shift information 1501 D, process the extracted Doppler shift information 1501 D to create reconstructed carrier phase information 1502D.
  • Figure 15E depicts a raw pseudorange smoothing based on carrier phase information (CPI) logic 1530C.
  • the raw pseudorange smoothing based on CPI logic 1530C can include Hatch logic 1532E or filter 1534E, or both.
  • the Hatch logic 1530A is described in U.S. Patent No.
  • the input to the pseudorange smoothing based on CPI logic 1530C can be extracted raw pseudoranges 1501 E and carrier phase information (CPI) 1502E.
  • the carrier phase information 1502E can be either real carrier phase information or reconstructed carrier phase information.
  • the output of the raw pseudorange smoothing based on CPI logic 1530C is smoothed pseudoranges 1503E.
  • the raw pseudorange smoothing based on CPI logic 1530C can smooth the extracted raw pseudoranges 1501 E with the CPI using either the Hatch logic 1532E or the filter 1534E to provide the smoothed pseudoranges 1503E.
  • Figure 15F depicts a movement sensor position fix smoothing logic 1510C.
  • the movement sensor position fix smoothing logic 1510C includes a filter 1512F.
  • the inputs to the movement sensor position fix smoothing logic 1510C can be position fixes 1501 F and locally measured movement information 1502F.
  • the output of the movement sensor position fix smoothing logic 1510C is smoothed position fixes 1503F.
  • the smoothed position fixes 1503F are position fixes that locally measured movement (LMM) information has been applied to.
  • Either or both of the accelerometer smoothing logic 1512C and the ICD smoothing logic 1514C can be implemented with a filter 1512F.
  • the processing logic discards at least one of the first set of position fixes based on the locally measured movement information, where the first process discards the at least one of the first set of position fixes based on the locally measured movement information.
  • the processing logic discards at least one of the second set of position fixes based on the locally measured movement information, where the second process discards the at least one of the second set of position fixes based on the locally measured movement information.
  • the discarding can be performed by movement sensor position fix smoothing logic 1510C in processing logic 1550A.
  • the processing logic 1550A obtains external corrections from a correction source that is external to the cellular device; provides, performed by the first process, corrected unsmoothed pseudoranges by applying the external corrections to the extracted raw pseudoranges; and determines, performed by the first process, the first set of position fixes based on the corrected unsmoothed
  • the processing logic 1550A obtains external corrections from a correction source that is external to the cellular device; provides, performed by the second process, as described herein, corrected smoothed pseudoranges by applying the external corrections to the carrier phase smoothed pseudoranges; and determines, performed by the second process, the second set of position fixes based on the corrected smoothed pseudoranges.
  • various filters such as filters 1524D, 1534E, 1512F
  • filters 1524D, 1534E, 1512F can be implemented using a Kalman Filter, robust estimation, least squares, particle filtering, Hough transform, RANSAC, sequential least squares, non-linear variants, such as sigma-editing, both a priori and a posteriori, and non-optimal (in a Gaussian sense) linear variants.
  • Figure 15G depicts an image capturing device 1540G, for example, in a hip or belt mounted orientation, according to one embodiment.
  • the image capturing device 1540G includes an entrance pupil 1542g and an axis 1543G that is at the center 1544G of the entrance pupil 1542g.
  • the x axis runs approximately parallel to the ground and parallel to the longer side of the image capturing device 1540G.
  • the y axis runs approximately parallel to the ground and parallel to the shorter side of the image capturing device 1540G.
  • the z axis is vertical to the ground and parallel to the gravity vector, which represents the pull of gravity toward the earth's surface and is widely used in coordinate measurement systems to provide at least one degree of orientation for devices.
  • the image capturing device 1540G is in a hip, belt or hat mounted
  • the image plane 1550G that defines the orientation of an image captured with the image capturing device 1540G would be defined by the x axis and z axis and the ground plane 1560G that is approximately parallel to the ground would be defined by the x axis and the y axis.
  • the body of the cellular device is often tipped so that it is no longer in a vertical orientation.
  • the image capture device may view the nearby ground as well as objects in the foreground. No loss of functionality of position shift motion detection occurs for the LMM system.
  • Photogrammetry is the practice of determining the geometric properties of objects from photographic images.
  • the distance between two points that lie on a plane parallel to the photographic image plane can be determined by measuring their distance on the image, if the scale s of the image is known. This is done by multiplying the measured distance by a scale factor 1/S.
  • FIG. 15H depicts a block diagram of an apparatus 1510H and K images 1524H, 1526H, through 1528H taken at respective locations using the image capturing device 1540G, according to various embodiments.
  • the apparatus 151 OH includes memory 210, processor 109, algorithm 1521 H, mobile platform 1512H, 6'-Vector 1540H, navigation processor 107, additional navigation device 170, image capturing device 1540G, and lenses 1516H.
  • the 6'-Vector 1540H includes the position
  • the algorithm 1521 H can include an algorithm that uses MatchMove software, or improved algorithms such as the Sequential Rolling Bundle Adjustment algorithm, as discussed herein. Sequential Rolling Bundle Adjustment algorithm can be used to obtain coordinates and orientation of the image capturing device 1540G in real time, according to one embodiment. Other types of MatchMove algorithms can be used for algorithm 1521 H that are well in the image processing arts.
  • Figure 15H also depicts K images 1524H, 1526H, through 1528H in the i- frame: i is an integer, key-points 1530H, l 2 1532H, i k 1534H in the respective images #1 1524H, #2 1526H, #K 1528H, position coordinates 1542H (x M , y M , z M ), 1544H (x i2 , y i2 , z i2 ), 1546H (x ik , y ik , z ik ) for the respective key-points , i 2 , and i k .
  • the additional navigation device 170 (including the navigation processor 107) is configured to provide the initial position coordinates and orientation of the image capturing device 1540G.
  • the image capturing device 1540G is mounted on the mobile platform 1512H.
  • a mobile platform 1512H include a person, a car, a truck, a bike, a motorbike, a boat, etc.
  • the apparatus 151 OH can be attached to the person, for example, using a belt, a hat or some other kind of coupling mechanism.
  • the apparatus 151 OH can be coupled to various parts of the person's body such as at the hip, the head, other parts of the person's body.
  • the image capturing device 1540G is configured to perform image capture of a scene.
  • the algorithm 1521 H can be software instructions stored in memory 210 and executed by the processor 109 or can be hardware, such as an ASIC chip (or FPGA chip) (in analog or digital modes).
  • the algorithm 1521 H is used as a part of analyzing the set of K- images 1524H, 1526H, ...1528H collected in each i-frame.
  • Lens 1516H is for focusing.
  • the focal length of lenses i.e., the distance between the rears of the lenses (when focused on infinity) the imaging device, determines the angle of the view, or the field of view (FOV) and the size of objects as they appear as images 1524H, 1526H, and ...1528H.
  • the image is focused on that surface by adjusting the distance between the lenses and the surface.
  • Image capturing devices used in cell phones typically have fixed focal length imaging systems.
  • the calibrated image capturing device 1540G is configured to collect the K images 1524H, 1526H, through 1528H in the i-frame: i is an integer.
  • key-points are identified within each of the K images (1524H, 1526H, through 1528H.
  • the key-points are the features that are common in multiple frames. For example, in the first frame the key-points are: the key-point ⁇ 1530H in the image #1 1524H, the key point l 2 1532H in the image #2 1526H, and key-point i k 1534H in the image #K 1528H. These key-points can be tracked in the following frames as discussed herein.
  • the obtained image data for the key-points ( 1530H in the image #1 1524H; i 2 1532H in the image #2 1526H; ...i K 1534H in the image #K 1528H) is used within the algorithm 1521 H, as discussed herein, to estimate the position and orientation of the image capturing device 1540G: the '6'-vector 1540H including the position coordinates (x, y, z) as well as the orientation angles ⁇ , ⁇ , ⁇ .
  • the obtained image data for the key-points ( 1530H in the image #1 1524H; i 2 1532H in the image #2 1526H; ...i K 1534H in the image #K 1528H) is also used within the algorithm 1521 H to obtain the position coordinates of the key-points: position coordinates 1542H ( ⁇ ⁇ , yn, Zii ) of the key-point , the position coordinates 1544H (x i2 , y, 2 , z i2 ) of the key-point i 2 ; and the position coordinates 1546H (x ik , y ik , z ik ) of the key-point i k .
  • Figure 151 depicts three points in a 3 dimensional (3D) field of view
  • Figure 151 depicts a two dimensional (2D) projections on a 2D image plane 1550G (S) of points in view a field of view of a real 3D environment.
  • Figure 151 depicts a 2D projection 15341 ( ⁇ ') of 3D point 15281 (P), which is a 2D projection 15301 (R') of 3D point 15241 (4), and 2D projection 15321 (Q') of 3D point 15261 (Q) on an image plane 1550G (s) by using an image capturing device 1540G and the lines between the 2D projection points 15301 (R'), 15321 (Q'), 15341 ( ⁇ ') and their respective 3D points 15241 (R), 15261 (Q), and 15281 (P) intersect at intersection 15441.
  • One or more points can be selected as key-points and the lines represent rays that can be bundled to form ray bundles, as will be discussed in more detail hereinafter.
  • the intersection 15441 of the rays can be used to determine the 3D location of the points 15241 (R), 15261 (Q), and 15281 (P) using triangulation.
  • Figure 15J depicts a block diagram of a cellular device 1500J that is coupled to an image capturing device 1540J that is external to the cellular device 1500J, according to one embodiment.
  • a cellular device 1500J include a cell phone, a non-voice enabled cellular device, a tablet computer, and a mobile hand-held GNSS receiver.
  • the cellular device 1500A may be mobile or stationary.
  • Examples of a tablet computer are Microsoft Surface, Apple iPads, Apple iPad mini, Samsung Galaxy Tab families.
  • the cellular device 1500J is coupled or in communication, or a combination thereof, with image capturing device 1540J.
  • the cellular device 1500J can include one or more of GNSS chipset 170, improved accuracy SUPL client 1501 A, operating system 160, and processor 109, memory 210, accelerometer 1502A.
  • the cellular device 1500J may or may not have an internal image capturing device 1540G of its own.
  • Various embodiments as discussed herein, are well suited for the cellular device 1500J using LMM information from the external image capturing device 1540J.
  • the image capturing device 1540J has a known physical relationship with the cellular device 1500J.
  • the physical relationship between the external image capturing device 1540J is fixed, and, therefore, does not change with respective to the cellular device 1500J.
  • the physical relationship can be known since it is fixed.
  • the physical relationship can be known in terms of at least distance or orientation between the image capturing device 1540J and the cellular device 1500J, or a combination thereof.
  • Figure 16 depicts a block diagram of a cellular device 1600 for improving position fix determination based on locally measured movement (LMM) information, according to one embodiment.
  • the GNSS chipset 170 is located on a system on a chip (SOC) substrate (SOCS) 1690.
  • SOC system on a chip
  • SOCS chip substrate
  • Other entities such as 1501 A, 160, and 1580A can also be located on the system on a chip substrate 1690.
  • a cellular device 1600's hardware architecture includes discreet physical layout and interconnection of multiple chipsets for processing and for special purposes such as a GNSS chipset 170.
  • newer architectures involve further integration of chipsets in the "system on a chip” (SoC) configuration. In this configuration, the GNSS chipset 170 can still be a complete element capable of delivering a PVT (position velocity and time) solution.
  • PVT position velocity and time
  • the pseudorange information, carrier phase, and/or Doppler measurements, along with WAAS corrections if available, are extracted prior to further signal processing in the GNSS chipset 170 and are processed using different algorithms and corrections data for developing an improved accuracy PVT solution. In so doing the deleterious effects of multipath and other error sources may be minimized.
  • GNSS chipset 170 outputs are ignored and not displayed when the external processing is employed and the higher-accuracy PVT data is available.
  • Figure 17 depicts a block diagram of a cellular device 1700 and multiple sources for providing positioning correction information to the cellular device 1700 for processing pseudorange information, according to one embodiment. Many of the features depicted in Figure 17 have already been described herein. Therefore, in the interest of brevity, those features will not be described again.
  • the cellular device 1700 also includes an image capturing device 1540G and an accelerometer 1502A.
  • Examples of a cellular device 1500A, 1500J, 1600, 1700 include a cell phone, a non-voice enabled cellular device, a tablet computer, and a mobile hand-held GNSS receiver.
  • the cellular device 1500A may be mobile or stationary. Examples of a tablet computer are Microsoft Surface, Apple iPads, Apple iPad mini, Samsung Galaxy Tab families.
  • a cellular device is a mobile communications device (MCD) with cellular communications capabilities (also referred to as a "cellular communication enabled mobile communications device").
  • a mobile communications device has communications capabilities, such as Wi-Fi or Bluetooth, or a combination thereof.
  • a mobile communications device includes or communicates with one or more of a camera, compass, and accelerometer.
  • Examples of a mobile communications device are tablet computers, laptops with detachable tablets, personal digital assistants, Trimble Geo-7, Trimble Juno, and similar devices.
  • the blocks that represent features in Figures 15A-17 can be arranged differently than as illustrated, and can implement additional or fewer features than what are described herein. Further, the features represented by the blocks in Figures 15A-17 can be combined in various ways.
  • a cellular device 1500A, 1600, 1700 ( Figures 15A-17) can be implemented using software, hardware, hardware and software, hardware and firmware, or a combination thereof.
  • various embodiments that are described as being a part of the cellular device 1500A, 1600, 1700, whether depicted as a part of the cellular device 1500A, 1600, 1700 or not, can be implemented using software, hardware, hardware and software, hardware and firmware, software and firmware, or a combination thereof.
  • Various blocks in Figures 15A-17 refer to features that are logic, such as but not limited to, 170, 151 OA, 1 10B, 1520A, 1550A, 150, 1540C, 1510C, 1520C, 1530C, 1521 H, which can be implemented using software, hardware, hardware and software, hardware and firmware, software and firmware, or a combination thereof.
  • a hardware embodiment includes hardware, such as one or more of the processor 109, memory 210, sensors 1502A and 1540G, and the GNSS chipset 170.
  • An example of hardware memory 210 is a physically tangible computer readable storage medium, such as, but not limited to a disk, a compact disk (CD), a digital versatile device (DVD), random access memory (RAM) or read only memory (ROM) for storing instructions.
  • An example of a hardware processor 109 for executing instructions is a central processing unit. Examples of instructions are computer readable instructions for implementing at least the SUPL Client 1501 A that can be stored on a hardware memory 210 and that can be executed, for example, by one or more hardware processors 109.
  • the SUPL client 1501 A may be implemented as computer readable instructions, firmware or hardware, such as circuitry, or a combination thereof.
  • the six parameters are referred to as obtaining the image capturing device 1540G's "pose.”
  • the method of choice is to use the imagery captured directly by an image capturing device 1540G that is a movie camera, however, various embodiments are also well suited using a sequence of individual images captured with an image capturing device 1540G that is not a movie camera.
  • the process involves tracking objects in the field of view of the image capturing device 1540G from one image frame to the next via feature detection methods, and then performing some mathematical processes to determine where the entrance pupil 1542G has to be in order to "see” the tracked features in the next frame as they are seen in the next frame image.
  • the ray paths also referred to as "rays" from a feature on an external object pass through the entrance pupil 1542G and are captured on the image capturing device 1540G. These ray paths from multiple features form a group of lines, commonly called a bundle.
  • the location on the image plane 1550G for each feature is determined and stored for each captured image 1524H, 1526H...1528H.
  • the image capturing device 1540G In the next image captured, if the image capturing device 1540G has moved, the location of the features in the image have moved and thus the entire collection of ray paths has changed. Previously identified features are again found by a matching technique. Their location in the second image is estimated. To determine where the image capturing device 1540G has moved, the first image 1524H's feature points are compared to their respective new locations in the second image 1526H and so on between subsequent image pairs. The comparison is done by creating a transformation or conversion matrix, which deals with all the data available. The transformation matrix also creates an estimate of the error in location for each feature data point from first image to second image. The image capturing device 1540G's location is adjusted iteratively until the errors are reduced as much as possible.
  • the image capturing device 1540G can be modeled by a pinhole camera 2908 that captures light beams 2904 and 2906 passing through the pinhole 2902 for purposes of explanation.
  • the lens 1516H further comprises regular rectilinear lens.
  • Rectilinear lens is a lens in which straight lines are not substantially curved or distorted. Such lenses are commonly found in cell phone cameras.
  • the lens 1516H further comprises a fisheye lens.
  • a fisheye lens is a wide-angle lens that takes in an extremely wide, hemispherical image. Fisheye lenses are often used to shoot broad landscapes.
  • Fisheye lenses achieve extremely wide angles of view by forgoing a rectilinear image, opting instead for a special mapping (for example: equisolid angle), which gives images a characteristic convex appearance.
  • a fisheye lens may be added to a cell phone camera via a clip-on device such as found in the product called the Olloclip; information about this product can be found at www.olloclip.com/product.
  • the image capturing device 1540G further comprises a stereo digital camera.
  • a stereo camera is a type of camera with two or more lenses. This allows the camera to simulate binocular vision, and therefore gives it the ability to capture three-dimensional images, a process known as stereo photography.
  • Cell phone cameras may be augmented by an image-combining device which emulates a true stereo camera by using a pair of lens separated by a short distance that provides two images delivered to the camera imager, which may be processed as a stereo pair.
  • a device providing this stereo imaging capability is offered by HolgaDirect called the Holga 3D Lens Set for an Iphone; information about this device can be found at
  • Stereo images may be processed via photogrammetric methods to reveal dimensional information about the objects in view, as well as distance information from image capturing device to an object.
  • the image capturing device 1540G (camera) is calibrated. This calibration is used to correct the images for lens 1516H distortions. Typical calibrations correct for principal distance (focal length), principal point offset, radial distortion, tangential distortion, and other effects that can be found in any text book on photogrammetry. All image measurements are corrected with these calibration parameters.
  • the calibrated image capturing device 1540G is configured to capture an i-th frame including K sub-images (1524H, 1526H, through 1528H); / ' is an integer.
  • the key-points are the features that are common in multiple frames. For example, in the first frame the key-points are: the key-point i f 1530H in the sub-image #1 1524H, the key-point i 2 1532H in the sub-image #2 1526H, and key-point i K 1534H in the sub-image #K 1528H. These key-points should be tracked in the following frames.
  • the obtained image data for the key-points (/ ' 1530H in the sub-image #1 1524H; i 2 1532H in the sub-image #2 1526H; ... / K 1534H in the sub-image #K 1528H) is used within the bundle adjustment algorithm to estimate the position and orientation of the image capturing device 1540G: the '6'-vector 1540H including the position coordinates (x, y, z) as well as the orientation angels ⁇ , ⁇ , and ⁇ .
  • position coordinates 1542H (x i y i ⁇ ⁇ ) of the key- point i-i position coordinates 1542H (x i y i ⁇ ⁇ ) of the key- point i-i
  • position coordinates 1544H (x i2 , y, 3 ⁇ 4 z i2 ) of the key-point i 2 and so on; and finally, the position coordinates 1546H (x iK , ⁇ , ⁇ , z iK ) of the key-point i K .
  • the algorithm 1521 H includes the sequential rolling bundle adjustment algorithm, which is the further development of the full bundle adjustment algorithm.
  • the bundle adjustment can be defined as the problem of simultaneously refining the 3-D coordinates describing the scene geometry as well as the parameters of the relative motion and the optical characteristics of the image capturing device 1540G ( Figure 15H) employed to acquire these images, according to an optimality criterion involving the corresponding image projections of all points.
  • the correspondence problem refers to the problem of ascertaining which parts of one image (or frame) correspond to which parts of subsequent image (or frame), where differences are due to movement of the camera, the elapse of time, and/or movement of objects in the photos. More specifically, given two or more images (or frames) of the same 3-D scene, taken from different points of view and at different time, the
  • correspondence problem refers to the task of finding a set of points in one frame which can be identified as the same points in another subsequent frame.
  • the correspondence problem can occur in a stereo situation when two images of the same scene are used, or can be generalized to the N-view correspondence problem. In the latter case, the images may come either from N different image capturing devices 1540G (cameras) photographing at the same time or from one image capturing device 1540G (camera) which is moving relative to the scene and collecting the image data from N-frames.
  • the problem is made more difficult when the objects in the scene are in motion relative to the image capturing device(s) 1540G.
  • the correlation-based method includes checking if one location in one image looks/seems like another in another image.
  • the feature-based method includes finding features in an image and seeing if the layout of a subset of features is similar in the two images. To avoid the aperture problem a good feature should have local variations in two directions.
  • an image rectification is used to perfect cameras' alignment.
  • Image rectification is usually performed regardless of camera precision because it may be impractical to perfectly align cameras, and even perfectly aligned cameras may become misaligned over time.
  • a linear transformation can be used including: (i) X & Y rotation that puts the images on the same plane, (ii) scaling that makes the images to be of the same size, and (iii) Z rotation & skew adjustments are made to make the image pixel rows directly line up.
  • a small window is passed over a number of positions in one image, according to one embodiment. Each position is checked to see how well it compares with the same location in the other image. Also several nearby locations are also compared for the objects in one image may not be at exactly the same image-location in the other image. It is possible that there is no fit that is good enough. This may mean that the feature is not present in both images, it has moved farther than your search accounted for; it has changed too much, or is being hidden by other parts of the image.
  • the Hough transform (mostly used in the scale-invariant feature transform) is an algorithm important in understanding the full bundle adjustment algorithm. More specifically, the Hough transform is a feature extraction technique used in image analysis, computer vision, and digital image processing.
  • the purpose of the Hough transform technique is to find imperfect instances of objects within a certain class of shapes by a voting procedure.
  • This Hough voting procedure is carried out in a parameter space, from which object candidates are obtained as local maxima in a so-called accumulator space that is explicitly constructed by the algorithm for computing the Hough transform.
  • the classical Hough transform was concerned with the identification of lines in the image, but later the Hough transform has been extended to identifying positions of arbitrary shapes, most commonly circles or ellipses.
  • Scale-invariant feature transform is an algorithm in computer vision designed to detect and describe local features in images. The algorithm was published by David Lowe in 1999. This algorithm uses the Hough transform. Applications include object recognition, robotic mapping and navigation, image stitching, 3-D modeling, gesture recognition, video tracking, individual identification of wildlife and match moving. The algorithm is patented in the US; the owner is the University of British Columbia. Please, see US Patent No.: 6,71 1 ,293, entitled "Method and apparatus for identifying scale invariant features in an image and use of same for locating an object in an image” and issued to David G. Lowe.
  • scale-invariant feature transform for any object in an image, interesting points on the object can be extracted to provide a "feature description" of the object.
  • This description extracted from a training image, can then be used to identify the object when attempting to locate the object in a test image containing many other objects.
  • the features extracted from the training image be detectable even under changes in image scale, noise and illumination.
  • Such points usually lie on high-contrast regions of the image, such as object edges.
  • SIFT key-points of objects are first extracted from a set of reference images and stored in a database.
  • An object is recognized in a new image by individually comparing each feature from the new image to this database and finding candidate matching features based on Euclidean distance of their feature vectors. From the full set of matches, subsets of key-points that agree on the object and its location, scale, and orientation in the new image are identified to filter out good matches.
  • the determination of consistent clusters is performed rapidly by using an efficient hash table implementation of the generalized Hough transform.
  • Each cluster of 3 or more features that agree on an object and its pose is then subject to further detailed model verification and subsequently outliers are discarded.
  • the probability that a particular set of features indicates the presence of an object is computed, given the accuracy of fit and number of probable false matches. Object matches that pass all these tests can be identified as correct with high confidence.
  • Match moving is another 3-D reconstruction algorithm.
  • match moving is a cinematic technique that allows the insertion of computer graphics into live-action footage with correct position, scale, orientation, and motion relative to the photographed objects in the shot.
  • Match moving is primarily used to track the movement of a camera through a shot so that an identical virtual camera move can be reproduced in a 3-D animation program.
  • new animated elements When new animated elements are composited back into the original live-action shot, they will appear in perfectly-matched perspective and therefore appear seamless.
  • the pose can be described by means of a rotation and translation transformation which brings the object from a reference pose to the observed pose.
  • This rotation transformation can be represented in different ways, e.g., as a rotation matrix or a quaternion.
  • the specific task of determining the pose of an object in an image is referred to as pose estimation.
  • the pose estimation problem can be solved in different ways depending on the image sensor configuration, and choice of methodology. Three classes of methodologies can be distinguished: analytic or geometric methods, genetic algorithm methods, and learning-based methods.
  • the image sensor (camera) is calibrated by using the mapping from 3-D points in the scene to the 2-D points in the image. If the geometry of an object is known, the projected image of the object on the camera image is a well-known function of the object's pose. Once a set of control points on the object, typically corners or other feature points, has been identified it is then possible to solve the pose transformation from a set of equations which relate the 3-D coordinates of the points with their 2-D image coordinates.
  • the Bundle adjustment algorithm is used as the last step of every feature- based 3-D reconstruction algorithm. It amounts to an optimization problem on the 3-D structure and viewing parameters (i.e., camera pose and possibly intrinsic calibration and radial distortion), to obtain a reconstruction which is optimal under certain assumptions regarding the noise pertaining to the observed image features.
  • bundle adjustment is the Maximum Likelihood Estimator. Its name refers to the bundles of light rays originating from each 3-D feature and converging on each camera's optical center, which are adjusted optimally with respect to both the structure and viewing parameters.
  • MLE Maximum-Likelihood estimation
  • the method of maximum likelihood selects the set of values of the model parameters that maximizes the likelihood function. Intuitively, this maximizes the "agreement" of the selected model with the observed data, and for discrete random variables it indeed maximizes the probability of the observed data under the resulting distribution.
  • Maximum-likelihood estimation gives a unified approach to estimation, which is well-defined in the case of the normal distribution and many other problems.
  • Bundle adjustment boils down to minimizing the re-projection error between the image locations of observed and predicted image points, which is expressed as the sum of squares of a large number of nonlinear, real-valued functions.
  • the re-projection error is a geometric error corresponding to the image distance between a projected point and a measured one. It is used to quantify how closely an estimate of a 3-D point recreates the point's true projection.
  • Minimizing the re projection error can be used for estimating the error from point correspondences between two images.
  • the correspondences can be interpreted as imperfect images of a world point and the re-projection error quantifies their deviation from the true image projections.
  • the full bundle adjustment is the optimal solution and makes use of all images. However, it requires all images to be collected before any processing can be completed and is not a real-time solution.
  • Kalman filter also can be used to estimate the current position and orientation (pose) of an object.
  • the Kalman filter also known as linear quadratic estimation (LQE)
  • LQE linear quadratic estimation
  • the Kalman filter algorithm works in a two-step process.
  • the Kalman filter produces estimates of the current state variables, along with their uncertainties. Once the outcome of the next measurement (necessarily corrupted with some amount of error, including random noise) is observed, these estimates are updated using a weighted average, with more weight being given to estimates with higher certainty. Because of the algorithm's recursive nature, it can run in real time using only the present input measurements and the previously calculated state; no additional past information is required.
  • the present technology of the rolling bundle adjustment is an improvement over the prior art techniques of bundle adjustment algorithm because it allows to significantly decrease the amount of computation time thus making possible the real time estimation of the pose of the image capturing device 1540G.
  • the rolling bundle adjustment algorithm prescribes removing the position and orientation states associated with the oldest frame and adding position and orientation states for the new frame.
  • An initial estimate of the current frames position and orientation can be made by simply using the previous frames position and orientation estimate.
  • the image locations of the key-points from the last frame are then identified in the new frame. These image measurements are then added to the estimation process using the method of sequential least squares which is much more efficient than completely running the bundle adjustment on the last N frames.
  • the general processor 109 of Figure 15H is configured to execute the algorithm 1521 H further comprising a rolling bundle adjustment algorithm.
  • the rolling bundle adjustment algorithm computes a bundle adjustment using N frames every time a new frame is available. This is the starting point for this new technique, however the rolling bundle adjustment algorithm uses sequential least squares to add the new frame rather than completely redo the bundle adjustment.
  • the rolling bundle adjustment algorithm of the present technology (also referred to as "sequential rolling bundle adjustment”) is basically a cross between a Kalman filter and the rolling bundle adjustment. Although implemented using sequential least squares, the mathematics are identical to a Kalman filter that retains the previous N-1 frame position and orientation states.
  • Figure 28 illustrates a frame from the video sequence 2860 including a set of sib-images 2886, 2888, and 2890 taken from a Nikon D 800 camera using a 35 mm lens.
  • Each sub-image includes at least four key-points: sub-image 2886 includes the key-points 2862, 2864, 2866 and 2868, sub-image 2890 includes the key-points 2878, 2880, 2882 and 2884, and sub-image 2888 includes the key-points 2870, 2872, 2874 and 2876.
  • the camera was set to collect 720 p video (1280 x 720) at 25 frames per second. Calibration
  • the round targets (1000- 101 1 ) (or key-points 2862, 2864, 2866 2868, 2870, 2872, 2874, 2876, 2878, 2880, 2882 and 2884), were tracked throughout the sequence while the camera was moved (keeping the targets in view at all times to simplify the test). For this example the number of frames used in the rolling bundle adjustment is 25, i.e. 1 second of data.
  • the system should be initialized.
  • the initial position coordinates of the image capturing device 1540G can be estimated by using the full bundle adjustment algorithm for N preceding frames.
  • the additional navigation device 107 ( Figure 15H) can be used to estimate the initial position coordinates of the image capturing device 1540G.
  • the key-points are identified by using 3 non-collinear targets with known absolute or relative positions. This can be done for the example by automatically identifying the target centers using an existing algorithm within Trimble. The choice of these points can be an important decision. If the initial set of points is able to sufficiently define a datum, the estimated camera positions and orientations can be in this datum and will be appropriately scaled.
  • the key-points are identified by using a key-point detection algorithm such as SIFT, Surf, BRISK, etc. Many of these algorithms are already implemented within Open CV.
  • an arbitrary coordinate system (not shown) can be defined. If a distance measurement is visible in the images it can be used to correctly scale the solution, otherwise the estimates will also be arbitrarily scaled (i.e. the estimated positions will require a similarity transformation to obtain world coordinates). Alternatively, if the location of the image capturing device 1540G can be determined via some other positioning system (say GNSS), these location estimates of the image capturing device 1540G can be used to scale the solution as well as define the required datum.
  • GNSS some other positioning system
  • the Lucas-Kanade method is a widely used differential method for optical flow estimation developed by Bruce D. Lucas and Takeo Kanade. It assumes that the flow is essentially constant in the proximity of the pixel under consideration, and solves the basic optical flow equations for all the pixels in that vicinity, by the least squares criterion. By combining information from several nearby pixels, the Lucas-Kanade method can often resolve the inherent ambiguity of the optical flow equation. It is also less sensitive to image noise than point-wise methods. On the other hand, since it is a purely local method, it cannot provide flow information in the interior of uniform regions of the image.
  • KLT Kanade-Lucas-Tomasi
  • the sequential rolling bundle adjustment algorithm 1521 H (Figure 15H) needs at least 5 key-points for each frame.
  • one of the requirements for the imagery is that the corresponding images (in consequent frames) have a significant overlap (say >50%) with one another.
  • the frame rate required to maintain such overlap is dependent on the camera dynamics. Higher dynamics will require a higher frame rate.
  • an alternative approach to using a constant frame rate is to collect images whenever the camera moves a given distance or changes orientation by a maximum rotation. This approach requires a secondary source of position, velocity, and/or orientation to control the camera shutter.
  • the collected image data is next fed into a least squares bundle adjustment algorithm 1521 H which estimates the position and orientation of the image capturing device 1540G for each frame (6 '-vector 1540h including the position coordinates (x, y, z) as well as the orientation angels ⁇ , ⁇ , and ⁇ ) as well as the 3-D coordinates of the tracked key-points: position coordinates 1542h data (xn, y , Zn) for the key-point , the position coordinates 1544h data ⁇ Xiz Yi2, z i2 ) for the key-point i 2 , and the position coordinates 1546h data ( ⁇ , ⁇ , y,x, z iK ) for the key-point i K .
  • the collinearity equations are a set of two equations, used in photogrammetry and remote sensing to relate coordinates in a sensor plane (in two dimensions) to object coordinates (in three dimensions).
  • the equations originate from the central projection of a point of the object through the optical center of the camera to the image on the sensor plane, also known as an image plane 1550G.
  • Figures 29, 151, and 30 illustrate the geometry that is utilized in collinearity equations.
  • Figure 29 depicts light beams 2904 and 2906 passing through the pinhole 2902 of a pinhole camera 2908 for purposes of illustration.
  • the pinhole camera 2908 is an example of an image capturing device 1540G.
  • Figure 151 depicts three points in a 3 dimensional (3D) field of view representing feature points on one or more objects, and their locations in the image plane of the imaging device, according to one embodiment.
  • Figure 151 depicts 2-D projection 15341 of 3-D point 15281 (2-D projection 15301 of 3-D point 15241, and 2-D projection 15321 of 3-D point 15261) on a plane 1550G by using a pinhole camera with the center 1544G.
  • Figure 30 illustrates a graph 3050 with an x axis 3052 and a z axis 3054 for plotting x and z coordinates of a 2-D projection of 3-D point through the center of a pinhole camera, according to one embodiment.
  • Figure 30 depicts x (3068) and z (3062) coordinates of 2-D projection C 3056 of 3-D point through a projection center 2902 of the pinhole camera 2908 of Figure 29, as well as x (3064) and z (3060) coordinates of 2-D projection P 3058 of 3-D point through the projection center 2902 of the pinhole camera 2908 of Figure 29.
  • x a is the measured x image coordinate of point a.
  • y a is the measured y image coordinate of point a.
  • X a , Y a , Z a are the world coordinates of point a.
  • X ; , Yj, Z; are the world coordinates of camera I.
  • ⁇ , ⁇ , ⁇ are the Euler angle rotations of camera I.
  • c is the principal distance (approximately the focal length of the camera)
  • m is the rotation matrix from the camera coordinate system to the world coordinate system.
  • Figure 33 illustrates the geometry 3320 involved in formulation of collinearity equations (Eq. 1 and Eq. 2) with the matrix m given by (Eq. 3 and Eq. 4) that are utilized for estimation of the position and orientation of an image capturing device 1540G for each frame and for estimating 3-D coordinates of the tracked key-points.
  • 3-D coordinates (X A , Y A , Z A ) of 3-D point A in World Coordinate System (WCS) 3334 (with X axis 3326, Y axis 3324, Z axis 3322) are indicated by point 3332, whereas 3-D coordinates (X L , Y
  • the collinearity equations (Eq. 1 and Eq. 2) with the matrix m given by (Eq. 3 and Eq. 4) are re-formulated in terms of least squares adjustment for the purposes of optimal estimation.
  • I is a vector of adjusted observations
  • x° is the current extimate of the state x.
  • A is a Jacobean matrix (partial derivatives of the collinearity equations w.r.t. the unknowns)
  • w is a vector of misclosures
  • C> 3 ⁇ 4 is the covariance matrix for the estimated parameters.
  • the positions and orientations of the image capturing device 1540G for the first N frames have been estimated along with the positions of the selected key-points.
  • the next step is to continue estimating the image capturing device 1540G's states as new subsequent frames ⁇ N+1, N+2, N+3, N+4, etc.) become available.
  • Figure 32 shows the rolling adjustment sequential update algorithm 3250 in estimation of image capturing device 1540G's positions and orientations from the initial N frames to the subsequent (N+1 ) frames.
  • Figure 32 depicts frames 3252-3270 along a frame number axis 3272 with the frame numbers 1 , 2, 3, 4, N, N+1 , N+2, N+3, N+4 for each of the respective frames 3252-3270.
  • Figure 32 also depicts solutions 3274, 3276, 3280, and 3278 that correspond respectively with frame N, frame N+1 , frame N+2, and frame N+3.
  • the bundle adjustment algorithm solution 3250 based on the initial N frames (from 3252 and up to 3262) is schematically noted as the initial solution 3274
  • the bundle adjustment algorithm solution 3250 based on (N+1 ) frames (from 3252 and up to 3264) is schematically noted as the subsequent solution 3276
  • the bundle adjustment algorithm solution 3250 based on (N+2) frames (from 3256 through 3264) is schematically noted as subsequent solution 3278
  • the bundle adjustment algorithm solution 3250 based on (N+3) frames is schematically noted as subsequent solution 3280.
  • the oldest frame is removed from the state estimation.
  • the rows and columns associated with the frame to be removed are replaced with initial estimates for the newest frame.
  • This initial estimate of the camera position and orientation at the new frame may be computed from the estimated key-points or if the frame rate is high relative to the camera dynamics the estimate can simply be set to the same values as the previous frame.
  • the sequential rolling update is accomplished in a sequential manner using the following equations:
  • the major advantage of this technique is that the only new inversion required for the sequential update is the matrix contained within the gain term K.
  • the matrix to be inverted is a square matrix with the dimensions equal to the number of new measurements associated with the new image.
  • the computer-readable and computer-executable instructions may reside on computer useable/readable media.
  • Modern image capturing devices 1540G also have accelerometers built in, and so can also track their movements.
  • 3-axis accelerometers again it is possible to track the cellular device's pose in real time, but the error build-up is quadratic. This error can be eliminated by periodic resetting the accelerometer, usually when the change in position or pose is close to zero. However, the reset results in a restart of tracked motion, from the new zero point. Since the error build up in image-based tracking systems is linear, image tracking can be used for longer time periods. Resetting an image tracking system may be done via the accelerometer as well.
  • the two pose tracking systems may be combined via a Kalman filter with appropriate weighting functions to indicate a distance traveled during a given time interval. Knowing this distance as a kind of "truth" distance allows for additional filtering on GNSS observables and processed position fixes, to improve accuracy.
  • one or more operations of various embodiments may be controlled or implemented using computer-executable instructions, such as program modules, being executed by a computer.
  • program modules include routines, programs, objects, components, data structures, etc., that perform particular tasks or implement particular abstract data types.
  • steps of exemplary methods of implementation are disclosed herein, these steps are examples of steps that may be performed in accordance with various exemplary embodiments. That is, embodiments disclosed herein are well suited to performing various other steps or variations of the steps recited. Moreover, the steps disclosed herein may be performed in an order different than presented, and not all of the steps are necessarily performed in a particular embodiment.
  • multipath error can occur as signals bounce on various objects, such as buildings or other objects, reflecting signals along many paths.
  • Extracted pseudorange information is an example of
  • Multipath refers to the simultaneous processing in the GNSS receiver of both the desired GNSS signal and reflected versions of the desired GNSS signal that arrive a very short time after the desired signal.
  • the two signals pass through the GNSS receiver and are processed by the down converter and the timing measurement systems that develop the pseudoranges.
  • Instantaneous combining of the two signals, desired and slightly-later multipath result in erroneous pseudoranges, which may be quite different in instantaneous magnitude from the true pseudorange that should have been determined.
  • Multipath error can be reduced by smoothing pseudoranges using, for example, real carrier phase information or reconstructed carrier phase information.
  • the filter 1534E can remove "outlier" pseudoranges that do not conform to the extent of a change in pseudorange expected under the instant conditions, as measured by the covariance matrix. For example, if a sequence of pseudoranges contains the following data [pseudorange time estimates of the time for a timing signal to travel from a satellite to a receiver in second]: .0675, 00676, .0677 .0680, .0679.... the filter 1534E may delete the .0680 entry as an "outlier.”
  • LMM Locally measured movement information
  • an accelerometer that is attached or part of a cellular device can be used to measure the distance that the cellular device has moved.
  • a series of images obtained with an image capturing device 1540G that is attached or part of the cellular device can be used to measure the distance the cellular device has moved.
  • movement can be measured in a plane that is parallel to the ground where the plane is defined by an x axis and a y axis, such as ground plane 1560G. Movement can also be measured along a z axis (also known as "height") that is perpendicular to the ground the determination of the x and y coordinates in position as well as time to fix can be improved. Most consistent results will occur when the cellular device with its image capturing device 1540G is oriented in a reasonably fixed direction. Wearing a cellular device on a belt hook or attached to a hat or some other type of platform, for example, can be used to maintain orientation.
  • a front-facing or a rear-facing image capturing device 1540G can be used to view the surrounding area, according to one embodiment. If the image capturing device 1540G is held by hand, then whatever orientation is first used needs to be approximately maintained. However, modern cellular device accelerometers indicate orientation in all planes and software can accommodate any change is physical orientation of the cell device.
  • a mounted orientation may be referenced in the software that is used to define the imaging output, so that the image from the image capturing device 1540G can directly measure changes in a horizontal plane 1560G, parallel to the earth's surface, and perpendicular to the image plane 1550G of the image capturing device 1540G.
  • the image will be approximately perpendicular to the plane of the earth's surface.
  • X and Z are directly viewable in the captured image.
  • Y is in the plane 1560G that is approximately perpendicular to the captured image, and
  • the image capturing device 1540G can measure left- right motion easily which is like a delta X whereas height Z is up-down. Depth view of the captured image provides Y information. However, all that is required for LMM operation is that either the accelerometers are operative and useful, or the image capturing device can see and track some features in its environment.
  • LMM Locally measured movement
  • Examples of a movement sensor are an image capturing device 1540G and an accelerometer 1502A.
  • Various patterns can be created by using one or more types of locally measured movement information.
  • One pattern occurs when LMM is used from a single sensor.
  • Another pattern occurs when LMM from two sensors are used simultaneously.
  • Yet another pattern can occur when LMM from two sensors are mutually exclusively alternated with respect to one another.
  • Yet still another pattern can occur when LMM from two sensors over lap at times and alternate at other times.
  • Figure 18A depicts a diagram of a pattern where locally measured movement information 1801 from an accelerometer is used to improve position determination, according to one embodiment.
  • Axis 1801 A, 1802A, 1803A are for time
  • axis 1801 B is for distance 1812A measured by the accelerometer
  • axis 1802B is for position fix distance 1814A as determined by the movement sensor position fix smoothing logic 1510C using pseudorange information
  • axis 1803B is for the plot 1816a of real distance plot.
  • the circular elements in plot 1816B, the X elements in plot 1814B, and the cross-shaped elements in plot 1818b are data points corresponding to the user position where the cellular device is being held by the user.
  • the LMM devices provide incremental distances from one measurement location to the next, as shown in Figure 18B at 1820B, 1821 B, and 1822B.
  • the plot 1812A of the distance measured by the accelerometer is an example of locally measured movement information.
  • the locally measured accelerometer distance plot 1812A is a plot 1816a of locally measured movement of the real distance of a cellular device as it is moving.
  • the locally measured accelerometer distance, indicated in plot 1812A is used to correct the position fix distance as indicated by plot 1814A. Therefore, the plot 1814A of the position fix distance approximates the real distance plot 1816A.
  • the accelerometer reaches a limiting factor.
  • Delta-GNSS 1840a is the difference between the last two position fix distances for the plot 1814A.
  • Delta-LMM 1860A is the difference between the last two accelerometer distances for plot 1812a. Respective deltas may be calculated for any two successive position fixes or distances measured by a sensor, such as an image capturing device or accelerometer.
  • Figure 18B depicts a diagram of a pattern where locally measured movement information from an image capturing device 1540G is used to improve position
  • Axis 1801 A, 1802A, 1803A are for time
  • axis 1804B is for the plot 1818B of the distances measured by the image capturing device
  • axis 1802B is for the plot 1814B of position fix distances as determined by the movement sensor position fix smoothing logic 1510C using pseudorange information
  • axis 1803B is for the plot 1816B of real distances.
  • Plot 1818B is a plot of distances measured by the image capturing device, which is an example of locally measured movement information.
  • the locally measured image capturing device distance plot 1818B is locally measured movement of the real distance, depicted in plot 1816B, of a cellular device as it is moving.
  • the locally measured image capturing device distance, as indicated by plot 1818B is used to correct the position fix distances as indicated by plot 1814B. Therefore, the plot 1814D of the position fix distances approximates the real distances plot 1816B.
  • Delta-GNSS 1840B is the difference between the last two position fix distances for the plot 1814B.
  • Delta-LMM 1850a is the difference between the last two distances measured by the image capturing device for plot 1818B. Respective deltas may be calculated for any two successive position fixes or distances measured by a sensor, such as an image capturing device or accelerometer.
  • Figure 18C depicts a diagram of a pattern where locally measured movement information, as indicated by plots 1818C and 1812C, from an accelerometer and an image capturing device are continuously integrated together to improve position determination during a period of time and the image capturing device alone is used after the accelerometer reaches a limiting factor at time 1810C, according to one embodiment.
  • Axis 1801A, 1802A, 1803A and 1804A are for time
  • axis 1801 B is for distance measured by the accelerometer plot 1812C
  • axis 1802B is for the position fix distances plot 1814C
  • axis 1803B is for real distances plot 1816C
  • axis 1804B is for the plot 1818C of distances measured by an image capturing device.
  • the position fix distance plot 1814C includes the position fixes 1821 C-1827C.
  • Position fix 1826C is one of the position fixes in the position fix distance plot 1814C where 1826C is an "outlier.”
  • Distance, as indicated in plots 1812C and 1818C, measured respectively by the accelerometer's distance and the image capturing device's distance are examples of locally measured movement information.
  • the locally measured distances plots 1812C and 1818C are locally measured movement of the real distance, as indicated by plot 1816A, of a cellular device as it is moving.
  • the locally measured accelerometer's distance plot 1812C and the image capturing device's distance plot 1818C are used to correct the position fix distances, as indicated by plot 1814C.
  • the position fix 1828C is a new position fix that was determined based on a blend of locally measured movement (LMM) information from both an accelerometer and an image capturing device (also referred to as “blended locally measured movement information").
  • LMM locally measured movement
  • the new position fix 1828C can replace the "outlier" position fix 1826C, as discussed herein.
  • the accelerometer reaches a limiting factor and is not used after time 1810C.
  • Delta-GNSS 1840c is the difference between the second and third position fixes for the plot 1814C.
  • Delta-LMM 1850c is the difference between the two image capturing distances, which correspond to the second and third position fix, for plot 1818C.
  • Delta-LMM 1860C is the distance between two accelerometer distances, which correspond to the second and third position fix, for plot 1812C. Respective deltas may be calculated for any two successive position fixes or distances measured by a sensor, such as an image capturing device or accelerometer.
  • Figure 18D depicts a diagram of a pattern where the position determination is improved by alternating the use of non-overlapping locally measured movement information from an accelerometer and an image capturing device as indicated by respective plots 1812D and 1818D, according to one embodiment. For example, from tO to t1 , only the accelerometer's locally measured movement information, as indicated by plot 1812D, is used, from time t1 to t2 only the image capturing device's locally measured movement information, as indicated by plot 1818d, is used. The locally measured accelerometer distances plot 1812D and the image capturing device's distances plot 1818D are used to correct the position fix distances, as indicated by plot 1814D.
  • the plot 1814D of the position fix distances approximates the real distances plot 1816D.
  • the accelerometer reaches a limiting factor and is not used after time 1810D.
  • Figure 18E depicts various graphs 1800E-3, 1800E-2, 1800E-1 for estimating a new position fix when a GNSS position fix is an outlier, according to various embodiments.
  • Graph 1800E-1 depicts a plan view, looking down at the ground from above, of the path a user is walking as they are holding their cellular device.
  • There is an X-Y direction reference 1810E where x is the x direction that the user can walk and y is the y direction that the user can walk.
  • Graphs 1800E-1 's x axis represents times to to ti+1. Since graph 1800E-1 is a plan view, the x axis also represents the direction that a person can walk in the x direction.
  • the graph 1800E-1 depicts the GNSS position fixes P1-P9 that the user traveled while carrying their cellular device and distances D1 -D9 between each of the respective pairs of GNSS position fixes P1 -P9.
  • the distances D1-D9 are scalar distances traveled by the cellular device as measured by locally measured movement information, according to various embodiments.
  • the position fixes P1 -P9 are absolute coordinates as measured by a GNSS receiver.
  • the position fixes P1 -P9 are latitude longitude position fixes instead of distances traveled.
  • Each of the position fixes occur at the respective times ti-7 to ti+1.
  • P8 at time ti is an outlier 1803E.
  • the real position fix for the user at time ti is depicted as real position fix 1804E.
  • Graph 1800E-2 depicts a comparison between distances calculated based on GNSS position fixes (also known as “GNSS position fix distances”) and distances calculated based on locally measured movement information (also known as “LMM distances”), according to various embodiments.
  • GNSS position fix distances also known as “GNSS position fix distances”
  • LMM distances locally measured movement information
  • the y axis represents scalar distances for the GNSS position fix distances and the LMM distances.
  • the scalar distance is an absolute value. For example, an equation to compute the scalar distance between P(ti) and P(ti-1 ) is
  • ⁇ -io to ⁇ 8 7 represent distances calculated based on the GNSS position fixes P1-P8.
  • D1-D8 represent distances calculated based on locally measured movement (LMM) information, where ⁇ 10 is the distance between P0 and P1 , ⁇ 2 ⁇ is the distance between P1 and P2 and so on.
  • LMM locally measured movement
  • a distance between GNSS position fixes can be determined using an equation that subtracts a subsequent position fix P from a previous position fix P.
  • the graph 1800E-2 provides a comparison by depicting respective pairs together, such as D1 with ⁇ 10 , D2 with ⁇ 21, and so on through D8 with ⁇ 87 .
  • 1820E represents the maximum error allowed, also referred to herein as a metric threshold.
  • the GNSS position fix distance ⁇ 87 exceeds the LMM distance D8 by ⁇ , using the equation ⁇ > D8 + maximum error 1820E. Therefore, the GNSS position fix P8 that corresponds with ⁇ 87 is determined to be an "outlier," according to one embodiment.
  • Image measured distances and accelerometer distances depicted in Figures 18A-18D are examples of LMM distances D1 -D8.
  • Position fix distances depicted in Figures 18A-18D are examples of GNSS position fix distances AP 10 to ⁇ 87 .
  • Graph 1800E-2 depicts a GNSS position fix 1803E that is an "outlier" at time ti.
  • the GNSS position fix 1803E was calculated using various embodiments, as discussed herein. To make it easier to compare the GNSS position fix 1803E with the real position, at position fix 1804E, graph 1800E-1 also depicts the GNSS position fix 1803E, which is the "outlier.”
  • Graph 1800E-3 depicts a plan view of position fixes P(t0) to P(ti-1 ) taken respectively at times t0-t1 , according to one embodiment, where P(t0) to P(ti-1 ) depicted in graph 1800E-3 respectively are P0 to P8 depicted in graph 1800E-1.
  • the x axis represents the direction the cellular device carried by the user travels in the x direction and the y axis represents the direction the cellular device travels in the y direction. In this illustration, for the sake of simplicity, it is assumed that the user is walking on near level ground.
  • the graph 1800E-3 does not depict a z-axis since the z slope would be close to zero.
  • the letter M shall be used to represent slopes for LMM distances D1-D9. Therefore, the path in space from P(ti-2) to P(ti-1 ) is equal to MxX + MyY +MzZ + P(ti-2).
  • a cellular device 1500A, 1500J, 1600, 1700 may be used to estimate the position in 3D space of a position fix given by the cellular device 1500A, 1500J, 1600, 1700 which is declared to be an "outlier," as discussed herein.
  • GNSS data created by a cellular device 1500A, 1500J, 1600, 1700 is stored, for example, in memory 210 as discussed herein.
  • Examples of GNSS data include raw pseudoranges, corrected unsmoothed pseudoranges, corrected smoothed, uncorrected unsmoothed pseudoranges, uncorrected smoothed pseudoranges, smoothed pseudoranges, and various types of GNSS position fixes calculated, as discussed herein.
  • LMM data generated by a sensor, such as 1502A, 1540G, 1540J, is stored, for example, in memory 210, as discussed herein. A distance traveled can be determined based on LMM data, according to various
  • a GNSS average distance travelled can be determined based on GNSS data for a variable number of time intervals, such as tO-ti. For the same intervals tO-ti, an LMM average distance traveled can be estimated using locally measured movement information. In an embodiment, when there is a discrepancy between the GNSS average distance traveled and the LMM average distance traveled, the GNSS position fix may be determined to be an outlier, and may be discarded.
  • the real position 1804E's location in 3D may be estimated by the following method.
  • Let Ti represent the time that corresponds with the outlier position fix 1803E.
  • previous position fixes such as P(ti-2), P(ti-1 ) depicted in graph 1800E-3, prior to the time of the outlier 1803E may be used to determine a vector direction that can give an indication of the expected direction of travel. This vector is based on calculating the mathematical slopes of the components of a line in space.
  • an example of a slope is the slope of the line between P(ti-2) and P(ti-1 ).
  • Such slopes Mx, My, and Mz for the respective x, y and z coordinates may be determined by well-known methods involving the data points for the previous 2 known positions, Ti-1 and Ti-2, as shown in Figure 18E.
  • the average travel distance LMM represented by LMMave, may be determined by averaging the previous position fixes for 2 or more previous positions, such as P(ti-2) and P(t-1 ).
  • the estimated position of the replacement for the outlier 1803E may be determined by vector addition of the LMM average distance traveled scalar quantity to the vector position of the last known position fix at time Ti-1.
  • Pest[Ti] P[Ti-1 ] + LMMave x [Vector components Mx, My, Mz], where x and y are represented coordinates in 1810E and z represents height.
  • the LMM estimate 1802E depicted in graph 1800E-3 is an example of Pest[Ti].
  • the LMM estimate 1802E can be used to replace the GNSS position fix 1803E, according to various embodiments.
  • the direction of the line between P(ti-2) and P(ti-1 ) is continued from P(ti-1 ) to P E sT(ti) so that P(ti-2), P(ti-1 ) and P E sT(ti) appear to be in a straight line.
  • PEsi(ti) may be calculated by adding the distance D8 to the position fix P(ti-1 ), which is the last position fix that was determined to be sufficiently accurate, according to one embodiment.
  • Position fix P(ti-1 ) can be determined to be sufficiently accurate because D7 and ⁇ 2 ⁇ do not differ by the metric threshold 1820E.
  • This method may be performed in near-real time if the LMM distance is needed for other functions.
  • Other embodiments are also useful.
  • a more sophisticated estimation procedure may be applied that takes more previous and successive data points into account, such as a curve-fitting method.
  • the interval for collecting position fixes and distances for an image capturing device or accelerometer can vary, for example, from 1/10 th of a second to a second, according to one embodiment.
  • the metric threshold can range from 10 centimeters (cms) to 1 meter (m) or any other range of distance appropriate to the conditions of use.
  • Figures 18A-18E were depicted with movement information from one sensor or two sensors. If the movement information is from two or more sensors, the movement information can be blended based on weighting factors, as discussed herein. However, embodiments are well suited to a different number of sensors.
  • Weighting factors can be used as a part of implementing the patterns of using movement information as depicted in Figures 18A-18E.
  • a weighting factor determines how much of a sensor's output is used, for example, in a particular process. Weighting factors thus capture the relative importance of a sensor in operating the particular process. Weighting factors range from 0% to 100%, and all the weighting factors for all of the sensors of a cellular device that are being used at a point in time for a particular process generally add up to 100%. For example, if only one sensor is used, then then a weight of 100% may be used for the LMM information from that sensor.
  • movement information for sensor a may have a weight of 10% while the weight of the other sensor b may have a weight of 90% where 10% and 90% totals 100%.
  • a weight of 55% may be used for the movement information from sensor a and a weight of 45% may be used for the movement information from sensor b where 55% and 45% total 100%.
  • the movement information from one of the sensors is not used, for example, by assigning it a weight of 0. For example, if the movement information for the accelerometer is assigned a weight of 0, then the
  • accelerometer's movement information is not used. Similarly, if a weight of zero is assigned to the movement information of an image capturing device, then the image capturing device's movement information is not used.
  • a weight for a type of movement information may vary over time. For example, movement information from a single sensor a or b may have a weight of 10% from time tO to time t1 , then 15% from time t1 to time t2 and so on. In another example, when movement information from two or more sensors are used, a weight of 5% may be used for the movement information from sensor a and a weight of 7% may be used for the movement information from sensor b from time tO to time t1 and a weight of 8% may be used for the movement information from sensor a and a weight of 4% may be used for the movement information from sensor b from time t1 to time t2.
  • the weighting factor for the LMM information from a sensor of a plurality of sensor is determined based on the quality the LMM information. For example, if the quality of the LMM information from sensor a is twice as good as the LMM information from sensor b, then the weighting factor for the LMM information from sensor a may be twice that of the weighting factor for the LMM information from sensor b. [00495]
  • the quality of the LMM information for an accelerometer may be determined, for example, based on one or more of the quality of the accelerometer, the amount of time that has elapsed since the accelerometer was reset.
  • the quality of the LMM information from an image capturing device may be determined, for example, based on the quality of the image capturing device, the number of features associated with the one or more images obtained with the image capturing device, the amount of distance that the image capturing device has been moved since it was reset, the number of key features and so on.
  • the blending, based on weights, of the locally measured movement information from two or more sensors can be used as a part of determining the accuracy of a position fix, discarding a position fix that is an outlier, or calculating a new position fix to replace the discarded position fix, or a combination thereof.
  • the weighting factors can be used to take into account that there are error buildups that occur with the Locally Measured Movement information.
  • the weighting factors can be time dependent according to rules. For example the weighting factor for the accelerometer may decrease over the time limit preset for providing acceptable accuracy. The decrease may be linear or exponential.
  • the weighting factor for use of the image-based position shift estimator may also be decreased over time and over distance traveled.
  • the sum of the two position shift sources may be weighted appropriately and then used in a second summation process as follows.
  • LMM based sources such as an accelerometer and image capturing device
  • a first kind of test may be to 1 ) calculate the relative position fix changes for each type of sensor from a first time to a second time period; then blend the two LMM data sources together to get an LMM position shift. Then calculate the position shift determined by two successive GNSS-determined position fixes. By comparing these two successive GNSS-determined position fixes, a judgment can be made about the expected reliability of the GNSS-determined position fix.
  • Delta-GNSS 1840A, 1840B, 1840C be the difference between two successive position shifts based on GNSS.
  • Delta- LMM 1860A, 1850B, 1850C, 860C be the estimated position shift determined by the LMM sensors. If the difference between a respective Delta-GNSS and a Delta-LMM is greater than a predetermined threshold, then the GNSS position fix may be suspect, and may be discarded. For example, if the Delta-GNSS 1840A exceeds Delta-LMM 1860A for the accelerometer by a predetermined threshold, then the second position fix, which is used to calculate the Delta-GNSS 1840A, may be discarded.
  • a Delta-LMM may be the blend of the Delta-LMMs 1850C, 1860C for two sensors.
  • a blend of Delta-LMMs shall be referred to as a "bdl.” If the Delta GNSS-1840c exceeds the blended Delta-LMM bdl by a predetermined threshold, such as threshold 1820 ( Figure 18E), then the second position fix, which is used to calculate delta-GNSS 1840C, may be discarded. The discarded position fix may be replaced with a GNSS position fix data point that is calculated based on the Delta-LMM data 1860A, 1850B, 1850C, 1860C, blended Delta-LMM bdl, which is only a linear distance estimate.
  • the calculated GNSS position fix data point may be determined by extending a vector from the previous GNSS data point, based on the previous 2 or 3 GNSS position fixes and their X, Y, Z coordinates.
  • a vector between the first and second position fix in plot 1814A can be used in calculating a GNSS position fix data point based on the Delta-LMM data 1860a that will replace the third position fix in plot 1814A. In this way, outliers may be discarded and replaced with new estimates of a position in space at the time of the discard.
  • the LMM data may be used to both smooth and blend the GNSS position fix data, in another filter process.
  • the use of a composite weighting factor for LMM data may include a time and distance-traveled dependency.
  • this pair of weighting factors are applied to the two Deltas described earlier: Delta-GNSS position shift at time period ti to ti+1 , and Delta-LMM composite position shift at the same time period.
  • the blending /disciplining of any GNSS position fix can both be time dependent, in the following manner. As the lifetime of useful LMM data decreases, its weight may decrease, and the weight of the factor being applied to the Delta-GNSS position shift can be increased in opposite proportion, so the sum of the weighting factors is always one. This decrease in relative importance of LMM data is essential to minimize adding errors to a position fix estimate.
  • the locally measured cellular device movement information is a blend of two or more locally measured cellular device movement information obtained from two or more sensors that are in the known physical relationship with the cellular device and wherein the method further comprises blending the two or more locally measured cellular device movement information based on weighting factors.
  • the method further comprises changing the weighting factors over time based on respective quality of the two or more locally measured cellular device movement information.
  • Resetting the LMM data sources may be done automatically according to various kinds of rules, which can be chosen by a designer. For the accelerometer, the accuracy becomes unacceptable after some time period, on the order of tens of seconds. A reset can be done by program control when the accelerometer movement data drops below a threshold, such as when relative movement is less than 2 cm. Similar methods can be applied to the image capturing device, based on time and distance travelled.
  • a cellular device 1500A, 1600, 1700 includes limiting factor logic 1540C, where the accelerometer limiting factor logic 1542C pertains to limiting factor for the accelerometer 1502A and the ICD limiting factor logic 1544C pertains to limiting factors for an image capturing device 1540G.
  • Limiting factors can, for example, be used for determining whether to use movement information from a sensor, for example, due to the movement information being too inaccurate. For example, the accuracy of the movement information from an
  • the movement information from an accelerometer may be used from the time the accelerometer is set to a threshold of time.
  • a threshold of time for an accelerometer is approximately 10 seconds. The threshold of time depends on the quality of the
  • accelerometer where higher quality accelerometers will have a higher threshold of time than poor quality accelerometers. Higher quality accelerometers usually cost more and weigh more, so are not as appropriate as MEMS accelerometers, which are very small and light and fit with the overall design of a cellular device.
  • the accuracy of the movement information from an image capturing device depends, according to one embodiment, on the number of features that are in an image obtained with the image capturing device. For example, the more features that are in the image the more accurate the movement information from that image will be, up to a point of diminishing returns.
  • movement information from an image is used when the number of features of the image is ranges from 6 to 200 points.
  • the minimum number of points is 36 points with 6 degrees of freedom for x, y, z, roll, pitch and yaw, as 6 times 6 samples equals 36.
  • a technology known as match move can be used for measuring the amount of movement of a cellular device based on images taken with an image capturing device.
  • a type of movement information is not used if the limiting factor for the corresponding type of sensor is exceeded.
  • sensors are hardware image capturing devices and hardware accelerometers.
  • the threshold number of features may be set higher or lower than 200 in other embodiments.
  • the image capturing device is reset to use a new reference image. For example, if the image capturing device has moved ten or more feet since the reference image was set, a new image may be used as the reference image. In yet another example, if approximately 10 seconds has passed since an accelerometer was reset, then the movement information from the accelerometer is not used.
  • the weighting factor for a type of movement information is set to zero when the limiting factor of that type of movement information is exceeded.
  • a weight of zero can be assigned for movement information of an image from a camera when there are fewer than approximately 36 features in the image.
  • a weighting factor of zero can be assigned for movement information from an accelerometer when 10 seconds has passed since the accelerometer was reset.
  • Many types of data estimation methods may be employed to smooth the data from any single source to remove outliers, or to combine the effects of multiple and different data sources, as may be found in the cellular device system described herein.
  • Well-known methods include use of least squares, Bayes filtering, sequential least squares, particle filtering, other methods for robust estimation, the Hough transform, the Random Sample Consensus [RANSAC] method, and so forth, as is well-known in the estimation arts.
  • the Kalman Filtering method is also well-suited to multi-variant blending of dissimilar data sets. It is described herein as one example of a suitable estimation method.
  • Figure 19 depicts an example Kalman Filter processing 1900, according to some embodiments.
  • the Kalman Filtering process 1900 is performed by filtering logic 1524D, 1534E, 1512F. It should be appreciated that Kalman Filtering is well known. As such, Figure 19 and the associated discussion are utilized only to provide a high-level general description. Variations in the described procedures will occur during specific implementations of Kalman Filtering.
  • the extended Kalman Filter and the unscented Kalman Filter represent some of the variations to the basic method.
  • Kalman Filtering is a basic two-step predictor/corrector modeling process that is commonly used to model dynamic systems. A dynamic system will often be described with a series of mathematical models.
  • Models describing satellites in a Global Navigation Satellite System are one example of a dynamic system. Because the position of any satellite and/or the positions of all the satellites in a system constantly and dynamically change and the satellites output a signal that can be measured by a GNSS receiver, Kalman Filtering can be used in determining position fixes in a portion of a cellular device that is outside of the GNSS receiver. The models can also describe the position of a cellular device that includes GNSS receiver, for example, based on movement information.
  • GNSS Global Navigation Satellite System
  • Examples of inputs to the Kalman Filter processing 1900 are position fixes 1501 F and locally measured movement information 1502F.
  • the Kalman Filter processing 1900 selects one or more position fixes for removal. The position fixes can then be smoothed by removing the selected position fix(es).
  • the Kalman Filter processing 1900 selects one or more extracted pseudorange information from one (or more) sensors for removal. The extracted pseudorange information can then be smoothed by removing the selected information.
  • Examples of output from the Kalman Filter processing 1900 are predicted observations 1922, which may be used by other processes. Examples of the outputs are adjustments to a position fix, adjustments to Doppler shift information to reconstruct carrier phase information, or adjustments to extracted pseudorange information, according to various embodiments.
  • a basic Kalman Filter implemented using Kalman Filter processing 1900 typically has at least two major components 1910: states 191 1 and covariances 1912.
  • States 191 1 represent variables that are used to describe a system being modeled, at a particular moment in time.
  • Covariances 1912 are represented in a covariance matrix that describes uncertainty, or lack of confidence, of states 191 1 with respect to each other at that same moment in time.
  • Kalman Filter processing 1900 also handles noise, or unpredictable variability, in the model. There are two principal types of noise, observation noise 1941 and process noise 1921 . A Kalman Filter may handle additional noise types, in some
  • Process noise 1921 describes noise of the states 191 1 as a function of time.
  • Observation noise 1941 is noise that relates to the actual observation(s) 1940 (e.g., observed measurements) that are used as an input/update to Kalman Filtering process 1900.
  • a prediction phase 1920 is the first phase of Kalman Filter processing 1900.
  • Prediction phase 1920 uses predictive models to propagate states 191 1 to the time of an actual observation(s) 1940.
  • Prediction phase 1920 also uses process noise 1921 and predictive models to propagate the covariances 1912 to time of the actual observation(s) 1940 as well.
  • the propagated states 191 1 are used to make predicted observation(s) 1922 for the time of actual observation(s) 1940.
  • a correction phase 1930 is the second phase in the Kalman Filter processing 1900.
  • Kalman Filter processing 1900 uses the difference between the predicted observation(s) 1922 and the actual observation(s) 1940 to create an observation measurement residual 1931 , which may commonly be called the "measurement residual.”
  • Observation noise 1941 can be noise in actual observation(s) 1940 and/or noise that occurs in the process of taking the actual observation(s) 1940.
  • a Kalman gain 1932 is calculated using both the covariances 1912 and the observation noise 1941 .
  • the states 191 1 are then updated using the Kalman Gain 1932 multiplied by the observation measurement residual 1931.
  • the covariances 1912 are also updated using a function related to the Kalman gain 1932; for example, in one embodiment where Kalman gain 1932 is limited to a value between 0 and 1 , this function may be 1 minus the Kalman gain 1932. This updating is sometimes referred to as the "covariance update.”
  • the Blending factor logic 1933 is logic for weighting the movement information and using the weighted movement information or not using the movement information, as discussed herein.
  • Kalman Filter processing 1900 can simply skip correction phase 1930 and update the states 191 1 and covariances 1912 using only the information from prediction phase 1920, and then begin again. Using the new definitions of the states 191 1 and covariances 1912, Kalman Filter processing 1900 is ready to begin again and/or to be iteratively accomplished.
  • Kalman Filter processing 1900 may include correcting smoothed pseudoranges or correcting unsmoothed pseudoranges by
  • Kalman Filter processing 1900 could be used for filter 1524D to provide reconstructed carrier phase information 1502D based on extracted Doppler shift information 1501 D.
  • Kalman Filter processing 1900 could be used for filter 1534E to smooth extracted raw pseudoranges 1501 E based on carrier phase information (CPI) 1502E, real or reconstructed, to provide smoothed pseudoranges 1503E.
  • CPI carrier phase information
  • Kalman Filter processing 1900 could be used for filter 1512F to apply locally measured movement (LMM) information 1502F to calculated position fixes 1501 F, as discussed herein.
  • LMM locally measured movement
  • Inputs to a Kalman Filter could include accelerometer data; image based position shift data; GNSS-based position fix data, with shifts in position vs. time; generic weighting factors such as length of time accelerometer data is valid; length of time image- based position shift data is valid; metric for discarding a GNSS position fix or position shift, for example, in terms of how many centimeters (cm) is allowable before discarding.
  • accelerometer data image based position shift data
  • GNSS-based position fix data with shifts in position vs. time
  • generic weighting factors such as length of time accelerometer data is valid
  • length of time image- based position shift data is valid
  • metric for discarding a GNSS position fix or position shift for example, in terms of how many centimeters (cm) is allowable before discarding.
  • a Kalman Filter could calculate and output, for example, time-varying weighting factors; difference between GNSS position fix shifts and external sensor position shifts; a new position fix (also referred to as an "interpolated") based on locally measured movement (LMM) information to be used instead of a deleted position fix that is an "outlier.”
  • LMM locally measured movement
  • the Kalman Filter's states 191 1 are the parameters that the Kalman Filter calculates and outputs, as discussed herein. According to one embodiment, the state parameters are estimated.
  • the Kalman Filter's measurement model 1910 represents how the measurements are related to the state parameters 191 1 and the measurement noise covariance matrix 1912 (i.e., the variances of each measurement). According to one embodiment, the measurements are estimated.
  • Inputs raw pseudoranges, carrier phase, reconstructed carrier phase.
  • Outputs Smoothed pseudoranges
  • the inputs and outputs for the Filter 1512F, according to one embodiment, for the movement sensor position fix smoothing logic 1510C is as follows:
  • Inputs accelerometer data, image capture position shift data derived from Sequential Rolling Bundle Adjustment estimator; time dependent/distance dependent weighting factors.
  • Figure 20A is a flowchart of a method 2000A for improving position fix determination of a cellular device using locally measured movement, according to one embodiment.
  • the GNSS chipset embedded within the cellular device is accessed.
  • the GNSS chipset calculates raw observables that include raw pseudoranges and one of either Doppler Shift Information or Real Carrier Phase Information.
  • the GNSS chipset can be accessed in a manner similar to that described in the context of operation 620 of Figure 6.
  • the raw observables are extracted from the GNSS chipset for processing elsewhere in the cellular device outside of the GNSS chipset.
  • the raw observables can be extracted from the GNSS chipset in a manner similar to that described in the context of operation 630 of Figure 6.
  • the extracted raw observables may be raw pseudoranges, raw pseudoranges and Real Carrier Phase information, or raw pseudoranges and Doppler Shift Information.
  • the same or different commands may be used for extracting each of the types of raw observables.
  • the same command may be used to extract the raw pseudoranges, the real carrier phase information and the Doppler shift information, or similar commands may be used for extracting the raw pseudoranges, the real carrier phase information and the Doppler shift information.
  • a position fix is determined based on the raw observables. For example, a position fix may be determined based on the raw pseudoranges, a position fix may be determined based on smoothed pseudoranges that were smoothed based on real or reconstructed carrier phase information. A position fix may be determined based on corrected pseudoranges, uncorrected pseudoranges, unsmoothed pseudoranges, smoothed pseudoranges, or a combination thereof.
  • locally measured cellular device movement information is obtained from at least one sensor that is in a known physical relationship with the cellular device.
  • a sensor that is internal to a cellular device are accelerometer 1502A and an image capturing device 1540G.
  • Examples of a known physical relationship is a sensor that is internal to a cellular device, such as sensors 1502A or 1540G.
  • a sensor with a known physical relationship with the cellular device may be external to the cellular device.
  • Examples of an external sensor with a known physical relationship to a cellular device is image capturing device 1540J. Examples of locally measured cellular device movement information are depicted in plots 1812A, 1818B, 1818C, 1812C, 1812D, and 1818D.
  • the locally measured cellular device movement information is applied to the position fix.
  • position fixes which locally measured cellular device movement information can be applied to, are the position fixes depicted in the plots 1814A, 1814B, 1814C, 1814D and position fix 1560C.
  • the locally measured cellular device movement information (also referred to as "LMM information") can be applied to the position fix. For example, the position fix may be discarded based on the application of the LMM information to the position fix.
  • Kalman Filtering Logic such as filter 1512F using Kalman Filter processing 1900, can be used for determining the accuracy, determining if the position fix is an "outlier,” removing the "outlier,” calculating the new position fix, replacing the "outlier” with the new position fix, as discussed herein.
  • the removal of one or more position fixes that are identified as “outliers” is also referred to as smoothing.
  • Figures 18A-18D depict various patterns of movement information that may be used from a single sensor or two sensors, according to various embodiments, as a part of applying movement information to one or more position fixes.
  • the blending factor logic 1933 is logic for weighting the movement information and using the weighted movement information or not using the movement information, as discussed herein. Blending factors logic 1933 can be used for determining how to blend the movement information based on one or more weights, as discussed herein. Various patterns of blending, as depicted in Figures 18A-18D, can result from the blending factors logic 1933. One or more weights can be used to achieve the patterns, as discussed herein.
  • Operation 2060A can be performed in pseudorange information processing logic 1550A. Operation 2060A shall be described in more detail in the context of Figures 21 -27C. Another example of operation 2060A is operation 1425 ( Figure 14).
  • the processing of method 2000A can be performed in a loop for each determined position fix 1821 C-1827C as a user is moving.
  • LMM information can be applied to each position fix 1821 C-1827C.
  • LMM information can be used as a part of calculating a new position fix to replace each position fix that is discarded as the user is moving.
  • Figure 20B depicts a flowchart of a method 2000B of improving position determination of a cellular device using locally measured movement information, according to one embodiment.
  • the accuracy of any one of the position fixes 1821 C-1827C may be determined.
  • the accuracy of the position fixes 1821 C-1825C and 1827C indicate that they are acceptable and the accuracy of position fix 1826C is an "outlier.”
  • the accuracy of any one of position fixes P0-P9 may be determined.
  • the accuracy of the position fixes P0-P7 and P9 indicate that they are acceptable and the accuracy of position fix P8 is an "outlier," as discussed herein.
  • Embodiments are also well suited to using Delta-GNSSs 1840A, 1840B, 1840C, ⁇ -io to ⁇ 87 , combined GNSS delta cdg and Delta-LMMs 1860A, 1850B, 1850C, 1860C, D1-D8 or blended LMM-Delta bdl, or a combination thereof, as described herein, for determining the accuracy of position fixes.
  • a blended Delta-LMM bdl may be a blend of two or more LMM-Deltas that are blended using weighting factors as discussed herein.
  • position fix 1826C is selected to be discarded because the accuracy of position fix 1826C indicates it is an "outlier.”
  • position fix 1826C is removed and, therefore, will not be output to a user as a position fix 1560C. Since the accuracy of position fixes 1821 C-1825C and 1827C indicate that they are not outliers, they will be output as position fixes 1560C.
  • position fixe P8 is removed and, therefore, will not be output to a user as position fixes 1560C. Since the accuracy of the position fixe P0 to P7 and P9 indicate that they are not outliers, they will be output as position fixes 1560C.
  • a new position fix can be calculated based on LMM information.
  • a trajectory of the direction that the user of the cellular device is moving can be determined based on two or more of the position fixes that precede the discarded position fix.
  • the distance indicated by LMM information from one or more sensors in combination with the trajectory can be used to estimate a new position fix of the cellular device.
  • the LMM information can be a blend of two or more sensors using weights and patterns of blending, as discussed herein.
  • the trajectory can be determined using two previous position fixes with x, y and z coordinates.
  • a vector direction can be determined based on the two position fixes that occur before the position discarded position fix. For example, assuming the third position fix depicted in plot 1814A ( Figure 18A) will be discarded, the vector direction can be determined based on the first and second position fixes depicted in plot 1814A.
  • the discarded position fix 1826C indicated that the user moved 6 feet and the LMM information from the one or more sensors indicated the person moved 3 feet.
  • two or more position fixes such as for example, 1821 C-1825C ( Figure 18C) that precede the discarded position fix 1826C indicate the trajectory that the cellular device is moving along.
  • the new position fix 1828C can be determined based by adding the 3 feet to the position fix 1825C that immediately precedes the discarded position fix 1826C in the direction of the trajectory.
  • two or more calculated position fixes P0-P7 that precede the discarded position fix P8 can be used to determine a trajectory that the cellular device is moving along.
  • the position fixes P(ti-2), also known as P6, and P(ti-1 ), also known as P7 may be used could be used to determine the trajectory.
  • P(ti-2), also known as P6, and P(ti-1 ), also known as P7 may be used could be used to determine the trajectory.
  • the distance that the cellular device has traveled from 5 to 6 can be determined based on locally measured movement (LMM) information from one or more sensors (also referred to as “LMM distance”).
  • LMM distance locally measured movement
  • the new position fix 1802E (also referred to as “P E sT(ti)” or “LMM position fix”) can be determined by adding the LMM distance D8 to the calculated position fix P(ti-1 ), also known as P7, which immediately precedes the discarded position fix P8, in the direction of the trajectory.
  • interpolating for example, because the calculation involves determining a trajectory, as discussed herein, and adding the "LMM distance" D8, which was determined based on the LMM information, that the cellular device has been moved between the preceding measurements (at ti-1 in this example) and the current measurements (at ti in this example). For example, if the position fix is not needed in real time, then the additional data points collected subsequent to the outlier position may also be used to determine a best fit position fix to replace the "outlier.”
  • position fix 1826C is replaced with the new position fix 1828C.
  • LMM-deltas can be compared to each other directly.
  • An LMM position fix can be found by adding the LMM-delta for a given time period to a previously position fix.
  • the previous position fix may be a position fix that was determined based on extracted raw pseudoranges or an LMM position fix.
  • LMM position fixes can be compared directly with each other.
  • “Smoothing" position fixes can include, according to one embodiment, one or more of 2020B-20260B.
  • the discarding (2040B) of a position fix and replacing (2050B) the discarded position fix with a new position fix is also referred to as "adjusting" or "modifying" a position fix.
  • the discarded position fix is adjusted or modified to be the new position fix.
  • Method 2000B can be performed iterative for each position fix 1821 C-1827C ( Figure 18C), position fix P0-P9 ( Figure 18E) in a loop.
  • position fix 1821 C can be processed with method 2000B
  • position fix 1822C can be processed with method 2000B.
  • the position fixes 1821 C-1825C, 1828C, 1827C would be output as position fixes 1560C ( Figure 15C).
  • the method 2000B is performed by pseudorange information processing logic 1550A.
  • method 2000B can be performed as a part of operation 2060A ( Figure 20A).
  • a filter such as filter 1512F, can be used to perform the method 2000B, according to various embodiments.
  • Figure 21 is a flowchart of a method 2100 of improving position determination of a cellular device using locally measured movement information from an image capturing device, according to one embodiment.
  • the method starts. Processing proceeds to 2120. [00576] At 2120, a determination is made as to whether a current image with movement information is available from the image capturing device. One or more images are taken with an image capturing device are examples of movement information.
  • the current image is the first image or if movement the image capturing device exceeds a distance threshold, then reset the image capturing device to use the current image as a reference image.
  • the current image is used as a new reference image when the image capturing device 1540G movement exceeds a distance threshold since the current reference image was taken or since the previous image, depending on how far the image capturing device 1540G has been moved, or how much time has passed.
  • the creation of an association between the current image and one or more previous images will be interfered with if the image capturing device 1540G has been moved too far or if too much time has passed.
  • a range of a distance threshold is approximately 3 to 10 feet when a new reference image may be taken.
  • a new reference image is taken and used if the image capturing device 1540G has moved about 10 feet or more.
  • One of the limiting factors is being able to track original feature points in a previous reference image.
  • a new reference image might take and used (also referred to as "renewing") after a movement of 3 feet.
  • This renewal feature of the reference frame is variable and can be subject to experimental validation for the type of image obtained with the image capturing device 1540G.
  • Operation 2125 can be performed by the ICD movement information accessing logic 1512B. Processing proceeds to 2130.
  • the movement information of the current image from the image capturing device is accessed and stored.
  • the movement information can be stored in memory 210.
  • Memory 210 may be cleared after a period of time, or after an accumulation of a specified number of images. Since memory costs continue to decline, the size of memory may be determined by the use case, and in event, the use of external memory cards, such as SD, SDHC, etc., may prove to be sufficient.
  • Operation 2130 can be performed by ICD movement information accessing logic 1512B. Processing proceeds to 2140.
  • a determination is made as to whether the movement information of the current image exceeds a limiting factor for that type of movement information. For example, according to one embodiment, a determination can be made as to whether there are at least 30 features associated with an image obtained from the image capturing device. The minimum may be increased based on environmental conditions. The minimum may be factory set or adjustable in the field.
  • processing proceeds back to 2120. For example, if there are less than 30-50 features associated with the image, then the image is not used and processing proceeds to 2120. This number of minimum feature set may be as low as 10. Accuracy will decrease with the decrease in feature set size.
  • the processing proceeds to 2150. For example, if there are more than approximately 100-200 features associated with the image, then the image can be used to improve the quality or improve the accuracy of the extracted pseudorange information at 2150. Operation 2150 can be performed by ICD limiting factor logic 1544C.
  • the LMM information is applied to the position fix, for example, as described by operation 2060A and/or flowchart 2000B.
  • Figure 22 is a flowchart of a method 2200 of improving position determination of a cellular device using locally measured movement information from an accelerometer, according to one embodiment.
  • the accelerometer 1502A can be used to perform 2220.
  • accelerometer movement information accessing logic 1512A can perform operation 2230. Processing can proceed to 2240. [00589] At 2240, movement information is obtained from the accelerometer and stored. The movement information can be stored in memory 210. The accelerometer movement information accessing logic 1512A can perform operation 2230. Processing can proceed to 2250.
  • Accelerometer limiting factor logic 1542C can perform operation 2250.
  • LMM information from the accelerometer is applied to a position fix, for example, as described by operation 2060A and/or flowchart 2000B
  • a message can be displayed to the user asking the user if the user wants to stop moving the accelerometer so that it can be reset because a limiting factor has been exceeded.
  • Accelerometer limiting factor logic 1542C can perform operation 2270. Processing can proceed to operation 2220.
  • one or more position fixes are passed through an LMM smoothing process, such as movement sensor position fix smoothing logic 1510C, even if no locally measured movement information is currently available. For example, even if the accelerometer is past a threshold, such as 10 seconds, and the image capturing device is not turned on, so the locally measured movement information is not available, one or more position fix(es) may still be passed through the movement sensor position fix smoothing logic 1510C.
  • LMM smoothing process such as movement sensor position fix smoothing logic 1510C
  • an initial amount locally measured movement information is obtained.
  • additional locally measured cellular device movement information may be obtained.
  • the additional locally measured cellular device movement information can be applied to an additional position fix that was determined based on additional raw pseudoranges that were, for example, obtained or extracted after an initial amount of raw pseudoranges that were used to determine, for example, a previous position fix.
  • Figure 23 is a flowchart of a method of performing sequential rolling bundle adjustments, according to one embodiment.
  • the images are associated with a video that is at 10.
  • the video is at 10Hz such that the images are at 1 , 1.1 , 1.2, ... 2.0.
  • GPS positions are collected at time 1 s and 2s along with
  • the image processing algorithm is initialized. Operations 2332, 2334, 2336 can be performed as a part of 2330.
  • tie points are provided by finding matching features in, for example, 10 images.
  • “Bundle adjustment” refers to the process of adjusting the image capturing device's position and orientation so that the bundles of ray paths from the features being tracked in the second image are made to match the original bundles of ray paths from the feature locations in the first image.
  • the mathematical process is well known in the Match Move arts. This is an image processing step and is not related to any other kind of input data. Sequential rolling bundle adjustments speed the process by only dealing with the most significant changes.
  • the estimated position and orientation of image capturing device is outputted.
  • the method depicted in Figure 23 provides trajectory smoothing effect because the image measurements have a high level of precision. Higher rate positions would be available with higher rate image capturing devices provided the image capturing devices have sufficient processing power, and GPS outages could be bridged.
  • At least 5 image samples are used from one image to the next as a part of determining position fixes.
  • the scale can come from the fact that there are GPS positions at previous epochs, or it could come from ground control, or it could come from knowing approximately the positions of the 5 key points from previous epochs.
  • the additional locally measured cellular device movement information is applied to the additional position fix if the additional locally measured cellular device movement information includes at least 5 features in the image.
  • the additional locally measured cellular device movement information is based on an image and the limiting factor is at least 5 features in the image.
  • Figures 24A to 24C are flow charts for determining what, if any, of the sensor devices can be used, according to one embodiment.
  • Flowchart 2400 starts at 2410. At 2420, a decision is performed to determine whether an operational accelerometer is available that is capable of providing quality above a specified threshold. If the decision to 2420 is yes, processing proceeds to 2430. If the decision to 2420 is no, processing proceeds to 2440.
  • a decision is performed to determine whether an operational image capturing device is available that is capable of providing a position fix above a specified threshold. If the answer to the decision at 2430 is yes, then processing proceeds to 2450 indicating that locally measured movement information can be obtained from both the accelerometer and the image capturing device. If the answer to the determination at 2430 is no, then processing proceeds to 2460 indicating that locally measured movement information may still be obtained from only the accelerometer.
  • a decision is performed to determine whether an operational image capturing device is available that is capable of providing quality above a specified threshold. If the answer to the decision at 2440 is yes, then processing proceeds to 2470 indicating that locally measured movement information can be obtained only from image capturing device. If the answer to the determination at 2440 is no, then processing proceeds to 2480 indicating that locally measured movement information will not be obtained.
  • Figure 24B depicts a flowchart with more details for the processing of 2430 and 2440, according to various embodiments.
  • a decision is performed as to whether the cellular device has an image capturing device (ICD). If the decision for 2402B is no, then the decision for 2430 is no. If the decision for 2402B is yes, then processing proceeds to 2404B where a determination is made as to whether the image capturing device is turned on. If the answer to the decision at 2402B is no, processing proceeds to 2406B where the image capturing device is turned on. After either 2404B or 2406B, the image capturing device is turned on and the answer to the decision for 2430 or 2440 is yes and processing can proceed, according to one embodiment, to flowchart 2100 depicted on Figure 21 .
  • ICD image capturing device
  • Figure 24C depicts a flowchart with more details for the processing of 2420, according to various embodiments.
  • a decision is performed as to whether the cellular device has an accelerometer (ACC). If the cellular device does not have an accelerometer, then the decision for 2420 is no. If the cellular device has an accelerometer, then the answer for decision 2402C is yes and processing proceeds to 2410C.
  • ACC accelerometer
  • FIG. 25 depicts a flowchart 2500 for improving a position fix based on locally measured movement information, according to one embodiment.
  • raw pseudoranges are accessed.
  • a GNSS chipset can be accessed and the raw pseudoranges can be extracted as discussed herein.
  • Raw pseudoranges are one type of raw observables.
  • Other types of raw observables such as real carrier phase information or Doppler Shift Information can also be accessed at 2520.
  • the extracted raw pseudoranges can be stored in memory 210. Processing proceeds to 2530.
  • smoothing can be performed using carrier phase information, which is real or reconstructed, if the carrier phase information is available.
  • the smoothing can be performed on the extracted raw pseudoranges.
  • the output of 2530 is smoothed
  • uncorrected pseudoranges if carrier phase information is available. Otherwise, the output of 2530 is unsmoothed uncorrected pseudoranges. According to one embodiment, if both Doppler Shift Information and real carrier phase information are available, real carrier phase information will be used instead of Doppler Shift Information. Processing proceeds to 2540.
  • a position fix is determined based on the output of 2520, 2530, or 2540 depending on which was last performed since 2530 and 2540 are optional.
  • the position fix from 2550 can optionally be smoothed based on locally measured movement information from a sensor with a known physical relationship to a cellular device, such as an accelerometer or an image capturing device.
  • a cellular device such as an accelerometer or an image capturing device.
  • LMM information from one or more sensors can be applied to the position fix from 2550, as described herein. Processing proceeds to 2580.
  • Operations 2530, 2540, 2550 and 2560 are a part of improving position determination, according to various embodiments, by processing raw observables 2570.
  • Figures 26A-26G depict flowcharts for improving position determination using LMM information, according to various embodiments.
  • Figure 26A depicts a flowchart 2600A for obtaining and storing raw observables.
  • the raw observables can be obtained by extracting them from a GNSS chipset 170 and stored in memory 210.
  • Figure 26B-26G depict respective flowcharts 2600B-2600G for processing the raw extracted observables.
  • Figure 26F depicts a flowchart 2600F for processing raw observables based on real carrier phase information.
  • Figure 26D depicts a flowchart 2600D for processing raw observables based on reconstructed carrier phase information that was reconstructed based on Doppler Shift Information.
  • Figure 26B is used for processing raw observables when neither Doppler Shift nor Real Carrier Phase information is available.
  • raw observables are obtained and stored. More specifically, processing proceeds from the start 2601 to determining whether raw pseudoranges are available at 261 OA and 2617A. If raw pseudoranges are not available, processing proceeds to 2605A. If raw pseudoranges are available, then processing proceeds to 2615A.
  • timers are reset. These timers are for the time thresholds that are used to determine if enough, such as a predetermined amount, real carrier phase information or enough Doppler Shift Information have been obtained within their respective time thresholds.
  • raw pseudoranges are continuously obtained and stored using a continuous loop 2660A.
  • raw pseudoranges can continuously be extracted from the GNSS chipset 170 and stored in memory 210.
  • real carrier phase information is obtained and stored. Processing proceeds to 2640A.
  • real carrier phase information can continuously be extracted from the GNSS chipset 170 and stored in memory 210.
  • DSI Doppler Shift Information
  • Doppler Shift Information is obtained and stored.
  • Doppler Shift information can continuously be extracted from the GNSS chipset 170 and stored in memory 210. Processing proceeds to 2645A.
  • approximately 20-100 seconds of raw observables such as raw pseudoranges, real carrier phase information, and Doppler Shift Information, are obtained, for example, at least at 1413, 1415, 1416 ( Figure 14), 2615A, 2630A, 2635A ( Figure 26A).
  • Two or more of obtaining pseudoranges at 2610A, obtaining real carrier phase information at 2630A and obtaining Doppler Shift Information at 2635A can be performed concurrently, for example, by one or more processors 109.
  • two or more of obtaining pseudoranges at 261 OA, obtaining real carrier phase information at 2630A and obtaining Doppler Shift Information at 2635A can be performed by separate processes or threads that are executed concurrently, for example, by one or more processors 109.
  • raw pseudoranges 2610B are obtained from memory 210.
  • the raw pseudoranges were placed into memory 210 at 2615A ( Figure 26A).
  • the processing of the raw pseudoranges 2610B proceeds to 2625B.
  • the raw pseudorange 2610B are uncorrected and unsmoothed.
  • uncorrected pseudoranges 2610B proceeds to 2631 B. If external corrections were applied, processing of the corrected pseudoranges 2640B proceeds to 2641 B.
  • an unsmoothed uncorrected position fix 2632B is determined based on the raw unsmoothed uncorrected pseudoranges 2610B.
  • an unsmoothed corrected position fix 2642B is determined based on the unsmoothed corrected pseudoranges 2640B.
  • the unsmoothed uncorrected position fix 2632B is optionally smoothed using locally measured movement information.
  • the locally measured movement (LMM) information can be obtained from memory 210 at 2655B.
  • the locally measured movement (LMM) information may have been placed into memory 210 at either 2130 ( Figure 21 ) or 2240 ( Figure 22) or both 2130 and 2240. Processing of the smoothed uncorrected position fix 2660B can proceed to 2670B.
  • the smoothed uncorrected position fix 2660B can be provided to a user. If the position fix 2632B is not smoothed at 2645B, then the unsmoothed uncorrected position fix 2632B is provided to the user at 2670B. Processing can proceed back to 2605B [00649]
  • the unsmoothed corrected position fix 2640B can be smoothed using locally measured movement information.
  • the locally measured movement (LMM) information can be obtained from memory 210 at 2655B.
  • the locally measured movement (LMM) information may have been placed into memory 210 at either 2130 ( Figure 21 ) or 2240 ( Figure 22) or both 2130 and 2240. Processing of the smoothed corrected position fix 2665B can proceed to 2675B.
  • the smoothed corrected position fix 2665B can be provided to a user. If the position fix 2642B is not smoothed at 2650B, then the unsmoothed corrected position fix 2642B is provided to the user at 2675B. Processing can proceed back to 2605B.
  • the flow chart 2600C can be performed concurrently with flowchart 2600B ( Figure 26B), to determine whether either real carrier phase
  • Doppler Shift Information becomes available and switch to processing raw pseudoranges based on real carrier phase information or Doppler Shift Information if enough, such as a predetermined amount, of either becomes available.
  • timers are reset.
  • a timer for the real carrier phase information threshold that is checked at 2630C and a timer for the Doppler Shift Information that is checked at 2635C are reset.
  • real carrier phase information is obtained and stored.
  • real carrier phase information can continuously be extracted from the GNSS chipset 170 and stored in memory 210. Processing proceeds to 2630C.
  • DSI Doppler Shift Information
  • Doppler Shift Information is obtained and stored.
  • Doppler Shift information can continuously be extracted from the GNSS chipset 170 and stored in memory 210. Processing proceeds to 2635C.
  • Doppler Shift Information is obtained and stored. For example, additional Doppler Shift information can be extracted from the GNSS chipset 170 and stored in memory 210. If the time threshold has expired, then enough Doppler Shift Information has been obtained and processing proceeds to flowchart 2600D on Figure 26D.
  • Doppler Shift Information 2610D is obtained from storage.
  • the Doppler Shift Information 2610D can be obtained from memory 210 where it was placed, for example, at 2635A ( Figure 26A).
  • the processing of the Doppler Shift Information 2610D proceeds to 2615D.
  • the Doppler Shift Information is processed to provide reconstructed carrier phase information 2620D.
  • a filter 1524D ( Figure 15D) or some other type of integration logic 1522D ( Figure 15D) can be used to reconstruct carrier phase information based on Doppler Shift Information. Processing can proceed to 2625D.
  • raw pseudoranges 2630D are obtained from memory 210.
  • the raw pseudoranges 2630D can be obtained from memory 210 where it was placed, for example, at 2615A ( Figure 26A).
  • the raw pseudoranges 2630D are uncorrected and unsmoothed.
  • the processing of the raw pseudoranges 2630D can proceed to 2635D.
  • a filter 1534E ( Figure 15E) or the hatch logic 1532E ( Figure 15E) can be used for smoothing the raw
  • pseudoranges 2630D with the reconstructed carrier phase information 2620D at 2635D. Processing of the smoothed uncorrected pseudoranges 2640D from 2635D proceeds to 2655D.
  • external corrections are optionally applied to the smoothed uncorrected pseudoranges 2640D.
  • External corrections are pseudoranges corrections that can be obtained, for example, from a correction source such as at least correction service 221 , FM radio distribution 226, or satellite radio distributor 227, or a combination thereof.
  • a correction source is located outside of the cellular device (also referred to as an "external correction source,” and, therefore, corrections from the correction source are referred to as “external corrections" or "external pseudorange corrections.”
  • Examples of external corrections include WAAS, SBAS, DGPS, PPP, RTK, VRS and RTX corrections. Processing proceeds to 2660D.
  • a smoothed uncorrected position fix 2662D is determined based on the smoothed uncorrected pseudoranges 2640D. Processing proceeds to 2675D.
  • the smoothed uncorrected position fix 2650D can be additionally smoothed based on locally measured movement (LMM) information.
  • the locally measured movement (LMM) information can be obtained from memory 210 at 2680D.
  • the locally measured movement (LMM) information may be placed into memory 210 at either 2130 ( Figure 21 ) or 2240 ( Figure 22) or both 2130 and 2240. Processing of the additionally smoothed uncorrected position fix 2690D can proceed to 2692D.
  • the additionally smoothed uncorrected position fix 2690D can be provided to the user. If the position fix 2662D was not smoothed based on LMM at 2675D, then the smoothed uncorrected position fix 2662D can be provided to the user at 2692D. Processing proceeds back to 2605D.
  • a smoothed corrected position fix 2672D is determined based on the smoothed corrected pseudoranges 2670D. Processing proceeds to 2685D.
  • the smoothed corrected position fix 2670D can be additionally smoothed based on locally measured movement (LMM) information.
  • the locally measured movement (LMM) information can be obtained from memory 210 at 2680D.
  • the locally measured movement (LMM) information may be placed into memory 210 at either 2130 ( Figure 21 ) or 2240 ( Figure 22) or both 2130 and 2240. Processing of the additionally smoothed corrected position fix 2691 D can proceed to 2693D.
  • the additionally smoothed corrected position fix 2691 D can be provided to the user. If the position fix 2672D was not smoothed based on LMM information at 2685D, then the smoothed corrected position fix 2662D can be provided to the user at 2693D. Processing proceeds back to 2605D.
  • the flowchart 2600E can be performed concurrently with flowchart 2600D ( Figure 26D) to determine whether Doppler Shift Information becomes unreliable or unavailable and switch to processing raw pseudoranges without Doppler Shift Information. If enough, such as a predetermined amount, Doppler Shift Information is not obtained, then the already obtained Doppler Shift Information is not useful for smoothing. If enough Doppler Shift Information is obtained, the processing continues with flowchart 2600D.
  • a timer is reset.
  • a timer that is checked at 2620E is reset. Processing proceeds to 2610E.
  • Doppler Shift Information is obtained and stored.
  • Doppler Shift information can continuously be extracted from the GNSS chipset 170 and stored in memory 210. Processing proceeds to 2620E.
  • Real Carrier Phase Information 261 OF is obtained from memory 210.
  • the Real Carrier Phase Information 261 OF was placed into memory 210 at 2630A ( Figure 26A).
  • the processing of the Real Carrier Phase Information 261 OF proceeds to 2615F.
  • raw pseudoranges 2620F are obtained from memory 210.
  • the raw pseudoranges 2620F were placed into memory 210 at 2615A ( Figure 26A).
  • the processing of the raw pseudoranges 2620F can proceed to 2625F.
  • the raw pseudoranges 2620F are smoothed using the real carrier phase information 261 OF provided at 2605F.
  • a filter 1534E Figure 15E
  • the hatch logic 1532E Figure 15E
  • the output of 2625F is smoothed uncorrected pseudoranges 2640F. Processing of the smoothed uncorrected pseudoranges 2640F proceeds from 2625F proceeds to 2645F.
  • external corrections are optionally applied to the smoothed uncorrected pseudoranges 2640F.
  • External corrections are pseudorange corrections that can be obtained, for example, from a correction source such as at least correction service 221 , FM radio distribution 226, or satellite radio distributor 227, or a combination thereof.
  • a correction source is located outside of the cellular device, and, therefore, corrections from the correction source are referred to as "external corrections" or "external pseudorange corrections.”
  • Examples of external corrections include WAAS, SBAS, DGPS, PPP, RTK, VRS and RTX corrections. Processing proceeds to 2650F.
  • a smoothed uncorrected position fix 2652F is determined based on the smoothed uncorrected pseudoranges 2640F. Processing proceeds to 2655F.
  • the smoothed uncorrected position fix 2640F can be additionally smoothed based on locally measured movement (LMM) information.
  • the locally measured movement (LMM) information can be obtained from memory 210 at 2660F.
  • the locally measured movement (LMM) information may be placed into memory 210 at either 2130 ( Figure 21 ) or 2240 ( Figure 22) or both 2130 and 2240. Processing of the additionally smoothed uncorrected position fix 2670F can proceed to 2680F.
  • the additionally smoothed uncorrected position fix 2670F can be provided to the user. If the position fix 2652F was not smoothed based on LMM at 2655F, then the smoothed uncorrected position fix 2652F can be provided to the user at 2680F. Processing proceeds back to 2605F.
  • a smoothed corrected position fix 2654F is determined based on the smoothed corrected pseudoranges 2650F. Processing proceeds to 2665F.
  • the smoothed corrected position fix 2654F can be additionally smoothed based on locally measured movement (LMM) information.
  • the locally measured movement (LMM) information can be obtained from memory 210 at 2660F.
  • the locally measured movement (LMM) information may be placed into memory 210 at either 2130 ( Figure 21 ) or 2240 ( Figure 22) or both 2130 and 2240. Processing of the additionally smoothed corrected position fix 2675F can proceed to 2685F.
  • the additionally smoothed corrected position fix 2675F can be provided to the user. If the position fix 2654F is smoothed based on LMM information at 2665F, then the smoothed corrected position fix 2654F can be provided to the user at 2685F. Processing proceeds back to 2605F.
  • the flowchart 2600G can be performed concurrently with flowchart 2600F ( Figure 26F) to determine whether real carrier phase information becomes unreliable or unavailable and switch to processing raw pseudoranges without real carrier phase information. If enough carrier phase information is not obtained within a threshold of time, then the already obtained real carrier phase information is no longer sufficiently useful. If enough real carrier phase information is obtained within a threshold of time, the processing continues with flowchart 2600F.
  • a timer is reset. For example, a timer that is checked at 2620G is reset. Processing proceeds to 2610G.
  • real carrier phase information is obtained and stored.
  • real carrier phase information can continuously be extracted from the GNSS chipset 170 and stored in memory 210. Processing proceeds to 2620G.
  • Various operations refer to obtaining raw observables, such as extracted raw pseudoranges, real carrier phase information, and Doppler Shift information, from memory 210.
  • the raw observables may be obtained from memory 210 using a push method or pull method.
  • the pull method is also referred to as "fetch.”
  • the control logic 1520A ( Figure 15A) is responsible for directly performing the processing of flowcharts 14, 20-26G or indirectly coordinating the processing of flowcharts 14, 20-26G, according to various embodiments.
  • An example of direct is when the control logic 1520A performs the processing itself.
  • An example of indirect is when the control logic 1520A calls another entity to perform the processing.
  • the control logic 1520A can call any one or more entities associated with a cellular device to perform the processing of flowcharts 14, 20A-26G indirectly.
  • the control logic 1520A may call at least one or more of the following to perform processing of flowcharts 14, 20-26G indirectly:
  • carrier phase measurement extracting logic 1 12B-4 to obtain and store real carrier phase information, for example, at 2530 (Figure 25), 2620C (Figure 26C), 2615G (Figure 26G), 1416 ( Figure 14), 2630A ( Figure 26A);
  • carrier phase reconstructing logic 1520C to reconstruct carrier phase information based on Doppler Shift Information, for example, at 1427 (Figure 14), 2615D ( Figure 26D);
  • Process 1 for continuously extracting and storing raw pseudoranges could include operations 141 1 , 1412 and 1413,
  • Process 2 for processing when neither real carrier phase information nor reconstructed carrier phase information is available.
  • process 2 could include operations 1416, 1418, 1424, 1423, 1425, 1426,
  • the real carrier phase information can be continuously obtained and stored into memory 210.
  • the process 3 could include operations 1416, 1415, 1428, 1424, 1423, 1425, 1426,
  • Process 4 for processing when Doppler Shift Information is available The Doppler Shift information can be continuously obtained and stored into memory 210.
  • the process 4 could include operations 1418, 1417, 1427, 1421 , 1424, 1423, 1425, and 1426,
  • Process 5 for continuously accessing and storing into memory 210 locally measured movement information from an ICD and handling ICD limiting factor.
  • process 5 could include operations 2120, 2125, 2130 and 2140 ( Figure 21 ), and • Process 6 for continuously accessing and storing into memory 210 locally measured movement information from an accelerometer and handling accelerometer limiting factor.
  • process 6 could include operations 2220, 2230, 2240, 2250, and 2270.
  • two or more of processes 1-6 are executed concurrently.
  • process 1 and one or more of processes 2-6 are executed concurrently.
  • One or more hardware processors 109 can be used for executing one or more of processes 1 -6.
  • Combination 1 processes 1 , 2, 3 , and 5 or 6,
  • Combination 2 processes 1 , 2, 4, 5 and 6
  • Combination 3 processes 1 , 2, 3, and 5 or 6,
  • Combination 4 processes 1 , 2, 4, 5 and 6,
  • Process 1 for continuously extracting and storing raw pseudoranges into memory 210 can include loop 2660A that is executed continuously,
  • process 2 for processing when neither real carrier phase information nor reconstructed carrier phase information is available.
  • process 2 may include a process pair 2A and 2B.
  • process 2A may include flowchart 2600B and process 2B may include flowchart 2600C,
  • process 3 may include a process pair 3a and 3b.
  • Process 3a may include operations 2620A, 2630A, 2640A, flowcharts 2600F for real carrier phase information.
  • Process 3b may include flowchart 2600G,
  • process 4 includes a process pair 4a and 4B.
  • Process 4A may include operations 2625A, 2635A, 2645A, flowchart 2600D for Doppler Shift Information.
  • Process 4B may include flowchart 2600E,
  • Process 5 for accessing and storing locally measured movement information from an ICD and handling ICD limiting factor.
  • process 5 could include operations 2120, 2125, 2130 and 2140 ( Figure 21 ), and
  • Process 6 for accessing and storing locally measured movement information from an accelerometer and handling accelerometer limiting factor.
  • process 6 could include operations 2220, 2230, 2240, 2250, and 2270.
  • processes 2A and 2B are executed concurrently.
  • processes 3A and 3B are executed concurrently.
  • processes 4A and 4B are executed concurrently.
  • two or more of processes 1-6 are executed concurrently.
  • process 1 and one or more of processes 2-6 are executed concurrently.
  • One or more hardware processors 109 can be used for executing one or more of processes 1 -6.
  • Combination 1 processes 1 , 2A, 2B, 3A, 3B, and 5 or 6,
  • Combination 2 processes 1 , 2A, 2B, 4A, 4B, 5 and 6
  • Combination 3 processes 1 , 2A, 2B, 3A, 3B, and 5 or 6,
  • Combination 4 processes 1 , 2A, 2B, 4A, 4B, 5 and 6,
  • Combination 8 process 1 , 2A, 2B, 3A, and 3B,
  • Combination 9 process 1 , 2A, 2B, 4A, and 4B.
  • different continuously executing concurrent processes can be used for obtaining and storing various types of information.
  • a continuously executing process could be used for extracting raw pseudoranges and storing raw pseudoranges into memory 210.
  • Another continuously executing process could be used for obtaining and storing into memory 210 real carrier phase information.
  • Yet another continuously executing process could be used for obtaining and storing into memory 210 Doppler Shift Information.
  • Yet still another continuously executing process could be used for obtaining and storing into memory LMM information from an accelerator.
  • Yet still another continuously executing process could be used for obtaining and storing into memory 210, LMM information from an image capturing device.
  • Yet one or more additional processes could be used to fetch or receive pushed information, such as extracted raw pseudorange information, real carrier phase information, Doppler Shift Information, and/or real carrier phase information to perform various types of processing, such as smoothing based on carrier phase information, reconstruct carrier phase information, apply external corrections, perform additional smoothing based on LMM information, performing decision logic, such as determining whether limiting factors have been exceeded, determining whether raw observables are available in sufficient amounts, and so on.
  • pushed information such as extracted raw pseudorange information, real carrier phase information, Doppler Shift Information, and/or real carrier phase information to perform various types of processing, such as smoothing based on carrier phase information, reconstruct carrier phase information, apply external corrections, perform additional smoothing based on LMM information, performing decision logic, such as determining whether limiting factors have been exceeded, determining whether raw observables are available in sufficient amounts, and so on.
  • a combination of processes could be used for an entire work session, according to one embodiment.
  • An example of a work session could be a period of time that the cellular device is being used to survey an area.
  • Different combinations could be used during different subsets of a work session, according to another embodiment. For example, one combination could be used while the cellular device is unobstructed and capable of obtaining good signals and another combination could be used while the cellular device is obstructed. In another example, one combination could be used while both the
  • accelerometer and the ICD are turned on and another combination could be used when one of the sensors becomes unavailable. These are just a few examples. Embodiments are well suited for other examples.
  • Figures 27A-27C are example timelines that demonstrate techniques for using various combinations of sensors and/or carrier phase smoothing concurrently over time for improving position determination of a cellular device using locally measured movement information, according to various embodiments.
  • an accelerometer (acc) and no carrier phase smoothing is used for improving position determination of a cellular device using locally measured movement information.
  • LMM information can be obtained from only an accelerometer (2460 on Figure 24A) and no carrier phase smoothing (A in Figure 26A) may be performed.
  • the accelerometer is used for the time periods of tO- t1 , t2-t5, t6-t7 to obtain movement information (2050A at Figure 20A and 2240 at Figure 22) and to improve position determination (2060A at Figure 20A, 2570 at Figure 25, 1420 at Figure 14, 2260 at Figure 22, 2600B at Figure 26B).
  • the accelerometer's limiting factor(s) is exceeded (2250 at Figure 22) at t1 , t3, t4, t5 and t7.
  • the accelerometer is reset (2230 at Figure 22) at times tO, t2, t3, t4 and t6.
  • the accelerometer is not used during the time periods of t1-t2 and t5-t6.
  • the image capturing device (ICD) and no carrier phase smoothing is used for improving position determination of a cellular device using locally measured movement information.
  • LMM information is obtained from only the image capturing device (2470 on Figure 24A) and no carrier phase smoothing is performed (A on Figure 26A).
  • the image capturing device is used for the time periods of t0-t1 , t1-t2 and t3-t4 to obtain movement information (2130 at Figure 21 ) and to improve position determination (2150 at Figure 21 , 2570 at Figure 25, 1420 at Figure 14, 2600B at Figure 26B).
  • the image capturing device's limiting factor(s) is exceeded (2140 at Figure 21 ) at t1 , t2 and t4.
  • the image capturing device is reset (2125 at Figure 21 ) at times tO, t1 , and t3.
  • the image capturing device is not used during the time period of t2-t3.
  • the accelerometer (acc), the image capturing device (ICD) and no carrier phase smoothing are used for improving position determination of a cellular device using locally measured movement information.
  • locally measured movement information from both the accelerometer and the image capturing device (2450 on Figure 24A) with no carrier phase information (A on Figure 26A) is used.
  • the accelerometer is used for the time periods of t0-t1 , t1-t2, t3-t6, t7-t8 and t8-t9 to obtain movement information (2240 at Figure 22) and to improve position determination (2060A at Figure 20A, 2570 at Figure 25, 1420 at Figure 14, 2260 at Figure 22, 2600B at Figure 26B).
  • the accelerometer's limiting factor(s) is exceeded (2250 at Figure 22) at t1 , t2, t6, t8 and t9.
  • the accelerometer is reset at times tO, t1 , t3, t7 and t8.
  • the image capturing device is used for the time periods of t0-t4 and t5-t9 to obtain movement information (2130 at Figure 21 ) and to improve position determination (2150 at Figure 21 , 2570 at Figure 25, 1420 at Figure 14, 2600B at Figure 26B).
  • the image capturing device's limiting factor(s) is exceeded (2140 at Figure 21 ) at t4 and t9.
  • the image capturing device is reset (2125 at Figure 21 ) at times tO and t5.
  • the use of the accelerometer and the image capturing device overlap for the time periods of t0-t2, t3-t4, t5-t6, and t7-t9.
  • the accelerometer only is used from time t4-t5. Embodiments are well suited for periods of time when the image capturing device only is used for periods of time as well.
  • carrier phase smoothing real or reconstructed, is not used immediately because it takes some time for carrier phase smoothing information with sufficient quality to be obtained. For example, it may take several 100s of seconds before the carrier phase smoothing information is useful.
  • one or more sensors may be used without carrier phase smoothing until the carrier phase smoothing information becomes useful.
  • an accelerometer (acc) and carrier phase smoothing (CPS) is used for improving position determination of a cellular device using locally measured movement information.
  • acc accelerometer
  • CPS carrier phase smoothing
  • locally measured movement information from only the accelerometer (2460 on Figure 24A) and carrier phase information (2620A or 2625A on Figure 26A) are used.
  • the carrier phase smoothing may be based on either reconstructed or real carrier phase information.
  • the accelerometer is used for the time periods of t0-t1 , t1-t2, t3-t4, t6-t7 and t8-t9 to obtain movement information (2240 at Figure 22) and to improve position determination (2060A at Figure 20A, 2570 at Figure 25, 1420 at Figure 14, 2260 at Figure 22, either 2600D on Figure 26D or 2600F on Figure 26F).
  • the accelerometer's limiting factor(s) is exceeded (2250 on Figure 22) at t1 , t2, t4, t7 and t9.
  • the accelerometer is reset (2230 at Figure 22) at times tO, t1 , t3, t6 and t8.
  • Carrier phase smoothing is used from time t5 on.
  • the accelerometer alone is used for the time periods of t0-t2 and t3-t4.
  • Carrier phase smoothing alone is used for the time periods of t5-t6, t7-t8 and t9. No improvements are used from either the accelerometer or carrier phase smoothing during the time periods of t2- t3 and t4-t5.
  • the image capturing device (ICD) and carrier phase smoothing (CPS) are used for improving position determination of a cellular device using locally measured movement information.
  • ICD image capturing device
  • CPS carrier phase smoothing
  • the image capturing device is used for the time periods of t0-t1 , t2-t3, t3-t4, t6-t7, t8-t9 and t10-t1 1 to obtain movement information (2130 at Figure 21 ) and to improve position determination (2150 at Figure 21 , 2570 at Figure 25, 1420 at Figure 14, either 2600D or 2600F).
  • the image capturing device's limiting factor(s) is exceeded (2140 at Figure 21 ) at t1 , t3, t4, t7, t9, and t1 1.
  • the image capturing device is reset (2125 at Figure 21 ) at times tO, t2, t3, t6, t8, and t10.
  • Carrier phase smoothing is used from time t5-t12.
  • the use of the image capturing device and carrier phase smoothing overlap during the time periods of t6-t7, t8-t9 and t10-t1 1.
  • carrier phase smoothing alone is used during the periods of t5-t6, t7-t8, t9-t10, 11 1 -t 12.
  • Neither the image capturing device nor carrier phase smoothing is used during the period of t1-t2 and t4-t5.
  • the accelerometer (acc), the image capturing device (ICD) and carrier phase smoothing (CSP) are used for improving position determination of a cellular device using locally measured movement information.
  • locally measured movement information from both an accelerometer and an image capturing device (2450 on Figure 24A) and carrier phase information are used.
  • the accelerometer is used for the time periods of t1-t2, t3-t4, t5-t6, t8-t9, t10-t1 1 , t14-t15, t16-t17, t19-t21 , t21-t22, t23-t24, t27-t28 to obtain movement information (2240 at Figure 22) and improve position
  • the accelerometer's limiting factor(s) is exceeded (2250 at Figure 22) at t2, t4, t6, t9, t1 1 , t15, t17, t21 , t22, t24, t28.
  • the accelerometer is reset (2125 at Figure 21 ) at times t1 , t3, t5, t8, t10, t14, t16, t19, t21 , t23 and t27.
  • the image capturing device is used for the time periods of t0-t7, t7-t12 t13- t18, t20-t25, t26-t28 to obtain movement information (2130 at Figure 21 ) and to improve position determination (2150 at Figure 21 , 2570 at Figure 25, 1420 at Figure 14, either 2600D or 2600F).
  • the image capturing device's limiting factor(s) is exceeded (2140 at Figure 21 ) at t7, t12, t18, t25 and t28.
  • the image capturing device is reset (2125 at Figure 21 ) at times tO, t7, t13, t20, t26.
  • Carrier phase smoothing is used from time t17 on.
  • the image capturing device alone is used for the time periods of t0-t1 , t2-t3, t4-t5, t6-t8, t9-t10, t1 1 -t12, t13-t14, t15-t16.
  • the accelerometer and the image capturing device are used together during the time periods of t1-t2, t3-t4, t5-t6, t8-t9, t10-t1 1 , t14-t15, t16-t17.
  • Carrier phase smoothing and the image capturing device without the accelerometer are used during the periods of t17-t18, t24-t25 and t26-t27.
  • Carrier phase smoothing and the accelerometer without the image capturing device are used during the period of t19-t20.
  • the use of the image capturing device, the accelerometer and carrier phase smoothing overlap during the periods of t20-t22, t23-t24 and t27-t28.
  • Carrier phase smoothing alone is used during the periods of t18-t19 and t25- t26.
  • any one or more of the operations depicted in flowcharts 1400, 1900-2600G can be performed by the hardware processor 109 that is located in the cellular device 1500A, 1500J, 1600, 1700 and outside of the GNSS chipset 170 embedded in the cellular device.
  • the applying of LMM information to position fixes is performed automatically and on the fly.
  • a method of improving position determination of a cellular device 1500A, 1500J, 1600, 1700 using locally measured movement is provided.
  • a Global Navigation Satellite System (GNSS) chipset 170 embedded within the cellular device 1500A, 1500J, 1600, 1700 is accessed where the GNSS chipset 170 calculates raw pseudoranges.
  • the raw pseudoranges are extracted from the GNSS chipset 170 for processing elsewhere in the cellular device 1500A, 1500J, 1600, 1700 outside of the GNSS chipset 170.
  • a position fix is calculated (2040A, Figure 20A) based on the raw pseudoranges.
  • a first image is obtained with an image capturing device that is in a known physical relationship with the cellular device.
  • a second image is obtained with the image capturing device 1540G.
  • Examples of a first point in time could be any point in time depicted in Figures 27A- 27C that the image capturing device 1540G (ICD) is being used.
  • Examples of a second point in time could be any point in time depicted in Figures 27A-27C that is subsequent to the first point in time.
  • An estimate of a distance that the cellular device 1500A, 1500J, 1600, 1700 moved from the first point in time to the second point in time is calculated by processing image data collected for the time frame from the first time to the second time.
  • Various embodiments described herein provide for processing the position fix based on the estimate of the distance, he accessing, the extracting, the calculating of the position fix, the obtaining the first image, the obtaining the second image, the calculating of the estimate, and the processing of the position fix are performed by one or more hardware processors 109 located in the cellular device and outside of the GNSS chipset 170.
  • the calculating of the estimate of the distance that the cellular device moved from the first point in time to the second point in time by processing image data collected for the time frame from the first point in time to the second point in time further comprises replacing a set of image data related to at least five key-points included in the first image related to at least five same key-points included in the second image.
  • the obtaining, at the first point in time, of the first image with the image capturing device further comprises calibrating the image capturing device to correct the image for lens distortion, the lens distortion selected from a group consisting of a principal distance distortion, a focal length, a principal point offset, a radial distortion, and a tangential distortion.
  • the position fix is a current position fix of the cellular device and wherein the method further comprises: obtaining a set of images 1 to n using the image capturing device from at least the first point in time to the second point in time, each image of the set of images 1 to n includes a set of image data and images 1 to n- 1 has at least one respective subsequent image and images 2 to n has at least one respective previous image; calculating position fix estimates of positions of the cellular device between the first point in time and the second point in time by replacing a set of image data included in an image with a set of image data included in a respective subsequent image; determining a previous position fix, based on previous raw
  • the previous position fix correlates with a position of the cellular device at a time that is less than or equal to the second point in time; and determining the estimate of the distance based on the previous position fix and at least one of the position fix estimates.
  • the method further comprises collecting position fixes from the first point in time to the second point in time; collecting synchronized video that includes a plurality of images from the first point in time to the second point time; initializing an image processing algorithm; locating correspondences; performing sequential rolling bundle adjustment; adding new locally measured movement information from new images and the new images are taken with the cellular device; and adding new position fixes based on the new measurements, where the collecting of position fixes, the collecting of synchronized video, the initializing of the image processing algorithm, the locating of correspondences, the performing of the sequential rolling bundle adjustment, the adding of new locally measured movement information and the adding of new position fixes are performed by the one or more hardware processors.
  • accelerometer data is obtained from an accelerometer 1502A that is part of the cellular device 1500A, 1500J, 1600, 1700.
  • second accelerometer data is obtained from the accelerometer 1502A.
  • a second estimate of the distance is calculated based on the first accelerometer data and the second accelerometer data.
  • a third estimate is determined by blending the first estimate and the second estimate using any type of filter described herein. The obtaining of the first accelerometer data, the obtaining of the second accelerometer data, the calculating of the second estimate and the determining of the third estimate are performed by the one or more hardware processors 109.
  • a previous position fix of the cellular device 1500A, 1500J, 1600, 1700 is determined for the first point in time based on previous raw pseudoranges and a current position fix is determined for the second point in time based on current raw pseudoranges.
  • P7 is an example of a previous position fix
  • P8 is an example of a current position fix.
  • a position fix distance ⁇ 87 is determined that is the difference between the current position fix P8 and the previous position fix P7.
  • a second difference ⁇ is determined between the estimate of the distance D8 and the position fix distance ⁇ 87 . If the second difference ⁇ exceeds a metric threshold 1820E, the current position fix P8 is discarded.
  • a trajectory of movement of the cellular device 1500A, 1500J, 1600, 1700 is determined based on two or more position fixes P(ti-2), P(ti-1 ), which are previous to the current position fix P8, of the cellular device.
  • a new position fix PEsi(ti) is interpolated based on the estimate of the distance D8 and the trajectory.
  • FIG. 14, 19-26G depict flowcharts 1400, 1900-2600G, according to one embodiment. Although specific operations are disclosed in flowcharts 1400, 1900-2600G, such operations are exemplary. That is, embodiments of the present invention are well suited to performing various other operations or variations of the operations recited in flowcharts 1400, 1900-2600G. It is appreciated that the operations in flowcharts 1400, 1900-2600G may be performed in an order different than presented, and that not all of the operations in flowcharts 1400, 1900-2600G may be performed.
  • FIG. 14 The operations depicted in Figures 14, 19-26G transform data or modify data to transform the state of a cellular device 1500A, 1500J, 1600, 1700. For example, by extracting pseudorange information from a GNSS chipset 170 for use elsewhere, the state of the cellular device 1500A, 1500J, 1600, 1700 is transformed, for example, from a cellular device that is not capable of determining a position fix itself into a cellular device that is capable of determining a position fix itself.
  • operations depicted in flowcharts 1400, 1500J, 1900-2600G transform the state of a cellular device 1500A, 1500J, 1600, 1700 from not being capable of providing an improved accuracy position fix 1560C to being capable of providing an improved accuracy position fix 1560C.
  • any one or more of the embodiments described herein can be implemented using non-transitory computer readable storage medium and computer readable instructions which reside, for example, in computer-readable storage medium of a computer system or like device.
  • the non-transitory computer readable storage medium can be any kind of physical memory that instructions can be stored on. Examples of the non-transitory computer readable storage medium include but are not limited to a disk, a compact disk (CD), a digital versatile device (DVD), read only memory (ROM), flash, and so on.
  • one or more of the various embodiments described herein can be implemented as hardware, such as circuitry, firmware, or computer readable instructions that are stored on non-transitory computer readable storage medium.
  • the computer readable instructions of the various embodiments described herein can be executed by a hardware processor, such as central processing unit, to cause the cellular device 1500A, 1500J, 1600, 1700 to implement the functionality of various embodiments.
  • the SUPL client 1501A and the operations depicted or described in the context of Figure 14-33 are implemented with computer readable instructions that are stored on computer readable storage medium, which can be tangible or non-transitory or a combination thereof, and can be executed by a hardware processor 109 of a cellular device 1500A, 1500J, 1600, 1700.
  • a method of improving position determination of a cellular device using locally measured movement comprising:
  • GNSS Global Navigation Satellite System
  • the obtaining of the first accelerometer data, the obtaining of the second accelerometer data, the calculating of the second estimate and the determining of the third estimate are performed by the one or more hardware processors.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Fixing By Use Of Radio Waves (AREA)
  • Navigation (AREA)

Abstract

A Global Navigation Satellite System (GNSS) chipset embedded within the cellular device is accessed. The GNSS chipset calculates raw pseudoranges. The raw pseudoranges are extracted from the GNSS chipset for processing elsewhere in the cellular device outside of the GNSS chipset. A position fix is calculated based on the raw pseudoranges. At a first point in time, a first image, and at a second point in time, a second image are obtained with an image capturing device that is in a known physical relationship with the cellular device. An estimate of a distance that the cellular device moved from the first point in time to the second point in time is calculated by processing image data collected from the first point in time to the second point in time. The position fix is processed based on the estimate of the distance.

Description

DEAD RECKONING SYSTEM BASED ON LOCALLY MEASURED MOVEMENT
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application is related to and claims priority to and benefit of U.S. Patent Application No. 14/268,993 filed on May 2, 2014 entitled "DEAD RECONING SYSTEM BASED ON LOCALLY MEASURED MOVEMENT" by Richard RUDOW, having Attorney Docket No. TRMB-3172.CIP12.
[0002] This application is related to and claims priority to and benefit of U.S. Patent Application No. 14/268,998 filed on May 2, 2014 entitled "CONCURRENT DUAL
PROCESSING OF PSEUDORANGES WITH CORRECTIONS" by Richard RUDOW, having Attorney Docket No. TRMB-3172.CIP13.
[0003] Application Serial Numbers 14/268,993 and 14/268,998, claimed priority to and are continuations-in-part to the co-pending patent application, Serial Number 14/035,884, Attorney Docket Number TRMB-3172.CIP1 , entitled "EXTRACTING PSEUDORANGE INFORMATION USING A CELLULAR DEVICE," by Richard Rudow et al, with filing date Sept. 24, 2013, and assigned to the assignee of the present application.
[0004] U.S. Patent Application No. 14/035,884 claimed priority to and benefit of then copending U.S. Provisional Patent Application No. 61/746,916, filed on December 28, 2012 entitled, "IMPROVED GPS/GNSS ACCURACY FOR A CELL PHONE" by Rudow et al., having Attorney Docket No. TRMB-3172.PRO, and assigned to the assignee of the present application.
[0005] Application Serial Number 14/035,884, also claimed priority to and is a continuation- in-part to the co-pending patent application, Serial Number 13/842,447, Attorney Docket Number TRMB-3172, entitled OBTAINING PSEUDORANGE INFORMATION USING A CELLULAR DEVICE," by Richard Rudow, with filing date March 15, 2013, and assigned to the assignee of the present application.
[0006] Application Serial Numbers 14/268,993 and 14/268,998 are continuation-in-part applications of and claim the benefit of co-pending U.S. Patent Application No. 13/954,995 filed on July 31 , 2013, entitled "ROLLING SEQUENTIAL BUNDLE ADJUSTMENT," by Shawn D. Weisenburger, having Attorney Docket No. TRMB-4134, and assigned to the assignee of the present application. BACKGROUND
[0007] The Global Positioning System (GPS) and its extensions in the Global Navigation Satellite Systems (GNSS) have become thoroughly pervasive in all parts of human society, worldwide. GPS and GNSS receivers in the form of chipsets have become widely incorporated into cell phones and other types of cellular devices with cellular-based communications equipment.
[0008] Typically, cellular devices include highly integrated GNSS chipsets that are designed to work with the E-91 1 service primarily, and are not designed to provide anywhere near a full range of features and outputs. They do provide a position fix, but are not designed to make available very many other parameters of interest. All GNSS receivers must acquire, track and decode a data message that conveys information about the location of the satellites in space, and time information. The principal additional parameter obtained is the "pseudorange." However, conventionally, this set of data is not available as an output from the cellular device's GNSS chipsets for use by the cellular device itself. Conventionally, in circumstances where it is available, it is under access control by the vendor.
BRIEF DESCRIPTION OF THE DRAWING
[0009] The accompanying drawings, which are incorporated in and form a part of this application, illustrate embodiments of the subject matter, and together with the description of embodiments, serve to explain the principles of the embodiments of the subject matter. Unless noted, the drawings referred to in this brief description of drawings should be understood as not being drawn to scale. Herein, like items are labeled with like item numbers.
[0010] Figure 1A depicts a block diagram of a cellular device for extracting pseudorange information, according to one embodiment.
[0011] Figure 1 B depicts a block diagram of a cellular device for extracting and processing pseudorange information, according to one embodiment.
[0012] Figure 1 C depicts decision logic for determining whether to apply WAAS (Wide Area Augmentation System) corrections or DGPS (Differential Global Positioning System) corrections, according to one embodiment.
[0013] Figure 1 D depicts a block diagram of a cellular device for extracting pseudorange information, according to one embodiment.
[0014] Figure 2 depicts a block diagram of multiple sources for providing positioning correction information to a cellular device for processing pseudorange information, according to one embodiment.
[0015] Figure 3 depicts a conceptual view of pseudorange measurements, according to various embodiments.
[0016] Figure 4 depicts a flowchart for determining an RTK (Real Time Kinematic) position solution, according to one embodiment.
[0017] Figure 5A is a flowchart of a method for performing a carrier phase smoothing operation using real carrier phase information, according to one embodiment.
[0018] Figure 5B is a flowchart of a method for generating reconstructed carrier phase information based on Doppler shift, according to one embodiment. [0019] Figure 6 depicts a flowchart of a method of extracting pseudorange information using a cellular device, according to one embodiment.
[0020] Figures 7A-10 depict flowcharts of methods of improving the position accuracy using one or more position accuracy improvements, according to various embodiments.
[0021] Figure 1 1 depicts a flowchart a method of accessing and processing extracted pseudorange information, according to one embodiment.
[0022] Figure 12 depicts a block diagram of a GNSS receiver, according to one
embodiment.
[0023] Figure 13 depicts an example Kalman Filtering process, according to some embodiments.
[0024] Figure 14 depicts a flow chart with at least two processes executing concurrently for providing position fix(es), according to various embodiments.
[0025] Figures 15A-15J depict block diagrams of a cellular device and various portions of the cellular device for providing improved position fix determination, according to one embodiment.
[0026] Figure 16 depicts a block diagram of a cellular device for providing improved position fix determination, according to one embodiment.
[0027] Figure 17 depicts a block diagram of a cellular device and multiple sources for providing positioning correction information to the cellular device for processing
pseudorange information, according to one embodiment.
[0028] Figures 18A-18D depict diagrams of patterns where locally measured movement information is used to improve position fix determination, according to various embodiments.
[0029] Figure 18E depicts various graphs for estimating a new position fix when a GNSS position fix is an outlier, according to various embodiments. [0030] Figure 19 depicts an example of Kalman Filter processing, according to some embodiments.
[0031] Figures 20a-26G depict flowcharts of methods for improving position determination of a cellular device using locally measured movement, according to one embodiment.
[0032] Figures 27A-27C are example timelines that demonstrate techniques for using various combinations of sensors and/or carrier phase smoothing concurrently over time for improving position determination of a cellular device using locally measured movement information, according to various embodiments.
[0033] Figure 28 illustrates a frame from the 720 p video (1280 x 720) sequence taken at 25 frames per second by Nikon D 800 camera using 35 mm lens, according to one
embodiment.
[0034] Figure 29 depicts light beams passing through the pinhole of a pinhole camera, according to one embodiment.
[0035] Figure 30 illustrates x- and z-coordinates of the 2-D projection of a 3-D point through a projection center of a pinhole camera, according to one embodiment.
[0036] Figure 31 depicts an image including a number of segments, each segment including a minimum number of tracked features, according to one embodiment.
[0037] Figure 32 shows the sequential update in estimation of camera positions and orientation from the initial N frames to the subsequent (N+1 ) frames while using the sequential rolling bundle adjustment algorithm, according to one embodiment.
[0038] Figure 33 illustrates the solution of collinearity equations utilized for estimation of camera position and orientation for each frame and for estimating 3-D coordinates of the tracked key-points system, according to one embodiment. DESCRIPTION OF EMBODIMENTS
[0039] Reference will now be made in detail to various embodiments of the subject matter, examples of which are illustrated in the accompanying drawings. While various
embodiments are discussed herein, it will be understood that they are not intended to limit to these embodiments. On the contrary, the presented embodiments are intended to cover alternatives, modifications and equivalents, which may be included within the spirit and scope the various embodiments as defined by the appended claims. Furthermore, in the following Description of Embodiments, numerous specific details are set forth in order to provide a thorough understanding of embodiments of the present subject matter. However, embodiments may be practiced without these specific details. In other instances, well known methods, procedures, components, and circuits have not been described in detail as not to unnecessarily obscure aspects of the described embodiments.
[0040] Unless specifically stated otherwise as apparent from the following discussions, it is appreciated that throughout the description of embodiments, discussions utilizing terms such as "accessing," "calculating," "extracting," "using," "providing," "applying," "correcting," "smoothing," "reconstructing," "modeling," "improving," "adjusting," "filtering," "discarding," "removing," "processing," "determining," "selecting," "determining," "locating," "positioning," "increasing," "accessing," "differentiating," "integrating," "bridging," displaying," "performing," "providing," "obtaining," "calculating," "receiving," "storing," "notifying," "matching," "creating," "generating," "communicating," "transmitting," "requesting," "providing," "activating,
"deactivating," "initiating," "terminating," "interpolating," "changing," "replacing," "causing," "transforming data," "modifying data to transform the state of a computer system," or the like, refer to the actions and processes of a computer system, data storage system, storage system controller, microcontroller, hardware processor, or similar electronic computing device or combination of such electronic computing devices. The computer system or similar electronic computing device manipulates and transforms data represented as physical (electronic) quantities within the computer system's/device's registers and memories into other data similarly represented as physical quantities within the computer system's/device's memories or registers or other such information storage, transmission, or display devices.
EXTRACTING PSEUDORANGE INFORMATION USING A CELLULAR DEVICE
Overview [0041] Cellular devices, such as cell phones and non-voice enabled cellular devices, possesses pseudorange information that can be used in surveying and other positioning operations. Conventionally, however, the pseudorange information from cellular device chipsets are only available under a limited set of conditions, usually only when performing a E-91 1 service call, and then only for use by the Assisted GPS service located in conjunction with the E-91 1 service facility. Therefore, according to one embodiment, an embedded GNSS chipset is employed with in a cellular device, which: a) calculates pseudorange information for use by the GNSS chipset; and b) permits extraction of this pseudorange information by the cellular device in which it is embedded. As will be discussed, the pseudorange information from the GNSS chipset is extracted for use elsewhere in the cellular device outside of the GNSS chipset.
Examples of Systems for Extracting Pseudorange Information
[0042] Figure 1A depicts a block diagram of a cellular device 100 for extracting
pseudorange information, according to one embodiment. Examples of a cellular device 100 include a cell phone, a non-voice enabled cellular device, and a mobile hand-held GNSS receiver. The cellular device may be mobile or stationary. The cellular device may be hand- holdable or incorporated as a portion of a system which is not hand-holdable. In some embodiments, a cellular device, such as cellular device 100, may be utilized as a portion of a navigation system, security system, safety system, telematics device/box, or the like. In some embodiments, cellular device 100 may be utilized as sub-system of the vehicle mounted portion of a vehicle safety system, security system, and/or navigation system. The vehicle mounted portion of the OnStar® vehicle safety, vehicle security, and vehicle navigation system that is utilized in many vehicles is one non-limiting example of a system which may include cellular device 100.
[0043] As depicted in Figure 1A, the cellular device 100 includes a GNSS chipset 170, a GNSS receiver 107, a processor 172 that is part of the GNSS receiver 107, a chipset accessor logic 141 , a pseudorange information extractor logic 142, an improved accuracy Secure User Platform Location (SUPL) client 101 , a pseudorange information bridger logic 143, a pseudorange information processing logic 150, an operating system 160, a location manager logic 161 , a location displayer logic 162, hardware 180 that is outside of the GNSS receiver 107. According to one embodiment, the chipset accessor logic 141 , the
pseudorange information extractor logic 142, the pseudorange information processing logic 150, and the pseudorange information bridger logic 143 are a part of the improved accuracy SUPL client 101 . [0044] According to one embodiment, the hardware 180 includes a hardware processor 109 and memory 210. An example of a hardware processor 109 is a central processing unit. An example of hardware memory 210 is computer readable storage, such as, but not limited to, a disk, a compact disk (CD), a digital versatile device (DVD), random access memory (RAM) or read only memory (ROM). The hardware memory 210 is physical and, therefore, tangible, according to one embodiment. The hardware memory 210, according to another embodiment, is non-transitory.
[0045] According to one embodiment, the processor 172 and the GNSS receiver 107 are a part of the GNSS chipset 170. According to one embodiment, the chipset accessor logic 141 , pseudorange information extractor logic 142, the pseudorange information bridger logic 143, the improved accuracy SUPL client 101 , the operating system 160, and the processor 109 are located in a portion of the cellular device 100 that is outside of the GNSS chipset 170. The location manager logic 161 can be a part of the operating system 160 and external to the GNSS chipset 170. According to one embodiment, the location displayer logic 162 is a part of the location manager logic 161. According to one embodiment, the chipset accessor logic 141 , pseudorange information extractor logic 142, the pseudorange information processing logic 150, pseudorange information bridger logic 143, and improved accuracy SUPL client 101 are application programming interfaces (API) function
applications that reside in memory of the cellular device 100 and are executed by a processor 109 of the cellular device 100.
[0046] According to one embodiment, the GNSS receiver 107 is capable of receiving signals from GPS satellites, GLONASS satellites, or from a combination of satellites from different constellations. The GNSS receiver 107 can perform GPS measurements to derive raw measurement data for a position of the cellular device 100. The raw measurement data can provide an instant location of the cellular device 100. According to one embodiment, the raw measurement data is the pseudorange information that is extracted (also referred to as "extracted pseudorange information"). Examples of the extracted pseudorange information are uncorrected pseudorange information, observed pseudorange information, or unsmoothed pseudorange information, or a combination thereof. Conventionally, the raw measurement data is only for use by the GNSS chipset 170 and the GNSS chipset 170 calculates pseudorange information that is only for use by the GNSS chipset 170.
Examples of pseudorange information are uncorrected pseudorange information, smoothed pseudoranges, and corrected pseudoranges. Examples of corrections used to improve accuracy of a position fix include differential GNSS corrections (DGPS), high precision GNSS satellite orbital data, GNSS satellite broadcast ephemeris data, and ionospheric and tropospheric error corrections and error projections based on location.
[0047] The GNSS chipset 170 has a processor 172 and, therefore, is capable of processing information, such as pseudorange information, itself. However, according to various embodiments, information that the GNSS chipset 170 has can be extracted from the GNSS chipset 170 and processed outside of the GNSS chipset 170 instead of by the GNSS chipset 170 using its own processor 172, in order to provide an improved accuracy position fix.
[0048] The chipset accessor logic 141 is configured for accessing the GNSS chipset 170. The pseudorange information extractor logic 142 is configured for extracting the
pseudorange information from the accessed GNSS chipset 170. The extracted
pseudorange information can be received and stored continuously. The pseudorange information bridger logic 143 is configured for bridging the pseudorange information from the GNSS chipset 170 to the location manager logic 161 that resides in the operating system 160 of the cellular device 100.
[0049] According to one embodiment, the chipset accessor logic 141 , the pseudorange information extractor logic 142, the pseudorange information processing logic 150 and pseudorange information bridger logic 143 are a part of an improved accuracy SUPL client 101. For example, The SUPL client 101 can interface between the GNSS chipset 170 and the location manager logic 161 , which resides in the operating system 160.
[0050] The pseudorange information can be obtained from the processor 172 of the GNSS receiver 107. The GNSS chipset 170 may be designed, for example, by the manufacturer of the GNSS chipset 170, to provide requested information, such as pseudorange information, in response to receiving the command. The pseudorange information may be extracted from the GNSS chipset 170 using the command that the manufacturer has designed the GNSS chipset 170 with. For example, according to one embodiment, the GNSS chipset 170 is accessed using an operation that is a session started with a message that is an improved accuracy Secure User Platform Location (SUPL) start message or a high precision SUPL INIT message. According to one embodiment, the message is a custom command that is specific to the GNSS chipset 170 (also referred to as "a GNSS chipset custom command") and by which the improved accuracy SUPL client 101 can gain access to the raw
measurements of the GNSS chipset 170. Access may be controlled by the chipset manufacturer and a suitable key made available for use in the SUPL for obtaining access to the pseudoranges. A suitable key is an example of a "custom command."
[0051] A worker thread associated with the SUPL client 101 can monitor the raw
measurements delivered by the GNSS chipset 170 into the GNSS chipset 170's memory buffers, cache the raw measurements and use the raw measurements to determine a position fix. The pseudorange information extractor logic 142 and the pseudorange information processing logic 150 can be associated with the worker thread. For example, the pseudorange information extractor logic 142 can cache the raw measurements and the pseudorange information processing logic 150 can determine the location.
[0052] According to one embodiment, a worker thread is a light weight process that executes a specific sequence of tasks in the background. The tasks can be of long term and/or at times periodic in nature. The worker thread can assist in helping the main thread, which may also be referred to as the main program or main task, with specific functions. Worker threads can be started when these functions of the sequence of tasks are to be executed. A worker thread can remain in the active state as long as its respective functions are being executed. A worker thread may terminate itself, when it completes its functions or when it reaches a point where it can no longer continue to function, for example, due to an irrecoverable error. A worker thread can post its status to the main thread when it ends. Examples of posted status are completion or termination. A worker thread may also post to the main thread the level of progress of its functions periodically. At a given point in time, there may be many such worker threads in progress at the same time. Worker threads may maintain some sort of synchronization amongst themselves depending upon the tasks they are intended for. The main thread may terminate a worker thread, for example, when the functions of that worker thread are no longer needed or due to other execution changes in the system.
[0053] According to one embodiment, the cellular device 100 can improve the accuracy of the extracted pseudorange information. For example, the pseudorange information processing logic 150 can improve the accuracy of the extracted pseudorange information, as will become more evident.
[0054] The output of the pseudorange information processing logic 150 can be used for determining the location of the cellular device 100. For example, a latitude, longitude and altitude can be determined based on the output of the pseudorange information processing logic 150, which can be displayed by the location displayer logic 162. [0055] According to one embodiment, the pseudorange information bridger logic 143 communicates the output from the pseudorange information processing logic 150 to the location manager logic 161 in the operating system 160. According to one embodiment, the output of the pseudorange information processing logic 150 is a location that is defined in terms of latitude, longitude, and altitude. The methods are well-known in the GPS arts. The pseudoranges are used to first determine a location the WGS-84 coordinate system of the Global Positioning System, and then converted into latitude, longitude, and elevation.
[0056] The location displayer logic 162 can display the location with respect to a digital representation of a map available, for example, from third parties via download to the cellular device.
[0057] Figure 1 B depicts a block diagram of a portion of a cellular device 100, 100D for extracting pseudorange information, according to one embodiment. The cellular device 100, 100D includes accessing-logic 1 10B and processing logic 150. The accessing logic 1 10B includes extracting logid 12B and receiving logic 1 14B. The extracting logic 1 12B includes pseudorange information extracting logic 142, satellite-based augmentation system (SBAS), extracting logic 1 12B-5, WAAS extracting logic 1 12B-2, Doppler shift extracting logic 1 12B- 3, and carrier phase measurement extracting logic 1 12B-4. According to one embodiment, WAAS is an example of SBAS. According to one embodiment, SBAS extracting logic 1 12B- 5 includes WAAS extracting logic 1 12B-2.
[0058] Examples of satellite-based augmentation system (SBAS) are Indian GPS aided Geo Augmented Navigation System (GAGAN), European Geostationary Navigation Overlay Service (EGNOS), Japanese Multi-functional Satellite Augmentation System (MSAS), John Deere's StarFire, WAAS, and Trimble's OmniStar.
[0059] As depicted in Figure 1 B, the pseudorange information processing logic 150 includes pseudorange-correction-logic 151 , pseudorange-carrier-phase-smoothing-logic 152, position accuracy improvement determination logic 180B and determining position fix logic 170B. Examples of "improving" are "smoothing" or "correcting," or a combination thereof. The pseudorange-correction-logic 151 includes WAAS logic 151 A, DGPS logic 151 B, Precise Point Positioning (PPP) logic 151 C, RTK logic 151 D, VRS (Virtual Reference Station) logic 151 E, and RTX logic 151 F. The pseudorange-carrier-phase-smoothing-logic 152 includes real carrier phase logic 152A and reconstructed carrier phase logic 152B. According to one embodiment, the accessing-logic 1 10B and the processing logic 150 reside in the improved accuracy SUPL client 101 .
[0060] Examples of pseudorange information are extracted pseudoranges, corrected pseudoranges, smoothed pseudoranges, or a combination thereof, among other things. Examples of pseudorange corrections include Wide Area Augmentation System (WAAS) corrections, Differential Global Positioning System (DGPS) corrections, Precise Point Positioning (PPP) corrections, Real Time Kinematic (RTK) corrections, and Virtual
Reference Station (VRS) corrections. Examples of carrier phase information include real carrier phase and reconstructed carrier phase information.
[0061] The extracting logic 1 12B can extract various types of information from the GNSS chipset 170, as discussed herein. For example, the extracting logic 1 12B includes pseudorange information extracting logic 142, WAAS extracting logic 1 12B-2, Doppler extracting logic 1 12B-3, and carrier phase measurement extracting logic 1 12B-4. According to one embodiment, the extracting logic 1 12B can be used to extract these various types of information from the GNSS chipset 170 in a similar manner that the pseudorange information extractor logic 142 extracts pseudorange information from the GNSS chipset 170, for example, using an SUPL Client 101 that employs a command designed or provided by the manufacturer of the GNSS chipset 170, as described herein. More specifically, the WAAS extracting logic 1 12B-2, the Doppler extracting logic 1 12B-3, and carrier phase measurement extracting logic 1 12B-4 can employ commands designed or provided by the manufacturer of the GNSS chipset 170 to extract respectively WAAS, Doppler information, and carrier phase measurements for real carrier phase information.
[0062] The receiving logic 1 14B receives other types of information that are not extracted from the GNSS chipset 170. The receiving logic 1 14B can receive the information in response to a request (also commonly known as "pulling") or receive the information without the information being requested (also commonly known as "pushing"). "Obtaining" and "accessing" can be used interchangeably, according to various embodiments.
[0063] Table 1 depicts the types of information that are extracted from the GNSS chipset or received without extraction, as discussed herein, according to various embodiments.
Table 1 : Types of Information that are Extracted from the GNSS Chipset or Received without Extraction Extracted Received
Pseudorange Information WAAS/SBAS
Doppler Shift Information DGPS
Carrier Phase Measurements for real carrier RTK
phase information
WAAS/SBAS Not Applicable
[0064] The information depicted in the extracted column can be extracted from the GNSS chipset 170 using the SUPL client 101 in a manner similar to extracting pseudorange information, as discussed herein. WAAS may be extracted or received, for example, over the Internet. When this Doppler shift information is available but real carrier phase information is not, the extracted Doppler shift information can be integrated by processor 109, for example, to reconstruct carrier phase information. Techniques for reconstructing carrier phase information from Doppler shift information are well known in the art. Any one or more of the information depicted in Table 1 can be processed by the cellular device 100, for example, using the processor 109 that is outside of the GNSS chipset 170.
[0065] The pseudorange-carrier-phase-smoothing-logic 152 can smooth pseudorange information by applying carrier phase information to the pseudorange information.
[0066] The pseudorange-carrier-phase-smoothing-logic 152 receives raw pseudorange information from the accessing logic 1 10B. The carrier phase information may be reconstructed carrier phase information or real carrier phase information.
[0067] The pseudorange-correction-logic 151 can correct pseudorange information. For example, the pseudorange-correction-logic 151 can receive pseudorange information and apply pseudorange corrections to the pseudorange information. Examples of the pseudorange information received by the pseudorange-correction-logic 151 include extracted pseudorange information, DGPS corrected pseudoranges, and smoothed pseudoranges that were smoothed, for example, using either real carrier phase information or reconstructed carrier phase information. Examples of pseudorange corrections that can be applied to the received pseudorange information are WAAS corrections, DGPS corrections, PPP corrections, RTK corrections and VRS corrections. The PPP logic 151 C performs Precise Point Positioning (PPP) processing on pseudorange information.
According to one embodiment, RTX™is proprietary form of PPP developed by Trimble Navigation Limited. It should be appreciated that there are other forms of Precise Point Positioning which may operate using similar principles.
[0068] The pseudorange information processing logic 150 may also include a determining position fix logic 170B that performs, for example, a least squares solution 171 B can be performed after the extracted pseudorange information is improved by the pseudorange- correction-logic 151 or the pseudorange-carrier-phase-smoothing-logic 152, or a
combination thereof and prior to transmitting the output to the pseudorange information bridger logic 143. According to one embodiment, the determining position fix logic 170B resides in the processing logic 150. Least-squares solution methods are well-known in the position determination arts.
[0069] According to one embodiment, extracted pseudorange information is passed from the extracting pseudorange information logic 142 to the smoothing logic 152 where it is smoothed at either real carrier phase logic 152A or reconstructed carrier phase logic 152B. According to one embodiment, the smoothed pseudorange information is communicated from the smoothing logic 152 to the correcting logic 151 for further correction, where one or more corrections may be performed. If a plurality of corrections is performed, they can be performed in various combinations. If carrier phase smoothing is not possible, the extracted pseudorange information can be communicated from extracting pseudorange information logic 142 to correction logic 151. One or more of the logics 152A, 152B, 151 A, 151 E, 151 F in the processing logic 150 can communicate with any one or more of the logics 152A, 152B, 151A, 151 E 151 F in various orders and combinations. Various embodiments are not limited to just the combinations and orders that are described herein. According to one embodiment, extracted pseudorange information may not be smoothed or corrected. In this case, unsmoothed uncorrected pseudorange information can be communicated from logic 142 to logic 170B.
[0070] The cellular device 100 may also include a position-accuracy-improvement- determination-logic 180B for determining whether to apply any improvements and if so, the one or more position accuracy improvements to apply to the extracted pseudorange information. For example, the cellular device 100 may be preconfigured based on the signals that are available to the cellular device 100 or a user of the cellular device 100 may manually configure the cellular device 100. For example, the cellular device 100 can display the signals that are available to the user and the user can select which signals they desire from the displayed list of signals. The configuration information, whether preconfigured or manually configured by the user, can be stored for example, in a look up table in the cellular device 100. Examples of position improvements that can be determined by the position accuracy improvement determination logic 180B are real carrier phase information, reconstructed carrier phase information, WAAS, DGPS, PPP, RTX™, RTK and VRS. The position accuracy improvement determination logic 180B can be used to determine to reconstruct carrier phase information based on Doppler shift if real carrier phase information is not available, for example. The position-accuracy-improvement-determination-logic 180B, according to one embodiment, is a part of the SUPL client 101 .
[0071] Extracted pseudorange information without any additional improvements provides 4- 5 meters of accuracy. Various combinations of position accuracy improvements can be applied to extracted pseudorange information (EPI) according to various embodiments, where examples of position accuracy improvements include, but are not limited to, Wide Area Augmentation System (WAAS) pseudorange corrections, Differential GPS (DGPS) pseudorange corrections, Precise Point Positioning (PPP) processing, RTX™, Real Time Kinematic (RTK), Virtual Reference Station (VRS) corrections, real carrier phase information (real CPI) smoothing, and reconstructed carrier phase information (reconstructed CPI) smoothing.
[0072] One or more of the logics 1 10B, 1 12B, 1 14B, 142, 1 12B-2, 1 12B-3, 180B, 152, 152A, 152B, 151 , 151 Aj-151 F, 170B, 171 B ean be executed, for example, by the processor 109 of the cellular device 100 that is located outside of the GNSS chipset 170.
[0073] Table 2 depicts combinations of information that result in a position fix 172B, according to various embodiments. However, various embodiments are not limited to the combinations depicted in Table 2.
Table 2: Combinations of Information that Result in a Position Fix
8 EPI+DGPS+WAAS
9 EPI+DGPS+PPP
10 EPI+RTK
1 1 EPI+VRS
[0074] Figure 1 C depicts decision logic 151 H for determining whether to apply SBAS corrections 151 G, WAAS corrections 151 A, PPP corrections 151 C, RTX™ corrections 151 F or DGPS corrections 151 B, according to one embodiment. According to one embodiment, the SBAS corrections that are applied are WAAS corrections. According to one
embodiment, the decision logic 151 H is located in the position accuracy improvement determination logic 180B or the correction logic 151.
[0075] According to one embodiment, a first position is determined by an available means. For example, the first position may be based on uncorrected unsmoothed extracted pseudorange information, cellular tower triangulation, WiFi triangulation or other means. A level of precision may be selected, for example, by a user or preconfigured into the cellular device, where DGPS or one or more of SBAS, WAAS, RTX™, PPP would be used to achieve that level of precision. The decision logic 151 H can access the level of precision and receive two or more reference station locations by sending a message to a database enquiring about nearby reference stations for DGPS. The decision logic 151 H can determine the distance between the cellular device 100 and the nearest reference station. If the distance is greater than some selected distance threshold, the decision logic 151 H can use PPP, RTX™, SBAS or WAAS, instead of DGPS. If the distance is less than the selected distance threshold, the decision logic 151 H can use DGPS instead of PPP, RTX ™, SBAS or WAAS. According to one embodiment, a range for a distance threshold is approximately 20 to 60 miles. According to one embodiment, the distance threshold is approximately 60 miles.
[0076] If the decision logic 151 H determines to apply DGPS corrections at DGPS logic 151 B resulting in DGPS corrected smoothed pseudoranges, further corrections can be made using the orbit-clock information contained in the PPP corrections. For example, a position fix can be determined based on the DGPS corrected smoothed pseudoranges and the PPP corrections. The position fix can be determined external to the GNSS chipset, for example, at the processing logic 150. [0077] The cellular device 100 may be configured with the distance threshold, for example, by the manufacturer of the cellular device 100 or by a user of the cellular device 100. The cellular device 100 may be configured with the distance threshold through service that is remote with respect to the cellular device 100 or may be configured locally. The distance threshold can be selected based on a degree of position accuracy that is desired.
[0078] Figure 1 D depicts a block diagram of a cellular device 100D for extracting pseudorange information, according to one embodiment.
[0079] As depicted in Figure 1 D, the GNSS chipset 170 is located on a system on a chip (SOC) substrate (SOCS) 190.
[0080] As described herein, various information can be extracted from the GNSS receiver 1 130, such as pseudorange information, Doppler Shift Information, Real Carrier Phase Measurement, WAAS and SBAS. Other types of processing information output by the GNSS receiver 1 130 can be ignored.
[0081] A Cell device 100D's hardware architecture includes discreet physical layout and interconnection of multiple chipsets for processing and for special purposes such as a GNSS chipset 170. In addition, newer architectures involve further integration of chipsets in the "system on a chip" (SoC) configuration. In this configuration, the GNSS chipset 170 can still be a complete element capable of delivering a PVT (position velocity and time) solution. However in an embodiment, the pseudorange information, carrier phase, and/or Doppler measurements, along with WAAS corrections if available, are extracted prior to further signal processing in the GNSS chipset 170 and are processed using different algorithms and corrections data for developing an improved accuracy PVT solution. In so doing the deleterious effects of multipath and other error sources may be
minimized. Further the GNSS chipset 170 outputs are ignored and not displayed when the external processing is employed and the higher-accuracy PVT data is available.
[0082] Figure 2 depicts a block diagram of a set of correction delivery options for providing positioning information to a cellular device for extracting pseudorange information, according to one embodiment. Examples of a cellular device 200 include a cell phone, a non-voice enabled cellular device, and a mobile hand-held GNSS receiver. The cellular device may be mobile or stationary. [0083] The cellular device 200 includes a bus 216, a satellite receiver 206, a GNSS receiver 107, an FM radio receiver 208, a processor 109, memory 210, a cellular transceiver 21 1 , a display 212, audio 213, Wi-Fi transceiver 214, IMU 215, image capturing device 240, and operating system 160. Components 206, 107, 208, 109, 210, 21 1 , 212, 213, 214, 215, and 240 are all connected with the buss 216.
[0084] In Figure 2, a plurality of broadcast sources is used to convey data and media to a cellular device 200. As an example, cellular device 200 can receive broadcast signals from communication satellites 201 (e.g., two-way radio, satellite-based cellular such as the Inmarsat or Iridium communication networks, etc.), global navigation satellites 202 which provide radio navigation signals (e.g., the GPS, GNSS, GLONASS, GALILEO, BeiDou, Compass, etc.), and terrestrial radio broadcast (e.g., FM radio, AM radio, shortwave radio, etc.)
[0085] A cellular device 200 can be configured with a satellite radio receiver 206 coupled with a communication bus 216 for receiving signals from communication satellites 201 , a GNSS receiver 107 coupled with bus 216 for receiving radio navigation signals from global navigation satellites 202 and for deriving a position of cellular device 200 based thereon. Cellular device 200 further comprises an FM radio receiver 208 coupled with bus 216 for receiving broadcast signals from terrestrial radio broadcast 203. Other components of cellular device 200 comprise a processor 109 coupled with bus 216 for processing information and instructions, a memory 210 coupled with bus 216 for storing information and instructions for processor 109. It is noted that memory 210 can comprise volatile memory and non-volatile memory, as well as removable data storage media in accordance with various embodiments. Cellular device 200 further comprises a cellular transceiver 21 1 coupled with bus 216 for communicating via cellular network 222. Examples of cellular networks used by cellular device 200 include, but are not limited to GSM: cellular networks, GPRS cellular networks, GDMA cellular networks, and EDGE cellular networks. Cellular device 200 further comprises a display 212 coupled with bus 216. Examples of devices which can be used as display 212 include, but are not limited to, liquid crystal displays, LED- based displays, and the like. It is noted that display 212 can be configured as a touch screen device (e.g., a capacitive touch screen display) for receiving inputs from a user as well as displaying data. Cellular device 200 further comprises an audio output 213 coupled with bus 216 for conveying audio information to a user. Cellular device 200 further comprises a Wi-Fi transceiver 214 and an inertial measurement unit (IMU) 215 coupled with bus 216. Wi-Fi transceiver 1 14 may be configured to operate on any suitable wireless communication protocol including, but not limited to WiFi, WiMAX, implementations of the IEEE 802.1 1 specification, implementations of the IEEE 802.15.4 specification for personal area networks, and a short range wireless connection operating in the Instrument Scientific and Medical (ISM) band of the radio frequency spectrum in the 2400-2484 MHz range (e.g., implementations of the Bluetooth® standard).
[0086] Improvements in GNSS/GPS positioning may be obtained by using reference stations with a fixed receiver system to calculate corrections to the measured pseudoranges in a given geographical region. Since the reference station is located in a fixed environment and its location can be determined very precisely via ordinary survey methods, a processor associated with the Reference Station GNSS/GPS receivers can determine more precisely what the true pseudoranges should be to each satellite in view, based on geometrical considerations. Knowing the orbital positions via the GPS almanac as a function of time enables this process, first proposed in 1983, and widely adopted ever since. The difference between the observed pseudorange and the calculated pseudorange for a given Reference station is called the pseudorange correction. A set of corrections for all the global navigation satellites 202 in view is created second by second, and stored, and made available as a service, utilizing GPS/GNSS reference stations 220 and correction services 221 . The pseudoranges at both the cellular device 200 GPS receiver 107 and those at the reference stations 220 are time-tagged, so the corrections for each and every pseudorange measurement can be matched to the local cell phone pseudoranges. The overall service is often referred to as Differential GPS, or DGPS. Without any corrections, GNSS/GPS receivers produce position fixes with absolute errors in position on the order of 4.5 to 5.5 m per the GPS SPS Performance Standard, 4th Ed. 2008. In Figure 2, one or more correction services 221 convey these corrections via a cellular network 222, or the Internet 223.
Internet 223 is in turn coupled with a local Wi-Fi network 224 which can convey the corrections to cellular device 200 via Wi-Fi transceiver 214. Alternatively, cellular network 222 can convey the corrections to cellular device 200 via cellular transceiver 21 1. In some embodiments, correction services 221 are also coupled with a distribution service 225 which conveys the corrections to an FM radio distributor 226. FM radio distributor 226 can broadcast corrections as a terrestrial radio broadcast 103. It should be appreciated that an FM signal is being described as a subset of possible terrestrial radio broadcasts which may be in a variety of bands and modulated in a variety of manners. In some embodiments, cellular device 200 includes one or more integral terrestrial radio antennas associated with integrated terrestrial receivers; FM radio receiver 208 is one example of such a terrestrial receiver which would employ an integrated antenna designed to operate in the correct frequency band for receiving a terrestrial radio broadcast 103. In this manner, in some embodiments, cellular device 200 can receive the corrections via FM radio receiver 208 (or other applicable type of integrated terrestrial radio receiver). In some embodiments, correction services 221 are also coupled with a distribution service 225 which conveys the corrections to a satellite radio distributor 227. Satellite radio distributor 227 can broadcast corrections as a broadcast from one or more communications satellites 201. In some embodiments, cellular device 200 includes one or more integral satellite radio antennas associated with integrated satellite radio receivers 206. Satellite radio receiver 206 is one example of such a satellite receiver which would employ an integrated antenna designed to operate in the correct frequency band for receiving a corrections or other information broadcast from communication satellites 201 . In this manner, in some embodiments, cellular device 200 can receive the corrections via satellite radio receiver 206.
[0087] Examples of a correction source that provides pseudorange corrections are at least correction service 221 , FM radio distribution 226, or satellite radio distributor 227, or a combination thereof. According to one embodiment, a correction source is located outside of the cellular device 200.
[0088] Examples of image capturing device 240 are a camera, a video camera, a digital camera, a digital video camera, a digital camcorder, a stereo digital camera, a stereo video camera, a motion picture camera, and a television camera. The image capturing device 240 may use a lens or be a pinhole type device.
[0089] The blocks that represent features in Figures 1A-2 can be arranged differently than as illustrated, and can implement additional or fewer features than what are described herein. Further, the features represented by the blocks in Figures 1A-2 can be combined in various ways. A cellular device 100, 200 (Figures 1A-3) can be implemented using software, hardware, hardware and software, hardware and firmware, or a combination thereof. Further, unless specified otherwise, various embodiments that are described as being a part of the cellular device 100, 200, whether depicted as a part of the cellular device 100, 200 or not, can be implemented using software, hardware, hardware and software, hardware and firmware, software and firmware, or a combination thereof. Various blocks in Figures 1A-2 refer to features that are logic, such as but not limited to, 150, 180B, 152, 152A, 152B, 151 , 151A-151 G, 170B, which can be ;implemented using software, hardware, hardware and software, hardware and firmware, software and firmware, or a combination thereof.
[0090] The cellular device 100, 200, according to one embodiment, includes hardware, such as the processor 109, memory 210, and the GNSS chipset 170. An example of hardware memory 210 is a physically tangible computer readable storage medium, such as, but not limited to a disk, a compact disk (CD), a digital versatile device (DVD), random access memory (RAM) or read only memory (ROM) for storing instructions. An example of a hardware processor 109 for executing instructions is a central processing unit. Examples of instructions are computer readable instructions for implementing at least the SUPL Client 101 that can be stored on a hardware memory 210 and that can be executed, for example, by the hardware processor 109. The SUPL client 101 may be implemented as computer readable instructions, firmware or hardware, such as circuitry, or a combination thereof.
Pseudorange Information
[0091] A GNSS receiver 107 (also referred to as a "receiver"), according to various embodiments, makes a basic measurement that is the apparent transit time of the signal from a satellite to the receiver, which can be defined as the difference between signal reception time, as determined by the receiver's clock, and the transmission time at the satellite, as marked in the signal. This basic measurement can be measured as the amount of time shift required to align the C/A-code replica generated at the receiver with the signal received from the satellite. This measurement may be biased due to a lack of
synchronization between the satellite and receiver clock because each keeps time independently. Each satellite generates a respective signal in accordance using a clock on board. The receiver generates a replica of each signal using its own clock. The
corresponding biased range, also known as a pseudorange, can be defined as the transit time so measured multiplied by the speed of light in a vacuum.
[0092] There are three time scales, according to one embodiment. Two of the time scales are the times kept by the satellite and receiver clocks. A third time scale is a common time reference, GPS Time (GPST), also known as a composite time scale that can be derived from the times kept by clocks at GPS monitor stations and aboard the satellites.
[0093] Let T be the transit time associated with a specific code transition of the signal from a satellite received at time t per GPST. The measured apparent range r, called pseudorange, can be determined from the apparent transmit time using equation 1 as follows: measured pseudorange at (t) = c[arrival time at (t)- emission time at (t- τ)]. Eq. 1
Both t and τ are unknown, and can be estimated. In this discussion of pseudoranges, measurements from a GPS satellite are dealt with in a generic way to make the notation simple, making no reference to the satellite ID or carrier frequency (L1 or L2). [0094] Equations 2 and 3 depict how to relate the time scales of the receiver and the satellite clocks with GPST: arrival time at (t) = t + receiver clock at (t) eq. 2 arrival time at (t- τ ) = (t- τ ) + satellite clock error at (t- τ ) eq. 3
[0095] where receiver clock error represents the receiver 304's clock bias 303 and satellite clock error represents the bias 301 in the satellite 305's clock, and both the receiver clock and the satellite clock are measured relative to GPST 302, as shown in Figure 3. Receiver clock error and satellite clock error represent the amounts by which the satellite 305 and receiver 304 clocks are advanced in relation to GPST. The satellite clock error 301 is estimated by the Control Segment and specified in terms of the coefficients of a quadratic polynomial in time. The values of these coefficients can be broadcast in the navigation message.
[0096] Accounting for the clock biases, the measured pseudorange (eq. 1 ) can be written as indicated in equation 4:
PR (t) = c[t + receiver clock error at (t) - (t - τ + satellite clock error at (t- τ ))] +
miscellaneous errors at (t) = c τ + c[receiver clock errors at (t) - satellite clock error at (t- τ )] + miscellaneous errors at (t) eq. 4 where miscellaneous errors represent unmodeled effects, modeling error, and measurement error. The transmit time multiplied by the speed of light in a vacuum can be modeled as satellite position at (t- τ ). Ionosphere error and troposphere error reflect the delays associated with the transmission of the signal respectively through the ionosphere and the troposphere. Both ionosphere error and troposphere error are positive.
[0097] For simplicity, explicitly reference to the measurement epoch t has been dropped, and the model has been rewritten for the measured pseudorange as indicated in equation 5.
PR = r +[receiver clock error - satellite clock error] + ionosphere error + troposphere error + miscellaneous errors eq. 5 where PR is the measured pseudorange, r is the true range from the receiver to the satellite, receiver clock error is the difference between the receiver clock and the GPSTIME, satellite clock error is the difference between the satellite clock and GPSTIME, GPSTIME is ultimately determined at the receiver as part of the least squared solution determined by the least squares solution 171 B so that all clock errors can be resolved to some level of accuracy as part of the position determination process, and miscellaneous errors include receiver noise, multipath and the like.
[0098] At least one source of error is associated with satellite positions in space. The navigation message in the GPS signal contains Keplerian parameters which define orbital mechanics mathematics and, thus, the positions of the satellites as a function of time. One component of WAAS and RTX™ contains adjustments to these parameters, which form part of the constants used in solving for the position fix at a given time. Taking account of the corrections is well-known in the GPS position determining arts.
[0099] Ideally, the true range r to the satellite is measured. Instead, what is available is PR, the pseudorange, which is a biased and noisy measurement of r. The accuracy of an estimated position, velocity, or time, which is obtained from these measurements, depends upon the ability to compensate for, or eliminate, the biases and errors.
[00100] The range to a satellite is approximately 20,000 kilometers (km) when the satellite is overhead, and approximately 26,000 km when the satellite is rising or setting. The signal transit time varies between about 70 millisecond (ms) and 90 ms. The C/A-code repeats each millisecond, and the code correlation process essentially provides a measurement of pseudo-transmit time modulo 1 ms. The measurement can be ambiguous in whole milliseconds. This ambiguity, however, is easily resolved if the user has a rough idea of his location within hundreds of kilometers. The week-long P(Y)-code provides unambiguous pseudoranges.
[00101] The receiver clocks are generally basic quartz crystal oscillators and tend to drift. The receiver manufacturers attempt to limit the deviation of the receiver clock from GPST, and schedule the typical once-per-second measurements at epochs that are within plus or minus 1 millisecond (ms) of the GPST seconds. One approach to maintaining the receiver clock within a certain range of GPST is to steer the receiver clock 'continuously.' The steering can be implemented with software. The second approach is to let the clock drift until it reaches a certain threshold (typically 1 ms), and then reset it with a jump to return the bias to zero. [00102] An example of pseudorange measurements with a receiver using the second approach shall now be described in more detail. Assume that there are pseudorange measurements from three satellites which rose about the same time but were in different orbits. Assume that one comes overhead and stays in view for almost seven hours.
Assume that the other two stay lower in the sky and could be seen for shorter periods. There are discontinuities common to all three sets of measurements due to the resetting of the receiver clock. A determination can be made as to whether the receiver clock is running fast or slow, and its frequency offset from the nominal value of 10.23 megahertz (MHz) can be estimated.
[00103] For more information on pseudorange information, refer to "Global
Positioning Systems," by Pratap Misra and Per Eng, Ganga-Jamuna Press, 2001 ; ISBN 0- 9709544-0-9.
Position Accuracy Improvements
[00104] The pseudorange information processing logic 150 can include various types of logic for improving the position accuracy of the extracted pseudorange information, as described herein. Table 2, as described herein, depicts various combinations of position accuracy improvements for improving extracted pseudorange information, according to various embodiments. Table 3 also depicts various combinations of position accuracy improvements for improving extracted pseudorange information, according to various embodiments.
TABLE 3: Various Combinations of Position Accuracy Improvements for Improving
Extracted Pseudorange Information
830B, 840B DGPS + WAAS
Figure 8B
7 820B, 824B, EPI + real CPI + DGPS + < 1 m
830B, 840B WAAS
(Figure 8B)
8 920A (Figure 9A) EPI + PPP < 1 m
9 930A (Figure 9A) EPI + PPP + DGPS < 1 m
10 Figure 9B EPI + reconstructed CPI + <1 m
PPP + DGPS
1 1 1020 and 1030 EPI + CPI + PPP « 1 m
(Figure 10)
12 1040 (Figure 10) EPI + CPI + PPP + DGPS approx. 10 cm
13 EPI+RTK approx. 2-10 cm
[00105] Table 3 includes columns for combination identifier, operation, description, and accuracy. The combination identifier column indicates an identifier for each
combination of improvements. The operation column specifies operations of various flowcharts in Figures 6-10 for the corresponding combination. The description column specifies various combinations of position accuracy improvements that can be applied to extracted pseudorange information (EPI) according to various embodiments, where examples of position accuracy improvements include, but are not limited to, Wide Area Augmentation System (WAAS) pseudorange corrections, real carrier phase smoothing (real CPI) information, reconstructed carrier phase smoothing information (reconstructed CPI), Differential GPS (DGPS) pseudorange corrections, and Precise Point Positioning (PPP) processing. The accuracy column specifies levels of accuracy provided by the
corresponding combination.
[00106] Combination 1 is extracted pseudorange information without any additional improvements, which provides 4-5 meters of accuracy. Combination 1 is described in Table 3 to provide a comparison with the other combinations 2-13.
[00107] According to one embodiment, the SUPL client 101 can also include a position-accuracy-improvement-determination-logic 180B for determining the one or more position accuracy improvements to apply to the extracted pseudorange information based on one or more factors such as cost, quality of service, and one or more characteristics of the cellular device. For example, different costs are associated with different position accuracy improvements. More specifically, extracted pseudorange information, WAAS and Doppler information are typically free. There is a low cost typically associated with DGPS and real carrier phase information. There is typically a higher cost associated with PPP. Therefore, referring to Table 3, according to one embodiment, combinations 1 , 2, and 3 are typically free, combinations 4-7 typically are low cost, and combinations 8-12 are typically higher cost.
[00108] Various cellular devices have different characteristics that make them capable of providing different types of position accuracy improvements. For example, one type of cellular device may be capable of providing WAAS but not be capable of providing Doppler information. In another example, some types of cellular devices may be capable of providing DGPS but not capable of providing PPP. In yet another example, different activities may require different levels of improvement. For example, some activities and/or people may be satisfied with 4-5 meters, others may be satisfied with 1.7 meters. Yet others may be satisfied with less than 1 meter, and still others may only be satisfied with 2 centimeters. Therefore, different users may request different levels of accuracy.
[00109] Table 4 depicts sources of the various position accuracy improvements, according to various embodiments.
TABLE 4: Sources of the Various Position Accuracy Improvements
[00110] The first column of Table 4 provides the name of the position accuracy improvement. The second column of Table 4 specifies the source for the corresponding position accuracy improvement.
[00111] According to various embodiments, a cellular device 100, 200 can initially provide a position that is within 4-5 meters using, for example, unimproved extracted pseudorange information and the position can continually be improved, using various position accuracy improvements as described herein, as long as the antennae of the cellular device 100, 200 is clear of obstructions to receive various position accuracy improvements.
[00112] The following describes various position accuracy improvements and related topics in more detail.
Global Navigation Satellite Systems
[00113] A Global Navigation Satellite System (GNSS) is a navigation system that makes use of a constellation of satellites orbiting the earth to provide signals to a receiver, such as GNSS receiver 107, which estimates its position relative to the earth from those signals. Examples of such satellite systems are the NAVSTAR Global Positioning System (GPS) deployed and maintained by the United States, the GLObal NAvigation Satellite System (GLONASS) deployed by the Soviet Union and maintained by the Russian
Federation, and the GALILEO system currently being deployed by the European Union (EU).
[00114] Each GPS satellite transmits continuously using two radio frequencies in the L-band, referred to as L1 and L2, at respective frequencies of 1575.41 MHz and 1227.60 MHz. Two signals are transmitted on L1 , one for civil users and the other for users authorized by the Unites States Department of Defense (DoD). One signal is transmitted on L2, intended only for DoD-authorized users. Each GPS signal has a carrier at the L1 and L2 frequencies, a pseudo-random number (PRN) code, and satellite navigation data.
[00115] Two different PRN codes are transmitted by each satellite: A coarse acquisition (C/A) code and a precision (P/Y) code which is encrypted for use by authorized users. A receiver, such as GNSS receiver 107, designed for precision positioning contains multiple channels, each of which can track the signals on both L1 and L2 frequencies from a GPS satellite in view above the horizon at the receiver antenna, and from these computes the observables for that satellite comprising the L1 pseudorange, possibly the L2 pseudorange and the coherent L1 and L2 carrier phases. Coherent phase tracking implies that the carrier phases from two channels assigned to the same satellite and frequency will differ only by an integer number of cycles.
[00116] Each GLONASS satellite transmits continuously using two radio frequency bands in the L-band, also referred to as L1 and L2. Each satellite transmits on one of multiple frequencies within the L1 and L2 bands respectively centered at frequencies of 1602.0 MHz and 1246.0 MHz. The code and carrier signal structure is similar to that of NAVSTAR. A GNSS receiver designed for precision positioning contains multiple channels each of which can track the signals from both GPS and GLONASS satellites on their respective L1 and L2 frequencies, and generate pseudorange and carrier phase
observables from these. Future generations of GNSS receivers will include the ability to track signals from all deployed GNSSs.
Differential Global Positioning System (DGPS)
[00117] Differential GPS (DGPS) utilizes a reference station which is located at a surveyed position to gather data and deduce corrections for the various error contributions which reduce the precision of determining a position fix. For example, as the GPS signals pass through the ionosphere and troposphere, propagation delays may occur. Other factors which may reduce the precision of determining a position fix may include satellite clock errors, GPS receiver clock errors, and satellite position errors (ephemerides). The reference station receives essentially the same GPS signals as cellular devices 100, 200 which may also be operating in the area. However, instead of using the timing signals from the GPS satellites to calculate its position, it uses its known position to calculate timing. In other words, the reference station determines what the timing signals from the GPS satellites should be in order to calculate the position at which the reference station is known to be. The difference in timing can be expressed in terms of pseudorange lengths, in meters. The difference between the received GPS signals and what they optimally should be is used as an error correction factor for other GPS receivers in the area. Typically, the reference station broadcasts the error correction to, for example, a cellular device 100, 200 which uses this data to determine its position more precisely. Alternatively, the error corrections may be stored for later retrieval and correction via post-processing techniques.
[00118] DGPS corrections cover errors caused by satellite clocks, ephemeris, and the atmosphere in the form of ionosphere errors and troposphere errors. The nearer a DGPS reference station is to the receiver 107 the more useful the DGPS corrections from that reference station will be.
[00119] The system is called DGPS when GPS is the only constellation used for Differential GNSS. DGPS provides an accuracy on the order of 1 meter or 1 sigma for users in a range that is approximately in a few tens of kilometers (kms) from the reference station and growing at the rate of 1 m per 150 km of separation. DGPS is one type of Differential GNSS (DGNSS) technique. There are other types of DGNSS techniques, such as RTK and Wide Area RTK (WARTK), that can be used by high-precision applications for navigation or surveying that can be based on using carrier phase measurements. It should be
appreciated that other DGNSS which may utilize signals from other constellations besides the GPS constellation or from combinations of constellations. Embodiments described herein may be employed with other DGNSS techniques besides DGPS.
[00120] A variety of different techniques may be used to deliver differential corrections that are used for DGNSS techniques. In one example, DGNSS corrections are broadcast over an FM subcarrier. U.S. Patent No. 5,477,228 by Tiwari et al. describes a system for delivering differential corrections via FM subcarrier broadcast method, the contents of which are incorporated herein by reference.
Real-Time Kinematic System
[00121] An improvement to DGPS methods is referred to as Real-time Kinematic (RTK). As in the DGPS method, the RTK method, utilizes a reference station located at determined or surveyed point. The reference station collects data from the same set of satellites in view by the cellular device 100, 200 in the area. Measurements of GPS signal errors taken at the reference station (e.g., dual-frequency code and carrier phase signal errors) and broadcast to one or more cellular devices 100, 200 working in the area. The one or more cellular devices 100, 200 combine the reference station data with locally collected position measurements to estimate local carrier-phase ambiguities, thus allowing a more precise determination of the cellular device 100, 200's position. The RTK method is different from DGPS methods in that the vector from a reference station to a cellular device 100, 200 is determined (e.g., using the double differences method). In DGPS methods, reference stations are used to calculate the changes needed in each pseudorange for a given satellite in view of the reference station, and the cellular device 100, 200, to correct for the various error contributions. Thus, DGPS systems broadcast pseudorange correction numbers second-by-second for each satellite in view, or store the data for later retrieval as described above.
[00122] RTK allows surveyors to determine a true surveyed data point in real time, while taking the data. However, the range of useful corrections with a single reference station is typically limited to about 70 km because the variable in propagation delay
(increase in apparent path length from satellite to a receiver of the cellular device 100, 200, or pseudo range) changes significantly for separation distances beyond 70 km. This is because the ionosphere is typically not homogeneous in its density of electrons, and because the electron density may change based on, for example, the sun's position and therefore time of day.
[00123] Thus for surveying or other positioning systems which must work over larger regions, the surveyor must either place additional base stations in the regions of interest, or move his base stations from place to place. This range limitation has led to the
development of more complex enhancements that have superseded the normal RTK operations described above, and in some cases eliminated the need for a base station GPS receiver altogether. This enhancement is referred to as the "Network RTK" or "Virtual Reference Station" (VRS) system and method.
[00124] Figure 4 depicts a flowchart 400 for determining an RTK position solution, according to one embodiment. At 410, the method begins. The inputs to the method are reference station network or VRS corrections 412 and GNSS pseudorange plus carrier phase information from the cellular device 414. At 420, reference corrections and cellular device data are synchronized and corrections are applied to the GNSS data for atmospheric models and so on. The output of 420 is synchronized GNSS data 422, which is received by operation 430. At 430, position, carrier phase ambiguities in floating point, and nuisance parameters are estimated. The output 432 of 430 is user position plus carrier phase ambiguities in floating point. Operation 440 receives the output 432 and produces improved user-position estimates using the integer-nature of carrier phase ambiguities. The output 442 of 440 is an RTK position solution, which can be used according to various
embodiments. The method ends at 450.
Network RTK
[00125] Network RTK typically uses three or more GPS reference stations to collect GPS data and extract information about the atmospheric and satellite ephemeris errors affecting signals within the network coverage region. Data from all the various reference stations is transmitted to a central processing facility, or control center for Network RTK. Suitable software at the control center processes the reference station data to infer how atmospheric and/or satellite ephemeris errors vary over the region covered by the network.
[00126] The control center computer processor then applies a process which interpolates the atmospheric and/or satellite ephemeris errors at any given point within the network coverage area and generates a pseudo range correction comprising the actual pseudo ranges that can be used to create a virtual reference station. The control center then performs a series of calculations and creates a set of correction models that provide the cellular device 100, 200 with the means to estimate the ionospheric path delay from each satellite in view from the cellular device 100, 200, and to take account other error contributions for those same satellites at the current instant in time for the cellular device 100, 200's location.
[00127] The cellular device 100, 200 is configured to couple a data-capable cellular telephone to its internal signal processing system. The user operating the cellular device 100, 200 determines that he needs to activate the VRS process and initiates a call to the control center to make a connection with the processing computer.
[00128] The cellular device 100, 200 sends its approximate position, based on raw GPS data from the satellites in view without any corrections, to the control center. Typically, this approximate position is accurate to approximately 4-7 meters. The user then requests a set of "modeled observables" for the specific location of the cellular device 100, 200. The control center performs a series of calculations and creates a set of correction models that provide the cellular device 100, 200 with the means to estimate the ionospheric path delay from each satellite in view from the cellular device 100, 200, and to take into account other error contributions for those same satellites at the current instant in time for the cellular device 100, 200's location. In other words, the corrections for a specific cellular device 100, 200 at a specific location are determined on command by the central processor at the control center and a corrected data stream is sent from the control center to the cellular device 100, 200. Alternatively, the control center may instead send atmospheric and ephemeris corrections to the cellular device 100, 200 which then uses that information to determine its position more precisely.
[00129] These corrections are now sufficiently precise that the high performance position accuracy standard of 2-3 cm may be determined, in real time, for any arbitrary cellular device 100, 200's position. Thus a GPS enabled cellular device 100, 200's raw GPS data fix can be corrected to a degree that makes it behave as if it were a surveyed reference location; hence the terminology "virtual reference station."
[00130] An example of a network RTK system in accordance with embodiments of the present invention is described in U. S. Patent No.5,899,957, entitled "Carrier Phase
Differential GPS Corrections Network," by Peter Loomis, assigned to the assignee of the present invention and incorporated as reference herein in its entirety.
[00131] The Virtual Reference Station method extends the allowable distance from any reference station to the cellular devices 100, 200. Reference stations may now be located hundreds of miles apart, and corrections can be generated for any point within an area surrounded by reference stations. However, there are many construction projects where cellular coverage is not available over the entire physical area under construction and survey.
Virtual Reference Stations
[00132] To achieve very accurate positioning (to several centimeters or less) of a terrestrial mobile platform of a cellular device 100, 200, relative or differential positioning methods are commonly employed. These methods use a GNSS reference receiver located at a known position, in addition to the data from a GNSS receiver 107 on the mobile platform, to compute the estimated position of the mobile platform relative to the reference receiver.
[00133] The most accurate known method uses relative GNSS carrier phase interferometry between the GNSS cellular device 100, 200's receiver and GNSS reference receiver antennas plus resolution of integer wavelength ambiguities in the differential phases to achieve centimeter-level positioning accuracies. These differential GNSS methods are predicated on the near exact correlation of several common errors in the cellular device 100, 200 and reference observables. They include ionosphere and troposphere signal delay errors, satellite orbit and clock errors, and receiver clock errors.
[00134] When the baseline length between the mobile platform and the reference receiver does not exceed 10 kilometers, which is normally considered a short baseline condition, the ionosphere and troposphere signal delay errors in the observables from the cellular device 100, 200 and reference receivers are almost exactly the same. These atmospheric delay errors therefore cancel in the cellular device 100, 200's reference differential GNSS observables, and the carrier phase ambiguity resolution process required for achieving centimeter-level relative positioning accuracy is not perturbed by them. If the baseline length increases beyond 10 kilometers (considered a long baseline condition), these errors at the cellular device 100, 200 and reference receiver antennas become increasingly different, so that their presence in the cellular device 100, 200's-reference differential GNSS observables and their influence on the ambiguity resolution process increases. Ambiguity resolution on single cellular device 100, 200's reference receiver baselines beyond 10 kilometers becomes increasingly unreliable. This attribute limits the precise resolution of a mobile platform with respect to a single reference receiver, and essentially makes it unusable on a mobile mapping platform that covers large distances as part of its mission, such as an aircraft.
[00135] A network GNSS method computes the estimated position of a cellular device 100, 200's receiver using reference observables from three or more reference receivers that approximately surround the cellular device 100, 200's receiver trajectory. This implies that the cellular device 100, 200's receiver trajectory is mostly contained by a closed polygon whose vertices are the reference receiver antennas. The cellular device 100, 200's receiver 107 can move a few kilometers outside this polygon without significant loss of positioning accuracy. A network GNSS algorithm calibrates the ionosphere and troposphere signal delays at each reference receiver position and then interpolates and possibly extrapolates these to the cellular device 100, 200's position to achieve better signal delay cancellation on long baselines than could be had with a single reference receiver. Various methods of signal processing can be used, however they all yield essentially the same performance improvement on long baselines.
[00136] Kinematic ambiguity resolution (KAR) satellite navigation is a technique used in numerous applications requiring high position accuracy. KAR is based on the use of carrier phase measurements of satellite positioning system signals, where a single reference station provides the real-time corrections with high accuracy. KAR combines the L1 and L2 carrier phases from the cellular device 100, 200 and reference receivers so as to establish a relative phase interferometry position of the cellular device 100, 200's antenna with respect to the reference antenna. A coherent L1 or L2 carrier phase observable can be represented as a precise pseudorange scaled by the carrier wavelength and biased by an integer number of unknown cycles known as cycle ambiguities. Differential combinations of carrier phases from the cellular device 100, 200 and reference receivers result in the cancellation of all common mode range errors except the integer ambiguities. An ambiguity resolution algorithm uses redundant carrier phase observables from the cellular device 100, 200 and reference receivers, and the known reference antenna position, to estimate and thereby resolve these ambiguities.
[00137] Once the integer cycle ambiguities are known, the cellular device 100, 200's receiver 107 can compute its antenna position with accuracies generally on the order of a few centimeters, provided that the cellular device 100, 200 and reference antennas are not separated by more than 10 kilometers. This method of precise positioning performed in real-time is commonly referred to as real-time kinematic (RTK) positioning. The separation between a cellular device 100, 200 and reference antennas shall be referred to as "cellular device reference separation."
[00138] The reason for the cellular device-reference separation constraint is that KAR positioning relies on near exact correlation of atmospheric signal delay errors between the cellular device 100, 200 and reference receiver observables, so that they cancel in the cellular device 100, 200's reference observables combinations (for example, differences between cellular device 100, 200 and reference observables per satellite). The largest error in carrier-phase positioning solutions is introduced by the ionosphere, a layer of charged gases surrounding the earth. When the signals radiated from the satellites penetrate the ionosphere on their way to the ground-based receivers, they experience delays in their signal travel times and shifts in their carrier phases. A second significant source of error is the troposphere delay. When the signals radiated from the satellites penetrate the troposphere on their way to the ground-based receivers, they experience delays in their signal travel times that are dependent on the temperature, pressure and humidity of the atmosphere along the signal paths. Fast and reliable positioning requires good models of the spatio-temporal correlations of the ionosphere and troposphere to correct for these non- geometric influences.
[00139] When the cellular device 100, 200 reference separation exceeds 10 kilometers, as maybe the case when the cellular device 100, 200 has a GNSS receiver 107 that is a LEO satellite receiver, the atmospheric delay errors become de-correlated and do not cancel exactly. The residual errors can now interfere with the ambiguity resolution process and thereby make correct ambiguity resolution and precise positioning less reliable.
[00140] The cellular device 100, 200's reference separation constraint has made KAR positioning with a single reference receiver unsuitable for certain mobile positioning applications where the mission of the mobile platform of the cellular device 100, 200 will typically exceed this constraint. One solution is to set up multiple reference receivers along the mobile platform's path so that at least one reference receiver falls within a 10 km radius of the mobile platform's estimated position.
[00141] Network GNSS methods using multiple reference stations of known location allow correction terms to be extracted from the signal measurements. Those corrections can be interpolated to all locations within the network. Network KAR is a technique that can achieve centimeter-level positioning accuracy on large project areas using a network of reference GNSS receivers. This technique operated in real-time is commonly referred to as network RTK. The network KAR algorithm combines the pseudorange and carrier phase observables from the reference receivers as well as their known positions to compute calibrated spatial and temporal models of the ionosphere and troposphere signal delays over the project area. These calibrated models provide corrections to the observables from the cellular device 100, 200's receiver, so that the cellular device 100, 200's receiver 107 can perform reliable ambiguity resolution on combinations of carrier phase observables from the cellular device 100, 200 and some or all reference receivers. The number of reference receivers required to instrument a large project area is significantly less than what would be required to compute reliable single baseline KAR solutions at any point in the project area. See, for example, U.S. Pat. No. 5,477,458, "Network for Carrier Phase Differential GPS Corrections," and U.S. Pat. No. 5,899,957, "Carrier Phase Differential GPS Corrections Network". See also Liwen Dai et al., "Comparison of Interpolation Algorithms in Network- Based GPS Techniques," Journal of the Institute of Navigation, Vol. 50, No. 4 (Winter 1003- 1004) for a comparison of different network GNSS implementations and comparisons of their respective performances.
[00142] A virtual reference station (VRS) network method is a particular
implementation of a network GNSS method that is characterized by the method by which it computes corrective data for the purpose of cellular device 100, 200's position accuracy improvement. A VRS network method comprises a VRS corrections generator and a single- baseline differential GNSS position generator such as a GNSS receiver 107 with differential GNSS capability. The VRS corrections generator has as input data the pseudorange and carrier phase observables on two or more frequencies from N reference receivers, each tracking signals from M GNSS satellites. The VRS corrections generator outputs a single set of M pseudorange and carrier phase observables that appear to originate from a virtual reference receiver at a specified position (hereafter called the VRS position) within the boundaries of the network defined by a polygon (or projected polygon) having all or some of the N reference receivers as vertices. The dominant observables errors comprising a receiver clock error, satellite clock errors, ionosphere and troposphere signal delay errors and noise all appear to be consistent with the VRS position. The single-baseline differential GNSS position generator implements a single-baseline differential GNSS position algorithm, of which numerous examples have been described in the literature. B. Hofmann-Wellenhof et al., Global Positioning System: Theory and Practice, 5th Edition, 1001 (hereinafter "Hofmann-Wellenhof [1001]"), gives comprehensive descriptions of different methods of differential GNSS position computation, ranging in accuracies from one meter to a few centimeters. The single-baseline differential GNSS position algorithm typically computes differences between the cellular device 100, 200 and reference receiver observables to cancel atmospheric delay errors and other common mode errors such as orbital and satellite clock errors. The VRS position is usually specified to be close to or the same as the roving receiver's estimated position so that the actual atmospheric errors in the cellular device 100, 200 receiver 107's observables approximately cancel the estimated atmospheric errors in the VRS observables in the cellular device 100, 200's reference observables differences.
[00143] The VRS corrections generator computes the synthetic observables at each sampling epoch (typically once per second) from the geometric ranges between the VRS position and the M satellite positions as computed using well-known algorithms such as those given in IS-GPS-200G interface specification tilted "Navstar GPS Space
Segment/Navigation User Interfaces," and dated 5 September 2012. It estimates the typical pseudorange and phase errors comprising receiver clock error, satellite clock errors, ionospheric and tropospheric signal delay errors and noise, applicable at the VRS position from the N sets of M observables generated by the reference receivers, and adds these to the synthetic observables.
[00144] A network RTK system operated in real time requires each GNSS reference receiver to transmit its observables to a network server computer that computes and transmits the corrections and other relevant data to the GNSS cellular device 100, 200's receiver 107. The GNSS reference receivers, plus hardware to assemble and broadcast observables, are typically designed for this purpose and are installed specifically for the purpose of implementing the network. Consequently, those receivers are called dedicated (network) reference receivers.
[00145] An example of a VRS network is designed and manufactured by Trimble Navigation Limited, of Sunnyvale, California. The VRS network as delivered by Trimble includes a number of dedicated reference stations, a VRS server, multiple server-reference receiver bi-directional communication channels, and multiple server-cellular-device-bidirectional data communication channels. Each server-cellular device bi-directional communication channel serves one cellular device 100, 200. The reference stations provide their observables to the VRS server via the server-reference receiver bi-directional communication channels. These channels can be implemented by a public network such as the Internet. The bi-directional server-cellular-device communication channels can be radio modems or cellular telephone links, depending on the location of the server with respect to the cellular device 100, 200.
[00146] The VRS server combines the observables from the dedicated reference receivers to compute a set of synthetic observables at the VRS position and broadcasts these plus the VRS position in a standard differential GNSS (DGNSS) message format, such as one of the RTCM (Radio Technical Commission for Maritime Services) formats, an RTCA (Radio Technical Commission for Aeronautics) format or a proprietary format such as the CMR (Compact Measurement Report) or CMR+ format which are messaging system communication formats employed by Trimble Navigation Limited. Descriptions for numerous of such formats are widely available. For example, RTCM Standard 10403.1 for DGNSS Services - Version 3, published October 26, 2006 (and Amendment 2 to the same, published August 31 , 2007) is available from the Radio Technical Commission for Maritime Services, 1800 N. Kent St., Suite 1060, Arlington, Virginia 22209. The synthetic
observables are the observables that a reference receiver located at the VRS position would measure. The VRS position is selected to be close to the cellular device 100, 200's estimated position so that the cellular device 100, 200's VRS separation is less than a maximum separation considered acceptable for the application. Consequently, the cellular device 100, 200 receiver 107 must periodically transmit its approximate position to the VRS server. The main reason for this particular implementation of a real-time network RTK system is compatibility with RTK survey GNSS receivers that are designed to operate with a single reference receiver.
[00147] Descriptions of the VRS technique are provided in U.S. Patent no. 6,324,473 of (hereinafter "Eschenbach") (see particularly col. 7, line 21 et seq.) and U.S. Patent application publication no. 2005/0064878, of B. O'Meagher (hereinafter "O'Meagher"), which are assigned to Trimble Navigation Limited; and in H. Landau et al., Virtual Reference Stations versus Broadcast Solutions in Network RTK, GNSS 2003 Proceedings, Graz, Austria (2003); each of which is incorporated herein by reference.
[00148] The term "VRS", as used henceforth in this document, is used as shorthand to refer to any system or technique which has the characteristics and functionality of VRS described or referenced herein and is not necessarily limited to a system from Trimble Navigation Ltd. Hence, the term "VRS" is used in this document merely to facilitate description and is used without derogation to any trademark rights of Trimble Navigation Ltd. or any subsidiary thereof or other related entity.
Precise Positioning Point (PPP)
[00149] Descriptions of a Precise Point Positioning (PPP) technique are provided in U.S. Patent application publication 201 10187590, of Leandro, which is assigned to Trimble Navigation Limited and is incorporated herein by reference. Trimble Navigation Limited has commercialized a version of PPP corrections which it calls RTX™. PPP corrections can be any collection of data that provides corrections from a satellite in space, clock errors, ionosphere or troposphere, or a combination thereof. According to one embodiment, PPP corrections can be used in instead of WAAS or RTX™.
[00150] The term Precise Point Positioning (PPP), as used henceforth in this document, is used as shorthand to refer to any system or technique which has the characteristics and functionality of PPP described or referenced herein and is not necessarily limited to a system from Trimble Navigation Ltd. Hence, the term "PPP" is used in this document merely to facilitate description and is used without derogation to any trademark rights of Trimble Navigation Ltd. or any subsidiary thereof or other related entity. Techniques for generating PPP corrections are well known in the art. In general, a PPP system utilizes a network (which may be global) of GNSS reference receivers tracking navigation satellites such as GPS and GLONASS satellites and feeding data back to a centralized location for processing. At the centralized location, the precise orbits and precise clocks of all of the tracked navigation satellites are generated and updated in real time. A correction stream is produced by the central location; the correction stream contains the orbit and clock information. This correction stream is broadcast or otherwise provided to GNSS receivers, such as a GNSS receiver 107, in the field (conventionally by satellite service or cellular link). Corrections processors in the GNSS receivers utilize the corrections to produce centimeter level positions after a short convergence time (e.g., less than 30 minutes). A main difference between PPP and VRS is that PPP networks of reference receivers are typically global while VRS networks may be regional or localized with shorter spacing between the reference stations in a VRS network.
Wide Area Augmentation System (WAAS) [00151] Wide Area Augmentation System (WAAS) corrections are corrections of satellite position and their behavior. WAAS was developed by the Federal Aviation
Administration (FAA). WAAS includes a network of reference stations that are on the ground located in North America and Hawaii. The reference stations transmit their respective measurements to master stations which queue their respective received measurements. The master stations transmit WAAS corrections to geostationary WAAS satellites, which in turn broadcast the WAAS corrections back to earth where cellular devices 100, 200 that include WAAS-enabled GPS receivers can receive the broadcasted WAAS corrections. According to one embodiment, the GNSS receiver 107 is a WAAS- enabled GPS receiver. The WAAS corrections can be used to improve the accuracy of the respective cellular devices 100, 200' positions, for example, by applying the WAAS corrections to extracted pseudoranges. WAAS operation and implementation is well known in the art.
Real Carrier Phase Information
[00152] According to one embodiment, a GNSS chipset 170 provides real carrier phase information (also referred to as "actual carrier phase information"). The cellular device 100, 200 can extract real carrier phase information from the GNSS chipset 170 in a manner similar to extracting pseudorange information from the GNSS chipset 170, where the extracted carrier phase information is for use elsewhere in the cellular device 100, 200 outside of the GNSS chipset 170 as described herein, for example, with flowchart 600 of Figure 6.
[00153] Figure 5A is a flowchart 500A of a method for performing a carrier phase smoothing operation using real carrier phase information, according to one embodiment. In various embodiments, carrier phase smoothing logic 152 may be implemented by either a range domain hatch filter, or a position domain hatch filter, or by any of other
implementations known in the literature. The range domain hatch filter method is described in U.S. Patent No. 5,471 ,217 by Hatch et al., entitled "Method and Apparatus for Smoothing Coded Measurements in a Global Positioning System Receiver," filed February 1 , 1993, incorporated by reference herein, and the Hatch paper entitled "The synergism of GPS code and carrier measurements," published in the Proceedings of the Third International Geodetic symposium on satellite Doppler Positioning, New Mexico, 1982: 1213-1232. See also p 45 of the Master's Thesis by Sudha Neelima Thipparthi entitled "Improving Positional Accuracy using Carrier Smoothing Techniques in Inexpensive GPS Receivers," MSEE thesis, New Mexico State University, Las Cruces, NM, February 2004. [00154] The filtering/processing described herein lies in the family of errors in pseudorange processing that affect code and carrier measurements in the same way. In various embodiments, the code phase pseudorange measurements are "disciplined" by subtracting out a more constant equivalent pseudorange-like distance measurement derived from the carrier phase. Next, a filtering on the net subtracted signal is performed which allows various embodiments to eliminate multipath induced errors in the raw, and corrected, pseudorange data. This method does not deal with ionospheric effects, according to one embodiment.
[00155] In operation 501 A of Figure 5A, extracted pseudorange information and carrier phases for a first epoch are collected. In one embodiment, these extracted pseudorange information and carrier phases are received at carrier phase smoothing logic 152 from the GNSS receiver 107.
[00156] In operation 502A of Figure 5A, pseudorange corrections are collected and applied to the first set of extracted pseudoranges collected in operation 501 A. In one embodiment, these corrections themselves may be smoothed at the reference receiver (e.g., at GPS/GNSS reference stations 220) so that the delivered pseudorange corrections themselves are less noisy. Smoothing the pseudorange corrections derived at the
GPS/GNSS reference stations 220 using the same carrier phase method of flowchart 500A can vastly improve the quality of the delivered pseudorange corrections delivered to cellular device 100, 200 for use by a position determination processor (e.g., GNSS receiver 107 or pseudorange information processing logic 150). Such corrected pseudoranges that are also smoothed may be used by the cellular device 100, 200 and fetched if available.
[00157] In operation 503A of Figure 5A, delta carrier phase measurements for the same epoch are created using real carrier phase information. In accordance with various embodiments, this replicates creating a second distance measurement, similar to the reconstructed carrier phase information, based on integrated Doppler Shift.
[00158] In operation 504A of Figure 5A, the delta carrier phase measurements are subtracted from the corrected extracted pseudoranges. In accordance with various embodiments, this provides a fairly constant signal for that epoch and is equivalent to the corrected extracted pseudorange at the start of the integration interval. In accordance with various embodiments, this is referred to as a "disciplining" step that smoothes out the corrected extracted pseudorange signal and therefore reduces the instant errors in the later- computed position fixes.
[00159] In operation 505A of Figure 5A, the signal is filtered after the subtraction of operation 504A to reduce noise. In accordance with one embodiment, this is performed by averaging the carrier phase "yardsticks" over a series of epochs.
[00160] In operation 506A of Figure 5A, the delta carrier phase measurements from the real carrier phase processing operation is added back into the filtered signal of operation 505A.
[00161] In operation 507A of Figure 5A, the new filtered and corrected extracted pseudorange signal is processed, for example, at the pseudorange information processing logic 150, to derive a position fix 172B.
Reconstructing Carrier Phase Information based on Doppler Shift
[00162] Carrier Phase Information can be reconstructed (referred to herein as "reconstructed carrier phase") based on Doppler Shift. Doppler Shift is the change in frequency of a periodic event (also known as a "wave") perceived by an observer that is moving relative to a source of the periodic event. For example, Doppler shift refers to the change in apparent received satellite signal frequency caused by the relative motion of the satellites as they either approach the cellular device 100, 200 or recede from it. Thus any measurement of Doppler frequency change is similar to differentiating carrier phase. It is therefore possible to reconstruct the carrier phase by integrating the Doppler shift data. In an embodiment, the GNSS chipset 170 of GNSS receiver 107 may provide Doppler information it determines through other means. This Doppler frequency shift information or "Doppler" may be collected at each GPS timing epoch (e.g., one second) and integrated over a sequence of the one-second epochs, to produce a model of carrier phase. This Doppler-derived carrier phase model may be substituted for the real carrier phase data, and used in the same manner as shown in the flow chart for carrier phase smoothing of Figure 5A. Doppler Shift signal processing is well known in the art.
[00163] Figure 5B is a flowchart 500B of a method for generating reconstructed carrier phase information (also referred to as a "Doppler-derived carrier phase model") based on Doppler Shift, according to one embodiment. In accordance with one
embodiment, method of flowchart 500Bis implemented at GPS/GNSS reference stations and the modeled carrier phase is provided to cellular device 100, 200 via one of the communication networks described above.
[00164] In operation 501 B of Figure 5B, Doppler information from a GNSS receiver 107 of a GNSS chipset 170 is received by pseudorange-carrier-phase-smoothing-logic 152.
[00165] In operation 502B of Figure 5B, a series of Doppler information is integrated. As described above, Doppler frequency shift information may be collected at each GPS timing epoch (e.g., one second) and stored for use in producing a model of carrier phase.
[00166] In operation 503B of Figure 5B, a model of carrier phase is created based on integrated Doppler information. As discussed above with reference to operation 502B, a series of Doppler information for a plurality of timing epochs is integrated. In one
embodiment, this Doppler information is integrated over a sequence of the one-second epochs, to produce a model of carrier phase. The sequence may include 10-100 epochs, or seconds. The model of carrier phase smoothing is used as the reconstructed carrier phase information.
[00167] In operation 504B of Figure 5B, the modeled carrier phase, which is also referred to as "reconstructed carrier phase information", is supplied to pseudorange-carrier- phase-smoothing-logic 152. As described above, method of flowchart 500Bcan be implemented at GPS/GNSS reference stations 220 and the reconstructed carrier phase information can then be broadcast to cellular device 100, 200.
Method of Extracting Pseudorange Information
[00168] Figure 6 depicts a flowchart 600 of a method of extracting pseudorange information using a cellular device, according to one embodiment.
[00169] At 610, the method begins.
[00170] At 620, the cellular device 100, 200 accesses the GNSS chipset 170 embedded within the cellular device 100, 200 where the GNSS chipset 170 calculates pseudorange information for use by the GNSS chipset 170. For example, the GNSS receiver 107 can perform GPS measurements to derive raw measurement data for a position of the cellular device 100. The raw measurement data provides an instant location of the cellular device 100. The GNSS chipset 170 calculates pseudorange information that is for use by the GNSS chipset 170. According to one embodiment, the raw measurement data is the pseudorange information that will be extracted. Examples of pseudorange information are uncorrected pseudorange information, differential GNSS corrections, high precision GNSS satellite orbital data, GNSS satellite broadcast ephemeris data, and ionospheric projections.
[00171] A chipset accessor logic 141 , according to one embodiment, is configured for accessing the GNSS chipset 170. According to one embodiment, the chipset accessor logic 141 is a part of an SUPL client 101.
[00172] The pseudorange information can be obtained from the processor 172 of the GNSS receiver 107 using a command. The GNSS chipset 170 may be designed, for example, by the manufacturer of the GNSS chipset 170, to provide requested information, such as pseudorange information, in response to receiving the command. The
pseudorange information may be extracted from the GNSS chipset 170 using the command that the manufacturer has designed the GNSS chipset 170 with. For example, according to one embodiment, the GNSS chipset 170 is accessed using an operation that is a session started with a message that is an improved accuracy Secure User Platform Location (SUPL) start message or a high precision SUPL INIT message. According to one embodiment, the message is a custom command that is specific to the GNSS chipset 170 (also referred to as "a GNSS chipset custom command") and the improved accuracy SUPL client 101 can access to the raw measurements of the GNSS chipset 170.
[00173] Examples of chipset manufacturers include Qualcomm, Texas Instruments, FastraX, Marvel, SIRF, Trimble, SONY, Furuno, Nemerix, Phillips, and XEMICS, to name a few.
[00174] At 630, the cellular device 100, 200 extracts the pseudorange information from the GNSS chipset 170 for use elsewhere in the cellular device 100, 200 outside of the GNSS chipset 170. For example, pseudorange information extractor logic 142 may be associated with a worker thread of the SUPL client 101 . The worker thread associated with the SUPL client 101 can monitor the raw measurements delivered by the GNSS chipset 170 into the GNSS chipset 170's memory buffers, cache the raw measurements and use the raw measurements to determine a position fix. The pseudorange information extractor logic 142 and the pseudorange information processing logic 150 can be associated with the worker thread. For example, the pseudorange information extractor logic 142 can cache the raw measurements and the pseudorange information processing logic 150 can determine the location. [00175] According to one embodiment, the raw measurement data is the pseudorange information that is extracted. According to one embodiment, the raw measurement data is pseudorange information that is calculated by the GNSS chipset 170 and is only for use by the GNSS chipset 170.
[00176] According to one embodiment, a determining position fix logic 170B may perform a least squares solution171 B on the extracted pseudorange information prior to transmitting the output to the pseudorange information bridger logic 143. According to another embodiment, the extracted pseudorange information is improved using various embodiments described in Figures 7A-10 prior to performing a least squares solution171 B, as will be described herein.
Methods of Improving Position Accuracy of Extracted Pseudorange Information
[00177] The extracted pseudorange information without further improvements can be used to provide an instant location, as described herein. The extracted pseudorange information can be improved by applying position accuracy improvements that include, but are not limited to, those depicted in Tables 2 and 3. The instant location or the improved location can be communicated to location manager logic 161 , as discussed herein, that displays the instant location or the improved location with respect to a map.
[00178] Figure 7A depicts a flowchart 700A of a method of improving the position accuracy using one or more position accuracy improvements, according to one
embodiment.
[00179] At 71 OA, the method begins.
[00180] At 720A, the pseudorange-correction-logic 151 provides Wide Area
Augmentation System (WAAS) corrected pseudoranges by applying WAAS corrections to the extracted pseudorange information. For example, the pseudorange-correction-logic 151 receives the extracted pseudorange information that was extracted from the GNSS chipset 170 at 630 of Figure 6. The cellular device 100, 200 receives the WAAS corrections, as described herein, and provides the WAAS corrections to the pseudorange-correction-logic 151. The pseudorange-correction-logic 151 provides Wide Area Augmentation System (WAAS) corrected pseudoranges by applying the received WAAS corrections to the extracted pseudorange information. [00181] At 730A the method ends.
[00182] Figure 7B depicts a flowchart 700B of a method of improving the position accuracy using one or more position accuracy improvements, according to one
embodiment.
[00183] At 710B, the method begins.
[00184] At 720B, the pseudorange-carrier-phase-smoothing-logic 152 provides smoothed pseudorange information by performing pseudorange smoothing on the extracted pseudorange information based on carrier phase information. For example, if real carrier phase information is available, the cellular device 100, 200 can extract it as discussed herein. Otherwise, the cellular device 100, 200 can derive reconstructed carrier phase information as described herein and provide the reconstructed carrier phase information to the pseudorange-carrier-phase-smoothing-logic 152. The pseudorange-carrier-phase- smoothing-logic 152 can receive the extracted pseudorange information that was extracted from the GNSS chipset 170 at 630 of Figure 6. The pseudorange -carrier-phase-smoothing- logic 152 can apply either the real carrier phase information or the real carrier phase information to the extracted pseudorange information to provide smoothed pseudorange information.
[00185] At 730B, a position fix is determined based on the smoothed pseudorange information and WAAS pseudorange corrections. For example, the pseudorange- correction-logic 151 receives the smoothed pseudorange information and receives WAAS pseudorange corrections and determines a position fix based on the smoothed pseudorange information and the WAAS pseudorange corrections.
[00186] At 740B, the method ends.
[00187] According to one embodiment, a determining position fix logic 170B may perform a least squares solution 171 B on the output of flowchart 700A and 700B prior to transmitting the output to the pseudorange information bridger logic 143.
[00188] Figure 8A depicts a flowchart 800A of a method of improving the position accuracy using one or more position accuracy improvements, according to one
embodiment. [00189] At 81 OA, the method begins.
[00190] At 820A, the pseudorange-correction-logic 151 provides Differential Global Positioning System (DGPS) corrected pseudoranges by applying DGPS corrections to the extracted pseudorange information.
[00191] For example, the pseudorange-correction-logic 151 receives the extracted pseudorange information that was extracted from the GNSS chipset 170 at 630 of Figure 6. The cellular device 100, 200 receives the DGPS corrections as described herein and provides the DGPS corrections to the pseudorange-correction-logic 151. The pseudorange- correction-logic 151 provides Differential Global Positioning System (DGPS) corrected pseudoranges by applying the received DGPS corrections to the extracted pseudorange information.
[00192] At 830A, the pseudorange-correction-logic 151 provides WAAS-DGPS corrected pseudoranges by applying Wide Area Augmentation System (WAAS) to the DGPS corrected pseudoranges.
[00193] For example, the pseudorange-correction-logic 151 accesses the DGPS corrected pseudoranges determined at 820A of Figure 8A. The cellular device 100, 200 receives the WAAS corrections as described herein and provides the WAAS corrections to the pseudorange-correction-logic 151 . The pseudorange-correction-logic 151 provides WAAS-DGPS corrected pseudoranges by applying Wide Area Augmentation System (WAAS) to the DGPS corrected pseudoranges.
[00194] At 840A, the method ends.
[00195] Figure 8B depicts a flowchart 800B of a method of improving the position accuracy using one or more position accuracy improvements, according to one
embodiment.
[00196] At 810B, the method begins.
[00197] At 820B, a position determination decision is made as to whether to proceed to 822B or 824B. For example, at operation 820B, the position accuracy improvement determination logic 180B can determine whether to proceed to 822B or 824B as discussed herein. . [00198] At 830B, DGPS corrected smoothed pseudoranges are provided by applying corrections to the smoothed pseudorange information. For example, the pseudorange- correction-logic 151 can provide DGPS corrected smoothed pseudoranges by applying DGPS corrections to the smoothed pseudoranges determined at either 822B or 824B.
[00199] At 840B, WAAS-DGPS corrected smoothed pseudoranges are provided by applying WAAS to the DGPS corrected smoothed pseudoranges. For example, the pseudorange-correction-logic 151 can provide WAAS-DGPS corrected smoothed pseudoranges by applying WAAS corrections to the DGPS corrected smoothed
pseudoranges.
[00200] At 850B, the method ends.
[00201] According to one embodiment, a determining position fix logic 170B may perform a least squares solution 171 B on the output of flowcharts 800A or 800B prior to transmitting the output to the pseudorange information bridger logic 143.
[00202] Figure 9A depicts a flowchart 900A of a method of improving the position accuracy using one or more position accuracy improvements, according to one
embodiment.
[00203] At 91 OA, the method begins.
[00204] At 920A, DGPS corrected pseudoranges are determined by applying DGPS pseudorange corrections to extracted pseudorange information. For example, the pseudorange-correction-logic 151 receives extracted pseudorange information from the pseudorange information extractor logic 142 and applies the DGPS pseudorange corrections to the extracted pseudorange information.
[00205] At 930A, the pseudorange-correction-logic 151 can determine a position fix based on the DGPS corrected pseudoranges and PPP corrections.
[00206] At 940A, the method ends. [00207] Figure 9B depicts a flowchart 900B of a method of improving the position accuracy using one or more position accuracy improvements, according to one
embodiment.
[00208] At 910B, the method begins.
[00209] At 920B, smoothed pseudorange information is provided by performing pseudorange smoothing on the extracted pseudorange information using carrier phase information. For example, the pseudorange-carrier-phase-smoothing-logic 152 provides smoothed pseudorange information by performing pseudorange smoothing on the extracted pseudorange information, which can be obtained as discussed herein, based on carrier phase information. If real carrier phase information is available, the cellular device 100, 200 can extract the real carrier phase information, as discussed herein. Otherwise, the cellular device 100, 200 can derive reconstructed carrier phase information, as described herein, and provide the reconstructed carrier phase information to the pseudorange-carrier-phase- smoothing-logic 152.
[00210] At 930B, DGPS corrected smoothed pseudoranges are provided by applying DGPS pseudorange corrections to the smoothed pseudorange information. For example, the pseudorange-correction-logic 151 can receive the smoothed pseudorange information from the pseudorange-carrier-phase-smoothing-logic 152. The pseudorange-correction- logic 151 can determine the corrected smoothed pseudoranges by applying DGPS pseudorange corrections to the smoothed pseudorange information.
[00211] At 940B, a position fix can be determined based on the DGPS corrected smoothed pseudoranges and PPP corrections. For example, the pseudorange-correction- logic 151 can determine a position fix based on the DGPS corrected smoothed
pseudoranges and PPP corrections.
[00212] At 950B, the method ends.
[00213] According to one embodiment, a determining position fix logic 170B may perform a least squares solution 171 B on the output of flowcharts 900A and 900B prior to transmitting the output to the pseudorange information bridger logic 143. [00214] Figure 10 depicts a flowchart 1000 of a method of improving the position accuracy using one or more position accuracy improvements, according to one
embodiment.
[00215] At 1010, the method begins.
[00216] At 1020, the pseudorange-carrier-phase-smoothing-logic 152 smoothes the extracted pseudorange information based on carrier phase smoothing. For example, the pseudorange-carrier-phase-smoothing-logic 152 receives extracted pseudorange information from the pseudorange information extractor logic 142 and receives carrier phase information, which may be either real carrier phase information or reconstructed carrier phase information, as described herein. The pseudorange-carrier-phase-smoothing-logic 152 smoothes the extracted pseudorange information based on carrier phase smoothing.
[00217] At 1030, the PPP logic 151 C provides a smoothed improved accuracy position fix by performing Precise Point Positioning (PPP) processing on the smoothed extracted pseudorange information. For example, the PPP logic 151 C receives the smoothed extracted pseudorange information provided by the pseudorange-carrier-phase- smoothing-logic 152 at 1020. The PPP logic 151 C provides a smoothed improved accuracy position fix by performing Precise Point Positioning (PPP) processing on the smoothed extracted pseudorange information
[00218] At 1040, the pseudorange-correction-logic 151 can optionally correct the smoothed improved accuracy position fix by applying Differential Global Positioning System (DGPS) corrections to the smoothed improved accuracy position fix. For example, pseudorange-correction-logic 151 receives the smoothed improved accuracy position fix provided by the PPP logic 151 C at 1030. The pseudorange-correction-logic 151 receives DGPS corrections as described herein. The pseudorange-correction-logic 151 corrects the smoothed improved accuracy position fix by applying Differential Global Positioning System (DGPS) corrections to the smoothed improved accuracy position fix, thus, providing a corrected smoothed improved accuracy position fix. Operation 1040 is optional, according to one embodiment.
[00219] At 1050, the method ends. [00220] According to one embodiment, a determining position fix logic 170B may perform a least squares solution 171 B on the output of flowchart 1000 prior to transmitting the output to the pseudorange information bridger logic 143.
[00221] Figure 1 1 depicts a flowchart 1 100 of a method of accessing and processing extracted pseudorange information, according to one embodiment.
[00222] At 1 1 10, various types of information can be accessed. Examples of accessing are extracting 1 1 12 information and receiving 1 1 14 information. Unsmoothed uncorrected pseudorange information can be extracted at 1 1 12A, WAAS corrections can be extracted at 1 1 12B, SBAS corrections can be extracted at 1 1 12E, Doppler shift can be extracted at 1 1 12C, and carrier phase measurements can be extracted at 1 1 12D.
"Accessing" and "obtaining" can be used interchangeably. Table 1 depicts types of information that can be extracted at operation 1 1 12 from the GNSS chipset 170 and types of information that are received at operation 1 1 14 instead of being extracted. However, various embodiments are not limited to the types of information that can be extracted or received depicted in Table 1.
[00223] The received or extracted information or a combination thereof, can be processed at 1 120.
[00224] What or whether to apply position accuracy improvements can be determined at 1 160, for example, by the position accuracy improvement determination logic 180B.
Examples of position accuracy improvements are real carrier phase information,
reconstructed carrier phase information, WAAS, SBAS, DGPS, PPP, RTK, VRS and RTX™ corrections. The determination logic 180B can determine whether one or more and in what order logics 152A, 152B, 151A-151 F are performed, according to one embodiment. Tables 2 and 3 are examples of carrier phase information or corrections or a combination thereof, that the position accuracy improvement determination logic 180B may determine, as discussed herein.
[00225] The information can be smoothed at 1 130. Examples of smoothing 1 130 are real carrier phase smoothing 1 132 and reconstructed carrier phase smoothing 1 134.
[00226] Either unsmoothed information or smoothed information can be corrected at 1 140. For example, unsmoothed information from 1 1 10 or smoothed information from 1 130 can be corrected at 1 140. Examples of correcting are SBAS correcting 1 140G, WAAS correcting 1140A, DGPS correcting 1140B, PPP correcting 1140C, RTK correcting 1140D, VRS correcting 1140E, and RTX correcting 1140F. The smoothed information or unsmoothed information can be corrected using one or more of operations 1140A-1140G. According to one embodiment, WAAS correcting 1140A is an example of SBAS correcting 1140G.
[00227] Unsmoothed information from 1110, smoothed information from 1112, corrected unsmoothed information from 1140 or corrected smoothed information from 1140 can be used to determine a position fix 172B at 1150, for example, by performing a least squares solution 171 B at 1152. The output of flowchart 1100 is a position fix 172B. Table 2 and Table 3 depict combinations of information that result in a position fix 172B, according to various embodiments.
[00228] According to one embodiment, accessing 1110, extracting 1112, extracting pseudorange information 1112A, extracting SBAS 1112E, extracting WAAS 1112B, extracting Doppler 1112C, extracting carrier phase measurement 1112D, receiving 1114, smoothing 1130, correcting 1140, determining a position fix 1150, and performing a least squares solution 1152 can be performed respectively by logic 110B, 142, 112B-5, 112B-2, 112B-3, 112B-4, 114B, 150, 152, 151, and 170B. Real carrier phase smoothing 1132, reconstructed carrier phase smoothing 1134, correcting 1140A-1140G can be performed respectively by logic 152A, 152B, 151A-151E, 151 F, 151G.
[00229] Any one or more of 1112, 1112A-1112E, 1132, 1134, 1140A-1140G can be performed. Further, any one or more of 1112, 1112A-1112E, 1112B, 1112C, 1112E, 1132, 1134, 1140A-1140G can be performed in various orders. Various embodiments are not limited to just the combinations that are described herein.
[00230] According to one embodiment, a Global Navigation Satellite System (GNSS) chipset embedded within the cellular device is accessed at 620 (Figure 6) where the GNSS chipset calculates pseudorange information for use by the GNSS chipset. The pseudorange information is extracted at 640 (Figure 6), 112 (Figure 11 ) from the GNSS chipset for use elsewhere in the cellular device outside of the GNSS chipset. The accessing 620 and the extracting 640, 1112A can be performed by the cellular device 100, 200 that includes hardware 180.
[00231] The extracted pseudorange information can be smoothed at 1130. The smoothing 1130 can be based on reconstructed carrier phase information or real carrier phase information. The smoothed pseudorange information can be corrected at 1 140.
Examples of the types of corrected pseudoranges are Wide Area Augmentation System (WAAS), Differential Global Positioning System (DGPS), Precise Point Positioning (PPP), and Real Time Kinematic (RTK). Pseudorange corrections can be accessed 1 1 10. The corrected pseudorange information can be derived, for example at 1 140, by applying the pseudorange corrections to the extracted pseudorange information.
[00232] Figures 4-1 1 depict flowcharts 400-1 100, according to one embodiment. Although specific operations are disclosed in flowcharts 400-1 100, such operations are exemplary. That is, embodiments of the present invention are well suited to performing various other operations or variations of the operations recited in flowcharts 400-1 100. It is appreciated that the operations in flowcharts 400-1 100 may be performed in an order different than presented, and that not all of the operations in flowcharts 400-1 100 may be performed.
[00233] The operations depicted in Figures 4-1 1 transform data or modify data to transform the state of a cellular device 100, 200. For example, by extracting pseudorange information from a GNSS chipset 170 for use elsewhere, the state of the cellular device 100, 200 is transformed from a cellular device that is not capable of determining a position fix itself into a cellular device that is capable of determining a position fix itself. In another example, operations depicted in flowcharts 400-1 100 transform the state of a cellular device 100, 200 from not being capable of providing an improved accuracy position fix to be capable of providing an improved accuracy position fix.
[00234] The above illustration is only provided by way of example and not by way of limitation. There are other ways of performing the method described by flowcharts 400- 1 100.
[00235] The operations depicted in Figures 4-1 1 can be implemented as computer readable instructions, hardware or firmware. According to one embodiment, hardware associated with a cellular device 100, 200 can perform one or more of the operations depicted in Figures 4-1 1 .
Example GNSS Receiver
[00236] With reference now to Figure 12, a block diagram is shown of an embodiment of an example GNSS receiver which may be used in accordance with various embodiments described herein. In particular, Figure 12 illustrates a block diagram of a GNSS receiver in the form of a general purpose GPS receiver 1230 capable of demodulation of the L1 and/or L2 signal(s) received from one or more GPS satellites. A more detailed discussion of the function of a receiver such as GPS receiver 1230 can be found in U.S. Patent Number 5,621 ,416, by Gary R. Lennen, is titled Optimized processing of signals for enhanced cross-correlation in a satellite positioning system receiver," and includes a GPS receiver very similar to GPS receiver 1230 of Figure 12.
[00237] In Figure 12, received L1 and L2 signals are generated by at least one GPS satellite. Each GPS satellite generates different signal L1 and L2 signals and they are processed by different digital channel processors 1252 which operate in the same way as one another. Figure 12 shows GPS signals (L1 =1575.42 MHz, L2=1227.60 MHz) entering GPS receiver 1230 through a dual frequency antenna 1232. Antenna 1232 may be a magnetically mountable model commercially available from Trimble Navigation of
Sunnyvale, Calif. Master oscillator 1248 provides the reference oscillator which drives all other clocks in the system. Frequency synthesizer 1238 takes the output of master oscillator 1248 and generates important clock and local oscillator frequencies used throughout the system. For example, in one embodiment frequency synthesizer 1238 generates several timing signals such as a 1 st (local oscillator) signal L01 at 1400 MHz, a 2nd local oscillator signal L02 at 175 MHz, an SCLK (sampling clock) signal at 25 MHz, and a MSEC
(millisecond) signal used by the system as a measurement of local reference time.
[00238] A filter/LNA (Low Noise Amplifier) 1234 performs filtering and low noise amplification of both L1 and L2 signals. The noise figure of GPS receiver 1230 is dictated by the performance of the filter/LNA combination. The downconvertor 1236 mixes both L1 and L2 signals in frequency down to approximately 175 MHz and outputs the analogue L1 and L2 signals into an IF (intermediate frequency) processor 1250. IF processor 1250 takes the analog L1 and L2 signals at approximately 175 MHz and converts them into digitally sampled L1 and L2 inphase (L1 I and L2 I) and quadrature signals (L1 Q and L2 Q) at carrier frequencies 420 KHz for L1 and at 2.6 MHz for L2 signals respectively.
[00239] At least one digital channel processor 1252 inputs the digitally sampled L1 and L2 inphase and quadrature signals. All digital channel processors 1252 are typically are identical by design and typically operate on identical input samples. Each digital channel processor 1252 is designed to digitally track the L1 and L2 signals produced by one satellite by tracking code and carrier signals and to from code and carrier phase measurements in conjunction with the GNSS microprocessor system 1254. One digital channel processor 1252 is capable of tracking one satellite in both L1 and L2 channels. Microprocessor system 1254 is a general purpose computing device (such as computer system 1000 of Figure 10) which facilitates tracking and measurements processes, providing pseudorange and carrier phase measurements for a determining position fix logic 1258. In one embodiment, microprocessor system 1254 provides signals to control the operation of one or more digital channel processors 1252. According to one embodiment, the GNSS microprocessor system 1254 provides one or more of pseudorange information 1272, Doppler Shift information 1274, and real Carrier Phase Information 1276 to the determining position fix logic 1258. One or more of pseudorange information 1272, Doppler Shift information 1274, and real Carrier Phase Information 1276 can also be obtained from storage 1260. One or more of the signals 1272, 1274, 1276 can be conveyed to the cellular device's processor, such as processor 109 (Figure 1A) that is external to the GNSS chipset 170 (Figure 1A). Determining position fix logic 1258 performs the higher level function of combining measurements in such a way as to produce position, velocity and time information for the differential and surveying functions, for example, in the form of a position fix 1280. Storage 1260 is coupled with determining position fix logic 1258 and
microprocessor system 1254. It is appreciated that storage 1260 may comprise a volatile or non-volatile storage such as a RAM or ROM, or some other computer readable memory device or media. In some embodiments, determining position fix logic 1258 performs one or more of the methods of position correction described herein.
[00240] In some embodiments, microprocessor 1254 and/or determining position fix logic 1258 receive additional inputs for use in receiving corrections information. According to one embodiment, an example of the corrections information is WAAS corrections.
According to one embodiment, examples of corrections information are differential GPS corrections, RTK corrections, signals used by the previously referenced Enge-Talbot method, and wide area augmentation system (WAAS) corrections among others.
[00241] Although Figure 12 depicts a GNSS receiver 1 130 with navigation signals L1 I, L1 Q, L2I, L2Q, various embodiments are well suited different combinations of navigational signals. For example, according to one embodiment, the GNSS receiver 1 130 may only have an L1 1 navigational signal. According to one embodiment, the GNSS receiver 1 130 may only have L1 I, L1 Q and L2I.
[00242] Various embodiments are also well suited for future navigational signals. For example, various embodiments are well suited for the navigational signal L2C that is not currently generally available. However, there are plans to make it available for non-military receivers. [00243] According to one embodiment, either or both of the accessing logic 1 10B and the processing logic 150 reside at either or both of the storage 1260 and GNSS
microprocessor system 1254.
[00244] According to one embodiment, the GNSS receiver 1230 is an example of a GNSS receiver 107 (see e.g., Figure 1A and Figure 1 D). According to one embodiment, the determining position fix logic 1258 is an example of determining position fix logic 170B (Figure 1 B). According to one embodiment, position fix 1280 is an example of a position fix 172B (Figure 1 B).
Kalman Filtering
[00245] Figure 13 depicts an example Kalman filtering process 1300, according to some embodiments. It should be appreciated that Kalman filtering is well known. As such, Figure 13 and the associated discussion are utilized only to provide a high-level general description. Variations in the described procedures will occur during specific
implementations of Kalman filtering. The extended Kalman filter and the unscented Kalman filter represent some of the variations to the basic method. Such variations are normal and expected. Generally speaking, Kalman filtering is a basic two-step predictor/corrector modeling process that is commonly used model dynamic systems. A dynamic system will often be described with a series of mathematical models. Models describing satellites in a Global Navigation Satellite System (GNSS) are one example of a dynamic system.
Because the position of any satellite and/or the positions of all the satellites in a system constantly and dynamically change and the satellites output a signal that can be measured by a GNSS receiver, Kalman filtering can be used in determining positions of the satellites.
[00246] A basic Kalman filter implemented using Kalman filtering process 1300 typically has at least two major components 1310: states 131 1 and covariances 1312. States 131 1 represent variables that are used to describe a system being modeled, at a particular moment in time. Covariances 1312 are represented in a covariance matrix that describes uncertainty, or lack of confidence, of states 131 1 with respect to each other at that same moment in time. Kalman filtering process 1300 also handles noise, or unpredictable variability, in the model. There are two principle types of noise, observation noise 1341 and process noise 1321. A Kalman filter may handle additional noise types, in some
embodiments. Process noise 1321 describes noise of the states 131 1 as a function of time. Observation noise 1341 is noise that relates to the actual observation(s) 1340 (e.g., observed measurements) that are used as an input/update to Kalman filtering process1300.
[00247] A prediction phase 1320 is the first phase of Kalman filtering process 1300. Prediction phase 1320 uses predictive models to propagate states 131 1 to the time of an actual observation(s) 1340. Prediction phase 1320 also uses process noise 1321 and predictive models to propagate the covariances 1312 to time of the actual observation(s) 1340 as well. The propagated states 131 1 are used to make predicted observation(s) 1322 for the time of actual observation(s) 1340.
[00248] A correction phase 1330 is the second phase in the Kalman filtering process 1300. During correction phase 1330, Kalman filtering process 1300 uses the difference between the predicted observation(s) 1322 and the actual observation(s) 1340 to create an observation measurement residual 1331 , which may commonly be called the "measurement residual." Observation noise 1341 can be noise in actual observation(s) 1340 and/or noise that occurs in the process of taking the actual observation(s) 1340. A Kalman gain 1332 is calculated using both the covariances 1312 and the observation noise 1341 . The states 131 1 are then updated using the Kalman Gain 1332 multiplied by the observation measurement residual 1331. The covariances 1312 are also updated using a function related to the Kalman gain 1332; for example, in one embodiment where Kalman gain is limited to a value between 0 and 1 , this function may be 1 minus the Kalman gain. This updating is sometimes referred to as the "covariance update." In some embodiments, if no actual observation 1340 is available, Kalman filtering process 1300 can simply skip correction phase 1330 and update the states 131 1 and covariances 1312 using only the information from prediction phase 1320, and then begin again. Using the new definitions of the states 131 1 and covariances 1312, Kalman filtering process 1300 is ready to begin again and/or to be iteratively accomplished.
Computer Readable Storage Medium
[00249] Unless otherwise specified, any one or more of the embodiments described herein can be implemented using non-transitory computer readable storage medium and computer readable instructions which reside, for example, in computer-readable storage medium of a computer system or like device. The non-transitory computer readable storage medium can be any kind of physical memory that instructions can be stored on. Examples of the non-transitory computer readable storage medium include but are not limited to a disk, a compact disk (CD), a digital versatile device (DVD), read only memory (ROM), flash, and so on. As described above, certain processes and operations of various embodiments of the present invention are realized, in one embodiment, as a series of computer readable instructions (e.g., software program) that reside within non-transitory computer readable storage memory of a cellular device 100, 200 (Figures 1A-2) and are executed by a hardware processor of the cellular device 100, 200. When executed, the instructions cause a computer system to implement the functionality of various embodiments of the present invention. For example, the instructions can be executed by a central processing unit associated with the cellular device 100, 200. According to one embodiment, the non- transitory computer readable storage medium is tangible.
[00250] Unless otherwise specified, one or more of the various embodiments described herein can be implemented as hardware, such as circuitry, firmware, or computer readable instructions that are stored on non-transitory computer readable storage medium. The computer readable instructions of the various embodiments described herein can be executed by a hardware processor, such as central processing unit, to cause the cellular device 100, 200 to implement the functionality of various embodiments. For example, according to one embodiment, the SUPL client 101 and the operations of the flowcharts 400-1 100 depicted in Figures 4-1 1 are implemented with computer readable instructions that are stored on computer readable storage medium, which can be tangible or non- transitory or a combination thereof, and can be executed by a hardware processor 109 of a cellular device 100, 200..
II. IMPROVING POSITION DETERMINATION OF A CELLULAR DEVICE USING CARRIER PHASE SMOOTHING
OVERVIEW OF DISCUSSION
[00251] At times a current position fix can differ significantly from one or more previous position fixes or succeeding position fixes, or a combination of previous position fixes and succeeding position fixes. A position fix that differs significantly from one or more previous position fixes or succeeding position fixes, or a combination thereof, is referred to as an "outlier." Further, locally measured movement information obtained, for example, from hardware, such as an accelerometer or an image capturing device, may be used to validate the accuracy of a position fix, to discard a position fix that is an "outlier," or to calculate a new position fix that can replace the discarded position fix, or a combination there of. [00252] A position fix may be determined to be an "outlier" based on the accuracy of that position fix. Validating accuracy of a position fix, discarding a position fix that is an "outlier," and calculating a new position fix to replace a discarded position fix based on locally measured movement information are each examples of improving position determine of a cellular device using locally measured movement information. A filter can be used to perform one or more of the validating of the accuracy of a position fix, the discarding of the position fix, the calculating of a new position fix and the replacing of the discarded position fix.
[00253] The locally measured movement information that is used to determine to remove a position fix or to calculate a new position fix that will replace the removed position fix can be from dissimilar kinds of sensors. An accelerometer and an image capturing device are examples of sensors that are dissimilar with respect to each other. A filter can be used to integrate (also known as "blend") the locally measured movement information from the dissimilar sensors together, for example, using weighting factors, as discussed herein.
[00254] Locally measured movement information, according to one embodiment, is information that includes measurements of movement where the movement and the measurements of the movement occur locally with respect to a cellular device. For example, an accelerometer that is attached or part of a cellular device can be used to measurement the distance that the cellular device has moved. In another example, one or more images obtained with an image capturing device that is attached or part of the cellular device can be used to measure the distance the cellular device has moved.
[00255] According to various embodiments, there are at least two processes that execute concurrently. The first process extracts raw pseudorange information, which is uncorrected and unsmoothed, from a GNSS chipset embedded in the cellular device, determines position fix(es) based on the extracted raw pseudoranges and optionally smoothes, for example, by discarding one or more of the position fix(es) using locally measured movement (LMM) information. The extracted raw pseudoranges may be corrected based on external corrections prior to determining the position fix(es). Examples of external corrections include WAAS, SBAS, DGPS, PPP, RTK, VRS and RTX corrections. External corrections are obtained from sources that are external to the cellular device.
[00256] The second process extracts raw pseudorange information, smoothes the extracted raw pseudorange information using carrier phase information, which may be either real or reconstructed carrier phase information, determines one or more position fixes based on the smoothed pseudorange information, and optionally performs additional smoothing by applying locally measured movement (LMM) information to one or more position fix(es). According to one embodiment, real carrier phase information is preferred over reconstructed carrier phase information. The smoothed pseudoranges (also referred to as "carrier phase smoothed pseudoranges") may be corrected based on external corrections prior to determining a position fix.
[00257] Carrier phase smoothing can be used to discard pseudoranges with larger changes in apparent size than might be expected, due to a variety of impairments, well- known in the Global Positioning arts. Locally measured movement (LMM) information can be used for determining which of the position fix(es) exhibit unexpected and unwanted changes. A position fix that exhibits unexpected or unwanted changes is an "outlier." The process of filtering (also known as "smoothing") position fixes involves, according to one embodiment, examining position fixes to determine which position fixes are "outliers," and discarding position fixes that are "outliers." Position fixes are smoothed as a part of applying locally measured movement (LMM) information to position fixes, according to one embodiment.
[00258] Typically it takes substantially longer to provide a position fix using the second process than with the first process because the second process gathers enough, such as a predetermined amount, carrier phase information to smooth the extracted raw pseudoranges before providing a position fix. Therefore, according to various embodiments, one or more position fixes may be provided using the first process while waiting for the second process to be capable of providing a position fix. Further, if carrier phase smoothing becomes unavailable or unreliable while using the second process, subsequent position fix(es) can be provided to the user from the first process instead of the second process. If carrier phase smoothing becomes available and reliable while using the first process to provide position fix(es), subsequent position fix(es) can be provided to the user from the second process instead of the first process. Thus, the providing of position fix(es) to a user can be switched between the two processes depending, for example, on whether carrier phase information is available and reliable.
[00259] According to one embodiment, the first process determines a first set of one or more position fixes based on the extracted raw pseudorange information and the second process determines carrier phase smoothed pseudoranges by smoothing the extracted raw pseudorange information based on carrier phase information, while the first process and the second process are executing concurrently. [00260] According to one embodiment, a preference hierarchy of options is used as follows where the hierarchy is ordered from highest preference to least preference: (1 ) smoothed corrected pseudoranges that were smoothed based on real carrier phase information, (2) smoothed corrected pseudoranges that were smoothed based on reconstructed carrier phase information, (3) unsmoothed corrected pseudoranges, and (4) unsmoothed uncorrected pseudoranges. The particular option that is used depends, for example, on what information is available. For example, real carrier phase information will be used if it is available. If it is not available, but Doppler Shift Information is available, then reconstructed carrier phase information will be used. If external corrections are available, the pseudoranges might be corrected. If external corrections are not available, the pseudoranges will not be corrected.
[00261] Figure 14 depicts a flow chart 1400 with at least two processes executing concurrently for providing position fix(es), according to various embodiments.
[00262] As depicted in Figure 14, an example of a first process includes one or more of operations 1413, 1416, 1418, optionally 1424, 1423, and 1426. One example of a second process includes one or more of operations 1413, 1416, 1415, 1428, optionally 1424, 1423, 1418, 1417, 1427, 1421 , optionally 1424, 1423, and 1426.
[00263] Examples of raw observables are raw pseudoranges, real carrier phase information and Doppler Shift Information. According to various embodiments, the raw pseudoranges are smoothed using real carrier phase information if real carrier phase information is available. If real carrier phase information is not available and Doppler Shift Information is available, the raw pseudoranges are smoothed using reconstructed carrier phase information that was reconstructed using Doppler Shift Information. If neither Real Carrier Phase Information nor Doppler Shift Information is available, then the raw
pseudoranges may be corrected from external correction data sources, a position fix determined, and then the position fix can be smoothed using locally measured movement information.
[00264] Flow chart 1400 includes two major operations 1410 and 1420. For example, at 1405 the method begins and proceeds to the first major operation 1410. The first major operation is 1410 where raw observables are obtained and stored. The obtained raw observables can be stored in memory 210. Processing proceeds to the second major operation 1420. The second major operation processes raw observables 1420. [00265] The two major operations 1410 and 1420 each include additional operations, according to various embodiments. For example, obtaining and storing raw observables 1410 includes operations 141 1-1418 and processing raw observables 1420 includes operations 1421 -1428.
[00266] Processing of 1400 starts at 1405 and proceeds to 1412.
[00267] At 1412, a determination can be made as to whether raw pseudoranges are available. If raw pseudoranges are not available, a message can be displayed at 141 1 indicating that position data is not available. If raw pseudoranges are available, processing can proceed from 1412 to 1413 and 1416. At 1413, raw pseudoranges can be obtained and stored. The raw pseudoranges can be obtained by extracting them from a GNSS receiver. The obtained raw pseudoranges can be stored in memory 210. At 1416, a determination can be made as to whether real carrier phase information is available from the cellular device. The real carrier phase information can be obtained by extracting it from a GNSS receiver. The obtained real carrier phase information can be stored in memory 210. If the cellular device is capable of providing real carrier phase information, processing can proceed to 1415; otherwise, processing can proceed to 1418.
[00268] At 1415, a determination is made as to whether enough, such as a predetermined amount, of real carrier phase information is available to perform smoothing. If enough real carrier phase information is available, processing proceeds to 1428, which is a part of processing raw observables 1420. According to one embodiment, enough real carrier phase information or Doppler shift information is obtained before pseudorange smoothing is performed.
[00269] At 1418, a determination is made as to whether Doppler shift information (DSI) is available. If Doppler shift information is available, processing proceeds to 1417. Doppler Shift information can be obtained by extracting it from a GNSS receiver. The obtained Doppler Shift Information can be stored in memory 210. If Doppler Shift
Information is not available, processing proceeds to 1424, which is a part of processing raw extracted observables 1420.
[00270] At 1416, a determination is made as to whether enough, such as a predetermined amount, of Doppler Shift Information is available. If enough Doppler Shift Information is available, processing proceeds to 1427, which is a part of processing raw extracted observables 1420. If enough Doppler Shift Information is not available, processing proceeds to 1424, which is a part of processing raw observables.
[00271] Obtaining and processing raw extracted observables 1410 includes 141 1- 1418. After processing 1415, 1417, and 1418, the raw extracted observables have been obtained and stored 1410. The raw extracted observables are processed at 1420, upon proceeding to 1427, 1428 and 1424.
[00272] At 1428, the raw pseudoranges obtained at 1413 are smoothed with the real carrier phase information that were obtained at 1415, according to one embodiment.
Processing proceeds to 1424.
[00273] At 1427, the Doppler Shift Information obtained at 1417, is used to provide reconstructed carrier phase information. Processing proceeds to 1421.
[00274] At 1421 , the pseudoranges obtained at 1413 are smoothed with
reconstructed carrier phase information. Processing proceeds to 1424.
[00275] At 1424, external corrections can optionally be applied to unsmoothed uncorrected pseudoranges obtained at 1418, smoothed uncorrected pseudoranges obtained at 1421 or 1428. Processing proceeds to 1423.
[00276] At 1423, a position fix is calculated based on the pseudoranges, which are any one of unsmoothed uncorrected pseudoranges from 1418, smoothed uncorrected pseudoranges from 1421 or 1428, unsmoothed corrected pseudoranges from 1424 when 1424 is proceeded by either 1417 or 1418, and smoothed corrected pseudoranges from 1424 when 1424 is proceeded by either 1428 or 1421 .
[00277] At 1425, locally measured movement information can optionally applied to the position fix calculated at 1423 to provide additional smoothing. Processing proceeds to 1426.
[00278] At 1426, the position fix is provided to the user. Processing proceeds to 1430.
[00279] At 1430, the method stops. [00280] Raw observables can be or can become unreliable or unavailable for many reasons, such as the cellular device being obstructed from receiving the GNSS signals containing the raw observables because it is under a tree, a structure or obscured by surroundings. However, there are other reasons why the raw observables may be or may become unreliable or unavailable. A time threshold can be used to determine when enough, such as a predetermined amount, data has been received, for example, at 1415 and 1416 as a measure of reliability and availability, according to various embodiments. However, various embodiments are well suited to using other metrics for determining reliability and availability such as consistency of signal to noise ratio (SNR) and other metrics such as dilution of precision (DOP).
[00281] According to various embodiments, if raw pseudoranges are available (1412), the raw pseudoranges are smoothed (1421 ) using real carrier phase information if enough, such as a predetermined amount, real carrier phase information is available (1416, 1415). According to various embodiments, the result of smoothing based on real carrier phase information, smoothing based on reconstructed carrier phase information or neither can be used to determine a position fix (1423), optionally corrected by applying external corrections (1424), optionally smoothed using locally measured movement information (1425) to provide a position fix or an improved position fix (1426).
[00282] As can be seen, a position fix may be determined based on the raw pseudoranges using the path 1413, 1416, 1418, skip 1424, 1423, a position fix may be determined based on smoothed pseudoranges that were smoothed based on real carrier phase information using the path 1413, 1416, 1415, 1428, optionally 1424, 1423, a position fix may be determined based on smoothed pseudoranges that were smoothed based on reconstructed carrier phase information using the path 1413, 1416, 1418, 1417, 1427, 1421 , optionally 1424, 1423. A position fix may be determined based on corrected pseudoranges, uncorrected pseudoranges, unsmoothed pseudoranges, smoothed pseudoranges, or a combination thereof.
[00283] According to one embodiment, the position fix, that is output at 1425, is a locally measured movement smoothed position fix. According to one embodiment, smoothed pseudoranges are determined at 1428 by applying carrier phase information to the raw pseudoranges. According to one embodiment, a carrier phase smoothed position fix is determined at 1423 based on the smoothed pseudoranges. According to one
embodiment, operation 1425 performs processing the position fix based on the locally measured cellular device movement information. [00284] As discussed herein, processing can switch between the first process and the second process, as discussed herein. According to one embodiment, the first process can provide a quicker and less expensive position fix than the second process because, for example, it uses less processing power. The second process can provide a higher accuracy position fix, for example, because the raw position fixes are smoothed with carrier phase information. Further, either one of the first process or the second process can be turned off, for example, when it is not being used to save power.
SYSTEMS FOR IMPROVING PSEUDORANGES BY FILTERING THE EXTRACTED
PSEUDORANGE INFORMATION
[00285] Figure 15A depicts a block diagram of a cellular device 1500A for providing improved position fix determination, according to one embodiment. Examples of a cellular device 1500A include a cell phone, a non-voice enabled cellular device, a tablet computer, and a mobile hand-held GNSS receiver. The cellular device 1500A may be mobile or stationary. Examples of a tablet computer are Microsoft Surface, Apple iPads, Apple iPad mini, Samsung Galaxy Tab families. According to one embodiment, a cellular device is a mobile communications device (MCD) with cellular communications capabilities (also referred to as a "cellular communication enabled mobile communications device").
According to one embodiment, a mobile communications device has communications capabilities, such as Wi-Fi or Bluetooth, or a combination thereof. According to one embodiment, a mobile communications device includes or communicates with one or more of a camera, compass, and accelerometer. Examples of a mobile communications device are tablet computers, laptops with detachable tablets, personal digital assistants, Trimble Juno, and similar devices.
[00286] As depicted in Figure 15A, the cellular device 1500A includes a GNSS chipset 170, a GNSS receiver 107, a processor 172 that is part of the GNSS receiver 107, a chipset accessor 141 , accessing logic 1510A, accessing logic 1 10B, pseudorange information extractor logic 142, an improved accuracy Secure User Platform Location (SUPL) client 1501A, a pseudorange information bridger logic 143, control logic 1520A, a pseudorange information processing logic 1550A, an operating system 160, a location manager logic 161 , a location displayer logic 162, hardware 1580A that is outside of the GNSS receiver 107. [00287] According to one embodiment, the hardware 1580A includes a hardware processor 109, hardware memory 210, accelerometer 1502A, and image capturing device 1540G. Raw observables, such as raw pseudoranges, real carrier phase information, Doppler Shift Information, data, such as corrected pseudoranges, uncorrected
pseudoranges, smoothed pseudoranges, unsmoothed pseudoranges, or a combination thereof, can be stored in memory 210 and processed using one or more hardware processors 109. According to one embodiment, the cellular device includes at least one hardware processor 109. According to one embodiment, the cellular device includes at least one hardware sensor, such as 1502A, 1540G.
[00288] Examples of an image capturing device 1540G (also referred to as an "imager") are a camera, a video camera, a digital camera, a digital video camera, a digital camcorder, a stereo digital camera, a stereo video camera, a motion picture camera, and a television camera. The image capturing device 1540G most often will use a lens, although use of a pinhole type device is feasible. The image capture device may also be a separate unit not embedded in the cellular device's body. Such a unit may be coupled to the cellular device's electronics via a cable or via a Bluetooth wireless link. Cellular devices, such as cell phones, have a multi-purpose connector for recharging the battery and for inputting or exporting data of many kinds to and from the cellular device's processor and memory.
[00289] The images may or may not have been obtained with an image capturing device that is a video device. Therefore, the images may be individual images taken with a non-video device or may be frames of a video taken with a video device.
[00290] Examples of an accelerometer 1502A are an ADXL330/335 chipset accelerometer made by Analog Devices Inc. and a LIS3LV02DQ made by
STMicroelectronics. Many other such products are available and commonly used in cellular devices, such as cellphones.
[00291] According to one embodiment, the processor 172 and the GNSS receiver 107 are a part of the GNSS chipset 170. According to one embodiment, the chipset accessor 141 , the accessing logic 1510A, the accessing logic 1 10B, pseudorange information extractor logic 142, the pseudorange information bridger logic 143, the improved accuracy SUPL client 1501 A, the operating system 160, and the hardware 1580A are located in a portion of the cellular device 1500A that is outside of the GNSS chipset 170. The location manager logic 161 can be a part of the operating system 160 and external to the GNSS chipset 170. According to one embodiment, the location displayer logic 162 is a part of the location manager logic 161. According to one embodiment, the chipset accessor 141 , the accessing logic 151 OA, the accessing logic 1 10B, pseudorange information extractor logic 142, the control logic 1520A, the pseudorange information processing logic 1550A, pseudorange information bridger logic 143, and improved accuracy SUPL client 1501A are application programming interfaces (API) function applications that reside in memory of the cellular device 1500A and are executed by a processor 109 of the cellular device 1500A.
[00292] According to one embodiment, the chipset accessor 141 , the accessing logic 1510A, the accessing logic 1 10B, the pseudorange information extractor logic 142, the control logic 1520A, the pseudorange information processing logic 1550A and pseudorange information bridger logic 143 are a part of an improved accuracy SUPL client1501A. For example, The SUPL client 1501A can interface between the GNSS chipset 170 and the location manager logic 161 , which resides in the operating system 160.
[00293] Many of the features depicted in Figure 15A have already been described herein. Therefore, in the interest of brevity, those features will not be described again.
[00294] The Improved Accuracy SUPL Client 1501 A can extract pseudorange information from the GNSS chipset 170 in a similar manner that the improved Accuracy SUPL client 101 can extract pseudorange information.
[00295] The pseudorange information processing logic 1550A, according to one embodiment, provides improved position fix determination by performing one or more of determining the accuracy of a position fix, removing a position fix that is an "outlier," (also referred to as "filtering"), calculating a new position fix to replace the removed position fix. The determination of the accuracy of a position fix, the removal of a position fix that is an "outlier," and the calculation of a new position to replace a removed position fix are each performed based on locally measured movement (LMM) that is measured by hardware 1502A, 1540G coupled with the cellular device 1500A, according to various embodiments. The output of the processing logic 1550A includes one or more position fix(es) 1560C.
[00296] According to one embodiment, the control logic 1520A controls the improving of the position fix determination using locally measured movement information. For example, the control logic 1520A can provide the processing directly itself or may communicate with other entities, such as the chipset accessor 141 , the accessing logic 151 OA, the pseudorange information processing logic 1550A, associated with the cellular device 1500A to provide the processing. [00297] According to one embodiment, incidental errors in true, world position or location in one or more of x, y, z, latitude, longitude, and altitude can be corrected with data from an accelerometer 1502A. According to one embodiment, an image capturing device 1540G can provide position shift information as the image capturing device 1540G is moved. According to one embodiment, the information from the image capturing device 1540G accumulates errors more slowly than information from the accelerometer 1502A. Errors in position shift information from the image capturing device occur due to extent of motion experienced, or distance traveled, as well as over time. For continuous travel, or constant motion, time passed is a viable metric for estimating error buildup. When distance travelled is small, as when a user is standing around, executing some movement of the cellular device 1500A but over limited distance range, the time-out period for declaring a specific error buildup for the image capturing device 1540G can be extended by a factor that ranges from 2-5-10. In an embodiment, integrating the use of the image capturing device 1540G and accelerometer 1502A may provide extended operational correction time durations.
[00298] According to one embodiment, the accessing logic 151 OA (Figure 15a) performs the operation 1410 (Figure 14) of obtaining and storing raw observables.
According to one embodiment, the pseudorange information processing logic 1550A (Figure 15a) performs the operation 1420 (Figure 14) of processing raw observables.
[00299] According to one embodiment, a system is provided that comprises one or more hardware processors 109 located in the cellular device 1500A and outside of a Global Navigation Satellite System (GNSS) chipset 170 embedded within the cellular device 1500A. The cellular device 1500A includes accessing logic 1 10B that accesses the Global Navigation Satellite System (GNSS) chipset embedded within the cellular device, wherein the GNSS chipset calculates raw observables that include raw pseudoranges and either Doppler shift information or real carrier phase information. The cellular device 1500A includes extracting logic 1 12B that extracts the raw observables from the GNSS chipset for processing elsewhere in the cellular device outside of the GNSS chipset. The cellular device 1500A includes position fix determining based on raw observables logic 170B that determines a position fix based on the raw observables. The cellular device 1500A includes locally measured movement information accessing logic 1510B that obtains locally measured cellular device movement information from at least one sensor that has a known physical relationship with the cellular device. The cellular device 1500A includes processing logic 1550A that applies the locally measured cellular device movement information to the position fix. The accessing logic 1 1 OB, the extracting logic 1 12B, the position fix determining based on raw observables logic 170B, the locally measured movement information accessing logic 151 OB, the processing logic 1550A are executed by the one or more processor 109.
[00300] Figures 15B-15H depict portions of a cellular device 1500A for providing improved position fix determination based on locally measured movement information, according to one embodiment.
[00301] Referring to Figure 15B, the cellular device 1500A includes accessing logic 151 OA. The accessing logic 151 OA includes locally measured movement information accessing logic 1510B. Optionally, the accessing logic 151 OA includes accessing logic 1 10B. As depicted in Figure 1 B, accessing logic 1 10B includes extracting logic 1 12B and receiving logic 1 14B. The movement information accessing logic 1510B includes accelerometer movement information accessing logic 1512A and image capturing device (ICD) movement information accessing logic 1512B.
[00302] Figure 15C depicts processing logic 1550A, according to one embodiment. The processing logic 1550A includes determining position fix logic 170B, carrier phase reconstructing logic 1520C, raw pseudorange smoothing based on CPI logic 1530C, limiting factor logic 1540C, and movement sensor smoothing logic 1510C. Optionally, the processing logic 1550A includes processing logic 150. The limiting factor logic 1540C includes accelerometer limiting factor logic 1542C and ICD limiting factor logic 1544C. The movement sensor smoothing logic 1510C includes accelerometer smoothing logic 1512C and ICD smoothing logic 1514C. The output of the processing logic 1550A is a position fix 1560C.
[00303] The processing logic 1550A, according to one embodiment, provides provided pseudoranges that is one of smoothed uncorrected pseudoranges, smoothed corrected pseudoranges, unsmoothed corrected pseudoranges, and raw pseudoranges. According to one embodiment, determining position fix logic 170B (also referred to as "position determination logic") determines a position fix based on the provided
pseudoranges.
[00304] According to one embodiment, the extracting logic 1 12b extracts additional raw pseudoranges from the GNSS chipset for processing elsewhere in the cellular device outside of the GNSS chipset; the position fix determining logic 170B further determines an additional position fix based on the additional raw pseudoranges; the locally measured movement information accessing logic 151 OB further obtains additional locally measured cellular device movement information from the at least one sensor; and the movement sensor position fix smoothing logic 1510C of the processing logic 1550A further applies the additional locally measured cellular device movement information to the additional position fix if a limiting factor is not exceeded.
[00305] Figure 15D depicts carrier phase reconstructing logic 1520C, according to one embodiment. The carrier phase reconstructing logic 1520C can be implemented with integration logic 1522D or filter 1524D, or both. The input of the carrier phase
reconstructing logic 1520C can be extracted Doppler shift information 1501 D. The output of the carrier phase reconstructing logic 1520C can be reconstructed carrier phase information 1502D. Either the integration logic 1522D or the filter 1524D can receive the extracted Doppler shift information 1501 D, process the extracted Doppler shift information 1501 D to create reconstructed carrier phase information 1502D.
[00306] Figure 15E depicts a raw pseudorange smoothing based on carrier phase information (CPI) logic 1530C. The raw pseudorange smoothing based on CPI logic 1530C can include Hatch logic 1532E or filter 1534E, or both. The Hatch logic 1530A is described in U.S. Patent No. 5,471 ,217 by Hatch et al., entitled "Method and Apparatus for Smoothing Coded Measurements in a Global Positioning System Receiver," filed February 1 , 1993, incorporated by reference herein, and the Hatch paper entitled "The synergism of GPS code and carrier measurements," published in the Proceedings of the Third International Geodetic symposium on satellite Doppler Positioning, New Mexico, 1982: 1213-1232The Hatch method as described in Patent No. 5,471 ,217 can be implemented with or without a filter. Therefore, the Hatch method may be used as a part of implementing the filter 1534E.
[00307] The input to the pseudorange smoothing based on CPI logic 1530C can be extracted raw pseudoranges 1501 E and carrier phase information (CPI) 1502E. The carrier phase information 1502E can be either real carrier phase information or reconstructed carrier phase information. The output of the raw pseudorange smoothing based on CPI logic 1530C is smoothed pseudoranges 1503E. The raw pseudorange smoothing based on CPI logic 1530C can smooth the extracted raw pseudoranges 1501 E with the CPI using either the Hatch logic 1532E or the filter 1534E to provide the smoothed pseudoranges 1503E. [00308] Figure 15F depicts a movement sensor position fix smoothing logic 1510C. The movement sensor position fix smoothing logic 1510C includes a filter 1512F. The inputs to the movement sensor position fix smoothing logic 1510C can be position fixes 1501 F and locally measured movement information 1502F. The output of the movement sensor position fix smoothing logic 1510C is smoothed position fixes 1503F. The smoothed position fixes 1503F are position fixes that locally measured movement (LMM) information has been applied to. Either or both of the accelerometer smoothing logic 1512C and the ICD smoothing logic 1514C can be implemented with a filter 1512F.
[00309] According to various embodiments, the processing logic discards at least one of the first set of position fixes based on the locally measured movement information, where the first process discards the at least one of the first set of position fixes based on the locally measured movement information. According to various embodiments, the processing logic discards at least one of the second set of position fixes based on the locally measured movement information, where the second process discards the at least one of the second set of position fixes based on the locally measured movement information. The discarding can be performed by movement sensor position fix smoothing logic 1510C in processing logic 1550A.
[00310] According to various embodiments, the processing logic 1550A obtains external corrections from a correction source that is external to the cellular device; provides, performed by the first process, corrected unsmoothed pseudoranges by applying the external corrections to the extracted raw pseudoranges; and determines, performed by the first process, the first set of position fixes based on the corrected unsmoothed
pseudoranges. According to various embodiments, the processing logic 1550A obtains external corrections from a correction source that is external to the cellular device; provides, performed by the second process, as described herein, corrected smoothed pseudoranges by applying the external corrections to the carrier phase smoothed pseudoranges; and determines, performed by the second process, the second set of position fixes based on the corrected smoothed pseudoranges.
[00311] According to various embodiments, various filters, such as filters 1524D, 1534E, 1512F, can be implemented using a Kalman Filter, robust estimation, least squares, particle filtering, Hough transform, RANSAC, sequential least squares, non-linear variants, such as sigma-editing, both a priori and a posteriori, and non-optimal (in a Gaussian sense) linear variants. [00312] Figure 15G depicts an image capturing device 1540G, for example, in a hip or belt mounted orientation, according to one embodiment. The image capturing device 1540G includes an entrance pupil 1542g and an axis 1543G that is at the center 1544G of the entrance pupil 1542g. Three axes x, y and z are depicted in Figure 15G. The x axis runs approximately parallel to the ground and parallel to the longer side of the image capturing device 1540G. The y axis runs approximately parallel to the ground and parallel to the shorter side of the image capturing device 1540G. The z axis is vertical to the ground and parallel to the gravity vector, which represents the pull of gravity toward the earth's surface and is widely used in coordinate measurement systems to provide at least one degree of orientation for devices.
[00313] The image capturing device 1540G is in a hip, belt or hat mounted
orientation. Therefore, the image plane 1550G that defines the orientation of an image captured with the image capturing device 1540G would be defined by the x axis and z axis and the ground plane 1560G that is approximately parallel to the ground would be defined by the x axis and the y axis.
[00314] When the cellular device is held in a user's hand, the body of the cellular device is often tipped so that it is no longer in a vertical orientation. In this case, the image capture device may view the nearby ground as well as objects in the foreground. No loss of functionality of position shift motion detection occurs for the LMM system.
[00315] Photogrammetry is the practice of determining the geometric properties of objects from photographic images. In the simplest example, the distance between two points that lie on a plane parallel to the photographic image plane can be determined by measuring their distance on the image, if the scale s of the image is known. This is done by multiplying the measured distance by a scale factor 1/S.
[00316] One way of finding points uses features to identify the desired object, or point on a desired object. An example of an object is a door and an example of points on the object are the corners of the door. The points may be described by a "feature description" of the object. For example, the door's corners may be represented by a small collection of closely associated details, or image 'bits' which form a distinct and recognizable image pattern. Modern image processing methods are available for identifying such grouping of image bits as "feature points." [00317] Figure 15H depicts a block diagram of an apparatus 1510H and K images 1524H, 1526H, through 1528H taken at respective locations using the image capturing device 1540G, according to various embodiments. The apparatus 151 OH includes memory 210, processor 109, algorithm 1521 H, mobile platform 1512H, 6'-Vector 1540H, navigation processor 107, additional navigation device 170, image capturing device 1540G, and lenses 1516H. According to one embodiment, the 6'-Vector 1540H includes the position
coordinates (x, y, z) as well as the orientation angles θ, φ, ψ.
[00318] The algorithm 1521 H can include an algorithm that uses MatchMove software, or improved algorithms such as the Sequential Rolling Bundle Adjustment algorithm, as discussed herein. Sequential Rolling Bundle Adjustment algorithm can be used to obtain coordinates and orientation of the image capturing device 1540G in real time, according to one embodiment. Other types of MatchMove algorithms can be used for algorithm 1521 H that are well in the image processing arts.
[00319] Figure 15H also depicts K images 1524H, 1526H, through 1528H in the i- frame: i is an integer, key-points 1530H, l2 1532H, ik 1534H in the respective images #1 1524H, #2 1526H, #K 1528H, position coordinates 1542H (xM, yM, zM), 1544H (xi2, yi2, zi2), 1546H (xik, yik, zik) for the respective key-points , i2, and ik.
[00320] In an embodiment, the additional navigation device 170 (including the navigation processor 107) is configured to provide the initial position coordinates and orientation of the image capturing device 1540G.
[00321] The image capturing device 1540G is mounted on the mobile platform 1512H. Examples of a mobile platform 1512H include a person, a car, a truck, a bike, a motorbike, a boat, etc. When the mobile platform 1512H is a person, the apparatus 151 OH can be attached to the person, for example, using a belt, a hat or some other kind of coupling mechanism. The apparatus 151 OH can be coupled to various parts of the person's body such as at the hip, the head, other parts of the person's body.
[00322] The image capturing device 1540G is configured to perform image capture of a scene. The algorithm 1521 H can be software instructions stored in memory 210 and executed by the processor 109 or can be hardware, such as an ASIC chip (or FPGA chip) (in analog or digital modes). The algorithm 1521 H is used as a part of analyzing the set of K- images 1524H, 1526H, ...1528H collected in each i-frame. [00323] Lens 1516H is for focusing. The focal length of lenses, i.e., the distance between the rears of the lenses (when focused on infinity) the imaging device, determines the angle of the view, or the field of view (FOV) and the size of objects as they appear as images 1524H, 1526H, and ...1528H. The image is focused on that surface by adjusting the distance between the lenses and the surface. Image capturing devices used in cell phones typically have fixed focal length imaging systems.
[00324] In an embodiment, the calibrated image capturing device 1540G is configured to collect the K images 1524H, 1526H, through 1528H in the i-frame: i is an integer. In an embodiment within each of the K images (1524H, 1526H, through 1528H) key-points are identified. The key-points are the features that are common in multiple frames. For example, in the first frame the key-points are: the key-point \ι 1530H in the image #1 1524H, the key point l2 1532H in the image #2 1526H, and key-point ik 1534H in the image #K 1528H. These key-points can be tracked in the following frames as discussed herein.
[00325] In an embodiment, referring still to Figure 15H, the obtained image data for the key-points ( 1530H in the image #1 1524H; i2 1532H in the image #2 1526H; ...iK 1534H in the image #K 1528H) is used within the algorithm 1521 H, as discussed herein, to estimate the position and orientation of the image capturing device 1540G: the '6'-vector 1540H including the position coordinates (x, y, z) as well as the orientation angles θ, φ, ψ. The obtained image data for the key-points ( 1530H in the image #1 1524H; i2 1532H in the image #2 1526H; ...iK 1534H in the image #K 1528H) is also used within the algorithm 1521 H to obtain the position coordinates of the key-points: position coordinates 1542H (χΜ, yn, Zii ) of the key-point , the position coordinates 1544H (xi2, y,2, zi2) of the key-point i2; and the position coordinates 1546H (xik, yik, zik) of the key-point ik.
[00326] Figure 151 depicts three points in a 3 dimensional (3D) field of view
representing feature points on one or more objects, and their locations in the image plane of the imaging device, according to one embodiment. For example, Figure 151 depicts a two dimensional (2D) projections on a 2D image plane 1550G (S) of points in view a field of view of a real 3D environment. More specifically, Figure 151 depicts a 2D projection 15341 (Ρ') of 3D point 15281 (P), which is a 2D projection 15301 (R') of 3D point 15241 (4), and 2D projection 15321 (Q') of 3D point 15261 (Q) on an image plane 1550G (s) by using an image capturing device 1540G and the lines between the 2D projection points 15301 (R'), 15321 (Q'), 15341 (Ρ') and their respective 3D points 15241 (R), 15261 (Q), and 15281 (P) intersect at intersection 15441. One or more points can be selected as key-points and the lines represent rays that can be bundled to form ray bundles, as will be discussed in more detail hereinafter. The intersection 15441 of the rays can be used to determine the 3D location of the points 15241 (R), 15261 (Q), and 15281 (P) using triangulation.
[00327] Figure 15J depicts a block diagram of a cellular device 1500J that is coupled to an image capturing device 1540J that is external to the cellular device 1500J, according to one embodiment. Examples of a cellular device 1500J include a cell phone, a non-voice enabled cellular device, a tablet computer, and a mobile hand-held GNSS receiver. The cellular device 1500A may be mobile or stationary. Examples of a tablet computer are Microsoft Surface, Apple iPads, Apple iPad mini, Samsung Galaxy Tab families.
[00328] As depicted the cellular device 1500J is coupled or in communication, or a combination thereof, with image capturing device 1540J. The cellular device 1500J, according to various embodiments, can include one or more of GNSS chipset 170, improved accuracy SUPL client 1501 A, operating system 160, and processor 109, memory 210, accelerometer 1502A.
[00329] The cellular device 1500J may or may not have an internal image capturing device 1540G of its own. Various embodiments as discussed herein, are well suited for the cellular device 1500J using LMM information from the external image capturing device 1540J. The image capturing device 1540J has a known physical relationship with the cellular device 1500J. For example, the physical relationship between the external image capturing device 1540J is fixed, and, therefore, does not change with respective to the cellular device 1500J. The physical relationship can be known since it is fixed. The physical relationship can be known in terms of at least distance or orientation between the image capturing device 1540J and the cellular device 1500J, or a combination thereof.
[00330] Figure 16 depicts a block diagram of a cellular device 1600 for improving position fix determination based on locally measured movement (LMM) information, according to one embodiment. As depicted in Figure 16, the GNSS chipset 170 is located on a system on a chip (SOC) substrate (SOCS) 1690. Other entities such as 1501 A, 160, and 1580A can also be located on the system on a chip substrate 1690.
[00331] As described herein, various types of information can be extracted from the GNSS receiver 107, such as pseudorange information, Doppler Shift Information, Real Carrier Phase Measurement, WAAS and SBAS. Other types of processing information output by the GNSS receiver 107 can be ignored. [00332] A cellular device 1600's hardware architecture includes discreet physical layout and interconnection of multiple chipsets for processing and for special purposes such as a GNSS chipset 170. In addition, newer architectures involve further integration of chipsets in the "system on a chip" (SoC) configuration. In this configuration, the GNSS chipset 170 can still be a complete element capable of delivering a PVT (position velocity and time) solution. However in an embodiment, the pseudorange information, carrier phase, and/or Doppler measurements, along with WAAS corrections if available, are extracted prior to further signal processing in the GNSS chipset 170 and are processed using different algorithms and corrections data for developing an improved accuracy PVT solution. In so doing the deleterious effects of multipath and other error sources may be minimized.
Further the GNSS chipset 170 outputs are ignored and not displayed when the external processing is employed and the higher-accuracy PVT data is available.
[00333] Many of the features depicted in Figure 16 have already been described herein. Therefore, in the interest of brevity, those features will not be described again.
[00334] Figure 17 depicts a block diagram of a cellular device 1700 and multiple sources for providing positioning correction information to the cellular device 1700 for processing pseudorange information, according to one embodiment. Many of the features depicted in Figure 17 have already been described herein. Therefore, in the interest of brevity, those features will not be described again. The cellular device 1700 also includes an image capturing device 1540G and an accelerometer 1502A.
[00335] Examples of a cellular device 1500A, 1500J, 1600, 1700 include a cell phone, a non-voice enabled cellular device, a tablet computer, and a mobile hand-held GNSS receiver. The cellular device 1500A may be mobile or stationary. Examples of a tablet computer are Microsoft Surface, Apple iPads, Apple iPad mini, Samsung Galaxy Tab families. According to one embodiment, a cellular device is a mobile communications device (MCD) with cellular communications capabilities (also referred to as a "cellular communication enabled mobile communications device"). According to one embodiment, a mobile communications device has communications capabilities, such as Wi-Fi or Bluetooth, or a combination thereof. According to one embodiment, a mobile communications device includes or communicates with one or more of a camera, compass, and accelerometer. Examples of a mobile communications device are tablet computers, laptops with detachable tablets, personal digital assistants, Trimble Geo-7, Trimble Juno, and similar devices. [00336] The blocks that represent features in Figures 15A-17 can be arranged differently than as illustrated, and can implement additional or fewer features than what are described herein. Further, the features represented by the blocks in Figures 15A-17 can be combined in various ways. A cellular device 1500A, 1600, 1700 (Figures 15A-17) can be implemented using software, hardware, hardware and software, hardware and firmware, or a combination thereof. Further, unless specified otherwise, various embodiments that are described as being a part of the cellular device 1500A, 1600, 1700, whether depicted as a part of the cellular device 1500A, 1600, 1700 or not, can be implemented using software, hardware, hardware and software, hardware and firmware, software and firmware, or a combination thereof. Various blocks in Figures 15A-17 refer to features that are logic, such as but not limited to, 170, 151 OA, 1 10B, 1520A, 1550A, 150, 1540C, 1510C, 1520C, 1530C, 1521 H, which can be implemented using software, hardware, hardware and software, hardware and firmware, software and firmware, or a combination thereof.
[00337] The cellular device 1500A, 1500J, 1600, 1700, according to one
embodiment, includes hardware, such as one or more of the processor 109, memory 210, sensors 1502A and 1540G, and the GNSS chipset 170. An example of hardware memory 210 is a physically tangible computer readable storage medium, such as, but not limited to a disk, a compact disk (CD), a digital versatile device (DVD), random access memory (RAM) or read only memory (ROM) for storing instructions. An example of a hardware processor 109 for executing instructions is a central processing unit. Examples of instructions are computer readable instructions for implementing at least the SUPL Client 1501 A that can be stored on a hardware memory 210 and that can be executed, for example, by one or more hardware processors 109. The SUPL client 1501 A may be implemented as computer readable instructions, firmware or hardware, such as circuitry, or a combination thereof.
APPLICATIONS
[00338] Various embodiments can be used for different types of applications or uses. For example, various embodiments could be used as a part of making a movie, surveying, determining the location of the cellular device, tracking a person or tracking valuable moveable items. SEQUENTIAL ROLLING BUNDLE ADJUSTMENT METHOD FOR REAL TIME IMAGE CAPTURING DEVICE POSE DETERMINATION
[00339] Referring to Figure 15G, image-based position tracking has been developed extensively to support movie-making. When inserting computer-generated images into movies for special effects, the graphics focal point must be aligned with the entrance pupil 1542G of the lens of the image capturing device 1540G. Any departure from perfect coincidence makes the final cut look fake. Therefore, the location of the entrance pupil 1542G must be captured in relation to the movie's environment. This means that the location [x, y, z] of the image capturing device 1540G and its orientation in space [roll, pitch, and yaw, or Euler angles], must be determined and stored by an apparatus, such as a cellular device, associated with the image capturing device 1540G. Collectively, the six parameters are referred to as obtaining the image capturing device 1540G's "pose." The method of choice is to use the imagery captured directly by an image capturing device 1540G that is a movie camera, however, various embodiments are also well suited using a sequence of individual images captured with an image capturing device 1540G that is not a movie camera.
[00340] The process involves tracking objects in the field of view of the image capturing device 1540G from one image frame to the next via feature detection methods, and then performing some mathematical processes to determine where the entrance pupil 1542G has to be in order to "see" the tracked features in the next frame as they are seen in the next frame image. The ray paths (also referred to as "rays") from a feature on an external object pass through the entrance pupil 1542G and are captured on the image capturing device 1540G. These ray paths from multiple features form a group of lines, commonly called a bundle. The location on the image plane 1550G for each feature is determined and stored for each captured image 1524H, 1526H...1528H. In the next image captured, if the image capturing device 1540G has moved, the location of the features in the image have moved and thus the entire collection of ray paths has changed. Previously identified features are again found by a matching technique. Their location in the second image is estimated. To determine where the image capturing device 1540G has moved, the first image 1524H's feature points are compared to their respective new locations in the second image 1526H and so on between subsequent image pairs. The comparison is done by creating a transformation or conversion matrix, which deals with all the data available. The transformation matrix also creates an estimate of the error in location for each feature data point from first image to second image. The image capturing device 1540G's location is adjusted iteratively until the errors are reduced as much as possible. When a suitable error minimum is achieved, the new location of the image capturing device 1540G is found, for the point where the second image 1526H was taken. Essentially the location of the entrance pupil 1542G is moved until many of the ray paths pass through the same point at the entrance pupil 1542G. The mathematical techniques are well-known and referred to in the literature as "bundle adjustments." and the family of computer programs developed to support this activity are often referred to as MatchMove. However, this canonical approach to performing bundle adjustments is a kind of brute force approach and requires a lot of computer processing. The terms of art used herein include: Full Bundle Adjustment, Rolling Bundle Adjustment, and Sequential Rolling Bundle Adjustment. Sequential rolling bundle adjustment achieves sufficient processing speed to enable real-time operation in an image capturing device 1540G and processor.
[00341] Typically a range of images is processed together, where the range of images anywhere from 10 to 50 and all data is used and processed. Recent developments have enabled real-time processing via a simpler alternate iterative method for incrementally determining the bundle adjustments by simply deleting the oldest image and adding one new image and then using an alternative mathematical method for determining the incremental change in image capturing device 1540G's pose that does not require as much computation. When implemented in a cellular device, the location shifts and orientation shifts that occur while the user, or other platform for the image capturing device 1540G, is moving can now be captured in real time.
[00342] The new method is known as "Sequential Rolling Bundle Adjustment," and is fully described in a patent application with U.S. Patent Application Serial Number
13/954,995, attorney docket number A-4134/Tank-332, by Shawn D. Weisenburger titled "Sequential Rolling Bundle Adjustment" filed July 31 , 2013 and assigned to the same assignee as this current application. A summary of the method follows.
[00343] Referring to Figure 29, the image capturing device 1540G can be modeled by a pinhole camera 2908 that captures light beams 2904 and 2906 passing through the pinhole 2902 for purposes of explanation.
[00344] Referring to Figure 15H, in an embodiment of the present technology, the lens 1516H further comprises regular rectilinear lens. Rectilinear lens is a lens in which straight lines are not substantially curved or distorted. Such lenses are commonly found in cell phone cameras. [00345] In an embodiment of the present technology, the lens 1516H further comprises a fisheye lens. A fisheye lens is a wide-angle lens that takes in an extremely wide, hemispherical image. Fisheye lenses are often used to shoot broad landscapes.
Fisheye lenses achieve extremely wide angles of view by forgoing a rectilinear image, opting instead for a special mapping (for example: equisolid angle), which gives images a characteristic convex appearance. A fisheye lens may be added to a cell phone camera via a clip-on device such as found in the product called the Olloclip; information about this product can be found at www.olloclip.com/product.
[00346] In an embodiment of the present technology, the image capturing device 1540G further comprises a stereo digital camera. A stereo camera is a type of camera with two or more lenses. This allows the camera to simulate binocular vision, and therefore gives it the ability to capture three-dimensional images, a process known as stereo photography. Cell phone cameras may be augmented by an image-combining device which emulates a true stereo camera by using a pair of lens separated by a short distance that provides two images delivered to the camera imager, which may be processed as a stereo pair. A device providing this stereo imaging capability is offered by HolgaDirect called the Holga 3D Lens Set for an Iphone; information about this device can be found at
http://shop.holgadirect.eom/products/holga-3d-set-lens-kit-iphone-4-5#. Stereo images may be processed via photogrammetric methods to reveal dimensional information about the objects in view, as well as distance information from image capturing device to an object.
[00347] In an embodiment of the present technology, referring still to Figure 15H, the image capturing device 1540G (camera) is calibrated. This calibration is used to correct the images for lens 1516H distortions. Typical calibrations correct for principal distance (focal length), principal point offset, radial distortion, tangential distortion, and other effects that can be found in any text book on photogrammetry. All image measurements are corrected with these calibration parameters.
[00348] In an embodiment of the present technology, referring still to Figure 15H, the calibrated image capturing device 1540G is configured to capture an i-th frame including K sub-images (1524H, 1526H, through 1528H); /' is an integer.
[00349] In an embodiment of the present technology, referring still to Figure 15H, within each of K sub-images (1524H, 1526H, through 1528H) the key-points is identified. The key-points are the features that are common in multiple frames. For example, in the first frame the key-points are: the key-point if 1530H in the sub-image #1 1524H, the key-point i2 1532H in the sub-image #2 1526H, and key-point iK 1534H in the sub-image #K 1528H. These key-points should be tracked in the following frames.
[00350] In an embodiment of the present technology, referring still to Figure 15H, the obtained image data for the key-points (/' 1530H in the sub-image #1 1524H; i2 1532H in the sub-image #2 1526H; ... /K 1534H in the sub-image #K 1528H) is used within the bundle adjustment algorithm to estimate the position and orientation of the image capturing device 1540G: the '6'-vector 1540H including the position coordinates (x, y, z) as well as the orientation angels θ, φ, and ψ.
[00351] In an embodiment of the present technology, referring still to Figure 15H, the obtained image data for the key-points (/' 1530H in the sub-image #1 1524H; i2 1532H in the sub-image #2 1526H; ... /K 1534H in the sub-image #K 1528H) is also used to obtain the position coordinates of the key-points: position coordinates 1542H (xi yi ζή) of the key- point i-i , the position coordinates 1544H (xi2, y,¾ zi2) of the key-point i2 , and so on; and finally, the position coordinates 1546H (xiK, γ,κ, ziK) of the key-point iK .
[00352] In an embodiment of the present technology, referring still to Figure 15H, the algorithm 1521 H includes the sequential rolling bundle adjustment algorithm, which is the further development of the full bundle adjustment algorithm.
[00353] Given a set of images depicting a number of 3-D points from different viewpoints, the bundle adjustment can be defined as the problem of simultaneously refining the 3-D coordinates describing the scene geometry as well as the parameters of the relative motion and the optical characteristics of the image capturing device 1540G (Figure 15H) employed to acquire these images, according to an optimality criterion involving the corresponding image projections of all points.
[00354] The correspondence problem refers to the problem of ascertaining which parts of one image (or frame) correspond to which parts of subsequent image (or frame), where differences are due to movement of the camera, the elapse of time, and/or movement of objects in the photos. More specifically, given two or more images (or frames) of the same 3-D scene, taken from different points of view and at different time, the
correspondence problem refers to the task of finding a set of points in one frame which can be identified as the same points in another subsequent frame. [00355] The correspondence problem can occur in a stereo situation when two images of the same scene are used, or can be generalized to the N-view correspondence problem. In the latter case, the images may come either from N different image capturing devices 1540G (cameras) photographing at the same time or from one image capturing device 1540G (camera) which is moving relative to the scene and collecting the image data from N-frames. The problem is made more difficult when the objects in the scene are in motion relative to the image capturing device(s) 1540G.
[00356] There are two basic ways to find the correspondences between two images: the correlation-based method, and the feature based method.
[00357] The correlation-based method includes checking if one location in one image looks/seems like another in another image.
[00358] The feature-based method includes finding features in an image and seeing if the layout of a subset of features is similar in the two images. To avoid the aperture problem a good feature should have local variations in two directions.
[00359] Example I.
[00360] To find the correspondence between set A [1 ,2,3,4,5] and set B [3,4,5,6,7] find where they overlap and how far off one set is from the other. Here we see that the last three numbers in set A correspond with the first three numbers in set B. This shows that B is offset 2 to the left of A.
[00361] In most camera configurations, finding correspondences requires a search in two-dimensions. However, if the two cameras are aligned to be coplanar, the search is simplified to one dimension - a horizontal line parallel to the line between the cameras. Furthermore, if the location of a point in the left image is known, it can be searched for in the right image by searching left of this location along the line, and vice versa).
[00362] To perform the simplified search in one dimension, an image rectification is used to perfect cameras' alignment. Image rectification is usually performed regardless of camera precision because it may be impractical to perfectly align cameras, and even perfectly aligned cameras may become misaligned over time. [00363] If the images to be rectified are taken from camera pairs without geometric distortion, a linear transformation can be used including: (i) X & Y rotation that puts the images on the same plane, (ii) scaling that makes the images to be of the same size, and (iii) Z rotation & skew adjustments are made to make the image pixel rows directly line up.
[00364] In performing the linear transform, if the cameras themselves are calibrated for internal parameters, an essential matrix provides the relationship between the cameras.
[00365] The more general case (without camera calibration) is represented by the fundamental matrix. If the fundamental matrix is not known, it is necessary to find preliminary point correspondences between stereo images to facilitate its extraction.
[00366] There are basically three algorithms for image rectification: planar rectification, cylindrical rectification, and polar rectification. A simple method is to compare small patches between rectified images. This works best with images taken with roughly the same point of view and either at the same time or with little to no movement of the scene between image captures, such as stereo images.
[00367] A small window is passed over a number of positions in one image, according to one embodiment. Each position is checked to see how well it compares with the same location in the other image. Also several nearby locations are also compared for the objects in one image may not be at exactly the same image-location in the other image. It is possible that there is no fit that is good enough. This may mean that the feature is not present in both images, it has moved farther than your search accounted for; it has changed too much, or is being hidden by other parts of the image.
[00368] The Hough transform (mostly used in the scale-invariant feature transform) is an algorithm important in understanding the full bundle adjustment algorithm. More specifically, the Hough transform is a feature extraction technique used in image analysis, computer vision, and digital image processing.
[00369] The purpose of the Hough transform technique is to find imperfect instances of objects within a certain class of shapes by a voting procedure. This Hough voting procedure is carried out in a parameter space, from which object candidates are obtained as local maxima in a so-called accumulator space that is explicitly constructed by the algorithm for computing the Hough transform. [00370] The classical Hough transform was concerned with the identification of lines in the image, but later the Hough transform has been extended to identifying positions of arbitrary shapes, most commonly circles or ellipses.
[00371] There are several examples of a feature-based 3-D reconstruction algorithm.
[00372] Scale-invariant feature transform (or SIFT) is an algorithm in computer vision designed to detect and describe local features in images. The algorithm was published by David Lowe in 1999. This algorithm uses the Hough transform. Applications include object recognition, robotic mapping and navigation, image stitching, 3-D modeling, gesture recognition, video tracking, individual identification of wildlife and match moving. The algorithm is patented in the US; the owner is the University of British Columbia. Please, see US Patent No.: 6,71 1 ,293, entitled "Method and apparatus for identifying scale invariant features in an image and use of same for locating an object in an image" and issued to David G. Lowe.
[00373] According to the scale-invariant feature transform (or SIFT) algorithm, for any object in an image, interesting points on the object can be extracted to provide a "feature description" of the object. This description, extracted from a training image, can then be used to identify the object when attempting to locate the object in a test image containing many other objects. To perform reliable recognition, it is important that the features extracted from the training image be detectable even under changes in image scale, noise and illumination. Such points usually lie on high-contrast regions of the image, such as object edges.
[00374] Another important characteristic of these features is that the relative positions between them in the original scene shouldn't change from one image to another. For example, if only the four corners of a door were used as features, they would work regardless of the door's position; but if points in the frame were also used, the recognition would fail if the door is opened or closed. Similarly, features located in articulated or flexible objects would typically not work if any change in their internal geometry happens between two images in the set being processed.
[00375] However, in practice SIFT detects and uses a much larger number of features from the images, which reduces the contribution of the errors caused by these local variations in the average error of all feature matching errors. [00376] Lowe's patented method can robustly identify objects even among clutter and under partial occlusion because his SIFT feature descriptor is invariant to uniform scaling, orientation, and partially invariant to affine distortion and illumination changes. This section summarizes Lowe's object recognition method and mentions a few competing techniques available for object recognition under clutter and partial occlusion.
[00377] SIFT key-points of objects are first extracted from a set of reference images and stored in a database. An object is recognized in a new image by individually comparing each feature from the new image to this database and finding candidate matching features based on Euclidean distance of their feature vectors. From the full set of matches, subsets of key-points that agree on the object and its location, scale, and orientation in the new image are identified to filter out good matches. The determination of consistent clusters is performed rapidly by using an efficient hash table implementation of the generalized Hough transform. Each cluster of 3 or more features that agree on an object and its pose is then subject to further detailed model verification and subsequently outliers are discarded. Finally the probability that a particular set of features indicates the presence of an object is computed, given the accuracy of fit and number of probable false matches. Object matches that pass all these tests can be identified as correct with high confidence.
[00378] "Match moving" is another 3-D reconstruction algorithm. In cinematography, match moving is a cinematic technique that allows the insertion of computer graphics into live-action footage with correct position, scale, orientation, and motion relative to the photographed objects in the shot.
[00379] Match moving is primarily used to track the movement of a camera through a shot so that an identical virtual camera move can be reproduced in a 3-D animation program. When new animated elements are composited back into the original live-action shot, they will appear in perfectly-matched perspective and therefore appear seamless.
[00380] By using SIFT or a match moving algorithm to analyze a set of image data captured by an image capturing device 1540G, it is possible to obtain the combination of position and orientation, or pose, of an object.
[00381] The pose can be described by means of a rotation and translation transformation which brings the object from a reference pose to the observed pose. This rotation transformation can be represented in different ways, e.g., as a rotation matrix or a quaternion. [00382] The specific task of determining the pose of an object in an image (or stereo images, image sequence) is referred to as pose estimation. The pose estimation problem can be solved in different ways depending on the image sensor configuration, and choice of methodology. Three classes of methodologies can be distinguished: analytic or geometric methods, genetic algorithm methods, and learning-based methods.
[00383] By using analytic or geometric methods, the image sensor (camera) is calibrated by using the mapping from 3-D points in the scene to the 2-D points in the image. If the geometry of an object is known, the projected image of the object on the camera image is a well-known function of the object's pose. Once a set of control points on the object, typically corners or other feature points, has been identified it is then possible to solve the pose transformation from a set of equations which relate the 3-D coordinates of the points with their 2-D image coordinates.
[00384] The Bundle adjustment algorithm is used as the last step of every feature- based 3-D reconstruction algorithm. It amounts to an optimization problem on the 3-D structure and viewing parameters (i.e., camera pose and possibly intrinsic calibration and radial distortion), to obtain a reconstruction which is optimal under certain assumptions regarding the noise pertaining to the observed image features.
[00385] If the image error is zero-mean Gaussian, then bundle adjustment is the Maximum Likelihood Estimator. Its name refers to the bundles of light rays originating from each 3-D feature and converging on each camera's optical center, which are adjusted optimally with respect to both the structure and viewing parameters.
[00386] In statistics, Maximum-Likelihood estimation (MLE) is a method of estimating the parameters of a statistical model. When applied to a data set and given a statistical model, maximum-likelihood estimation provides estimates for the model's parameters.
[00387] In general, for a fixed set of data and underlying statistical model, the method of maximum likelihood selects the set of values of the model parameters that maximizes the likelihood function. Intuitively, this maximizes the "agreement" of the selected model with the observed data, and for discrete random variables it indeed maximizes the probability of the observed data under the resulting distribution. Maximum-likelihood estimation gives a unified approach to estimation, which is well-defined in the case of the normal distribution and many other problems. [00388] Bundle adjustment boils down to minimizing the re-projection error between the image locations of observed and predicted image points, which is expressed as the sum of squares of a large number of nonlinear, real-valued functions.
[00389] The re-projection error is a geometric error corresponding to the image distance between a projected point and a measured one. It is used to quantify how closely an estimate of a 3-D point recreates the point's true projection.
[00390] Minimizing the re projection error can be used for estimating the error from point correspondences between two images. The correspondences can be interpreted as imperfect images of a world point and the re-projection error quantifies their deviation from the true image projections.
[00391] Thus, the minimization of the re projection error can be achieved by using nonlinear least-squares algorithms. Of these, Levenberg-Marquardt has proven to be one of the most successful due to its ease of implementation and its use of an effective damping strategy that lends it the ability to converge quickly from a wide range of initial guesses.
[00392] Marquardt recommended starting with a value A0 and a factor v > 1. Initially setting A = A0 and computing the residual sum of squares after one step from the starting point with the damping factor of λ = A0 and secondly with AQ/V. If both of these are worse than the initial point then the damping is increased by successive multiplication by v until a better point is found with a new damping factor of for some k.
[00393] If use of the damping factor A/v results in a reduction in squared residual then this is taken as the new value of A (and the new optimum location is taken as that obtained with this damping factor) and the process continues; if using A/v resulted in a worse residual, but using A resulted in a better residual, then A is left unchanged and the new optimum is taken as the value obtained with λ as damping factor.
[00394] When solving the minimization problems arising in the framework of bundle adjustment, the normal equations have a sparse block structure owing to the lack of interaction among parameters for different 3-D points and cameras. This can be exploited to gain tremendous computational benefits by employing a sparse variant of the Levenberg- Marquardt algorithm which explicitly takes advantage of the normal equations zeros pattern, avoiding storing and operating on zero elements. [00395] Bundle adjustment amounts to jointly refining a set of initial camera and structure parameter estimates for finding the set of parameters that most accurately predict the locations of the observed points in the set of available images.
[00396] The full bundle adjustment is the optimal solution and makes use of all images. However, it requires all images to be collected before any processing can be completed and is not a real-time solution.
[00397] In the pair-wise or triplet pose change technique, only 2 or 3 images are used to estimate the change in position and orientation over the image set. When summed up over many images, a trajectory can be estimated. For example, see the US Patent No.: 7336814 entitled "Method and apparatus for machine-vision." However, the solution provided by this a technology is prone to drift over time due to the loss of connection between even 2 or 3 images over time.
[00398] Kalman filter also can be used to estimate the current position and orientation (pose) of an object.
[00399] More specifically, the Kalman filter, also known as linear quadratic estimation (LQE), is an algorithm that uses a series of measurements observed over time, containing noise (random variations) and other inaccuracies, and produces estimates of unknown variables that tend to be more precise than those based on a single measurement alone.
[00400] The Kalman filter algorithm works in a two-step process. In the prediction step, the Kalman filter produces estimates of the current state variables, along with their uncertainties. Once the outcome of the next measurement (necessarily corrupted with some amount of error, including random noise) is observed, these estimates are updated using a weighted average, with more weight being given to estimates with higher certainty. Because of the algorithm's recursive nature, it can run in real time using only the present input measurements and the previously calculated state; no additional past information is required.
[00401] From a theoretical standpoint, the main assumption of the Kalman filter is that the underlying system is a linear dynamical system and that all error terms and
measurements have a Gaussian distribution (often a multivariate Gaussian distribution). [00402] However, a solution provided by the Kalman drifts over time due to loss of connection between images thus making it difficult to use the Kalman filter for real time applications.
[00403] The present technology of the rolling bundle adjustment is an improvement over the prior art techniques of bundle adjustment algorithm because it allows to significantly decrease the amount of computation time thus making possible the real time estimation of the pose of the image capturing device 1540G.
[00404] Indeed, as it is fully explained below, with each new frame, the rolling bundle adjustment algorithm prescribes removing the position and orientation states associated with the oldest frame and adding position and orientation states for the new frame. An initial estimate of the current frames position and orientation can be made by simply using the previous frames position and orientation estimate. The image locations of the key-points from the last frame are then identified in the new frame. These image measurements are then added to the estimation process using the method of sequential least squares which is much more efficient than completely running the bundle adjustment on the last N frames.
[00405] In the embodiment of the present technology, as shown in Figure 15H, the general processor 109 of Figure 15H is configured to execute the algorithm 1521 H further comprising a rolling bundle adjustment algorithm. The rolling bundle adjustment algorithm computes a bundle adjustment using N frames every time a new frame is available. This is the starting point for this new technique, however the rolling bundle adjustment algorithm uses sequential least squares to add the new frame rather than completely redo the bundle adjustment.
[00406] The rolling bundle adjustment algorithm of the present technology (also referred to as "sequential rolling bundle adjustment") is basically a cross between a Kalman filter and the rolling bundle adjustment. Although implemented using sequential least squares, the mathematics are identical to a Kalman filter that retains the previous N-1 frame position and orientation states.
[00407] Example II.
[00408] Figure 28 illustrates a frame from the video sequence 2860 including a set of sib-images 2886, 2888, and 2890 taken from a Nikon D 800 camera using a 35 mm lens. Each sub-image includes at least four key-points: sub-image 2886 includes the key-points 2862, 2864, 2866 and 2868, sub-image 2890 includes the key-points 2878, 2880, 2882 and 2884, and sub-image 2888 includes the key-points 2870, 2872, 2874 and 2876. The camera was set to collect 720 p video (1280 x 720) at 25 frames per second. Calibration
parameters for the camera/lens were pre-computed using the Open CV camera calibration routines. It should be noted that the calibration parameters may also be estimated on the fly as part of the process, however this was not done in this test. The round targets (1000- 101 1 ) (or key-points 2862, 2864, 2866 2868, 2870, 2872, 2874, 2876, 2878, 2880, 2882 and 2884), were tracked throughout the sequence while the camera was moved (keeping the targets in view at all times to simplify the test). For this example the number of frames used in the rolling bundle adjustment is 25, i.e. 1 second of data.
[00409] In order for the rolling bundle adjustment algorithm of the present technology to work, the system should be initialized. For example, the initial position coordinates of the image capturing device 1540G can be estimated by using the full bundle adjustment algorithm for N preceding frames. In another example, the additional navigation device 107 (Figure 15H) can be used to estimate the initial position coordinates of the image capturing device 1540G.
[00410] In an embodiment of the present technology, the key-points are identified by using 3 non-collinear targets with known absolute or relative positions. This can be done for the example by automatically identifying the target centers using an existing algorithm within Trimble. The choice of these points can be an important decision. If the initial set of points is able to sufficiently define a datum, the estimated camera positions and orientations can be in this datum and will be appropriately scaled.
[00411] In an embodiment of the present technology, before any estimation can be done, the key-points are identified by using a key-point detection algorithm such as SIFT, Surf, BRISK, etc. Many of these algorithms are already implemented within Open CV.
[00412] When natural features are used, an arbitrary coordinate system (not shown) can be defined. If a distance measurement is visible in the images it can be used to correctly scale the solution, otherwise the estimates will also be arbitrarily scaled (i.e. the estimated positions will require a similarity transformation to obtain world coordinates). Alternatively, if the location of the image capturing device 1540G can be determined via some other positioning system (say GNSS), these location estimates of the image capturing device 1540G can be used to scale the solution as well as define the required datum. [00413] In an embodiment of the present technology, referring still to Figure 15H, once the key-point 1530H has been found in the first sub-image 1524H, the corresponding key-points should be found in the following frames (not shown). This can be done by using key-point descriptors or tracking algorithms such as the Lucas-Kanade tracking algorithm.
[00414] The Lucas-Kanade method is a widely used differential method for optical flow estimation developed by Bruce D. Lucas and Takeo Kanade. It assumes that the flow is essentially constant in the proximity of the pixel under consideration, and solves the basic optical flow equations for all the pixels in that vicinity, by the least squares criterion. By combining information from several nearby pixels, the Lucas-Kanade method can often resolve the inherent ambiguity of the optical flow equation. It is also less sensitive to image noise than point-wise methods. On the other hand, since it is a purely local method, it cannot provide flow information in the interior of uniform regions of the image.
[00415] The Kanade-Lucas-Tomasi (KLT) feature tracker is an approach to feature extraction. It is proposed mainly for the purpose of dealing with the problem that traditional image registration techniques are generally costly. KLT makes use of spatial intensity information to direct the search for the position that yields the best match. It is faster than traditional techniques for examining far fewer potential matches between the images.
[00416] In an embodiment of the present technology, the sequential rolling bundle adjustment algorithm 1521 H (Figure 15H) needs at least 5 key-points for each frame.
[00417] In an embodiment of the present technology, as shown in Figure 31 , to ensure good geometry while also keeping the number of tracked features low is to segment the image 3180 into sections (3182, 3184, 3186, 3188, 3190, 3192, 3194, 3196 and 3198) and attempt to track a minimum two key-points (3100 and 3102) in each segment in the subsequent frames.
[00418] In an embodiment of the present technology, one of the requirements for the imagery is that the corresponding images (in consequent frames) have a significant overlap (say >50%) with one another. The frame rate required to maintain such overlap is dependent on the camera dynamics. Higher dynamics will require a higher frame rate.
[00419] In an embodiment of the present technology, an alternative approach to using a constant frame rate is to collect images whenever the camera moves a given distance or changes orientation by a maximum rotation. This approach requires a secondary source of position, velocity, and/or orientation to control the camera shutter.
[00420] In an embodiment of the present technology, referring still to Figure 15H, the collected image data is next fed into a least squares bundle adjustment algorithm 1521 H which estimates the position and orientation of the image capturing device 1540G for each frame (6 '-vector 1540h including the position coordinates (x, y, z) as well as the orientation angels θ, φ, and ψ) as well as the 3-D coordinates of the tracked key-points: position coordinates 1542h data (xn, y , Zn) for the key-point , the position coordinates 1544h data {Xiz Yi2, zi2) for the key-point i2 , and the position coordinates 1546h data (χ,κ, y,x, ziK) for the key-point iK .
[00421] The fundamental equations that are solved in the estimation are known as the collinearity equations. The collinearity equations are a set of two equations, used in photogrammetry and remote sensing to relate coordinates in a sensor plane (in two dimensions) to object coordinates (in three dimensions). The equations originate from the central projection of a point of the object through the optical center of the camera to the image on the sensor plane, also known as an image plane 1550G.
[00422] Figures 29, 151, and 30 illustrate the geometry that is utilized in collinearity equations.
[00423] More specifically, Figure 29 depicts light beams 2904 and 2906 passing through the pinhole 2902 of a pinhole camera 2908 for purposes of illustration. The pinhole camera 2908 is an example of an image capturing device 1540G.
[00424] As discussed herein, Figure 151 depicts three points in a 3 dimensional (3D) field of view representing feature points on one or more objects, and their locations in the image plane of the imaging device, according to one embodiment. .For example, Figure 151 depicts 2-D projection 15341 of 3-D point 15281 (2-D projection 15301 of 3-D point 15241, and 2-D projection 15321 of 3-D point 15261) on a plane 1550G by using a pinhole camera with the center 1544G.
[00425] Figure 30 illustrates a graph 3050 with an x axis 3052 and a z axis 3054 for plotting x and z coordinates of a 2-D projection of 3-D point through the center of a pinhole camera, according to one embodiment. For example, Figure 30 depicts x (3068) and z (3062) coordinates of 2-D projection C 3056 of 3-D point through a projection center 2902 of the pinhole camera 2908 of Figure 29, as well as x (3064) and z (3060) coordinates of 2-D projection P 3058 of 3-D point through the projection center 2902 of the pinhole camera 2908 of Figure 29.
[00426] Derivation and details of the collinearity equations can be found in any textbook on photogrammetry. One possible derivation (please, see for the reference "Elements of Photogrammetry" by Paul R. Wolf, published by McGraw-Hill, 2000) results in the following:
_ m21 Xa-Xi )+m22 (Yg-Yi )+m23 (Zg-ZQ
(Eq. 2) m31 (Xa-Xl )+m32 (Ya-Yl )+ m33 (Za-Zi )
< coscp cosK sinod sincp COS + cosco sin
— coscp sinK — sin i 5ίηφ sinK + cos i COSK
5ίηφ — sin i ΰ05φ
(Eq. 4)
where
xa is the measured x image coordinate of point a.
ya is the measured y image coordinate of point a.
Xa, Ya, Za are the world coordinates of point a.
X;, Yj, Z; are the world coordinates of camera I.
ω, φ, κ are the Euler angle rotations of camera I.
c is the principal distance (approximately the focal length of the camera), m is the rotation matrix from the camera coordinate system to the world coordinate system.
[00427] In an embodiment of the present technology, Figure 33 illustrates the geometry 3320 involved in formulation of collinearity equations (Eq. 1 and Eq. 2) with the matrix m given by (Eq. 3 and Eq. 4) that are utilized for estimation of the position and orientation of an image capturing device 1540G for each frame and for estimating 3-D coordinates of the tracked key-points. [00428] Referring still to Figure 33, 3-D coordinates (XA, YA, ZA) of 3-D point A in World Coordinate System (WCS) 3334 (with X axis 3326, Y axis 3324, Z axis 3322) are indicated by point 3332, whereas 3-D coordinates (XL, Y|_, ZL) of 3-D point of the image capturing device's center L in World Coordinate System (WCS) 3334 are indicated by point 3336.
[00429] Referring still to Figure 33, 2-D coordinates (xa, ya) of the point a in 2-D camera Local Coordinate System (LCS) (camera frame plane) 3330 are shown by point 3328. Figure 33 also depicts c 3338, which is the principal distance that is approximately the focal length of the image capturing device 1540G.
[00430] Example III.
[00431] Referring still to Figure 28, suppose that the 12 targets (2862, 2864, 2866, 2868, 2870, 2872, 2874, 2876, 2878, 2880, 2882, and 2884) are tracked and their coordinates are known. Each sub-image results in 2 measurements (x and y) per target per frame resulting in 2*12*25 = 1200 measurements for 25 frames. The unknowns in this example would be the position and orientation of the image capturing device 1540G (Figure 15H) (including camera Nikon D 800 camera using a 35 mm lens) per frame, i.e. 6*25 = 150 unknowns. Clearly the minimum number of image measurements should be 150/25/2 = 3. In the case where an additional 3 natural features are tracked, there would be additional 3*2*25 = 150 measurements as well as additional 3*3 = 9 unknowns (XYZ for each of the three points). Additional measurements to known or unknown points can add significant geometric strength to the estimation resulting in estimates with less noise.
[00432] In an embodiment of the present technology, the collinearity equations (Eq. 1 and Eq. 2) with the matrix m given by (Eq. 3 and Eq. 4) are re-formulated in terms of least squares adjustment for the purposes of optimal estimation.
[00433] More specifically, in an embodiment of the present technology, the basic least squares equations for the above problem are summarized as follows:
I = /(X) (Eq. 5) f = AS + w (Eq. 6) w=/(x°) - 1 (Eq. 7)
Cx = N"1 (Eq. 9) Where
I is a vector of adjusted observations
/(x) is the collinearity equations evaluated at x
x° is the current extimate of the state x.
f is a vector of residuals
A is a Jacobean matrix (partial derivatives of the collinearity equations w.r.t. the unknowns)
S is a vector of corrections to the unknown parameters
w is a vector of misclosures
C; is the covariance matrix for the measurements
C>¾ is the covariance matrix for the estimated parameters.
[00434] One of the most time consuming operations in the estimation is the inversion of the matrix (N) with the number of rows and columns equal to the number of unknown states. Given the iterative nature of least squares, this matrix may require inversion once per iteration.
[00435] In an embodiment of the present technology, as was disclosed above, once the initialization has been completed, the positions and orientations of the image capturing device 1540G for the first N frames have been estimated along with the positions of the selected key-points. The next step is to continue estimating the image capturing device 1540G's states as new subsequent frames {N+1, N+2, N+3, N+4, etc.) become available.
[00436] In an embodiment of the present technology, Figure 32 shows the rolling adjustment sequential update algorithm 3250 in estimation of image capturing device 1540G's positions and orientations from the initial N frames to the subsequent (N+1 ) frames.
[00437] Figure 32 depicts frames 3252-3270 along a frame number axis 3272 with the frame numbers 1 , 2, 3, 4, N, N+1 , N+2, N+3, N+4 for each of the respective frames 3252-3270. Figure 32 also depicts solutions 3274, 3276, 3280, and 3278 that correspond respectively with frame N, frame N+1 , frame N+2, and frame N+3.
[00438] The bundle adjustment algorithm solution 3250 based on the initial N frames (from 3252 and up to 3262) is schematically noted as the initial solution 3274, the bundle adjustment algorithm solution 3250 based on (N+1 ) frames (from 3252 and up to 3264) is schematically noted as the subsequent solution 3276, the bundle adjustment algorithm solution 3250 based on (N+2) frames (from 3256 through 3264) is schematically noted as subsequent solution 3278, and the bundle adjustment algorithm solution 3250 based on (N+3) frames (from 3258 through 3278) is schematically noted as subsequent solution 3280.
[00439] When a new frame becomes available, the oldest frame is removed from the state estimation. The rows and columns associated with the frame to be removed are replaced with initial estimates for the newest frame. This initial estimate of the camera position and orientation at the new frame may be computed from the estimated key-points or if the frame rate is high relative to the camera dynamics the estimate can simply be set to the same values as the previous frame.
[00440] In an embodiment of the present technology, the sequential rolling update is accomplished in a sequential manner using the following equations:
ί(-)
δ(+, = δΗ - * w2 + Α2δ (Eq. 10)
Vf1 - KA2N^ (Eq. 1 1 ) 1AT 2 [Cl + A2N 1AT 2 (Eq. 12) where (+), (-) indicate parameters before and after the measurement update.
[00441] The major advantage of this technique is that the only new inversion required for the sequential update is the matrix contained within the gain term K. The matrix to be inverted is a square matrix with the dimensions equal to the number of new measurements associated with the new image.
[00442] Example IV.
[00443] For the Examples II and II outlined above in which 12 key-points are tracked, the required inversion would be on a 24 x 24 matrix. This is compared to re-computing the bundle adjustment with all N frames which would require an inversion of a matrix with dimensions of 25*6 x 25*6 = 150 x 150.
[00444] One of the practical justifications of the present algorithm of sequential rolling bundle adjustment that utilizes images to track position and orientation changes is that some key-points will no longer be visible as the image capturing device 1540G (also referred to as "camera") moves. This requires that the no longer visible key-points be removed from the estimation as they no longer provide useful information. This removal is accomplished by simply removing the associated rows and columns in the state and covariance matrices. Also, as the image capturing device 1540G moves it will become necessary to identify and track new key-points and add them into the estimation. Once a new key-point is identified, it should be tracked over multiple images in order to compute initial coordinates which can then be used to insert the associated position into the state and covariance matrices.
[00445] Experimental data indicates that as the number of frames increases, the differences between the optimal solution and the sequential solution begin to approach one another, and however the cost is a slight increase in computational requirements. In an example, when N=25 the maximum difference is about 21 mm. Also, the time required to update a frame was approximately 25 msec on a laptop with an Intel i7 processor and no optimization of the software. Thus this method enables operation in real time.
[00446] In an embodiment, the computer-readable and computer-executable instructions may reside on computer useable/readable media.
[00447] Modern image capturing devices 1540G also have accelerometers built in, and so can also track their movements. With 3-axis accelerometers, again it is possible to track the cellular device's pose in real time, but the error build-up is quadratic. This error can be eliminated by periodic resetting the accelerometer, usually when the change in position or pose is close to zero. However, the reset results in a restart of tracked motion, from the new zero point. Since the error build up in image-based tracking systems is linear, image tracking can be used for longer time periods. Resetting an image tracking system may be done via the accelerometer as well.
[00448] The two pose tracking systems, image-based and accelerometer-based, may be combined via a Kalman filter with appropriate weighting functions to indicate a distance traveled during a given time interval. Knowing this distance as a kind of "truth" distance allows for additional filtering on GNSS observables and processed position fixes, to improve accuracy.
[00449] Therefore, one or more operations of various embodiments may be controlled or implemented using computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform particular tasks or implement particular abstract data types. [00450] Although specific steps of exemplary methods of implementation are disclosed herein, these steps are examples of steps that may be performed in accordance with various exemplary embodiments. That is, embodiments disclosed herein are well suited to performing various other steps or variations of the steps recited. Moreover, the steps disclosed herein may be performed in an order different than presented, and not all of the steps are necessarily performed in a particular embodiment.
MULTIPATH ERRORS
[00451] Various embodiments are well suited for correcting or compensating for errors caused by multipath in pseudorange estimates. For example, multipath error can occur as signals bounce on various objects, such as buildings or other objects, reflecting signals along many paths. Extracted pseudorange information is an example of
pseudorange estimates.
[00452] Multipath refers to the simultaneous processing in the GNSS receiver of both the desired GNSS signal and reflected versions of the desired GNSS signal that arrive a very short time after the desired signal. The two signals pass through the GNSS receiver and are processed by the down converter and the timing measurement systems that develop the pseudoranges. Instantaneous combining of the two signals, desired and slightly-later multipath, result in erroneous pseudoranges, which may be quite different in instantaneous magnitude from the true pseudorange that should have been determined.
[00453] Since it is very hard to shield a GNSS receiver/antenna system from such reflections, alternate means for coping with the interference have been developed. The Hatch method is particularly useful when carrier phase data is available, as carrier phase is not affected by multipath, and therefore can serve as a kind of yardstick to compare pseudorange data to (also known as "disciplining" the pseudoranges).
[00454] Multipath error can be reduced by smoothing pseudoranges using, for example, real carrier phase information or reconstructed carrier phase information. For example, assuming that the raw pseudorange smoothing based on CPI logic 1530C is implemented with a filter 1534E, the filter 1534E can remove "outlier" pseudoranges that do not conform to the extent of a change in pseudorange expected under the instant conditions, as measured by the covariance matrix. For example, if a sequence of pseudoranges contains the following data [pseudorange time estimates of the time for a timing signal to travel from a satellite to a receiver in second]: .0675, 00676, .0677 .0680, .0679.... the filter 1534E may delete the .0680 entry as an "outlier."
LOCALLY MEASURED MOVEMENT LLM
[00455] Locally measured movement information, abbreviated here as "LLM," according to one embodiment, is information that includes measurements of movement where the movement and the measurements of the movement occur locally with respect to a cellular device. For example, an accelerometer that is attached or part of a cellular device can be used to measure the distance that the cellular device has moved. In another example, a series of images obtained with an image capturing device 1540G that is attached or part of the cellular device can be used to measure the distance the cellular device has moved.
[00456] Referring to Figure 15G, movement can be measured in a plane that is parallel to the ground where the plane is defined by an x axis and a y axis, such as ground plane 1560G. Movement can also be measured along a z axis (also known as "height") that is perpendicular to the ground the determination of the x and y coordinates in position as well as time to fix can be improved. Most consistent results will occur when the cellular device with its image capturing device 1540G is oriented in a reasonably fixed direction. Wearing a cellular device on a belt hook or attached to a hat or some other type of platform, for example, can be used to maintain orientation. A front-facing or a rear-facing image capturing device 1540G can be used to view the surrounding area, according to one embodiment. If the image capturing device 1540G is held by hand, then whatever orientation is first used needs to be approximately maintained. However, modern cellular device accelerometers indicate orientation in all planes and software can accommodate any change is physical orientation of the cell device.
[00457] By prior arrangement, a mounted orientation may be referenced in the software that is used to define the imaging output, so that the image from the image capturing device 1540G can directly measure changes in a horizontal plane 1560G, parallel to the earth's surface, and perpendicular to the image plane 1550G of the image capturing device 1540G. Thus the image will be approximately perpendicular to the plane of the earth's surface. In this case, X and Z are directly viewable in the captured image. Y is in the plane 1560G that is approximately perpendicular to the captured image, and
approximately parallel to the earth. The image capturing device 1540G can measure left- right motion easily which is like a delta X whereas height Z is up-down. Depth view of the captured image provides Y information. However, all that is required for LMM operation is that either the accelerometers are operative and useful, or the image capturing device can see and track some features in its environment.
[00458] Various embodiments are well suited to other types of locally measured movement that can be used for improving position determination, as discussed herein.
PATTERNS OF USING MOVEMENT INFORMATION
[00459] Locally measured movement (LMM) information from one or more types of sensors can be used to provide improved position determination. Examples of a movement sensor are an image capturing device 1540G and an accelerometer 1502A.
[00460] Various patterns can be created by using one or more types of locally measured movement information. One pattern occurs when LMM is used from a single sensor. Another pattern occurs when LMM from two sensors are used simultaneously. Yet another pattern can occur when LMM from two sensors are mutually exclusively alternated with respect to one another. Yet still another pattern can occur when LMM from two sensors over lap at times and alternate at other times. These are just a few examples of patterns of using LMM that can be used according to various embodiments. These patterns can be modified to incorporate three or more sensors.
[00461] Figure 18A depicts a diagram of a pattern where locally measured movement information 1801 from an accelerometer is used to improve position determination, according to one embodiment. Axis 1801 A, 1802A, 1803A are for time, axis 1801 B is for distance 1812A measured by the accelerometer, axis 1802B is for position fix distance 1814A as determined by the movement sensor position fix smoothing logic 1510C using pseudorange information, axis 1803B is for the plot 1816a of real distance plot. Note that the circular elements in plot 1816B, the X elements in plot 1814B, and the cross-shaped elements in plot 1818b are data points corresponding to the user position where the cellular device is being held by the user. The LMM devices provide incremental distances from one measurement location to the next, as shown in Figure 18B at 1820B, 1821 B, and 1822B. The plot 1812A of the distance measured by the accelerometer is an example of locally measured movement information. The locally measured accelerometer distance plot 1812A is a plot 1816a of locally measured movement of the real distance of a cellular device as it is moving. The locally measured accelerometer distance, indicated in plot 1812A, is used to correct the position fix distance as indicated by plot 1814A. Therefore, the plot 1814A of the position fix distance approximates the real distance plot 1816A. As depicted, at time 181 OA, the accelerometer reaches a limiting factor.
[00462] Delta-GNSS 1840a is the difference between the last two position fix distances for the plot 1814A. Delta-LMM 1860A is the difference between the last two accelerometer distances for plot 1812a. Respective deltas may be calculated for any two successive position fixes or distances measured by a sensor, such as an image capturing device or accelerometer.
[00463] Figure 18B depicts a diagram of a pattern where locally measured movement information from an image capturing device 1540G is used to improve position
determination, according to one embodiment. Axis 1801 A, 1802A, 1803A are for time, axis 1804B is for the plot 1818B of the distances measured by the image capturing device, axis 1802B is for the plot 1814B of position fix distances as determined by the movement sensor position fix smoothing logic 1510C using pseudorange information, axis 1803B is for the plot 1816B of real distances. Plot 1818B is a plot of distances measured by the image capturing device, which is an example of locally measured movement information. The locally measured image capturing device distance plot 1818B is locally measured movement of the real distance, depicted in plot 1816B, of a cellular device as it is moving. The locally measured image capturing device distance, as indicated by plot 1818B, is used to correct the position fix distances as indicated by plot 1814B. Therefore, the plot 1814D of the position fix distances approximates the real distances plot 1816B.
[00464] Delta-GNSS 1840B is the difference between the last two position fix distances for the plot 1814B. Delta-LMM 1850a is the difference between the last two distances measured by the image capturing device for plot 1818B. Respective deltas may be calculated for any two successive position fixes or distances measured by a sensor, such as an image capturing device or accelerometer.
[00465] Figure 18C depicts a diagram of a pattern where locally measured movement information, as indicated by plots 1818C and 1812C, from an accelerometer and an image capturing device are continuously integrated together to improve position determination during a period of time and the image capturing device alone is used after the accelerometer reaches a limiting factor at time 1810C, according to one embodiment. Axis 1801A, 1802A, 1803A and 1804A are for time, axis 1801 B is for distance measured by the accelerometer plot 1812C, axis 1802B is for the position fix distances plot 1814C, axis 1803B is for real distances plot 1816C, and axis 1804B is for the plot 1818C of distances measured by an image capturing device. The position fix distance plot 1814C includes the position fixes 1821 C-1827C. Position fix 1826C is one of the position fixes in the position fix distance plot 1814C where 1826C is an "outlier." Position fixes"! 821 C-1825C precede position fix 1826C and position fix 1827C succeeds position fix 1826C. Distance, as indicated in plots 1812C and 1818C, measured respectively by the accelerometer's distance and the image capturing device's distance are examples of locally measured movement information. The locally measured distances plots 1812C and 1818C are locally measured movement of the real distance, as indicated by plot 1816A, of a cellular device as it is moving. The locally measured accelerometer's distance plot 1812C and the image capturing device's distance plot 1818C are used to correct the position fix distances, as indicated by plot 1814C.
Therefore, the plot 1814C of the position fix distance approximates the real distances plot 1816C, except for the position fix 1826C, which is an "outlier." The position fix 1828C is a new position fix that was determined based on a blend of locally measured movement (LMM) information from both an accelerometer and an image capturing device (also referred to as "blended locally measured movement information"). The new position fix 1828C can replace the "outlier" position fix 1826C, as discussed herein. As depicted, at time 1810C, the accelerometer reaches a limiting factor and is not used after time 1810C.
[00466] Delta-GNSS 1840c is the difference between the second and third position fixes for the plot 1814C. Delta-LMM 1850c is the difference between the two image capturing distances, which correspond to the second and third position fix, for plot 1818C. Delta-LMM 1860C is the distance between two accelerometer distances, which correspond to the second and third position fix, for plot 1812C. Respective deltas may be calculated for any two successive position fixes or distances measured by a sensor, such as an image capturing device or accelerometer.
[00467] Figure 18D depicts a diagram of a pattern where the position determination is improved by alternating the use of non-overlapping locally measured movement information from an accelerometer and an image capturing device as indicated by respective plots 1812D and 1818D, according to one embodiment. For example, from tO to t1 , only the accelerometer's locally measured movement information, as indicated by plot 1812D, is used, from time t1 to t2 only the image capturing device's locally measured movement information, as indicated by plot 1818d, is used. The locally measured accelerometer distances plot 1812D and the image capturing device's distances plot 1818D are used to correct the position fix distances, as indicated by plot 1814D. Therefore, the plot 1814D of the position fix distances approximates the real distances plot 1816D. At time 1810D, the accelerometer reaches a limiting factor and is not used after time 1810D. ESTIMATING A NEW POSITION WHEN THE GNSS POSITION FIX IS AN OUTLIER
[00468] Figure 18E depicts various graphs 1800E-3, 1800E-2, 1800E-1 for estimating a new position fix when a GNSS position fix is an outlier, according to various embodiments.
[00469] Graph 1800E-1 depicts a plan view, looking down at the ground from above, of the path a user is walking as they are holding their cellular device. There is an X-Y direction reference 1810E where x is the x direction that the user can walk and y is the y direction that the user can walk. Graphs 1800E-1 's x axis represents times to to ti+1. Since graph 1800E-1 is a plan view, the x axis also represents the direction that a person can walk in the x direction.
[00470] The graph 1800E-1 depicts the GNSS position fixes P1-P9 that the user traveled while carrying their cellular device and distances D1 -D9 between each of the respective pairs of GNSS position fixes P1 -P9. The distances D1-D9 are scalar distances traveled by the cellular device as measured by locally measured movement information, according to various embodiments. The position fixes P1 -P9 are absolute coordinates as measured by a GNSS receiver. The position fixes P1 -P9 are latitude longitude position fixes instead of distances traveled. Each of the position fixes occur at the respective times ti-7 to ti+1. P8 at time ti is an outlier 1803E. The real position fix for the user at time ti is depicted as real position fix 1804E.
[00471] Graph 1800E-2 depicts a comparison between distances calculated based on GNSS position fixes (also known as "GNSS position fix distances") and distances calculated based on locally measured movement information (also known as "LMM distances"), according to various embodiments.
[00472] The y axis represents scalar distances for the GNSS position fix distances and the LMM distances. The scalar distance is an absolute value. For example, an equation to compute the scalar distance between P(ti) and P(ti-1 ) is
[00473] II P(ti)— P(ti-1 ) II.
[00474] ΔΡ-io to ΔΡ87 represent distances calculated based on the GNSS position fixes P1-P8. D1-D8 represent distances calculated based on locally measured movement (LMM) information, where ΔΡ10 is the distance between P0 and P1 , ΔΡ2ι is the distance between P1 and P2 and so on. A distance between GNSS position fixes can be determined using an equation that subtracts a subsequent position fix P from a previous position fix P. For example, ΔΡ2ι can be calculated using the equation ΔΡ2ι= P2-P1. The graph 1800E-2 provides a comparison by depicting respective pairs together, such as D1 with ΔΡ10, D2 with ΔΡ21, and so on through D8 with ΔΡ87.
[00475] 1820E represents the maximum error allowed, also referred to herein as a metric threshold. As depicted in graph 1800E-2, the GNSS position fix distance ΔΡ87 exceeds the LMM distance D8 by ΔΡ, using the equation ΔΡ > D8 + maximum error 1820E. Therefore, the GNSS position fix P8 that corresponds with ΔΡ87 is determined to be an "outlier," according to one embodiment.
[00476] Image measured distances and accelerometer distances depicted in Figures 18A-18D are examples of LMM distances D1 -D8. Position fix distances depicted in Figures 18A-18D are examples of GNSS position fix distances AP10 to ΔΡ87.
[00477] Graph 1800E-2 depicts a GNSS position fix 1803E that is an "outlier" at time ti. The GNSS position fix 1803E was calculated using various embodiments, as discussed herein. To make it easier to compare the GNSS position fix 1803E with the real position, at position fix 1804E, graph 1800E-1 also depicts the GNSS position fix 1803E, which is the "outlier."
[00478] Graph 1800E-3 depicts a plan view of position fixes P(t0) to P(ti-1 ) taken respectively at times t0-t1 , according to one embodiment, where P(t0) to P(ti-1 ) depicted in graph 1800E-3 respectively are P0 to P8 depicted in graph 1800E-1. The x axis represents the direction the cellular device carried by the user travels in the x direction and the y axis represents the direction the cellular device travels in the y direction. In this illustration, for the sake of simplicity, it is assumed that the user is walking on near level ground.
Therefore, the graph 1800E-3 does not depict a z-axis since the z slope would be close to zero.
[00479] P(ti-2) and P(ti-1 ), which are position fixes taken respectively at times ti-2 and ti— 1 _ At time ti, graph 1800E-3 depicts an LMM estimate 1802E.
[00480] LMMave is equal to the scalar distance which in turn is equal to 1/N∑ LMM(t0,ti) where n = N a fixed number that represents the total number of data points. The letter M shall be used to represent slopes for LMM distances D1-D9. Therefore, the path in space from P(ti-2) to P(ti-1 ) is equal to MxX + MyY +MzZ + P(ti-2). [00481] A cellular device 1500A, 1500J, 1600, 1700 may be used to estimate the position in 3D space of a position fix given by the cellular device 1500A, 1500J, 1600, 1700 which is declared to be an "outlier," as discussed herein. In an embodiment, GNSS data created by a cellular device 1500A, 1500J, 1600, 1700 is stored, for example, in memory 210 as discussed herein. Examples of GNSS data include raw pseudoranges, corrected unsmoothed pseudoranges, corrected smoothed, uncorrected unsmoothed pseudoranges, uncorrected smoothed pseudoranges, smoothed pseudoranges, and various types of GNSS position fixes calculated, as discussed herein. LMM data generated by a sensor, such as 1502A, 1540G, 1540J, is stored, for example, in memory 210, as discussed herein. A distance traveled can be determined based on LMM data, according to various
embodiments.
[00482] A GNSS average distance travelled can be determined based on GNSS data for a variable number of time intervals, such as tO-ti. For the same intervals tO-ti, an LMM average distance traveled can be estimated using locally measured movement information. In an embodiment, when there is a discrepancy between the GNSS average distance traveled and the LMM average distance traveled, the GNSS position fix may be determined to be an outlier, and may be discarded.
[00483] In the event that an estimate 1802E of the discarded position 1803E is wanted, the real position 1804E's location in 3D (x, y and z coordinates) may be estimated by the following method. Let Ti represent the time that corresponds with the outlier position fix 1803E. In an embodiment, previous position fixes, such as P(ti-2), P(ti-1 ) depicted in graph 1800E-3, prior to the time of the outlier 1803E may be used to determine a vector direction that can give an indication of the expected direction of travel. This vector is based on calculating the mathematical slopes of the components of a line in space. Referring to graph 1800E-3, an example of a slope is the slope of the line between P(ti-2) and P(ti-1 ). Such slopes Mx, My, and Mz for the respective x, y and z coordinates, may be determined by well-known methods involving the data points for the previous 2 known positions, Ti-1 and Ti-2, as shown in Figure 18E. The average travel distance LMM, represented by LMMave, may be determined by averaging the previous position fixes for 2 or more previous positions, such as P(ti-2) and P(t-1 ). The estimated position of the replacement for the outlier 1803E may be determined by vector addition of the LMM average distance traveled scalar quantity to the vector position of the last known position fix at time Ti-1. The equation for this method is: [00484] Pest[Ti] = P[Ti-1 ] + LMMave x [Vector components Mx, My, Mz], where x and y are represented coordinates in 1810E and z represents height.
[00485] The LMM estimate 1802E depicted in graph 1800E-3 is an example of Pest[Ti]. The LMM estimate 1802E can be used to replace the GNSS position fix 1803E, according to various embodiments.
[00486] For example, the direction of the line between P(ti-2) and P(ti-1 ) is continued from P(ti-1 ) to PEsT(ti) so that P(ti-2), P(ti-1 ) and PEsT(ti) appear to be in a straight line.
Further, PEsi(ti) may be calculated by adding the distance D8 to the position fix P(ti-1 ), which is the last position fix that was determined to be sufficiently accurate, according to one embodiment. For example, Position fix P(ti-1 ) can be determined to be sufficiently accurate because D7 and ΔΡ2ι do not differ by the metric threshold 1820E.
[00487] This method, as depicted in the context of Figure 18E, may be performed in near-real time if the LMM distance is needed for other functions. Other embodiments are also useful. In an embodiment, a more sophisticated estimation procedure may be applied that takes more previous and successive data points into account, such as a curve-fitting method.
[00488] Referring to Figures 18A-18E, the interval for collecting position fixes and distances for an image capturing device or accelerometer can vary, for example, from 1/10th of a second to a second, according to one embodiment.
[00489] According to one embodiment, the metric threshold can range from 10 centimeters (cms) to 1 meter (m) or any other range of distance appropriate to the conditions of use.
[00490] For the sake of simplicity, Figures 18A-18E were depicted with movement information from one sensor or two sensors. If the movement information is from two or more sensors, the movement information can be blended based on weighting factors, as discussed herein. However, embodiments are well suited to a different number of sensors.
WEIGHTING FACTORS
[00491] Weighting factors (also referred to as "weights") can be used as a part of implementing the patterns of using movement information as depicted in Figures 18A-18E. A weighting factor determines how much of a sensor's output is used, for example, in a particular process. Weighting factors thus capture the relative importance of a sensor in operating the particular process. Weighting factors range from 0% to 100%, and all the weighting factors for all of the sensors of a cellular device that are being used at a point in time for a particular process generally add up to 100%. For example, if only one sensor is used, then then a weight of 100% may be used for the LMM information from that sensor. In another example, if a cellular device is using sensors a and b for improving position fix determination based on LLM information, then movement information for sensor a may have a weight of 10% while the weight of the other sensor b may have a weight of 90% where 10% and 90% totals 100%. In yet another example, when the cellular device includes sensors a and b, a weight of 55% may be used for the movement information from sensor a and a weight of 45% may be used for the movement information from sensor b where 55% and 45% total 100%.
[00492] According to one embodiment, the movement information from one of the sensors is not used, for example, by assigning it a weight of 0. For example, if the movement information for the accelerometer is assigned a weight of 0, then the
accelerometer's movement information is not used. Similarly, if a weight of zero is assigned to the movement information of an image capturing device, then the image capturing device's movement information is not used.
[00493] Further, a weight for a type of movement information may vary over time. For example, movement information from a single sensor a or b may have a weight of 10% from time tO to time t1 , then 15% from time t1 to time t2 and so on. In another example, when movement information from two or more sensors are used, a weight of 5% may be used for the movement information from sensor a and a weight of 7% may be used for the movement information from sensor b from time tO to time t1 and a weight of 8% may be used for the movement information from sensor a and a weight of 4% may be used for the movement information from sensor b from time t1 to time t2.
[00494] The weighting factor for the LMM information from a sensor of a plurality of sensor, according to one embodiment, is determined based on the quality the LMM information. For example, if the quality of the LMM information from sensor a is twice as good as the LMM information from sensor b, then the weighting factor for the LMM information from sensor a may be twice that of the weighting factor for the LMM information from sensor b. [00495] The quality of the LMM information for an accelerometer may be determined, for example, based on one or more of the quality of the accelerometer, the amount of time that has elapsed since the accelerometer was reset. The quality of the LMM information from an image capturing device may be determined, for example, based on the quality of the image capturing device, the number of features associated with the one or more images obtained with the image capturing device, the amount of distance that the image capturing device has been moved since it was reset, the number of key features and so on.
[00496] The blending, based on weights, of the locally measured movement information from two or more sensors can be used as a part of determining the accuracy of a position fix, discarding a position fix that is an outlier, or calculating a new position fix to replace the discarded position fix, or a combination thereof. The weighting factors can be used to take into account that there are error buildups that occur with the Locally Measured Movement information. The weighting factors can be time dependent according to rules. For example the weighting factor for the accelerometer may decrease over the time limit preset for providing acceptable accuracy. The decrease may be linear or exponential.
Similarly, the weighting factor for use of the image-based position shift estimator may also be decreased over time and over distance traveled. The sum of the two position shift sources may be weighted appropriately and then used in a second summation process as follows.
[00497] The utility of the LMM as a kind of "sanity check" on casting out position jumps in the GNSS-determined position fix arises because LMM based sources, such as an accelerometer and image capturing device, typically do not experience large position shifts themselves. So a first kind of test may be to 1 ) calculate the relative position fix changes for each type of sensor from a first time to a second time period; then blend the two LMM data sources together to get an LMM position shift. Then calculate the position shift determined by two successive GNSS-determined position fixes. By comparing these two successive GNSS-determined position fixes, a judgment can be made about the expected reliability of the GNSS-determined position fix.
[00498] For example, referring to Figures 18A-18C, let Delta-GNSS 1840A, 1840B, 1840C be the difference between two successive position shifts based on GNSS. Let Delta- LMM 1860A, 1850B, 1850C, 860C be the estimated position shift determined by the LMM sensors. If the difference between a respective Delta-GNSS and a Delta-LMM is greater than a predetermined threshold, then the GNSS position fix may be suspect, and may be discarded. For example, if the Delta-GNSS 1840A exceeds Delta-LMM 1860A for the accelerometer by a predetermined threshold, then the second position fix, which is used to calculate the Delta-GNSS 1840A, may be discarded. In another example, a Delta-LMM may be the blend of the Delta-LMMs 1850C, 1860C for two sensors. A blend of Delta-LMMs shall be referred to as a "bdl." If the Delta GNSS-1840c exceeds the blended Delta-LMM bdl by a predetermined threshold, such as threshold 1820 (Figure 18E), then the second position fix, which is used to calculate delta-GNSS 1840C, may be discarded. The discarded position fix may be replaced with a GNSS position fix data point that is calculated based on the Delta-LMM data 1860A, 1850B, 1850C, 1860C, blended Delta-LMM bdl, which is only a linear distance estimate. The calculated GNSS position fix data point may be determined by extending a vector from the previous GNSS data point, based on the previous 2 or 3 GNSS position fixes and their X, Y, Z coordinates. For example, referring to Figure 18A, a vector between the first and second position fix in plot 1814A can be used in calculating a GNSS position fix data point based on the Delta-LMM data 1860a that will replace the third position fix in plot 1814A. In this way, outliers may be discarded and replaced with new estimates of a position in space at the time of the discard.
[00499] Additionally, the LMM data may be used to both smooth and blend the GNSS position fix data, in another filter process. The use of a composite weighting factor for LMM data may include a time and distance-traveled dependency. In an embodiment, this pair of weighting factors are applied to the two Deltas described earlier: Delta-GNSS position shift at time period ti to ti+1 , and Delta-LMM composite position shift at the same time period. The blending /disciplining of any GNSS position fix can both be time dependent, in the following manner. As the lifetime of useful LMM data decreases, its weight may decrease, and the weight of the factor being applied to the Delta-GNSS position shift can be increased in opposite proportion, so the sum of the weighting factors is always one. This decrease in relative importance of LMM data is essential to minimize adding errors to a position fix estimate.
[00500] Therefore, the locally measured cellular device movement information is a blend of two or more locally measured cellular device movement information obtained from two or more sensors that are in the known physical relationship with the cellular device and wherein the method further comprises blending the two or more locally measured cellular device movement information based on weighting factors. According to various
embodiments, as described herein, the method further comprises changing the weighting factors over time based on respective quality of the two or more locally measured cellular device movement information. [00501] Resetting the LMM data sources may be done automatically according to various kinds of rules, which can be chosen by a designer. For the accelerometer, the accuracy becomes unacceptable after some time period, on the order of tens of seconds. A reset can be done by program control when the accelerometer movement data drops below a threshold, such as when relative movement is less than 2 cm. Similar methods can be applied to the image capturing device, based on time and distance travelled.
LIMITING FACTORS
[00502] A cellular device 1500A, 1600, 1700, according to one embodiment, includes limiting factor logic 1540C, where the accelerometer limiting factor logic 1542C pertains to limiting factor for the accelerometer 1502A and the ICD limiting factor logic 1544C pertains to limiting factors for an image capturing device 1540G.
[00503] Limiting factors can, for example, be used for determining whether to use movement information from a sensor, for example, due to the movement information being too inaccurate. For example, the accuracy of the movement information from an
accelerometer decreases over time. Therefore, according to one embodiment, the movement information from an accelerometer may be used from the time the accelerometer is set to a threshold of time. An example of a threshold of time for an accelerometer is approximately 10 seconds. The threshold of time depends on the quality of the
accelerometer where higher quality accelerometers will have a higher threshold of time than poor quality accelerometers. Higher quality accelerometers usually cost more and weigh more, so are not as appropriate as MEMS accelerometers, which are very small and light and fit with the overall design of a cellular device.
[00504] The accuracy of the movement information from an image capturing device depends, according to one embodiment, on the number of features that are in an image obtained with the image capturing device. For example, the more features that are in the image the more accurate the movement information from that image will be, up to a point of diminishing returns. According to one embodiment, movement information from an image is used when the number of features of the image is ranges from 6 to 200 points. According to one embodiment, the minimum number of points is 36 points with 6 degrees of freedom for x, y, z, roll, pitch and yaw, as 6 times 6 samples equals 36.
[00505] A technology known as match move, as discussed herein, can be used for measuring the amount of movement of a cellular device based on images taken with an image capturing device. [00506] According to one embodiment, a type of movement information is not used if the limiting factor for the corresponding type of sensor is exceeded. Examples of sensors are hardware image capturing devices and hardware accelerometers. For example, in one embodiment, if there are fewer than 200 features in an image, then the image is not used as movement information, according to one embodiment. The threshold number of features may be set higher or lower than 200 in other embodiments. In another example, if the movement of image capturing device has exceeded a distance threshold that would interfere with correlating features in respective images, then the image capturing device is reset to use a new reference image. For example, if the image capturing device has moved ten or more feet since the reference image was set, a new image may be used as the reference image. In yet another example, if approximately 10 seconds has passed since an accelerometer was reset, then the movement information from the accelerometer is not used.
[00507] According to one embodiment, the weighting factor for a type of movement information is set to zero when the limiting factor of that type of movement information is exceeded. For example, a weight of zero can be assigned for movement information of an image from a camera when there are fewer than approximately 36 features in the image. Similarly, a weighting factor of zero can be assigned for movement information from an accelerometer when 10 seconds has passed since the accelerometer was reset.
KALMAN FILTER
[00508] Many types of data estimation methods may be employed to smooth the data from any single source to remove outliers, or to combine the effects of multiple and different data sources, as may be found in the cellular device system described herein. Well-known methods include use of least squares, Bayes filtering, sequential least squares, particle filtering, other methods for robust estimation, the Hough transform, the Random Sample Consensus [RANSAC] method, and so forth, as is well-known in the estimation arts. The Kalman Filtering method is also well-suited to multi-variant blending of dissimilar data sets. It is described herein as one example of a suitable estimation method.
[00509] Figure 19 depicts an example Kalman Filter processing 1900, according to some embodiments. According to one embodiment, the Kalman Filtering process 1900 is performed by filtering logic 1524D, 1534E, 1512F. It should be appreciated that Kalman Filtering is well known. As such, Figure 19 and the associated discussion are utilized only to provide a high-level general description. Variations in the described procedures will occur during specific implementations of Kalman Filtering. The extended Kalman Filter and the unscented Kalman Filter represent some of the variations to the basic method. Generally speaking, Kalman Filtering is a basic two-step predictor/corrector modeling process that is commonly used to model dynamic systems. A dynamic system will often be described with a series of mathematical models. Models describing satellites in a Global Navigation Satellite System (GNSS) are one example of a dynamic system. Because the position of any satellite and/or the positions of all the satellites in a system constantly and dynamically change and the satellites output a signal that can be measured by a GNSS receiver, Kalman Filtering can be used in determining position fixes in a portion of a cellular device that is outside of the GNSS receiver. The models can also describe the position of a cellular device that includes GNSS receiver, for example, based on movement information.
[00510] Examples of inputs to the Kalman Filter processing 1900 are position fixes 1501 F and locally measured movement information 1502F. The Kalman Filter processing 1900 selects one or more position fixes for removal. The position fixes can then be smoothed by removing the selected position fix(es). Similarly, the Kalman Filter processing 1900 selects one or more extracted pseudorange information from one (or more) sensors for removal. The extracted pseudorange information can then be smoothed by removing the selected information. Examples of output from the Kalman Filter processing 1900 are predicted observations 1922, which may be used by other processes. Examples of the outputs are adjustments to a position fix, adjustments to Doppler shift information to reconstruct carrier phase information, or adjustments to extracted pseudorange information, according to various embodiments.
[00511] A basic Kalman Filter implemented using Kalman Filter processing 1900 typically has at least two major components 1910: states 191 1 and covariances 1912.
States 191 1 represent variables that are used to describe a system being modeled, at a particular moment in time. Covariances 1912 are represented in a covariance matrix that describes uncertainty, or lack of confidence, of states 191 1 with respect to each other at that same moment in time. Kalman Filter processing 1900 also handles noise, or unpredictable variability, in the model. There are two principal types of noise, observation noise 1941 and process noise 1921 . A Kalman Filter may handle additional noise types, in some
embodiments. Process noise 1921 describes noise of the states 191 1 as a function of time. Observation noise 1941 is noise that relates to the actual observation(s) 1940 (e.g., observed measurements) that are used as an input/update to Kalman Filtering process 1900.
Ill [00512] A prediction phase 1920 is the first phase of Kalman Filter processing 1900. Prediction phase 1920 uses predictive models to propagate states 191 1 to the time of an actual observation(s) 1940. Prediction phase 1920 also uses process noise 1921 and predictive models to propagate the covariances 1912 to time of the actual observation(s) 1940 as well. The propagated states 191 1 are used to make predicted observation(s) 1922 for the time of actual observation(s) 1940.
[00513] A correction phase 1930 is the second phase in the Kalman Filter processing 1900. During correction phase 1930, Kalman Filter processing 1900 uses the difference between the predicted observation(s) 1922 and the actual observation(s) 1940 to create an observation measurement residual 1931 , which may commonly be called the "measurement residual." Observation noise 1941 can be noise in actual observation(s) 1940 and/or noise that occurs in the process of taking the actual observation(s) 1940. A Kalman gain 1932 is calculated using both the covariances 1912 and the observation noise 1941 . The states 191 1 are then updated using the Kalman Gain 1932 multiplied by the observation measurement residual 1931. The covariances 1912 are also updated using a function related to the Kalman gain 1932; for example, in one embodiment where Kalman gain 1932 is limited to a value between 0 and 1 , this function may be 1 minus the Kalman gain 1932. This updating is sometimes referred to as the "covariance update." The Blending factor logic 1933 is logic for weighting the movement information and using the weighted movement information or not using the movement information, as discussed herein.
[00514] In some embodiments, if no actual observation 1940 is available, Kalman Filter processing 1900 can simply skip correction phase 1930 and update the states 191 1 and covariances 1912 using only the information from prediction phase 1920, and then begin again. Using the new definitions of the states 191 1 and covariances 1912, Kalman Filter processing 1900 is ready to begin again and/or to be iteratively accomplished.
[00515] Other applications of the Kalman Filter processing 1900 may include correcting smoothed pseudoranges or correcting unsmoothed pseudoranges by
incorporating various other external correction inputs such as DGPS, RTX, PPP, SBAS, WAAS, RTK, VRS and the like, as described herein. For example, any one or more of the correction logics 151A-151 G could be implemented with Kalman Filter processing 1900. Other algorithms for incorporating corrections to pseudoranges are well known in the position determination arts involving GPS and GNSS. [00516] Kalman Filter processing 1900 could be used for filter 1524D to provide reconstructed carrier phase information 1502D based on extracted Doppler shift information 1501 D.
[00517] Kalman Filter processing 1900 could be used for filter 1534E to smooth extracted raw pseudoranges 1501 E based on carrier phase information (CPI) 1502E, real or reconstructed, to provide smoothed pseudoranges 1503E.
[00518] Kalman Filter processing 1900 could be used for filter 1512F to apply locally measured movement (LMM) information 1502F to calculated position fixes 1501 F, as discussed herein.
[00519] Inputs to a Kalman Filter could include accelerometer data; image based position shift data; GNSS-based position fix data, with shifts in position vs. time; generic weighting factors such as length of time accelerometer data is valid; length of time image- based position shift data is valid; metric for discarding a GNSS position fix or position shift, for example, in terms of how many centimeters (cm) is allowable before discarding.
[00520] A Kalman Filter could calculate and output, for example, time-varying weighting factors; difference between GNSS position fix shifts and external sensor position shifts; a new position fix (also referred to as an "interpolated") based on locally measured movement (LMM) information to be used instead of a deleted position fix that is an "outlier."
[00521] The Kalman Filter's states 191 1 (also known as "state parameters") are the parameters that the Kalman Filter calculates and outputs, as discussed herein. According to one embodiment, the state parameters are estimated.
[00522] The Kalman Filter's measurement model 1910 represents how the measurements are related to the state parameters 191 1 and the measurement noise covariance matrix 1912 (i.e., the variances of each measurement). According to one embodiment, the measurements are estimated.
[00523] The Kalman Filter's System Model specifies how the state parameters evolve over time. Normally the system model is described in terms of a state transition matrix and system driving noise covariance matrix, such as x(k+1 ) = StateTransitionMatrix * x(k) + SystemDrivingNoiseCovMatrix, wherein the system model is model component 1910, the state transition model is states 191 1 , and the system driving noise covariance matrix is covariances 1912.
[00524] The Kalman Filter's initial conditions of the filters, according to one
embodiment, are given in terms of the initial state covariance matrix and the initial state vector.
[00525] The inputs and outputs for filter 1534E, according to one embodiment, for the raw pseudorange smoothing based on CPI (carrier phase information) logic 1530C is as follows:
[00526] Inputs: raw pseudoranges, carrier phase, reconstructed carrier phase. [00527] Outputs: Smoothed pseudoranges
[00528] The inputs and outputs for the Filter 1512F, according to one embodiment, for the movement sensor position fix smoothing logic 1510C is as follows:
[00529] Inputs: accelerometer data, image capture position shift data derived from Sequential Rolling Bundle Adjustment estimator; time dependent/distance dependent weighting factors.
[00530] Outputs: disciplined Position Fixes including (1 ) position fixes from GNSS receiver, unsmoothed [no LMM active], (2) position fixes from GNSS receiver, disciplined by LMM data, (3) position fixes from GNSS receiver wherein LMM data is substituted for discarded, and (4) GNSS position fixes.
METHODS FOR IMROVING POSITION FIX DETERMINATION
[00531] Figure 20A is a flowchart of a method 2000A for improving position fix determination of a cellular device using locally measured movement, according to one embodiment.
[00532] At 201 OA, the method begins.
[00533] At 2020A, the GNSS chipset embedded within the cellular device is accessed. The GNSS chipset calculates raw observables that include raw pseudoranges and one of either Doppler Shift Information or Real Carrier Phase Information. The GNSS chipset can be accessed in a manner similar to that described in the context of operation 620 of Figure 6.
[00534] At 2030A, the raw observables are extracted from the GNSS chipset for processing elsewhere in the cellular device outside of the GNSS chipset. For example, the raw observables can be extracted from the GNSS chipset in a manner similar to that described in the context of operation 630 of Figure 6. The extracted raw observables may be raw pseudoranges, raw pseudoranges and Real Carrier Phase information, or raw pseudoranges and Doppler Shift Information. The same or different commands may be used for extracting each of the types of raw observables. For example, the same command may be used to extract the raw pseudoranges, the real carrier phase information and the Doppler shift information, or similar commands may be used for extracting the raw pseudoranges, the real carrier phase information and the Doppler shift information.
[00535] At 2040A, a position fix is determined based on the raw observables. For example, a position fix may be determined based on the raw pseudoranges, a position fix may be determined based on smoothed pseudoranges that were smoothed based on real or reconstructed carrier phase information. A position fix may be determined based on corrected pseudoranges, uncorrected pseudoranges, unsmoothed pseudoranges, smoothed pseudoranges, or a combination thereof.
[00536] At 2050A, locally measured cellular device movement information is obtained from at least one sensor that is in a known physical relationship with the cellular device. Examples of a sensor that is internal to a cellular device are accelerometer 1502A and an image capturing device 1540G. Examples of a known physical relationship is a sensor that is internal to a cellular device, such as sensors 1502A or 1540G. However, a sensor with a known physical relationship with the cellular device may be external to the cellular device. Examples of an external sensor with a known physical relationship to a cellular device is image capturing device 1540J. Examples of locally measured cellular device movement information are depicted in plots 1812A, 1818B, 1818C, 1812C, 1812D, and 1818D.
[00537] At 2060A, the locally measured cellular device movement information is applied to the position fix. Examples of position fixes, which locally measured cellular device movement information can be applied to, are the position fixes depicted in the plots 1814A, 1814B, 1814C, 1814D and position fix 1560C. [00538] The locally measured cellular device movement information (also referred to as "LMM information") can be applied to the position fix. For example, the position fix may be discarded based on the application of the LMM information to the position fix. If the application of the LMM information results in determining the accuracy of a position fix, determining that the position fix is an "outlier," the position fix can be removed, the removed position fix can be replaced by a new position fix that is calculated based on LMM information, as described herein, among other things. Kalman Filtering Logic, such as filter 1512F using Kalman Filter processing 1900, can be used for determining the accuracy, determining if the position fix is an "outlier," removing the "outlier," calculating the new position fix, replacing the "outlier" with the new position fix, as discussed herein. The removal of one or more position fixes that are identified as "outliers" is also referred to as smoothing.
[00539] Figures 18A-18D depict various patterns of movement information that may be used from a single sensor or two sensors, according to various embodiments, as a part of applying movement information to one or more position fixes.
[00540] The blending factor logic 1933 is logic for weighting the movement information and using the weighted movement information or not using the movement information, as discussed herein. Blending factors logic 1933 can be used for determining how to blend the movement information based on one or more weights, as discussed herein. Various patterns of blending, as depicted in Figures 18A-18D, can result from the blending factors logic 1933. One or more weights can be used to achieve the patterns, as discussed herein.
[00541] Operation 2060A can be performed in pseudorange information processing logic 1550A. Operation 2060A shall be described in more detail in the context of Figures 21 -27C. Another example of operation 2060A is operation 1425 (Figure 14).
[00542] At 2070A, the method ends.
[00543] The processing of method 2000A can be performed in a loop for each determined position fix 1821 C-1827C as a user is moving. For example, LMM information can be applied to each position fix 1821 C-1827C. Further, LMM information can be used as a part of calculating a new position fix to replace each position fix that is discarded as the user is moving. [00544] Figure 20B depicts a flowchart of a method 2000B of improving position determination of a cellular device using locally measured movement information, according to one embodiment.
[00545] At 2010B, the method begins.
[00546] At 2020B, the accuracy of a position fix is determined.
[00547] For example, referring to Figure 18C, the accuracy of any one of the position fixes 1821 C-1827C may be determined. In this illustration assume that the accuracy of the position fixes 1821 C-1825C and 1827C indicate that they are acceptable and the accuracy of position fix 1826C is an "outlier."
[00548] Referring to Figure 18E, the accuracy of any one of position fixes P0-P9 may be determined. In this illustration, assume that the accuracy of the position fixes P0-P7 and P9 indicate that they are acceptable and the accuracy of position fix P8 is an "outlier," as discussed herein.
[00549] Embodiments are also well suited to using Delta-GNSSs 1840A, 1840B, 1840C, ΔΡ-io to ΔΡ87 , combined GNSS delta cdg and Delta-LMMs 1860A, 1850B, 1850C, 1860C, D1-D8 or blended LMM-Delta bdl, or a combination thereof, as described herein, for determining the accuracy of position fixes. A blended Delta-LMM bdl may be a blend of two or more LMM-Deltas that are blended using weighting factors as discussed herein.
[00550] At 2030B, a determination is made as to whether to discard a position fix based on the position fix's accuracy.
[00551] For example, referring to Figure 18C, in this illustration assume that position fix 1826C is selected to be discarded because the accuracy of position fix 1826C indicates it is an "outlier."
[00552] Referring to Figure 18E, in this illustration, assume that position fix P8 is selected to be discarded because the accuracy of the position fix P8 indicates it is an "outlier."
[00553] At 2040B, the selected position fix is discarded. [00554] For example, referring to Figure 18C, in this illustration, position fix 1826C is removed and, therefore, will not be output to a user as a position fix 1560C. Since the accuracy of position fixes 1821 C-1825C and 1827C indicate that they are not outliers, they will be output as position fixes 1560C.
[00555] In another example, referring to Figure 18E, in this illustration, position fixe P8 is removed and, therefore, will not be output to a user as position fixes 1560C. Since the accuracy of the position fixe P0 to P7 and P9 indicate that they are not outliers, they will be output as position fixes 1560C.
[00556] At 2050B, a new position fix can be calculated based on LMM information.
[00557] For example, a trajectory of the direction that the user of the cellular device is moving can be determined based on two or more of the position fixes that precede the discarded position fix. The distance indicated by LMM information from one or more sensors in combination with the trajectory can be used to estimate a new position fix of the cellular device. The LMM information can be a blend of two or more sensors using weights and patterns of blending, as discussed herein.
[00558] According to one embodiment, the trajectory can be determined using two previous position fixes with x, y and z coordinates. A vector direction can be determined based on the two position fixes that occur before the position discarded position fix. For example, assuming the third position fix depicted in plot 1814A (Figure 18A) will be discarded, the vector direction can be determined based on the first and second position fixes depicted in plot 1814A.
[00559] More specifically, referring to Figure 18C, assume that the discarded position fix 1826C indicated that the user moved 6 feet and the LMM information from the one or more sensors indicated the person moved 3 feet. Assume for the sake of illustration that two or more position fixes, such as for example, 1821 C-1825C (Figure 18C) that precede the discarded position fix 1826C indicate the trajectory that the cellular device is moving along. The new position fix 1828C can be determined based by adding the 3 feet to the position fix 1825C that immediately precedes the discarded position fix 1826C in the direction of the trajectory.
[00560] In another example, referring to Figure 18E, two or more calculated position fixes P0-P7 that precede the discarded position fix P8 can be used to determine a trajectory that the cellular device is moving along. For example, the position fixes P(ti-2), also known as P6, and P(ti-1 ), also known as P7, may be used could be used to determine the trajectory. There are a variety of other estimation methods to determine a best estimate for the vector direction that are well-known in the estimation arts.
[00561] The distance that the cellular device has traveled from 5 to 6 can be determined based on locally measured movement (LMM) information from one or more sensors (also referred to as "LMM distance"). The new position fix 1802E (also referred to as "PEsT(ti)" or "LMM position fix") can be determined by adding the LMM distance D8 to the calculated position fix P(ti-1 ), also known as P7, which immediately precedes the discarded position fix P8, in the direction of the trajectory.
[00562] The calculation of the new position fix 1802E is also referred to as
"interpolating," for example, because the calculation involves determining a trajectory, as discussed herein, and adding the "LMM distance" D8, which was determined based on the LMM information, that the cellular device has been moved between the preceding measurements (at ti-1 in this example) and the current measurements (at ti in this example). For example, if the position fix is not needed in real time, then the additional data points collected subsequent to the outlier position may also be used to determine a best fit position fix to replace the "outlier."
[00563] Although only two previous position fixes P(ti-2) and P(ti-1 ) were used to determine a trajectory for the example depicted on Figure 18E, embodiments are well suited to using more position fixes. The position fixes may precede the "outlier," succeed the "outlier," or a combination thereof.
[00564] At 2060B, the "outlier" position fix is replaced with the new position fix.
[00565] For example, referring to Figure 18C, position fix 1826C is replaced with the new position fix 1828C.
[00566] In another example, referring to Figure 18E, the calculated position fix P8is replaced with the new position fix 1802E, also known as Pest(ti).
[00567] At 2070B, the method 2000B ends. [00568] LMM-deltas can be compared to each other directly. An LMM position fix can be found by adding the LMM-delta for a given time period to a previously position fix. The previous position fix may be a position fix that was determined based on extracted raw pseudoranges or an LMM position fix. LMM position fixes can be compared directly with each other.
[00569] "Smoothing" position fixes can include, according to one embodiment, one or more of 2020B-20260B. The discarding (2040B) of a position fix and replacing (2050B) the discarded position fix with a new position fix is also referred to as "adjusting" or "modifying" a position fix. For example, the discarded position fix is adjusted or modified to be the new position fix.
[00570] Method 2000B can be performed iterative for each position fix 1821 C-1827C (Figure 18C), position fix P0-P9 (Figure 18E) in a loop. For example, in a first iteration of the loop, position fix 1821 C can be processed with method 2000B, then in a second iteration of the loop, position fix 1822C can be processed with method 2000B. In this illustration, the position fixes 1821 C-1825C, 1828C, 1827C would be output as position fixes 1560C (Figure 15C).
[00571] According to one embodiment, the method 2000B is performed by pseudorange information processing logic 1550A.
[00572] According to various embodiments, method 2000B can be performed as a part of operation 2060A (Figure 20A). A filter, such as filter 1512F, can be used to perform the method 2000B, according to various embodiments.
[00573] Although, for the sake of simplicity, flowchart 2000B was discussed in the context of Figure 18C and Figure 18E, various embodiments are well suited to other position fixes.
[00574] Figure 21 is a flowchart of a method 2100 of improving position determination of a cellular device using locally measured movement information from an image capturing device, according to one embodiment.
[00575] At 21 10, the method starts. Processing proceeds to 2120. [00576] At 2120, a determination is made as to whether a current image with movement information is available from the image capturing device. One or more images are taken with an image capturing device are examples of movement information.
[00577] If this is the first image taken with the image capturing device 1540G since it was reset, then the first image can be used as the current image. Otherwise, the next image taken with the image capturing device 1540G can be used as the current image.
[00578] If movement information is available, processing proceeds to 2125. If movement information is not available, processing proceeds back to 2120. Operation 2120 can be performed by ICD movement information accessing logic 1512B.
[00579] At 2125, if the current image is the first image or if movement the image capturing device exceeds a distance threshold, then reset the image capturing device to use the current image as a reference image. For example, the current image is used as a new reference image when the image capturing device 1540G movement exceeds a distance threshold since the current reference image was taken or since the previous image, depending on how far the image capturing device 1540G has been moved, or how much time has passed. The creation of an association between the current image and one or more previous images will be interfered with if the image capturing device 1540G has been moved too far or if too much time has passed. For example, a range of a distance threshold is approximately 3 to 10 feet when a new reference image may be taken. Typically a new reference image is taken and used if the image capturing device 1540G has moved about 10 feet or more. One of the limiting factors is being able to track original feature points in a previous reference image. A new reference image might take and used (also referred to as "renewing") after a movement of 3 feet. This renewal feature of the reference frame is variable and can be subject to experimental validation for the type of image obtained with the image capturing device 1540G. Operation 2125 can be performed by the ICD movement information accessing logic 1512B. Processing proceeds to 2130.
[00580] At 2130, the movement information of the current image from the image capturing device is accessed and stored. The movement information can be stored in memory 210. Memory 210 may be cleared after a period of time, or after an accumulation of a specified number of images. Since memory costs continue to decline, the size of memory may be determined by the use case, and in event, the use of external memory cards, such as SD, SDHC, etc., may prove to be sufficient. Operation 2130 can be performed by ICD movement information accessing logic 1512B. Processing proceeds to 2140. [00581] At 2140, a determination is made as to whether the movement information of the current image exceeds a limiting factor for that type of movement information. For example, according to one embodiment, a determination can be made as to whether there are at least 30 features associated with an image obtained from the image capturing device. The minimum may be increased based on environmental conditions. The minimum may be factory set or adjustable in the field.
[00582] If the limiting factor is exceeded, then processing proceeds back to 2120. For example, if there are less than 30-50 features associated with the image, then the image is not used and processing proceeds to 2120. This number of minimum feature set may be as low as 10. Accuracy will decrease with the decrease in feature set size.
[00583] If the limiting factor is not exceeded, the processing proceeds to 2150. For example, if there are more than approximately 100-200 features associated with the image, then the image can be used to improve the quality or improve the accuracy of the extracted pseudorange information at 2150. Operation 2150 can be performed by ICD limiting factor logic 1544C.
[00584] At 2150, the LMM information is applied to the position fix, for example, as described by operation 2060A and/or flowchart 2000B.
[00585] Figure 22 is a flowchart of a method 2200 of improving position determination of a cellular device using locally measured movement information from an accelerometer, according to one embodiment.
[00586] At 2210, the method begins. Processing proceeds to 2220.
[00587] At 2220, a determination is made as to whether the cellular device is moving. If the cellular device is not moving, processing proceeds to 2230. If the cellular device is moving, processing proceeds to 2270. The accelerometer 1502A can be used to perform 2220.
[00588] At 2230, the accelerometer and the time are reset to zero. The
accelerometer movement information accessing logic 1512A can perform operation 2230. Processing can proceed to 2240. [00589] At 2240, movement information is obtained from the accelerometer and stored. The movement information can be stored in memory 210. The accelerometer movement information accessing logic 1512A can perform operation 2230. Processing can proceed to 2250.
[00590] At 2250, a determination is made as to whether a limiting factor of the accelerometer has been exceeded. For example, a determination can be made as to whether approximately 10 seconds have passed since the time was set to zero at 2230. If the limiting factor has been exceeded, then processing can proceed to 2270. For example, if more than approximately 10 seconds have passed since the time was set to zero at 2230, the processing can proceed to 2270. If the limiting factor has not been exceeded, then processing can proceed to 2260. For example, if approximately 10 seconds have not passed since the time was set to zero at 2230, then processing can proceed to 2260.
Accelerometer limiting factor logic 1542C can perform operation 2250.
[00591] At 2260, LMM information from the accelerometer is applied to a position fix, for example, as described by operation 2060A and/or flowchart 2000B
[00592] At 2270, optionally a message can be displayed to the user asking the user if the user wants to stop moving the accelerometer so that it can be reset because a limiting factor has been exceeded. Accelerometer limiting factor logic 1542C can perform operation 2270. Processing can proceed to operation 2220.
[00593] According to one embodiment, one or more position fixes are passed through an LMM smoothing process, such as movement sensor position fix smoothing logic 1510C, even if no locally measured movement information is currently available. For example, even if the accelerometer is past a threshold, such as 10 seconds, and the image capturing device is not turned on, so the locally measured movement information is not available, one or more position fix(es) may still be passed through the movement sensor position fix smoothing logic 1510C.
[00594] The first time that operations 2130, 2240 are executed, an initial amount locally measured movement information is obtained. However, subsequent times that the operations 2130, 2240 are performed in their respective loops, additional locally measured cellular device movement information may be obtained. The additional locally measured cellular device movement information can be applied to an additional position fix that was determined based on additional raw pseudoranges that were, for example, obtained or extracted after an initial amount of raw pseudoranges that were used to determine, for example, a previous position fix.
[00595] Figure 23 is a flowchart of a method of performing sequential rolling bundle adjustments, according to one embodiment.
[00596] For the sake of illustration, assume that the images are associated with a video that is at 10. For this example assume that the video is at 10Hz such that the images are at 1 , 1.1 , 1.2, ... 2.0.
[00597] At 2310, the method begins.
[00598] At 2320, GPS positions are collected at time 1 s and 2s along with
synchronized video 2320. Processing proceeds to operation 2330.
[00599] At 2330, the image processing algorithm is initialized. Operations 2332, 2334, 2336 can be performed as a part of 2330.
[00600] At 2332, tie points are provided by finding matching features in, for example, 10 images.
[00601] At 2334, perform bundle adjustment on data points and associate with first GNSS position fix
[00602] "Bundle adjustment" refers to the process of adjusting the image capturing device's position and orientation so that the bundles of ray paths from the features being tracked in the second image are made to match the original bundles of ray paths from the feature locations in the first image. The mathematical process is well known in the Match Move arts. This is an image processing step and is not related to any other kind of input data. Sequential rolling bundle adjustments speed the process by only dealing with the most significant changes.
[00603] At 2336, the estimated position and orientation of image capturing device is outputted.
[00604] At 2340, at time 2.1 , find correspondences and run sequential rolling bundle adjustment. [00605] At 2350, new image measurements continue to be added as new images arrive.
[00606] At 2360, new GPS positions are added as they arrive.
[00607] At 2370, new tie points are found as necessary and added to bundle adjustments.
[00608] At 2380, the method ends.
[00609] According to various embodiments, the method depicted in Figure 23 provides trajectory smoothing effect because the image measurements have a high level of precision. Higher rate positions would be available with higher rate image capturing devices provided the image capturing devices have sufficient processing power, and GPS outages could be bridged.
[00610] According to one embodiment, at least 5 image samples (also referred to as "5 points," "5 key points," or "5 features") are used from one image to the next as a part of determining position fixes. The minimum of 5 points is used to provide scale. For example, if there are 5 points in a pair of images, then there are 5 * 2 (x and y) * 2 (images) = 20 measurements with 5 * 3 (Χ,Υ,Ζ) + 6 (delta X, Y, Z, roll, pitch, yaw) = 21 unknowns. The scale can come from the fact that there are GPS positions at previous epochs, or it could come from ground control, or it could come from knowing approximately the positions of the 5 key points from previous epochs. Therefore, according to one embodiment, the additional locally measured cellular device movement information is applied to the additional position fix if the additional locally measured cellular device movement information includes at least 5 features in the image. According to one embodiment, the additional locally measured cellular device movement information is based on an image and the limiting factor is at least 5 features in the image.
[00611] Figures 24A to 24C are flow charts for determining what, if any, of the sensor devices can be used, according to one embodiment.
[00612] Flowchart 2400 starts at 2410. At 2420, a decision is performed to determine whether an operational accelerometer is available that is capable of providing quality above a specified threshold. If the decision to 2420 is yes, processing proceeds to 2430. If the decision to 2420 is no, processing proceeds to 2440.
[00613] At 2430, a decision is performed to determine whether an operational image capturing device is available that is capable of providing a position fix above a specified threshold. If the answer to the decision at 2430 is yes, then processing proceeds to 2450 indicating that locally measured movement information can be obtained from both the accelerometer and the image capturing device. If the answer to the determination at 2430 is no, then processing proceeds to 2460 indicating that locally measured movement information may still be obtained from only the accelerometer.
[00614] At 2440, a decision is performed to determine whether an operational image capturing device is available that is capable of providing quality above a specified threshold. If the answer to the decision at 2440 is yes, then processing proceeds to 2470 indicating that locally measured movement information can be obtained only from image capturing device. If the answer to the determination at 2440 is no, then processing proceeds to 2480 indicating that locally measured movement information will not be obtained.
[00615] Figure 24B depicts a flowchart with more details for the processing of 2430 and 2440, according to various embodiments. At 2402B, a decision is performed as to whether the cellular device has an image capturing device (ICD). If the decision for 2402B is no, then the decision for 2430 is no. If the decision for 2402B is yes, then processing proceeds to 2404B where a determination is made as to whether the image capturing device is turned on. If the answer to the decision at 2402B is no, processing proceeds to 2406B where the image capturing device is turned on. After either 2404B or 2406B, the image capturing device is turned on and the answer to the decision for 2430 or 2440 is yes and processing can proceed, according to one embodiment, to flowchart 2100 depicted on Figure 21 .
[00616] Figure 24C depicts a flowchart with more details for the processing of 2420, according to various embodiments. At 2402C a decision is performed as to whether the cellular device has an accelerometer (ACC). If the cellular device does not have an accelerometer, then the decision for 2420 is no. If the cellular device has an accelerometer, then the answer for decision 2402C is yes and processing proceeds to 2410C.
[00617] At 2410C, processing proceeds to flowchart 2200 depicted on Figure 22. [00618] Figure 25 depicts a flowchart 2500 for improving a position fix based on locally measured movement information, according to one embodiment.
[00619] At 2510, the method begins. Processing proceeds to 2520.
[00620] At 2520, raw pseudoranges are accessed. For example, a GNSS chipset can be accessed and the raw pseudoranges can be extracted as discussed herein. Raw pseudoranges are one type of raw observables. Other types of raw observables such as real carrier phase information or Doppler Shift Information can also be accessed at 2520. The extracted raw pseudoranges can be stored in memory 210. Processing proceeds to 2530.
[00621] At 2530, smoothing can be performed using carrier phase information, which is real or reconstructed, if the carrier phase information is available. The smoothing can be performed on the extracted raw pseudoranges. The output of 2530 is smoothed
uncorrected pseudoranges, if carrier phase information is available. Otherwise, the output of 2530 is unsmoothed uncorrected pseudoranges. According to one embodiment, if both Doppler Shift Information and real carrier phase information are available, real carrier phase information will be used instead of Doppler Shift Information. Processing proceeds to 2540.
[00622] At 2540, external corrections can optionally be applied to the output of 2530. Processing proceeds to 2550.
[00623] At 2550, a position fix is determined based on the output of 2520, 2530, or 2540 depending on which was last performed since 2530 and 2540 are optional.
Processing proceeds to 2560.
[00624] At 2560, the position fix from 2550 can optionally be smoothed based on locally measured movement information from a sensor with a known physical relationship to a cellular device, such as an accelerometer or an image capturing device. At 2560, LMM information from one or more sensors can be applied to the position fix from 2550, as described herein. Processing proceeds to 2580.
[00625] At 2580, the method ends.
[00626] Operations 2530, 2540, 2550 and 2560 are a part of improving position determination, according to various embodiments, by processing raw observables 2570. [00627] Figures 26A-26G depict flowcharts for improving position determination using LMM information, according to various embodiments.
[00628] Figure 26A depicts a flowchart 2600A for obtaining and storing raw observables. The raw observables can be obtained by extracting them from a GNSS chipset 170 and stored in memory 210. Figure 26B-26G depict respective flowcharts 2600B-2600G for processing the raw extracted observables. More specifically, Figure 26F depicts a flowchart 2600F for processing raw observables based on real carrier phase information. Figure 26D depicts a flowchart 2600D for processing raw observables based on reconstructed carrier phase information that was reconstructed based on Doppler Shift Information. Figure 26B is used for processing raw observables when neither Doppler Shift nor Real Carrier Phase information is available.
[00629] Referring to Figure 26A, the flow chart starts at 2601 A and proceeds to 2600A.
[00630] At 2600A, raw observables are obtained and stored. More specifically, processing proceeds from the start 2601 to determining whether raw pseudoranges are available at 261 OA and 2617A. If raw pseudoranges are not available, processing proceeds to 2605A. If raw pseudoranges are available, then processing proceeds to 2615A.
[00631] At 2605A, a message is displayed indicating to the user that a position fix cannot be provided because raw pseudoranges are not available.
[00632] At 2617A, timers are reset. These timers are for the time thresholds that are used to determine if enough, such as a predetermined amount, real carrier phase information or enough Doppler Shift Information have been obtained within their respective time thresholds.
[00633] At 2615A, raw pseudoranges are continuously obtained and stored using a continuous loop 2660A. For example, raw pseudoranges can continuously be extracted from the GNSS chipset 170 and stored in memory 210.
[00634] At 2620A, a determination is made as to whether real carrier phase
Information (Real CPI or RCPI) is available. If real carrier phase information is available, processing proceeds to 2630A. If real carrier phase information is not available, then processing proceeds to 2625A.
[00635] At 2630A, real carrier phase information is obtained and stored. Processing proceeds to 2640A. For example, real carrier phase information can continuously be extracted from the GNSS chipset 170 and stored in memory 210.
[00636] At 2640A, a determination is made as to whether a time threshold has expired for obtaining real carrier phase information. If a time threshold for obtaining has not expired, then processing proceeds back to 2630A where additional real carrier phase information is obtained and stored. For example, additional real carrier phase information can be extracted from the GNSS receiver 107 and stored in memory 210. If the time threshold has expired, indicating there is enough, such as a predetermined amount, data to begin applying LMM information to one or more position fixes, processing proceeds to flowchart 2600F on Figure 26F.
[00637] At 2625A, a determination is made as to whether Doppler Shift Information (DSI) is available. If Doppler Shift information is not available, processing proceeds to flowchart 2600B on Figure 26B. If Doppler Shift Information is available, processing proceeds to 2635A.
[00638] At 2635A, Doppler Shift Information is obtained and stored. For example, Doppler Shift information can continuously be extracted from the GNSS chipset 170 and stored in memory 210. Processing proceeds to 2645A.
[00639] At 2645A, a determination is made as to whether a time threshold has expired for obtaining Doppler Shift Information. If a time threshold for obtaining has not expired, then processing proceeds back to 2635A where additional Doppler Shift Information is obtained and stored. If the time threshold has expired, then enough Doppler shift information has been obtained and processing proceeds to flowchart 2600D on Figure 26D .
[00640] According to various embodiments, approximately 20-100 seconds of raw observables, such as raw pseudoranges, real carrier phase information, and Doppler Shift Information, are obtained, for example, at least at 1413, 1415, 1416 (Figure 14), 2615A, 2630A, 2635A (Figure 26A). [00641] Two or more of obtaining pseudoranges at 2610A, obtaining real carrier phase information at 2630A and obtaining Doppler Shift Information at 2635A can be performed concurrently, for example, by one or more processors 109. Further, two or more of obtaining pseudoranges at 261 OA, obtaining real carrier phase information at 2630A and obtaining Doppler Shift Information at 2635A can be performed by separate processes or threads that are executed concurrently, for example, by one or more processors 109.
[00642] Referring to Figure 26B, at 2605B, raw pseudoranges 2610B are obtained from memory 210. The raw pseudoranges were placed into memory 210 at 2615A (Figure 26A). The processing of the raw pseudoranges 2610B proceeds to 2625B. The raw pseudorange 2610B are uncorrected and unsmoothed.
[00643] At 2625B, external corrections are optionally applied to the raw
pseudoranges 2610B. Processing proceeds to 2630B.
[00644] At 2630B, a determination is made as to whether external corrections were applied at 2625B. If external corrections were not applied, processing of the raw
uncorrected pseudoranges 2610B proceeds to 2631 B. If external corrections were applied, processing of the corrected pseudoranges 2640B proceeds to 2641 B.
[00645] At 2631 B, an unsmoothed uncorrected position fix 2632B is determined based on the raw unsmoothed uncorrected pseudoranges 2610B.
[00646] At 2641 B, an unsmoothed corrected position fix 2642B is determined based on the unsmoothed corrected pseudoranges 2640B.
[00647] At 2645B, the unsmoothed uncorrected position fix 2632B is optionally smoothed using locally measured movement information. The locally measured movement (LMM) information can be obtained from memory 210 at 2655B. The locally measured movement (LMM) information may have been placed into memory 210 at either 2130 (Figure 21 ) or 2240 (Figure 22) or both 2130 and 2240. Processing of the smoothed uncorrected position fix 2660B can proceed to 2670B.
[00648] At 2670B the smoothed uncorrected position fix 2660B can be provided to a user. If the position fix 2632B is not smoothed at 2645B, then the unsmoothed uncorrected position fix 2632B is provided to the user at 2670B. Processing can proceed back to 2605B [00649] At 2650B, the unsmoothed corrected position fix 2640B can be smoothed using locally measured movement information. The locally measured movement (LMM) information can be obtained from memory 210 at 2655B. The locally measured movement (LMM) information may have been placed into memory 210 at either 2130 (Figure 21 ) or 2240 (Figure 22) or both 2130 and 2240. Processing of the smoothed corrected position fix 2665B can proceed to 2675B.
[00650] At 2675B the smoothed corrected position fix 2665B can be provided to a user. If the position fix 2642B is not smoothed at 2650B, then the unsmoothed corrected position fix 2642B is provided to the user at 2675B. Processing can proceed back to 2605B.
[00651] Referring to Figure 26C, the flow chart 2600C can be performed concurrently with flowchart 2600B (Figure 26B), to determine whether either real carrier phase
information or Doppler Shift Information becomes available and switch to processing raw pseudoranges based on real carrier phase information or Doppler Shift Information if enough, such as a predetermined amount, of either becomes available.
[00652] For example, at 2605C, timers are reset. For example, a timer for the real carrier phase information threshold that is checked at 2630C and a timer for the Doppler Shift Information that is checked at 2635C are reset.
[00653] At 2610C, a determination is made as to whether real carrier phase
Information (Real CPI or RCPI) is available. If real carrier phase information is available, processing proceeds to 2620C. If real carrier phase information is not available, then processing proceeds to 2615C.
[00654] At 2620C, real carrier phase information is obtained and stored. For example, real carrier phase information can continuously be extracted from the GNSS chipset 170 and stored in memory 210. Processing proceeds to 2630C.
[00655] At 2630A, a determination is made as to whether a time threshold has expired for obtaining real carrier phase information. If a time threshold for obtaining has not expired, then processing proceeds back to 2620C where additional real carrier phase information is obtained and stored. For example, additional carrier phase information can be extracted from the GNSS chipset 170 and stored in memory 210. If the time threshold has expired indicating enough, such as a predetermined amount, real carrier phase information has been obtained, processing proceeds to flowchart 2600F on Figure 26F. [00656] At 2615C, a determination is made as to whether Doppler Shift Information (DSI) is available. If Doppler Shift information is not available, processing proceeds to flowchart 2600B on Figure 26B. If Doppler Shift Information is available, processing proceeds to 2625C.
[00657] At 2625C, Doppler Shift Information is obtained and stored. For example, Doppler Shift information can continuously be extracted from the GNSS chipset 170 and stored in memory 210. Processing proceeds to 2635C.
[00658] At 2635C, a determination is made as to whether a time threshold has expired for obtaining Doppler Shift Information. If a time threshold for obtaining has not expired, then processing proceeds back to 2625C where additional Doppler Shift
Information is obtained and stored. For example, additional Doppler Shift information can be extracted from the GNSS chipset 170 and stored in memory 210. If the time threshold has expired, then enough Doppler Shift Information has been obtained and processing proceeds to flowchart 2600D on Figure 26D.
[00659] Referring to Figure 26D, at 2605D, Doppler Shift Information 2610D is obtained from storage. The Doppler Shift Information 2610D can be obtained from memory 210 where it was placed, for example, at 2635A (Figure 26A). The processing of the Doppler Shift Information 2610D proceeds to 2615D.
[00660] At 2615D, the Doppler Shift Information is processed to provide reconstructed carrier phase information 2620D. A filter 1524D (Figure 15D) or some other type of integration logic 1522D (Figure 15D) can be used to reconstruct carrier phase information based on Doppler Shift Information. Processing can proceed to 2625D.
[00661] At 2625D, raw pseudoranges 2630D are obtained from memory 210. The raw pseudoranges 2630D can be obtained from memory 210 where it was placed, for example, at 2615A (Figure 26A). The raw pseudoranges 2630D are uncorrected and unsmoothed. The processing of the raw pseudoranges 2630D can proceed to 2635D.
[00662] At 2635D, the raw pseudoranges 2630D are smoothed using the
reconstructed carrier phase information 2620D provided at 2615D. A filter 1534E (Figure 15E) or the hatch logic 1532E (Figure 15E) can be used for smoothing the raw
pseudoranges 2630D with the reconstructed carrier phase information 2620D at 2635D. Processing of the smoothed uncorrected pseudoranges 2640D from 2635D proceeds to 2655D.
[00663] At 2655D, external corrections are optionally applied to the smoothed uncorrected pseudoranges 2640D. External corrections are pseudoranges corrections that can be obtained, for example, from a correction source such as at least correction service 221 , FM radio distribution 226, or satellite radio distributor 227, or a combination thereof. According to one embodiment, a correction source is located outside of the cellular device (also referred to as an "external correction source," and, therefore, corrections from the correction source are referred to as "external corrections" or "external pseudorange corrections." Examples of external corrections include WAAS, SBAS, DGPS, PPP, RTK, VRS and RTX corrections. Processing proceeds to 2660D.
[00664] At 2660D, a determination is made as to whether external corrections were applied at 2655D. If corrections were applied, processing of the smoothed corrected pseudoranges 2670D proceeds from 2655D proceeds to 2671 D. If corrections were not applied, processing of the smoothed uncorrected pseudoranges 2640D proceeds to 2661 D.
[00665] At 2661 D, a smoothed uncorrected position fix 2662D is determined based on the smoothed uncorrected pseudoranges 2640D. Processing proceeds to 2675D.
[00666] At 2675D, the smoothed uncorrected position fix 2650D can be additionally smoothed based on locally measured movement (LMM) information. The locally measured movement (LMM) information can be obtained from memory 210 at 2680D. The locally measured movement (LMM) information may be placed into memory 210 at either 2130 (Figure 21 ) or 2240 (Figure 22) or both 2130 and 2240. Processing of the additionally smoothed uncorrected position fix 2690D can proceed to 2692D.
[00667] At 2692D, the additionally smoothed uncorrected position fix 2690D can be provided to the user. If the position fix 2662D was not smoothed based on LMM at 2675D, then the smoothed uncorrected position fix 2662D can be provided to the user at 2692D. Processing proceeds back to 2605D.
[00668] At 2671 D, a smoothed corrected position fix 2672D is determined based on the smoothed corrected pseudoranges 2670D. Processing proceeds to 2685D. [00669] At 2685D, the smoothed corrected position fix 2670D can be additionally smoothed based on locally measured movement (LMM) information. The locally measured movement (LMM) information can be obtained from memory 210 at 2680D. The locally measured movement (LMM) information may be placed into memory 210 at either 2130 (Figure 21 ) or 2240 (Figure 22) or both 2130 and 2240. Processing of the additionally smoothed corrected position fix 2691 D can proceed to 2693D.
[00670] At 2693D, the additionally smoothed corrected position fix 2691 D can be provided to the user. If the position fix 2672D was not smoothed based on LMM information at 2685D, then the smoothed corrected position fix 2662D can be provided to the user at 2693D. Processing proceeds back to 2605D.
[00671] Referring to Figure 26E, the flowchart 2600E can be performed concurrently with flowchart 2600D (Figure 26D) to determine whether Doppler Shift Information becomes unreliable or unavailable and switch to processing raw pseudoranges without Doppler Shift Information. If enough, such as a predetermined amount, Doppler Shift Information is not obtained, then the already obtained Doppler Shift Information is not useful for smoothing. If enough Doppler Shift Information is obtained, the processing continues with flowchart 2600D.
[00672] For example, at 2605E, a timer is reset. For example, a timer that is checked at 2620E is reset. Processing proceeds to 2610E.
[00673] At 2610E, a determination is made as to whether Doppler Shift Information is available. If Doppler Shift Information is not available, then processing proceeds to flowchart 2600B on Figure 26B. If enough, such as a predetermined amount, Doppler Shift Information is available, then processing proceeds to 2615E.
[00674] At 2615E, Doppler Shift Information is obtained and stored. For example, Doppler Shift information can continuously be extracted from the GNSS chipset 170 and stored in memory 210. Processing proceeds to 2620E.
[00675] At 2620E, a determination is made as to whether a time threshold has expired for obtaining Doppler Shift Information. If the time threshold for obtaining has not expired, then processing proceeds back to 2615E where additional Doppler Shift Information is obtained and stored. For example, additional Doppler shift information can be extracted from the GNSS chipset 170 and stored into memory 210. If the time threshold has expired, then enough Doppler Shift Information has been obtained, processing proceeds from 2630E and to 2605E where the loop in flowchart 2600E is reiterated.
[00676] Referring to Figure 26F, at 2605F, Real Carrier Phase Information 261 OF is obtained from memory 210. The Real Carrier Phase Information 261 OF was placed into memory 210 at 2630A (Figure 26A). The processing of the Real Carrier Phase Information 261 OF proceeds to 2615F.
[00677] At 2615F, raw pseudoranges 2620F are obtained from memory 210. The raw pseudoranges 2620F were placed into memory 210 at 2615A (Figure 26A). The processing of the raw pseudoranges 2620F can proceed to 2625F.
[00678] At 2625F, the raw pseudoranges 2620F are smoothed using the real carrier phase information 261 OF provided at 2605F. A filter 1534E (Figure 15E) or the hatch logic 1532E (Figure 15E) can be used for smoothing the raw pseudoranges 2620F with the real carrier phase information 261 OF at 2625F. The output of 2625F is smoothed uncorrected pseudoranges 2640F. Processing of the smoothed uncorrected pseudoranges 2640F proceeds from 2625F proceeds to 2645F.
[00679] At 2645F, external corrections are optionally applied to the smoothed uncorrected pseudoranges 2640F. External corrections are pseudorange corrections that can be obtained, for example, from a correction source such as at least correction service 221 , FM radio distribution 226, or satellite radio distributor 227, or a combination thereof. According to one embodiment, a correction source is located outside of the cellular device, and, therefore, corrections from the correction source are referred to as "external corrections" or "external pseudorange corrections." Examples of external corrections include WAAS, SBAS, DGPS, PPP, RTK, VRS and RTX corrections. Processing proceeds to 2650F.
[00680] At 2650F, a determination is made as to whether external corrections were applied at 2645F. If corrections were applied, processing of the smoothed corrected pseudoranges 2650F proceeds from 2650F proceeds to 2653F. If corrections were not applied, processing of the smoothed uncorrected pseudoranges 2640F proceeds from 2650F to 2651 F.
[00681] At 2651 F, a smoothed uncorrected position fix 2652F is determined based on the smoothed uncorrected pseudoranges 2640F. Processing proceeds to 2655F. [00682] At 2655F, the smoothed uncorrected position fix 2640F can be additionally smoothed based on locally measured movement (LMM) information. The locally measured movement (LMM) information can be obtained from memory 210 at 2660F. The locally measured movement (LMM) information may be placed into memory 210 at either 2130 (Figure 21 ) or 2240 (Figure 22) or both 2130 and 2240. Processing of the additionally smoothed uncorrected position fix 2670F can proceed to 2680F.
[00683] At 2680F, the additionally smoothed uncorrected position fix 2670F can be provided to the user. If the position fix 2652F was not smoothed based on LMM at 2655F, then the smoothed uncorrected position fix 2652F can be provided to the user at 2680F. Processing proceeds back to 2605F.
[00684] At 2653F, a smoothed corrected position fix 2654F is determined based on the smoothed corrected pseudoranges 2650F. Processing proceeds to 2665F.
[00685] At 2665F, the smoothed corrected position fix 2654F can be additionally smoothed based on locally measured movement (LMM) information. The locally measured movement (LMM) information can be obtained from memory 210 at 2660F. The locally measured movement (LMM) information may be placed into memory 210 at either 2130 (Figure 21 ) or 2240 (Figure 22) or both 2130 and 2240. Processing of the additionally smoothed corrected position fix 2675F can proceed to 2685F.
[00686] At 2685F, the additionally smoothed corrected position fix 2675F can be provided to the user. If the position fix 2654F is smoothed based on LMM information at 2665F, then the smoothed corrected position fix 2654F can be provided to the user at 2685F. Processing proceeds back to 2605F.
[00687] Referring to Figure 26G, the flowchart 2600G can be performed concurrently with flowchart 2600F (Figure 26F) to determine whether real carrier phase information becomes unreliable or unavailable and switch to processing raw pseudoranges without real carrier phase information. If enough carrier phase information is not obtained within a threshold of time, then the already obtained real carrier phase information is no longer sufficiently useful. If enough real carrier phase information is obtained within a threshold of time, the processing continues with flowchart 2600F. [00688] For example, at 2605G, a timer is reset. For example, a timer that is checked at 2620G is reset. Processing proceeds to 2610G.
[00689] At 2610G, a determination is made as to whether real carrier phase information is available. If real carrier phase information is not available, then processing proceeds to flowchart 2600B on Figure 26B. If real carrier phase information is available, then processing proceeds to 2615G.
[00690] At 2615G, real carrier phase information is obtained and stored. For example, real carrier phase information can continuously be extracted from the GNSS chipset 170 and stored in memory 210. Processing proceeds to 2620G.
[00691] At 2620G, a determination is made as to whether a time threshold has expired for obtaining real carrier phase information. If the time threshold for obtaining has not expired, then processing proceeds back to 2615G where additional real carrier phase information is obtained and stored. For example, real carrier phase information can continuously be extracted from the GNSS chipset 170 and stored in memory 210. If the time threshold has expired, then enough real carrier phase information has been obtained and processing proceeds to 2630G and to 2605G where the loop in flowchart 2600G is reiterated.
[00692] Various operations refer to obtaining raw observables, such as extracted raw pseudoranges, real carrier phase information, and Doppler Shift information, from memory 210. The raw observables may be obtained from memory 210 using a push method or pull method. The pull method is also referred to as "fetch."
[00693] The control logic 1520A (Figure 15A) is responsible for directly performing the processing of flowcharts 14, 20-26G or indirectly coordinating the processing of flowcharts 14, 20-26G, according to various embodiments. An example of direct is when the control logic 1520A performs the processing itself. An example of indirect is when the control logic 1520A calls another entity to perform the processing. The control logic 1520A can call any one or more entities associated with a cellular device to perform the processing of flowcharts 14, 20A-26G indirectly. For example, the control logic 1520A may call at least one or more of the following to perform processing of flowcharts 14, 20-26G indirectly:
[00694] (1 ) pseudorange information extractor 142 to obtain and store raw
pseudoranges, for example, at 2520 (Figure 25), 1413 (Figure 14), 2515A (Figure 26A); [00695] (2) accessing logic 151 OA, 1 10B to extract and store information such as real carrier phase information, for example, at 2530 (Figure 25), 2620C (Figure 26C), 2615G (Figure 26G), 1416 (Figure 14), 2630A (Figure 26A), Doppler Shift Information, for example, at 2530 (Figure 25), 1418 (Figure 14), 2635a (Figure 26A), 2625C (Figure 26C), 2615E (Figure 26E), or external corrections, for example, at 2540 (Figure 25), 1424 (Figure 14), 2625B (Figure 26B), 2655D (Figure 26D), 2645F (Figure 26F);
[00696] (3) carrier phase measurement extracting logic 1 12B-4 to obtain and store real carrier phase information, for example, at 2530 (Figure 25), 2620C (Figure 26C), 2615G (Figure 26G), 1416 (Figure 14), 2630A (Figure 26A);
[00697] (4) doppler-e-logic 1 12B-3 to obtain and store Doppler Shift Information, for example, at 2530 (Figure 25), 1418 (Figure 14), 2635A (Figure 26A), 2625C (Figure 26C), 2615E (Figure 26E);
[00698] (5) locally measured movement information accessing logic 1510B to obtain and store locally managed measurement (LMM) information, for example, at 2130 (Figure 21 ), 2240 (Figure 22);
[00699] (6) carrier phase reconstructing logic 1520C to reconstruct carrier phase information based on Doppler Shift Information, for example, at 1427 (Figure 14), 2615D (Figure 26D);
[00700] (7) real carrier phase logic 152B to perform smoothing based on real carrier phase information, for example, at 2530 (Figure 25), 1428 (Figure 14), 2625F (Figure 26F);
[00701] (8) reconstructed carrier phase logic 152B to perform smoothing based on reconstructed Doppler Shift Information, for example, at 2530 (Figure 25), 1421 (Figure 14), 2635 (Figure 26D);
[00702] (9) movement sensor position fix smoothing logic 1510C to perform smoothing based on LMM information, for example, at 2560 (Figure 25), 1425 (Figure 14), 2645B (Figure 26B), 2650B (Figure 26B), 2675D (Figure 26D), 2685D (Figure 26D), 2655F (Figure 26F), 2665F (Figure 26F); [00703] (10) determining position fix logic 170B to determine position fixes based on inputs, such as raw pseudoranges, smoothed pseudoranges, smoothed corrected pseudoranges, smoothed uncorrected pseudoranges , for example, at 2550 (Figure 25), 1423 (Figure 14), 2631 B (Figure 26B), 2641 B (Figure 26B), 2661 d (Figure 26D), 2671 D (Figure 26D), 2651 F (Figure 26F), 2653F (Figure 26F). The determining position fix logic 170B can perform a least squares error system to calculate the position fix;
• (1 1 ) correction-logic 151 to apply external corrections, for example, at 2540 (Figure 25), 1424 (Figure 14), 2625B (Figure 26B), 2655D (Figure 26D), 2645F (Figure 26F);
• (12) accessing logic 151 OA, 1 10B;
• (13) processing logic 1550A, 150; and
• (14) chipset accessor 141.
[00704] Referring to Figures 14, 21 and 22, according to various embodiments, different processes 1-6 can execute the following:
• Process 1 for continuously extracting and storing raw pseudoranges. For example, process 1 could include operations 141 1 , 1412 and 1413,
• Process 2 for processing when neither real carrier phase information nor reconstructed carrier phase information is available. For example, process 2 could include operations 1416, 1418, 1424, 1423, 1425, 1426,
• Process 3 for processing when real carrier phase information is available.
The real carrier phase information can be continuously obtained and stored into memory 210. The process 3 could include operations 1416, 1415, 1428, 1424, 1423, 1425, 1426,
• Process 4 for processing when Doppler Shift Information is available. The Doppler Shift information can be continuously obtained and stored into memory 210. The process 4 could include operations 1418, 1417, 1427, 1421 , 1424, 1423, 1425, and 1426,
• Process 5 for continuously accessing and storing into memory 210 locally measured movement information from an ICD and handling ICD limiting factor. For example, process 5 could include operations 2120, 2125, 2130 and 2140 (Figure 21 ), and • Process 6 for continuously accessing and storing into memory 210 locally measured movement information from an accelerometer and handling accelerometer limiting factor. For example, process 6 could include operations 2220, 2230, 2240, 2250, and 2270.
[00705] According to various embodiments, two or more of processes 1-6 are executed concurrently. According to various embodiments, process 1 and one or more of processes 2-6 are executed concurrently. One or more hardware processors 109 can be used for executing one or more of processes 1 -6.
[00706] Referring to Figures 14, 21 , and 22, examples of combinations of processes that could be executed concurrently include at least:
Combination 1 : processes 1 , 2, 3 , and 5 or 6,
Combination 2: processes 1 , 2, 4, 5 and 6
Combination 3: processes 1 , 2, 3, and 5 or 6,
Combination 4: processes 1 , 2, 4, 5 and 6,
Combination 5: processes 1 and 5,
Combination 6: process 1 and 6,
Combination 7: process 1 , 5 and 6,
Combination 8: process 1 , 2 and 3,
Combination 9: process 1 , 2 and 4.
[00707] Referring to Figures 21 , 22, 26A-26G, according to various embodiments, different processes 1-6 can execute the following:
• Process 1 for continuously extracting and storing raw pseudoranges into memory 210. For example, process 1 can include loop 2660A that is executed continuously,
• Process 2 for processing when neither real carrier phase information nor reconstructed carrier phase information is available. According to one embodiment, process 2 may include a process pair 2A and 2B. For example, process 2A may include flowchart 2600B and process 2B may include flowchart 2600C,
• Process 3 for processing when real carrier phase information is available.
According to one embodiment, process 3 may include a process pair 3a and 3b. Process 3a may include operations 2620A, 2630A, 2640A, flowcharts 2600F for real carrier phase information. Process 3b may include flowchart 2600G,
• Process 4 for processing when Doppler Shift Information is available.
According to one embodiment, process 4 includes a process pair 4a and 4B. Process 4A may include operations 2625A, 2635A, 2645A, flowchart 2600D for Doppler Shift Information. Process 4B may include flowchart 2600E,
• Process 5 for accessing and storing locally measured movement information from an ICD and handling ICD limiting factor. For example, process 5 could include operations 2120, 2125, 2130 and 2140 (Figure 21 ), and
• Process 6 for accessing and storing locally measured movement information from an accelerometer and handling accelerometer limiting factor. For example, process 6 could include operations 2220, 2230, 2240, 2250, and 2270.
[00708] According to one embodiment, processes 2A and 2B are executed concurrently. According to one embodiment, processes 3A and 3B are executed concurrently. According to one embodiment, processes 4A and 4B are executed concurrently. According to various embodiments, two or more of processes 1-6 are executed concurrently. According to various embodiments, process 1 and one or more of processes 2-6 are executed concurrently. One or more hardware processors 109 can be used for executing one or more of processes 1 -6.
[00709] Referring to Figures 21 , 22, 26A-26G , examples of combinations of processes that could be executed concurrently include at least:
Combination 1 : processes 1 , 2A, 2B, 3A, 3B, and 5 or 6,
Combination 2: processes 1 , 2A, 2B, 4A, 4B, 5 and 6
Combination 3: processes 1 , 2A, 2B, 3A, 3B, and 5 or 6,
Combination 4: processes 1 , 2A, 2B, 4A, 4B, 5 and 6,
Combination 5: processes 1 and 5,
Combination 6: process 1 and 6,
Combination 7: process 1 , 5 and 6,
Combination 8: process 1 , 2A, 2B, 3A, and 3B,
Combination 9: process 1 , 2A, 2B, 4A, and 4B.
[00710] According to one embodiment, different continuously executing concurrent processes can be used for obtaining and storing various types of information. For example, a continuously executing process could be used for extracting raw pseudoranges and storing raw pseudoranges into memory 210. Another continuously executing process could be used for obtaining and storing into memory 210 real carrier phase information. Yet another continuously executing process could be used for obtaining and storing into memory 210 Doppler Shift Information. Yet still another continuously executing process could be used for obtaining and storing into memory LMM information from an accelerator. Yet still another continuously executing process could be used for obtaining and storing into memory 210, LMM information from an image capturing device. Yet one or more additional processes could be used to fetch or receive pushed information, such as extracted raw pseudorange information, real carrier phase information, Doppler Shift Information, and/or real carrier phase information to perform various types of processing, such as smoothing based on carrier phase information, reconstruct carrier phase information, apply external corrections, perform additional smoothing based on LMM information, performing decision logic, such as determining whether limiting factors have been exceeded, determining whether raw observables are available in sufficient amounts, and so on.
[00711] A combination of processes could be used for an entire work session, according to one embodiment. An example of a work session could be a period of time that the cellular device is being used to survey an area. Different combinations could be used during different subsets of a work session, according to another embodiment. For example, one combination could be used while the cellular device is unobstructed and capable of obtaining good signals and another combination could be used while the cellular device is obstructed. In another example, one combination could be used while both the
accelerometer and the ICD are turned on and another combination could be used when one of the sensors becomes unavailable. These are just a few examples. Embodiments are well suited for other examples.
[00712] Figures 27A-27C are example timelines that demonstrate techniques for using various combinations of sensors and/or carrier phase smoothing concurrently over time for improving position determination of a cellular device using locally measured movement information, according to various embodiments.
[00713] The timelines depicted in Figures 27A-27C shall be discussed in the context of Figures 20A-26C.
[00714] Referring to timeline 2701 on Figure 27A, an accelerometer (acc) and no carrier phase smoothing is used for improving position determination of a cellular device using locally measured movement information. For example, LMM information can be obtained from only an accelerometer (2460 on Figure 24A) and no carrier phase smoothing (A in Figure 26A) may be performed. The accelerometer is used for the time periods of tO- t1 , t2-t5, t6-t7 to obtain movement information (2050A at Figure 20A and 2240 at Figure 22) and to improve position determination (2060A at Figure 20A, 2570 at Figure 25, 1420 at Figure 14, 2260 at Figure 22, 2600B at Figure 26B). The accelerometer's limiting factor(s) is exceeded (2250 at Figure 22) at t1 , t3, t4, t5 and t7. The accelerometer is reset (2230 at Figure 22) at times tO, t2, t3, t4 and t6. The accelerometer is not used during the time periods of t1-t2 and t5-t6.
[00715] Referring to timeline 2702 on Figure 27A, the image capturing device (ICD) and no carrier phase smoothing is used for improving position determination of a cellular device using locally measured movement information. For example, LMM information is obtained from only the image capturing device (2470 on Figure 24A) and no carrier phase smoothing is performed (A on Figure 26A). The image capturing device is used for the time periods of t0-t1 , t1-t2 and t3-t4 to obtain movement information (2130 at Figure 21 ) and to improve position determination (2150 at Figure 21 , 2570 at Figure 25, 1420 at Figure 14, 2600B at Figure 26B). The image capturing device's limiting factor(s) is exceeded (2140 at Figure 21 ) at t1 , t2 and t4. The image capturing device is reset (2125 at Figure 21 ) at times tO, t1 , and t3. The image capturing device is not used during the time period of t2-t3.
[00716] Referring to timeline 2703 of Figure 27B, the accelerometer (acc), the image capturing device (ICD) and no carrier phase smoothing are used for improving position determination of a cellular device using locally measured movement information. For example, locally measured movement information from both the accelerometer and the image capturing device (2450 on Figure 24A) with no carrier phase information (A on Figure 26A) is used. The accelerometer is used for the time periods of t0-t1 , t1-t2, t3-t6, t7-t8 and t8-t9 to obtain movement information (2240 at Figure 22) and to improve position determination (2060A at Figure 20A, 2570 at Figure 25, 1420 at Figure 14, 2260 at Figure 22, 2600B at Figure 26B). The accelerometer's limiting factor(s) is exceeded (2250 at Figure 22) at t1 , t2, t6, t8 and t9. The accelerometer is reset at times tO, t1 , t3, t7 and t8.
[00717] The image capturing device is used for the time periods of t0-t4 and t5-t9 to obtain movement information (2130 at Figure 21 ) and to improve position determination (2150 at Figure 21 , 2570 at Figure 25, 1420 at Figure 14, 2600B at Figure 26B). The image capturing device's limiting factor(s) is exceeded (2140 at Figure 21 ) at t4 and t9. The image capturing device is reset (2125 at Figure 21 ) at times tO and t5. [00718] The use of the accelerometer and the image capturing device overlap for the time periods of t0-t2, t3-t4, t5-t6, and t7-t9. The accelerometer only is used from time t4-t5. Embodiments are well suited for periods of time when the image capturing device only is used for periods of time as well.
[00719] According to various embodiments, carrier phase smoothing, real or reconstructed, is not used immediately because it takes some time for carrier phase smoothing information with sufficient quality to be obtained. For example, it may take several 100s of seconds before the carrier phase smoothing information is useful.
Therefore, according to various embodiments, one or more sensors may be used without carrier phase smoothing until the carrier phase smoothing information becomes useful.
[00720] Referring to timeline 2704 on Figure 27A, an accelerometer (acc) and carrier phase smoothing (CPS) is used for improving position determination of a cellular device using locally measured movement information. For example, locally measured movement information from only the accelerometer (2460 on Figure 24A) and carrier phase information (2620A or 2625A on Figure 26A) are used. The carrier phase smoothing may be based on either reconstructed or real carrier phase information. As depicted in timeline 2704, the accelerometer is used for the time periods of t0-t1 , t1-t2, t3-t4, t6-t7 and t8-t9 to obtain movement information (2240 at Figure 22) and to improve position determination (2060A at Figure 20A, 2570 at Figure 25, 1420 at Figure 14, 2260 at Figure 22, either 2600D on Figure 26D or 2600F on Figure 26F). The accelerometer's limiting factor(s) is exceeded (2250 on Figure 22) at t1 , t2, t4, t7 and t9. The accelerometer is reset (2230 at Figure 22) at times tO, t1 , t3, t6 and t8. Carrier phase smoothing is used from time t5 on. The use of the accelerometer and carrier phase smoothing overlap during the time periods of t6-t7 and t8- t9. The accelerometer alone is used for the time periods of t0-t2 and t3-t4. Carrier phase smoothing alone is used for the time periods of t5-t6, t7-t8 and t9. No improvements are used from either the accelerometer or carrier phase smoothing during the time periods of t2- t3 and t4-t5.
[00721] Referring to timeline 2705 of Figure 27C, the image capturing device (ICD) and carrier phase smoothing (CPS) are used for improving position determination of a cellular device using locally measured movement information. For example, locally measured movement information from only an ICD (2470 on Figure 24A) and carrier phase information (either 2620A or 2625A on Figure 26A) are used. As depicted in timeline 2705, the image capturing device is used for the time periods of t0-t1 , t2-t3, t3-t4, t6-t7, t8-t9 and t10-t1 1 to obtain movement information (2130 at Figure 21 ) and to improve position determination (2150 at Figure 21 , 2570 at Figure 25, 1420 at Figure 14, either 2600D or 2600F). The image capturing device's limiting factor(s) is exceeded (2140 at Figure 21 ) at t1 , t3, t4, t7, t9, and t1 1. The image capturing device is reset (2125 at Figure 21 ) at times tO, t2, t3, t6, t8, and t10.
[00722] Carrier phase smoothing is used from time t5-t12. The use of the image capturing device and carrier phase smoothing overlap during the time periods of t6-t7, t8-t9 and t10-t1 1. In this illustration, carrier phase smoothing alone is used during the periods of t5-t6, t7-t8, t9-t10, 11 1 -t 12. Neither the image capturing device nor carrier phase smoothing is used during the period of t1-t2 and t4-t5.
[00723] Referring to timeline 2706 of Figure 27C, the accelerometer (acc), the image capturing device (ICD) and carrier phase smoothing (CSP) are used for improving position determination of a cellular device using locally measured movement information. For example, locally measured movement information from both an accelerometer and an image capturing device (2450 on Figure 24A) and carrier phase information (either 2620A or 2625A on Figure 26A) are used. As depicted in timeline 2706, the accelerometer is used for the time periods of t1-t2, t3-t4, t5-t6, t8-t9, t10-t1 1 , t14-t15, t16-t17, t19-t21 , t21-t22, t23-t24, t27-t28 to obtain movement information (2240 at Figure 22) and improve position
determination (2060A at Figure 20A, 2570 at Figure 25, 1420 at Figure 14, 2260 at Figure 22, either 2600D on Figure 26D or 2600F on Figure 26F). The accelerometer's limiting factor(s) is exceeded (2250 at Figure 22) at t2, t4, t6, t9, t1 1 , t15, t17, t21 , t22, t24, t28. The accelerometer is reset (2125 at Figure 21 ) at times t1 , t3, t5, t8, t10, t14, t16, t19, t21 , t23 and t27.
[00724] The image capturing device is used for the time periods of t0-t7, t7-t12 t13- t18, t20-t25, t26-t28 to obtain movement information (2130 at Figure 21 ) and to improve position determination (2150 at Figure 21 , 2570 at Figure 25, 1420 at Figure 14, either 2600D or 2600F). The image capturing device's limiting factor(s) is exceeded (2140 at Figure 21 ) at t7, t12, t18, t25 and t28. The image capturing device is reset (2125 at Figure 21 ) at times tO, t7, t13, t20, t26. Carrier phase smoothing is used from time t17 on.
[00725] The image capturing device alone is used for the time periods of t0-t1 , t2-t3, t4-t5, t6-t8, t9-t10, t1 1 -t12, t13-t14, t15-t16. The accelerometer and the image capturing device are used together during the time periods of t1-t2, t3-t4, t5-t6, t8-t9, t10-t1 1 , t14-t15, t16-t17. Carrier phase smoothing and the image capturing device without the accelerometer are used during the periods of t17-t18, t24-t25 and t26-t27.
[00726] Carrier phase smoothing and the accelerometer without the image capturing device are used during the period of t19-t20. The use of the image capturing device, the accelerometer and carrier phase smoothing overlap during the periods of t20-t22, t23-t24 and t27-t28. Carrier phase smoothing alone is used during the periods of t18-t19 and t25- t26.
[00727] Any one or more of the operations depicted in flowcharts 1400, 1900-2600G can be performed by the hardware processor 109 that is located in the cellular device 1500A, 1500J, 1600, 1700 and outside of the GNSS chipset 170 embedded in the cellular device.
[00728] According to various embodiments, the applying of LMM information to position fixes is performed automatically and on the fly.
[00729] According to one embodiment, a method of improving position determination of a cellular device 1500A, 1500J, 1600, 1700 using locally measured movement is provided. For example, a Global Navigation Satellite System (GNSS) chipset 170 embedded within the cellular device 1500A, 1500J, 1600, 1700 is accessed where the GNSS chipset 170 calculates raw pseudoranges. The raw pseudoranges are extracted from the GNSS chipset 170 for processing elsewhere in the cellular device 1500A, 1500J, 1600, 1700 outside of the GNSS chipset 170. A position fix is calculated (2040A, Figure 20A) based on the raw pseudoranges. At a first point in time, a first image is obtained with an image capturing device that is in a known physical relationship with the cellular device. At a second point in time, a second image is obtained with the image capturing device 1540G. Examples of a first point in time could be any point in time depicted in Figures 27A- 27C that the image capturing device 1540G (ICD) is being used. Examples of a second point in time could be any point in time depicted in Figures 27A-27C that is subsequent to the first point in time. An estimate of a distance that the cellular device 1500A, 1500J, 1600, 1700 moved from the first point in time to the second point in time is calculated by processing image data collected for the time frame from the first time to the second time. Various embodiments described herein, provide for processing the position fix based on the estimate of the distance, he accessing, the extracting, the calculating of the position fix, the obtaining the first image, the obtaining the second image, the calculating of the estimate, and the processing of the position fix are performed by one or more hardware processors 109 located in the cellular device and outside of the GNSS chipset 170.
[00730] According to various embodiments, the calculating of the estimate of the distance that the cellular device moved from the first point in time to the second point in time by processing image data collected for the time frame from the first point in time to the second point in time further comprises replacing a set of image data related to at least five key-points included in the first image related to at least five same key-points included in the second image.
[00731] According to various embodiments, the obtaining, at the first point in time, of the first image with the image capturing device further comprises calibrating the image capturing device to correct the image for lens distortion, the lens distortion selected from a group consisting of a principal distance distortion, a focal length, a principal point offset, a radial distortion, and a tangential distortion.
[00732] According to various embodiments, the position fix is a current position fix of the cellular device and wherein the method further comprises: obtaining a set of images 1 to n using the image capturing device from at least the first point in time to the second point in time, each image of the set of images 1 to n includes a set of image data and images 1 to n- 1 has at least one respective subsequent image and images 2 to n has at least one respective previous image; calculating position fix estimates of positions of the cellular device between the first point in time and the second point in time by replacing a set of image data included in an image with a set of image data included in a respective subsequent image; determining a previous position fix, based on previous raw
pseudoranges, wherein the previous position fix correlates with a position of the cellular device at a time that is less than or equal to the second point in time; and determining the estimate of the distance based on the previous position fix and at least one of the position fix estimates.
[00733] According to various embodiments, the method further comprises collecting position fixes from the first point in time to the second point in time; collecting synchronized video that includes a plurality of images from the first point in time to the second point time; initializing an image processing algorithm; locating correspondences; performing sequential rolling bundle adjustment; adding new locally measured movement information from new images and the new images are taken with the cellular device; and adding new position fixes based on the new measurements, where the collecting of position fixes, the collecting of synchronized video, the initializing of the image processing algorithm, the locating of correspondences, the performing of the sequential rolling bundle adjustment, the adding of new locally measured movement information and the adding of new position fixes are performed by the one or more hardware processors.
[00734] According to various embodiments, at the first point in time, first
accelerometer data is obtained from an accelerometer 1502A that is part of the cellular device 1500A, 1500J, 1600, 1700. At the second point in time, second accelerometer data is obtained from the accelerometer 1502A. A second estimate of the distance is calculated based on the first accelerometer data and the second accelerometer data. A third estimate is determined by blending the first estimate and the second estimate using any type of filter described herein. The obtaining of the first accelerometer data, the obtaining of the second accelerometer data, the calculating of the second estimate and the determining of the third estimate are performed by the one or more hardware processors 109.
[00735] According to one embodiment, a previous position fix of the cellular device 1500A, 1500J, 1600, 1700 is determined for the first point in time based on previous raw pseudoranges and a current position fix is determined for the second point in time based on current raw pseudoranges. Referring to Figure 18E, P7 is an example of a previous position fix and P8 is an example of a current position fix. Still referring to Figure 18E, a position fix distance ΔΡ87 is determined that is the difference between the current position fix P8 and the previous position fix P7. A second difference ΔΡ is determined between the estimate of the distance D8 and the position fix distance ΔΡ87. If the second difference ΔΡ exceeds a metric threshold 1820E, the current position fix P8 is discarded. The extracting of the previous raw pseudoranges, the determining of the previous position fix, the determining of the position fix distance, the determining of the second difference and the discarding of the current position fix are performed by the one or more hardware processors 109. Still referring to Figure 18E, a trajectory of movement of the cellular device 1500A, 1500J, 1600, 1700 is determined based on two or more position fixes P(ti-2), P(ti-1 ), which are previous to the current position fix P8, of the cellular device. A new position fix PEsi(ti) is interpolated based on the estimate of the distance D8 and the trajectory.
[00736] Figures 14, 19-26G depict flowcharts 1400, 1900-2600G, according to one embodiment. Although specific operations are disclosed in flowcharts 1400, 1900-2600G, such operations are exemplary. That is, embodiments of the present invention are well suited to performing various other operations or variations of the operations recited in flowcharts 1400, 1900-2600G. It is appreciated that the operations in flowcharts 1400, 1900-2600G may be performed in an order different than presented, and that not all of the operations in flowcharts 1400, 1900-2600G may be performed.
[00737] The operations depicted in Figures 14, 19-26G transform data or modify data to transform the state of a cellular device 1500A, 1500J, 1600, 1700. For example, by extracting pseudorange information from a GNSS chipset 170 for use elsewhere, the state of the cellular device 1500A, 1500J, 1600, 1700 is transformed, for example, from a cellular device that is not capable of determining a position fix itself into a cellular device that is capable of determining a position fix itself. In another example, operations depicted in flowcharts 1400, 1500J, 1900-2600G transform the state of a cellular device 1500A, 1500J, 1600, 1700 from not being capable of providing an improved accuracy position fix 1560C to being capable of providing an improved accuracy position fix 1560C.
[00738] The above illustration is only provided by way of example and not by way of limitation. There are other ways of performing the method described by flowcharts 1400, 1900-2600G.
Computer Readable Storage Medium
[00739] Unless otherwise specified, any one or more of the embodiments described herein can be implemented using non-transitory computer readable storage medium and computer readable instructions which reside, for example, in computer-readable storage medium of a computer system or like device. The non-transitory computer readable storage medium can be any kind of physical memory that instructions can be stored on. Examples of the non-transitory computer readable storage medium include but are not limited to a disk, a compact disk (CD), a digital versatile device (DVD), read only memory (ROM), flash, and so on. As described above, certain processes and operations of various embodiments of the present invention are realized, in one embodiment, as a series of computer readable instructions (e.g., software program) that reside within non-transitory computer readable storage memory of a cellular device 1500A, 1500J, 1600, 1700 (Figures 15A-17) and are executed by a hardware processor of the cellular device 1500A, 1500J, 1600, 1700. When executed, the instructions cause a computer system to implement the functionality of various embodiments of the present invention. For example, the instructions can be executed by a central processing unit 109 associated with the cellular device 1500A, 1500J, 1600, 1700. According to one embodiment, the non-transitory computer readable storage medium is tangible. Instructions for any one or more of the operations depicted in or described in the context of Figures 14-33 could be stored in the non-transitory computer readable storage medium.
[00740] Unless otherwise specified, one or more of the various embodiments described herein can be implemented as hardware, such as circuitry, firmware, or computer readable instructions that are stored on non-transitory computer readable storage medium. The computer readable instructions of the various embodiments described herein can be executed by a hardware processor, such as central processing unit, to cause the cellular device 1500A, 1500J, 1600, 1700 to implement the functionality of various embodiments. For example, according to one embodiment, the SUPL client 1501A and the operations depicted or described in the context of Figure 14-33 are implemented with computer readable instructions that are stored on computer readable storage medium, which can be tangible or non-transitory or a combination thereof, and can be executed by a hardware processor 109 of a cellular device 1500A, 1500J, 1600, 1700.
[00741] As short summaries this writing has disclosed at least the following broad concepts.
Concept 1 . A method of improving position determination of a cellular device using locally measured movement, the method comprising:
accessing a Global Navigation Satellite System (GNSS) chipset embedded within the cellular device, wherein the GNSS chipset calculates raw pseudoranges;
extracting the raw pseudoranges from the GNSS chipset for processing elsewhere in the cellular device outside of the GNSS chipset;
calculating a position fix based on the raw pseudoranges;
obtaining, at a first point in time, a first image with an image capturing device that is in a known physical relationship with the cellular device;
obtaining, at a second point in time, a second image with the image capturing device; calculating an estimate of a distance that the cellular device moved from the first point in time to the second point in time by processing image data collected for a time frame from the first point in time to the second point in time; and
processing the position fix based on the estimate of the distance,
wherein the accessing, the extracting, the calculating of the position fix, the obtaining the first image, the obtaining the second image, the calculating of the estimate, and the processing of the position fix are performed by one or more hardware processors located in the cellular device and outside of the GNSS chipset. Concept 2. The method as recited by Concept 1 , wherein the estimate is a first estimate and wherein the method further comprises:
obtaining, at the first point in time, first accelerometer data from an accelerometer that is part of the cellular device;
obtaining, at the second point in time, second accelerometer data form the accelerometer;
calculating a second estimate of the distance based on the first accelerometer data and the second accelerometer data; and
determining a third estimate by blending the first estimate and the second estimate using a filter,
wherein the obtaining of the first accelerometer data, the obtaining of the second accelerometer data, the calculating of the second estimate and the determining of the third estimate are performed by the one or more hardware processors.
Concept 3. The method as recited by Concept 1 , wherein the processing of the position fix further comprises:
determining whether to discard the position fix based on the estimate of the distance; and
if the position fix is discarded,
interpolating a new position fix based on the distance and two or more position fixes that precede the discarded position fix; and
replacing the discarded position fix with the new position fix,
wherein the determining whether to discard, the interpolating and the replacing are performed by the one or more hardware processors.
Concept 4. The method as recited by Concept 3, wherein the raw pseudoranges are current raw pseudoranges, wherein the position fix is a current position fix at the second point in time, and wherein the method further comprises:
extracting previous raw pseudoranges from the GNSS chipset, wherein the previous raw pseudoranges are extracted before the current raw pseudoranges are extracted;
determining a previous position fix, for the first point in time, based on the previous raw;
determining a position fix distance that is a difference between the current position fix and the previous position fix;
determining a second difference between the estimate of the distance and the position fix distance; and If the second difference exceeds a metric threshold, discarding the current position fix,
wherein the extracting of the previous raw pseudoranges, the determining of the previous position fix, the determining of the position fix distance, the determining of the second difference and the discarding of the current position fix are performed by the one or more hardware processors.
Concept 5. The method as recited by Concept 4, wherein the position fix is a current position fix of the cellular device and wherein the interpolating of the new position fix further comprises:
determining a trajectory of movement of the cellular device based on two or more position fixes, which are previous to the current position fix, of the cellular device; and
interpolating the new position fix based on the estimate of the distance and the trajectory.
Concept 6. The method as recited by Concept 1 , wherein the calculating of the estimate of the distance that the cellular device moved from the first point in time to the second point in time by processing image data collected for the time frame from the first point in time to the second point in time further comprises:
replacing a set of image data related to at least five key-points included in the first image related to at least five same key-points included in the second image.
Concept 7. The method as recited by Concept 1 , wherein the obtaining, at the first point in time, of the first image with the image capturing device further comprises:
calibrating the image capturing device to correct the image for lens distortion, the lens distortion selected from a group consisting of a principal distance distortion, a focal length, a principal point offset, a radial distortion, and a tangential distortion.
Concept 8. The method as recited by Concept 1 , wherein the calculating the estimate of the distance that the cellular device moved from the first point in time to the second point in time by processing image data collected for the time frame from the first point in time to the second point in time further comprises:
calculating the estimate of the distance that the cellular device moved from the first point in time to the second point in time by processing image data collected for the time frame from the first point in time to the second point in time using a sequential rolling bundle adjustment algorithm. Concept 9. The method as recited by Concept 1 , wherein the position fix is a current position fix of the cellular device and wherein the method further comprises:
obtaining a set of images 1 to n using the image capturing device from at least the first point in time to the second point in time, each image of the set of images 1 to n includes a set of image data and images 1 to n-1 has at least one respective subsequent image and images 2 to n has at least one respective previous image;
calculating position fix estimates of positions of the cellular device between the first point in time and the second point in time by replacing a set of image data included in an image with a set of image data included in a respective subsequent image;
determining a previous position fix, based on previous raw pseudoranges, wherein the previous position fix correlates with a position of the cellular device at a time that is less than or equal to the second point in time; and
determining the estimate of the distance based on the previous position fix and at least one of the position fix estimates.
Concept 10. A system for improving position determination of a cellular device using locally measured movement, the system comprising:
accessing logic that accesses a Global Navigation Satellite System (GNSS) chipset embedded within the cellular device, wherein the GNSS chipset calculates raw
pseudoranges;
extracting logic that extracts the raw pseudoranges from the GNSS chipset for processing elsewhere in the cellular device outside of the GNSS chipset;
position fix determining logic that calculates a position fix based on the raw pseudoranges;
image capturing device movement information accessing logic that obtains, at a first point in time, a first image with an image capturing device that is in a known physical relationship with the cellular device and that obtains, at a second point in time, a second image with the image capturing device; and
processing logic that calculates an estimate of a distance that the cellular device moved from the first point in time to the second point in time by processing image data collected for a time frame from the first point in time to the second point in time, and that processes the position fix based on the estimate of the distance,
wherein the accessing logic, the extracting logic, the image capturing device movement information accessing logic and the processing logic are performed by one or more hardware processors located in the cellular device and outside of the GNSS chipset.
Concept 1 1. The system of Concept 10, wherein the image capturing device is selected from a group consisting of: a digital camera, a digital video camera, a digital camcorder, a stereo digital camera, a stereo video camera, a motion picture camera, and a television camera.
Concept 12. The system as recited by Concept 10, wherein the processing logic further comprises logic that:
determines whether to discard the position fix based on the estimate of the distance; and
if the position fix is discarded,
interpolates a new position fix based on the distance and two or more position fixes that precede the discarded position fix; and
replaces the discarded position fix with the new position fix.
Concept 13. The system as recited by Concept 12, wherein the raw pseudoranges are current raw pseudoranges, wherein the position fix is a current position fix at the second point in time, and wherein:
the extracting logic further comprises logic that extracts previous raw pseudoranges from the GNSS chipset, wherein the previous raw pseudoranges are extracted before the current raw pseudoranges are extracted;
the position fix determining logic further comprises logic that determines a previous position fix, for the first point in time, based on the previous raw; and
the processing logic further comprises logic that determines a position fix distance that is a difference between the current position fix and the previous position fix and determines a difference between the estimate of the distance and the position fix distance, and if the difference exceeds a metric threshold, discards the current position fix.
Concept 14. The system as recited by Concept 13, wherein the position fix is a current position fix of the cellular device and wherein the processing logic further comprises logic that:
determines a trajectory of movement of the cellular device based on two or more position fixes, which are previous to the current position fix, of the cellular device; and
interpolates the new position fix based on the estimate of the distance and the trajectory.
Concept 15. The system as recited by Concept 10, wherein the processing logic further comprises logic that: replaces a set of image data related to at least five key-points included in the first image related to at least five same key-points included in the second image as a part of calculating the estimate of the distance.
Concept 16. The system as recited by Concept 10, wherein image capturing device movement information accessing logic further comprises logic that:
calibrates the image capturing device to correct the image for lens distortion, the lens distortion selected from a group consisting of a principal distance distortion, a focal length, a principal point offset, a radial distortion, and a tangential distortion.
Concept 17. The system as recited by Concept 10, wherein the processing logic further comprises logic that:
calculates the estimate of the distance that the cellular device moved from the first point in time to the second point in time by processing image data collected for the time frame from the first point in time to the second point in time using a sequential rolling bundle adjustment algorithm.
Concept 18. The system as recited by Concept 10, wherein the cellular device comprises a cellular communication enabled mobile communications device.
Concept 19. A non-transitory computer readable storage medium having computer readable instructions stored thereon for causing a computer system to perform a method of improving position determination of a cellular device using locally measured movement, the method comprising:
accessing a Global Navigation Satellite System (GNSS) chipset embedded within the cellular device, wherein the GNSS chipset calculates raw pseudoranges;
extracting the raw pseudoranges from the GNSS chipset for processing elsewhere in the cellular device outside of the GNSS chipset;
calculating a position fix based on the raw pseudoranges;
obtaining, at a first point in time, a first image with an image capturing device that is in a known physical relationship with the cellular device;
obtaining, at a second point in time, a second image with the image capturing device; calculating an estimate of a distance that the cellular device moved from the first point in time to the second point in time by processing image data collected for a time frame from the first point in time to the second point in time; and
processing the position fix based on the estimate of the distance, wherein the accessing, the extracting, the calculating of the position fix, the obtaining the first image, the obtaining the second image, the calculating of the estimate, and the processing of the position fix are performed by one or more hardware processors located in the cellular device and outside of the GNSS chipset.
Concept 20. The non-transitory computer readable storage medium as recited by Concept 19, wherein the calculating the estimate of the distance that the cellular device moved from the first point in time to the second point in time by processing image data collected for the time frame from the first point in time to the second point in time further comprises:
calculating the estimate of the distance that the cellular device moved from the first point in time to the second point in time by processing image data collected for the time frame from the first point in time to the second point in time using a sequential rolling bundle adjustment algorithm.
Concept 21. The non-transitory computer readable storage medium as recited by Concept 19, wherein the processing of the position fix further comprises:
determining whether to discard the position fix based on the estimate of the distance; and
if the position fix is discarded,
interpolating a new position fix based on the distance and two or more position fixes that precede the discarded position fix; and
replacing the discarded position fix with the new position fix,
wherein the determining whether to discard, the interpolating and the replacing are performed by the one or more hardware processors.
Concept 22. The non-transitory computer readable storage medium as recited by Concept 19, wherein the method further comprises:
collecting position fixes from the first point in time to the second point in time;
collecting synchronized video that includes a plurality of images from the first point in time to the second point time;
initializing an image processing algorithm;
locating correspondences;
performing sequential rolling bundle adjustment;
adding new locally measured movement information from new images and the new images are taken with the cellular device; and
adding new position fixes based on the new measurements, wherein the collecting of position fixes, the collecting of synchronized video, the initializing of the image processing algorithm, the locating of correspondences, the performing of the sequential rolling bundle adjustment, the adding of new locally measured movement information and the adding of new position fixes are performed by the one or more hardware processors.
Concept 23. A method of improving position determination of a cellular device, the method comprising:
executing, performed by at least one hardware processor located in the cellular device and outside of a Global Navigation Satellite System (GNSS) chipset embedded in the cellular device, a first process and a second process concurrently;
extracting raw pseudorange information from the GNSS receiver;
obtaining locally measured movement information that reflects measurements of movement of the cellular device, wherein the measurements are obtained using at least one hardware sensor that is in a known physical relationship with the cellular device;
determining, performed by the first process, a first set of one or more position fixes based on the extracted raw pseudorange information;
determining, performed by the second process, carrier phase smoothed
pseudoranges by smoothing the extracted raw pseudorange information based on carrier phase information;
determining, performed by the second process, a second set of one or more position fixes based on the carrier phase smoothed pseudoranges;
while a predetermined amount of carrier phase information is not available for performing carrier phase smoothing, providing to a user one or more of the first set of position fixes; and
while a predetermined amount of carrier phase information is available for performing carrier phase smoothing, providing to the user one or more of the second set of position fixes.
Concept 24. The method as recited by Concept 23, wherein the method further comprises: applying the locally measured movement information to the first set of position fixes and the second set of position fixes while the locally measured movement information is available.
Concept 25. The method as recited by Concept 23, wherein the method further comprises: creating blended locally measured movement information by blending locally measured movement information from two or more sensors associated with the cellular device; and
applying the blended locally measured movement information to the first set of the position fixes while the blended locally measured movement information is available.
Concept 26. The method as recited by Concept 25, wherein the applying of the blended locally measured movement information further comprises:
applying the blended locally measured movement information to the first set of the position fixes and the second set of position fixes while the blended locally measured movement information is available.
Concept 27. The method as recited by Concept 25, wherein the creating of the blended locally measured movement information further comprises:
blending the locally measured movement information from the sensors based on weighting factors.
Concept 28. The method as recited by Concept 23, wherein the method further comprises:
determining whether to provide a position fix from the first set or the second set depending on whether a predetermined amount of carrier phase information is available, wherein a position fix is provided from the first set when a predetermined amount of carrier phase information is not available and a position fix is provided from the second set when a predetermined amount of carrier phase information is available.
Concept 29. The method as recited by Concept 23, wherein the method further comprises:
obtaining external corrections from a correction source that is external to the cellular device;
providing, performed by the first process, corrected unsmoothed pseudoranges by applying the external corrections to the extracted raw pseudoranges; and
determining, performed by the first process, the first set of position fixes based on the corrected unsmoothed pseudoranges.
Concept 30. The method as recited by Concept 23, wherein the method further comprises: obtaining external corrections from a correction source that is external to the cellular device;
providing, performed by the second process, corrected smoothed pseudoranges by applying the external corrections to the carrier phase smoothed pseudoranges; and
determining, performed by the second process, the second set of position fixes based on the corrected smoothed pseudoranges.
Concept 31. A system for improving position determination of a cellular device, the system comprising:
one or more hardware processors located in the cellular device and outside of a Global Navigation Satellite System (GNSS) chipset embedded in the cellular device;
the one or more hardware processors that concurrently executes a first process and a second process;
extracting logic that extracts raw pseudorange information from the GNSS receiver; locally measured movement information accessing logic that obtains locally measured movement information that reflects measurements of movement of the cellular device, wherein the measurements are obtained using at least one hardware sensor that is in a known physical relationship with the cellular device; and
processing logic that:
determines, performed by the first process, a first set of one or more position fixes based on the extracted raw pseudorange information;
determines, performed by the second process, carrier phase smoothed pseudoranges by smoothing the extracted raw pseudorange information based on carrier phase information;
determines, performed by the second process, a second set of one or more position fixes based on the carrier phase smoothed pseudoranges; while a predetermined amount of carrier phase information is not available for performing carrier phase smoothing, provides to a user one or more of the first set of position fixes; and
while a predetermined amount of carrier phase information is available for performing carrier phase smoothing, provides to the user one or more of the second set of position fixes.
Concept 32. The system as recited by Concept 31 , wherein the processing logic further applies the locally measured movement information to the first set of position fixes and the second set of position fixes while the locally measured movement information is available. Concept 33. The system as recited by Concept 31 , wherein the at least one hardware sensor is selected from a group consisting of a hardware sensor that is internal to the cellular device and a hardware sensor that is physically coupled to the cellular device.
Concept 34. The system as recited by Concept 31 , wherein the at least one hardware sensor is selected from a group consisting of an image capturing device and an
accelerometer.
Concept 35. The system as recited by Concept 31 , wherein:
the processing logic discards at least one of the first set of position fixes based on the locally measured movement information, wherein the first process discards the at least one of the first set of position fixes based on the locally measured movement information.
Concept 36. The system as recited by Concept 31 , wherein:
the processing logic discards at least one of the second set of position fixes based on the locally measured movement information, wherein the second process discards the at least one of the second set of position fixes based on the locally measured movement information.
Concept 37. The system as recited by Concept 31 , wherein the system further comprises: control logic that determines whether to provide a position fix from the first set or the second set depending on whether a predetermined amount of carrier phase information is available; and
position fix determining logic provides a position fix from the first set when a predetermined amount of carrier phase information is not available and a position fix is provided from the second set when a predetermined amount of carrier phase information is available.
Concept 38. The system as recited by Concept 31 , wherein the processing logic further: obtains external corrections from a correction source that is external to the cellular device;
provides, performed by the first process, corrected unsmoothed pseudoranges by applying the external corrections to the extracted raw pseudoranges; and
determines, performed by the first process, the first set of position fixes based on the corrected unsmoothed pseudoranges.
Concept 39. The system as recited by Concept 31 , wherein the processing logic further: obtains external corrections from a correction source that is external to the cellular device;
provides, performed by the second process, corrected smoothed pseudoranges by applying the external corrections to the carrier phase smoothed pseudoranges; and
determines, performed by the second process, the second set of position fixes based on the corrected smoothed pseudoranges.
Concept 40. The system as recited by Concept 31 , wherein the cellular device comprises a cellular communication enabled mobile communications device.
Concept 41. A non-transitory computer readable storage medium having computer readable instructions stored thereon for causing a computer system to perform a method of improving position determination of a cellular device using locally measured movement, the method comprising:
executing, performed by one or more hardware processors located in the cellular device and outside of a Global Navigation Satellite System (GNSS) chipset embedded in the cellular device, a first process and a second process concurrently;
extracting raw pseudorange information from the GNSS receiver;
obtaining locally measured movement information that reflects measurements of movement of the cellular device, wherein the measurements are obtained using at least one hardware sensor that is in a known physical relationship with the cellular device;
determining, performed by the first process, a first set of one or more position fixes based on the extracted raw pseudorange information;
determining, performed by the second process, carrier phase smoothed
pseudoranges by smoothing the extracted raw pseudorange information based on carrier phase information;
determining, performed by the second process, a second set of one or more position fixes based on the carrier phase smoothed pseudoranges;
while a predetermined amount of carrier phase information is not available for performing carrier phase smoothing, providing to a user one or more of the first set of position fixes; and
while a predetermined amount of carrier phase information is available for performing carrier phase smoothing, providing to the user one or more of the second set of position fixes.
Concept 42. The non-transitory computer readable storage medium as recited by Concept 41 , wherein the method further comprises: applying the locally measured movement information to the first set of position fixes and the second set of position fixes while the locally measured movement information is available.
Concept 43. The non-transitory computer readable storage medium as recited by Concept 41 , wherein the method further comprises:
discarding, performed by the first process, at least one of the first set of position fixes based on the locally measured movement information.
Concept 44. The non-transitory computer readable storage medium as recited by Concept 41 , wherein the method further comprises:
discarding, performed by the second process, at least one of the second set of position fixes based on the locally measured movement information.
Concept 45. The non-transitory computer readable storage medium as recited by Concept 41 , wherein the method further comprises:
determining whether to provide a position fix from the first set or the second set depending on whether a predetermined amount of carrier phase information is available, wherein a position fix is provided from the first set when a predetermined amount of carrier phase information is not available and a position fix is provided from the second set when a predetermined amount of carrier phase information is available.
Concept 46. The non-transitory computer readable storage medium as recited by Concept 41 , wherein the method further comprises:
obtaining external corrections from a correction source that is external to the cellular device;
providing, performed by the first process, corrected unsmoothed pseudoranges by applying the external corrections to the extracted raw pseudoranges; and
determining, performed by the first process, the first set of position fixes based on the corrected unsmoothed pseudoranges.
Concept 47. The non-transitory computer readable storage medium as recited by Concept 41 , wherein the method further comprises:
obtaining external corrections from a correction source that is external to the cellular device;
providing, performed by the second process, corrected smoothed pseudoranges by applying the external corrections to the carrier phase smoothed pseudoranges; and determining, performed by the second process, the second set of position fixes based on the corrected smoothed pseudoranges.
Conclusion
[00742] Example embodiments of the subject matter are thus described. Although the subject matter has been described in a language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
[00743] Various embodiments have been described in various combinations and illustrations. However, any two or more embodiments or features may be combined.
Further, any embodiment or feature may be used separately from any other embodiment or feature. Phrases, such as "an embodiment," "one embodiment," among others, used herein, are not necessarily referring to the same embodiment. Features, structures, or
characteristics of any embodiment may be combined in any suitable manner with one or more other features, structures, or characteristics.

Claims

CLAIMS What is Claimed is:
1. A method of improving position determination of a cellular device using locally measured movement, the method comprising:
accessing a Global Navigation Satellite System (GNSS) chipset embedded within the cellular device, wherein the GNSS chipset calculates raw pseudoranges;
extracting the raw pseudoranges from the GNSS chipset for processing elsewhere in the cellular device outside of the GNSS chipset;
calculating a position fix based on the raw pseudoranges;
obtaining, at a first point in time, a first image with an image capturing device that is in a known physical relationship with the cellular device;
obtaining, at a second point in time, a second image with the image capturing device; calculating an estimate of a distance that the cellular device moved from the first point in time to the second point in time by processing image data collected for a time frame from the first point in time to the second point in time; and
processing the position fix based on the estimate of the distance,
wherein the accessing, the extracting, the calculating of the position fix, the obtaining the first image, the obtaining the second image, the calculating of the estimate, and the processing of the position fix are performed by one or more hardware processors located in the cellular device and outside of the GNSS chipset.
2. The method as recited by Claim 1 , wherein the estimate is a first estimate and wherein the method further comprises:
obtaining, at the first point in time, first accelerometer data from an accelerometer that is part of the cellular device;
obtaining, at the second point in time, second accelerometer data form the accelerometer;
calculating a second estimate of the distance based on the first accelerometer data and the second accelerometer data; and
determining a third estimate by blending the first estimate and the second estimate using a filter,
wherein the obtaining of the first accelerometer data, the obtaining of the second accelerometer data, the calculating of the second estimate and the determining of the third estimate are performed by the one or more hardware processors.
3. The method as recited by Claim 1 , wherein the processing of the position fix further comprises:
determining whether to discard the position fix based on the estimate of the distance; and
if the position fix is discarded,
interpolating a new position fix based on the distance and two or more position fixes that precede the discarded position fix; and
replacing the discarded position fix with the new position fix,
wherein the determining whether to discard, the interpolating and the replacing are performed by the one or more hardware processors.
4. The method as recited by Claim 1 , wherein the position fix is a current position fix of the cellular device and wherein the method further comprises:
obtaining a set of images 1 to n using the image capturing device from at least the first point in time to the second point in time, each image of the set of images 1 to n includes a set of image data and images 1 to n-1 has at least one respective subsequent image and images 2 to n has at least one respective previous image;
calculating position fix estimates of positions of the cellular device between the first point in time and the second point in time by replacing a set of image data included in an image with a set of image data included in a respective subsequent image;
determining a previous position fix, based on previous raw pseudoranges, wherein the previous position fix correlates with a position of the cellular device at a time that is less than or equal to the second point in time; and
determining the estimate of the distance based on the previous position fix and at least one of the position fix estimates.
5. A system for improving position determination of a cellular device using locally measured movement, the system comprising:
an accessing logic that accesses a Global Navigation Satellite System (GNSS) chipset embedded within the cellular device, wherein the GNSS chipset calculates raw pseudoranges;
an extracting logic that extracts the raw pseudoranges from the GNSS chipset for processing elsewhere in the cellular device outside of the GNSS chipset;
a position fix determining logic that calculates a position fix based on the raw pseudoranges;
an image capturing device movement information accessing logic that obtains, at a first point in time, a first image with an image capturing device that is in a known physical relationship with the cellular device and that obtains, at a second point in time, a second image with the image capturing device; and
a processing logic that calculates an estimate of a distance that the cellular device moved from the first point in time to the second point in time by processing image data collected for a time frame from the first point in time to the second point in time, and that processes the position fix based on the estimate of the distance,
wherein the accessing logic, the extracting logic, the image capturing device movement information accessing logic, and the processing logic are performed by one or more hardware processors located in the cellular device and outside of the GNSS chipset.
6. A non-transitory computer readable storage medium having computer readable instructions stored thereon for causing a computer system to perform a method of improving position determination of a cellular device using locally measured movement, the method comprising:
accessing a Global Navigation Satellite System (GNSS) chipset embedded within the cellular device, wherein the GNSS chipset calculates raw pseudoranges;
extracting the raw pseudoranges from the GNSS chipset for processing elsewhere in the cellular device outside of the GNSS chipset;
calculating a position fix based on the raw pseudoranges;
obtaining, at a first point in time, a first image with an image capturing device that is in a known physical relationship with the cellular device;
obtaining, at a second point in time, a second image with the image capturing device; calculating an estimate of a distance that the cellular device moved from the first point in time to the second point in time by processing image data collected for a time frame from the first point in time to the second point in time; and
processing the position fix based on the estimate of the distance,
wherein the accessing, the extracting, the calculating of the position fix, the obtaining the first image, the obtaining the second image, the calculating of the estimate, and the processing of the position fix are performed by one or more hardware processors located in the cellular device and outside of the GNSS chipset.
7. The non-transitory computer readable storage medium as recited by Claim 6, wherein the calculating the estimate of the distance that the cellular device moved from the first point in time to the second point in time by processing image data collected for the time frame from the first point in time to the second point in time further comprises:
calculating the estimate of the distance that the cellular device moved from the first point in time to the second point in time by processing image data collected for the time frame from the first point in time to the second point in time using a sequential rolling bundle adjustment algorithm.
8. The non-transitory computer readable storage medium as recited by Claim 6, wherein the processing of the position fix further comprises:
determining whether to discard the position fix based on the estimate of the distance; and
if the position fix is discarded,
interpolating a new position fix based on the distance and two or more position fixes that precede the discarded position fix; and
replacing the discarded position fix with the new position fix,
wherein the determining whether to discard, the interpolating and the replacing are performed by the one or more hardware processors.
9. A method of improving position determination of a cellular device, the method comprising:
executing, performed by at least one hardware processor located in the cellular device and outside of a Global Navigation Satellite System (GNSS) chipset embedded in the cellular device, a first process and a second process concurrently;
extracting raw pseudorange information from the GNSS receiver;
obtaining locally measured movement information that reflects measurements of movement of the cellular device, wherein the measurements are obtained using at least one hardware sensor that is in a known physical relationship with the cellular device;
determining, performed by the first process, a first set of one or more position fixes based on the extracted raw pseudorange information;
determining, performed by the second process, carrier phase smoothed
pseudoranges by smoothing the extracted raw pseudorange information based on carrier phase information;
determining, performed by the second process, a second set of one or more position fixes based on the carrier phase smoothed pseudoranges;
while a predetermined amount of carrier phase information is not available for performing carrier phase smoothing, providing to a user one or more of the first set of position fixes; and
while a predetermined amount of carrier phase information is available for performing carrier phase smoothing, providing to the user one or more of the second set of position fixes.
10. The method as recited by Claim 9, wherein the method further comprises:
creating blended locally measured movement information by blending locally measured movement information from two or more sensors associated with the cellular device; and
applying the blended locally measured movement information to the first set of the position fixes while the blended locally measured movement information is available.
1 1 . The method as recited by Claim 9, wherein the method further comprises:
determining whether to provide a position fix from the first set or the second set depending on whether a predetermined amount of carrier phase information is available, wherein a position fix is provided from the first set when a predetermined amount of carrier phase information is not available and a position fix is provided from the second set when a predetermined amount of carrier phase information is available.
12. A system for improving position determination of a cellular device, the system comprising:
one or more hardware processors located in the cellular device and outside of a Global Navigation Satellite System (GNSS) chipset embedded in the cellular device;
the one or more hardware processors that concurrently executes a first process and a second process;
extracting logic that extracts raw pseudorange information from the GNSS receiver; locally measured movement information accessing logic that obtains locally measured movement information that reflects measurements of movement of the cellular device, wherein the measurements are obtained using at least one hardware sensor that is in a known physical relationship with the cellular device; and
processing logic that:
determines, performed by the first process, a first set of one or more position fixes based on the extracted raw pseudorange information;
determines, performed by the second process, carrier phase smoothed pseudoranges by smoothing the extracted raw pseudorange information based on carrier phase information;
determines, performed by the second process, a second set of one or more position fixes based on the carrier phase smoothed pseudoranges; while a predetermined amount of carrier phase information is not available for performing carrier phase smoothing, provides to a user one or more of the first set of position fixes; and while a predetermined amount of carrier phase information is available for performing carrier phase smoothing, provides to the user one or more of the second set of position fixes.
13. The system as recited by Claim 12, wherein the system further comprises:
control logic that determines whether to provide a position fix from the first set or the second set depending on whether a predetermined amount of carrier phase information is available; and
position fix determining logic provides a position fix from the first set when a predetermined amount of carrier phase information is not available and a position fix is provided from the second set when a predetermined amount of carrier phase information is available.
14. A non-transitory computer readable storage medium having computer readable instructions stored thereon for causing a computer system to perform a method of improving position determination of a cellular device using locally measured movement, the method comprising:
executing, performed by one or more hardware processors located in the cellular device and outside of a Global Navigation Satellite System (GNSS) chipset embedded in the cellular device, a first process and a second process concurrently;
extracting raw pseudorange information from the GNSS receiver;
obtaining locally measured movement information that reflects measurements of movement of the cellular device, wherein the measurements are obtained using at least one hardware sensor that is in a known physical relationship with the cellular device;
determining, performed by the first process, a first set of one or more position fixes based on the extracted raw pseudorange information;
determining, performed by the second process, carrier phase smoothed
pseudoranges by smoothing the extracted raw pseudorange information based on carrier phase information;
determining, performed by the second process, a second set of one or more position fixes based on the carrier phase smoothed pseudoranges;
while a predetermined amount of carrier phase information is not available for performing carrier phase smoothing, providing to a user one or more of the first set of position fixes; and
while a predetermined amount of carrier phase information is available for performing carrier phase smoothing, providing to the user one or more of the second set of position fixes.
15. The non-transitory computer readable storage medium as recited by Claim 14, wherein the method further comprises:
determining whether to provide a position fix from the first set or the second set depending on whether a predetermined amount of carrier phase information is available, wherein a position fix is provided from the first set when a predetermined amount of carrier phase information is not available and a position fix is provided from the second set when a predetermined amount of carrier phase information is available.
EP15721983.3A 2014-05-02 2015-04-30 Dead reckoning system based on locally measured movement Active EP3137923B1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/268,993 US9602974B2 (en) 2012-12-28 2014-05-02 Dead reconing system based on locally measured movement
US14/268,998 US9743373B2 (en) 2012-12-28 2014-05-02 Concurrent dual processing of pseudoranges with corrections
PCT/US2015/028622 WO2015168460A1 (en) 2014-05-02 2015-04-30 Dead reckoning system based on locally measured movement

Publications (2)

Publication Number Publication Date
EP3137923A1 true EP3137923A1 (en) 2017-03-08
EP3137923B1 EP3137923B1 (en) 2021-08-18

Family

ID=53175189

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15721983.3A Active EP3137923B1 (en) 2014-05-02 2015-04-30 Dead reckoning system based on locally measured movement

Country Status (2)

Country Link
EP (1) EP3137923B1 (en)
WO (1) WO2015168460A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11047992B2 (en) 2017-06-09 2021-06-29 Panasonic Intellectual Property Management Co., Ltd. Positioning method and positioning terminal
CN111077546A (en) * 2019-12-26 2020-04-28 广州比逊电子科技有限公司 Positioning jumping point processing method applied to unmanned aerial vehicle and receiver equipment
CN112070387B (en) * 2020-09-04 2023-09-26 北京交通大学 Method for evaluating multipath component clustering performance of complex propagation environment
US11802971B2 (en) * 2021-03-02 2023-10-31 Qualcomm Incorporated Real-time kinematic (RTK) and differential global navigation satellite system (DGNSS) corrections using multiple reference stations
KR20230112411A (en) * 2022-01-20 2023-07-27 현대자동차주식회사 Apparatus and method for guiding a route for vehicle
CN118259323B (en) * 2024-03-20 2024-10-11 中国人民解放军32021部队 Satellite orbit determination method and device based on combined observation of space and ground

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110205116A1 (en) * 2008-10-28 2011-08-25 Naomi Fujisawa Satellite navigation device
EP2570823A1 (en) * 2011-09-19 2013-03-20 Raytheon Company Method and apparatus for differential global positioning system (DGPS) - based real time attitude determination (RTAD)

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5471217A (en) 1993-02-01 1995-11-28 Magnavox Electronic Systems Company Method and apparatus for smoothing code measurements in a global positioning system receiver
US5477228A (en) 1993-04-13 1995-12-19 Differential Corrections Inc. Differential global positioning system using radio data system
US5477458A (en) 1994-01-03 1995-12-19 Trimble Navigation Limited Network for carrier phase differential GPS corrections
US5621416A (en) 1995-02-02 1997-04-15 Trimble Navigation Limited Optimized processing of signals for enhanced cross-correlation in a satellite positioning system receiver
US6324473B1 (en) 1997-08-04 2001-11-27 Trimble Navigation Limited Method and apparatus for collecting, processing and distributing differential global positioning system information using the internet
US6711293B1 (en) 1999-03-08 2004-03-23 The University Of British Columbia Method and apparatus for identifying scale invariant features in an image and use of same for locating an object in an image
US7480511B2 (en) 2003-09-19 2009-01-20 Trimble Navigation Limited Method and system for delivering virtual reference station data
US7151489B2 (en) * 2003-11-19 2006-12-19 Sirf Technology, Inc. Method and system for multi-function satellite positioning system receivers
US7336814B2 (en) 2004-07-14 2008-02-26 Braintech Canada, Inc. Method and apparatus for machine-vision
JP5127128B2 (en) * 2004-12-21 2013-01-23 韓國電子通信研究院 Camera position and orientation information correction method and apparatus
US20080319664A1 (en) * 2007-06-25 2008-12-25 Tidex Systems Ltd. Navigation aid
WO2010042441A1 (en) 2008-10-06 2010-04-15 Trimble Navigation Limited Position estimation method and apparatus
JP5559997B2 (en) * 2009-07-17 2014-07-23 株式会社トプコン Position measuring method and position measuring apparatus
US8447519B2 (en) * 2010-11-10 2013-05-21 GM Global Technology Operations LLC Method of augmenting GPS or GPS/sensor vehicle positioning using additional in-vehicle vision sensors
KR101241171B1 (en) * 2011-11-22 2013-03-11 현대자동차주식회사 Method for correcting gps position information by image sensor

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110205116A1 (en) * 2008-10-28 2011-08-25 Naomi Fujisawa Satellite navigation device
EP2570823A1 (en) * 2011-09-19 2013-03-20 Raytheon Company Method and apparatus for differential global positioning system (DGPS) - based real time attitude determination (RTAD)

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
G?IXENS DANIEL SANROM? ET AL: "System Aspects and Practical Results for Precise Car Navigation with Modern Civil Signals using a Software Receiver", GNSS 2008 - PROCEEDINGS OF THE 21ST INTERNATIONAL TECHNICAL MEETING OF THE SATELLITE DIVISION OF THE INSTITUTE OF NAVIGATION (ION GNSS 2008), THE INSTITUTE OF NAVIGATION, 8551 RIXLEW LANE SUITE 360 MANASSAS, VA 20109, USA, 19 September 2008 (2008-09-19), pages 2280 - 2292, XP056002800 *
See also references of WO2015168460A1 *

Also Published As

Publication number Publication date
EP3137923B1 (en) 2021-08-18
WO2015168460A1 (en) 2015-11-05

Similar Documents

Publication Publication Date Title
US9910158B2 (en) Position determination of a cellular device using carrier phase smoothing
US9602974B2 (en) Dead reconing system based on locally measured movement
US9880286B2 (en) Locally measured movement smoothing of position fixes based on extracted pseudoranges
US9639941B2 (en) Scene documentation
US9538336B2 (en) Performing data collection based on internal raw observables using a mobile data collection platform
US9544737B2 (en) Performing data collection based on external raw observables using a mobile data collection platform
CN107850673B (en) Vision inertial ranging attitude drift calibration
US9456067B2 (en) External electronic distance measurement accessory for a mobile data collection platform
US9462446B2 (en) Collecting external accessory data at a mobile data collection platform that obtains raw observables from an internal chipset
US9467814B2 (en) Collecting external accessory data at a mobile data collection platform that obtains raw observables from an external GNSS raw observable provider
US9488736B2 (en) Locally measured movement smoothing of GNSS position fixes
EP3137923B1 (en) Dead reckoning system based on locally measured movement
US9821999B2 (en) External GNSS receiver module with motion sensor suite for contextual inference of user activity
US9612341B2 (en) GNSS receiver positioning system
US9369843B2 (en) Extracting pseudorange information using a cellular device
US20160327653A1 (en) System and method for fusion of camera and global navigation satellite system (gnss) carrier-phase measurements for globally-referenced mobile device pose determination
Hsu et al. Hong Kong UrbanNav: An open-source multisensory dataset for benchmarking urban navigation algorithms
Li et al. Multi-GNSS PPP/INS/Vision/LiDAR tightly integrated system for precise navigation in urban environments
Niu et al. A continuous positioning algorithm based on RTK and VI-SLAM with smartphones
WO2015168451A1 (en) Locally measured movement smoothing of gnss position fixes
US20220276394A1 (en) Map-aided satellite selection
EP3198303B1 (en) External gnss receiver module with motion sensor suite for contextual inference of user activity
Rossi et al. Comparison between rgb and rgb-d cameras for supporting low-cost gnss urban navigation
Ho Ubiquitous positioning based smartphone level GNSS, camera, and INS for smart city applications

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20161123

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
PUAG Search results despatched under rule 164(2) epc together with communication from examining division

Free format text: ORIGINAL CODE: 0009017

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20201022

B565 Issuance of search results under rule 164(2) epc

Effective date: 20201022

RIC1 Information provided on ipc code assigned before grant

Ipc: G01S 19/49 20100101ALI20201019BHEP

Ipc: G01S 19/48 20100101AFI20201019BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20210420

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: TRIMBLE INC.

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602015072365

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Ref country code: AT

Ref legal event code: REF

Ref document number: 1422130

Country of ref document: AT

Kind code of ref document: T

Effective date: 20210915

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20210818

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1422130

Country of ref document: AT

Kind code of ref document: T

Effective date: 20210818

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211118

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211220

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211118

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602015072365

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20220519

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20220430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220430

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220430

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20150430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240423

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240429

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240430

Year of fee payment: 10

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210818