US20190361109A1

US20190361109A1 - High precision time of flight measurement system for industrial automation

Info

Publication number: US20190361109A1
Application number: US16/536,095
Authority: US
Inventors: David A. Mindell; Gregory L. Charvat; Michael Hirsch; James Campbell Kinsey; Matthew Ian Beane
Original assignee: Humatics Corp
Current assignee: Humatics Corp
Priority date: 2015-06-15
Filing date: 2019-08-08
Publication date: 2019-11-28
Also published as: US10422870B2; US20180239010A1

Abstract

A system for tracking position of objects in an industrial environment includes an interrogator, a transponder, and a processor. The interrogator transmits a signal and provides a first reference signal corresponding to the transmitted signal. The transponder provides a response signal. The interrogator receives the response signal and provides a second reference signal corresponding to the response signal. The processor determines a location of either the interrogator or the transponder, relative to the other, based on the two reference signals.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

This Application is a divisional claiming the benefit under 35 U.S.C. § 120 of U.S. application Ser. No. 15/960,224, filed Apr. 23, 2018, entitled “HIGH PRECISION TIME OF FLIGHT MEASUREMENT SYSTEM FOR INDUSTRIAL AUTOMATION,” which is a continuation claiming the benefit under 35 U.S.C. § 120 of U.S. application Ser. No. 15/181,999, filed Jun. 14, 2016, entitled “HIGH PRECISION TIME OF FLIGHT MEASUREMENT SYSTEM FOR INDUSTRIAL AUTOMATION”, which claims the benefit under 35 U.S.C. § 119(e) of U.S. Provisional Application Ser. No. 62/175,819, filed Jun. 15, 2015; U.S. Provisional Application Ser. No. 62/198,633, filed Jul. 29, 2015; U.S. Provisional Application Ser. No. 62/243,264, filed Oct. 19, 2015; U.S. Provisional Application Ser. No. 62/253,983, filed Nov. 11, 2015; U.S. Provisional Application Ser. Nos. 62/268,727, 62/268,734, 62/268,736, 62/268,741, and 62/268,745, each filed Dec. 17, 2015; U.S. Provisional Application Ser. No. 62/271,136, filed Dec. 22, 2015; U.S. Provisional Application Ser. No. 62/275,400, filed Jan. 6, 2016; and U.S. Provisional Application Ser. Nos. 62/306,469, 62/306,478, and 62/306,483, each filed Mar. 10, 2016, each of which is herein incorporated by reference in its entirety for all purposes.

BACKGROUND

1. Field of the Disclosure

The present disclosure generally relates to tracking objects in an industrial automation environment, and more particularly to tracking motion of industrial equipment or employees.

2. Discussion of Related Art

Industrial environments, such as manufacturing facilities, warehouses, fulfillment centers, etc., typically have a mix of personnel, machinery, and equipment working among and in combination with each other. Automated equipment and machinery, human-controlled equipment and machinery, and human personnel may all move about independently of each other and may pose risks to each other or may not perform their functions in an efficient or coordinated manner. Traditional systems to optimize operations and/or detect danger typically involve independent sensors on machinery and rules or operating procedures imposed upon humans, all of which are subject to malfunction, error, or actions out of the ordinary. There exists a need, therefore, for a set of components, a system, and a method to increase automation and precision tracking of operations and movement within industrial environments.

SUMMARY

Aspects and embodiments relate to tracking objects in an industrial automation environment, and more particularly to tracking motion of industrial equipment or employees.
According to one aspect, a system for tracking position of objects includes at least one interrogator which transmits a first electromagnetic signal and provides a first reference signal corresponding to the transmitted signal; at least one transponder which receives the first electromagnetic signal and provides a response signal; the at least one interrogator including a receiver which receives the response signal and provides a second reference signal corresponding to the response signal; and a processor which in response to the first reference signal and the second reference signal determines a precise location of at least one of the at least one interrogator or the at least one transponder; wherein the objects to be tracked includes at least one of a part of one of a human, a piece of equipment, and an item; wherein the system is configured to determine a precise position and location of the human's body movement in cooperation with the piece of equipment or item; and wherein one of the at least one interrogator and the at least one transponder is configured to be mounted to the object.
In some embodiments the at least one interrogator includes a plurality of interrogators in fixed positions. In some embodiments the at least one transponder includes a plurality of transponders in fixed positions. In some embodiments one of the at least one interrogator and the at least one transponder is integrated into a wristband. In some embodiments the at least one interrogator and the at least one transponder is integrated into a personal digital device. In some embodiments one of the at least one interrogator and the at least one transponder is configured with a feedback mechanism. In some embodiments the feedback mechanism includes one of a colored LED, a speaker, a microphone, a wireless beacon, an accelerometer, a gyroscope, and a haptic device. In some embodiments the system is configured to signal the feedback mechanism to give the human real time feedback regarding task performance. In some embodiments the feedback mechanism is configured to provide at least one indication of critical feedback and at least one other indication of routine feedback. In some embodiments the system is configured to provide the human with real time instructions. In some embodiments the system is configured to monitor and store work patterns of a limb of the human for one of analytics, performance monitoring, and training. In some embodiments the system is configured to track the piece of equipment or item for performance monitoring in a work environment. In some embodiments the work environment is one of a pick and pack environment, a warehouse environment, and an assembly environment. In some embodiments the limb is a person's hand and the system is configured for tracking the person's hand and the item to the selection of items from bins to provide real time feedback in a pick and pack environment. In some embodiments the system is configured for precisely tracking one or more human limbs in relation to the piece of equipment. In some embodiments the system is configured for actuating the industrial equipment to perform an action based on and in cooperation with the recognized movement the one or more limbs. In some embodiments the system is configured to detect a pending collision between the limb and piece of equipment, and in response to cause the industrial equipment to halt or to move out of the way of the collision. In some embodiments the system is configured for interpreting the movement of the human body part as a performable action. In some embodiments the system is configured to predict movement of the human limb. In some embodiments the system is configured for enabling setup or modifications of robotic lines to eliminate interference and optimize movement paths of robots operating in an industrial environment. In some embodiments the system is configured for automatic switching between modes of control for the piece of equipment based on the determined location of the piece of equipment. In some embodiments the system is configured for precise assembly or setup within tolerances of large scale machinery that has multiple subcomponents.
Still other aspects, embodiments, and advantages of these exemplary aspects and embodiments are discussed in detail below. Embodiments disclosed herein may be combined with other embodiments in any manner consistent with at least one of the principles disclosed herein, and references to “an embodiment,” “some embodiments,” “an alternate embodiment,” “various embodiments,” “one embodiment” or the like are not necessarily mutually exclusive and are intended to indicate that a particular feature, structure, or characteristic described may be included in at least on embodiment. The appearances of such terms herein are not necessarily all referring to the same embodiment.

BRIEF DESCRIPTION OF THE DRAWINGS

Various aspects of at least one embodiment are discussed below with reference to the accompanying figures, which are not intended to be drawn to scale. The figures are included to provide illustration and a further understanding of the various aspects and embodiments, and are incorporated in and constitute a part of this specification, but are not intended as a definition of the limits of the invention. In the figures, each identical or nearly identical component that is illustrated in various figures is represented by a like numeral. For purposes of clarity, not every component may be labeled in every figure.

In the Figures:

FIG. 1 illustrates one embodiment of a system for measuring distance with precision based on a bi-static ranging system configuration for measuring a direct time-of-flight (TOF);

FIG. 2 illustrates one embodiment of a system for measuring distance with precision based on frequency modulated continuous wave (FMCW) TOF signals;

FIG. 3 illustrates one embodiment of a system for measuring distance with precision based on direct sequence spread spectrum (DSSS) TOF signals;

FIG. 4 illustrates one embodiment of a system for measuring distance with precision based on wide-band, ultra-wide-band pulsed signals, or any pulse compressed waveform;

FIG. 5 illustrates one embodiment of a system for measuring distance with precision based on DSSS or frequency hopping spread spectrum (FHSS) FMCW ranging techniques;

FIG. 6 illustrates one embodiment of a system for measuring distance with precision with TOF signals having multiple transmitters, multiple transceivers, or a hybrid combination of transmitter and transceivers;

FIG. 7 illustrates one embodiment of a system for measuring distance with precision with TOF signals having multiple receivers, multiple transponders, or a hybrid combination of receivers and transponders;

FIG. 8 illustrates one embodiment of a system for measuring distance with precision with TOF signals having multiple transmitters, multiple transceivers, or a hybrid combination of transmitter and transceivers and well as multiple receivers, multiple transponders, or a hybrid combination of receivers and transponders;

FIG. 9 illustrates one embodiment of a system for measuring location with precision with modulated TOF signals;

FIG. 10 illustrates another embodiment of a system for measuring location with precision with modulated TOF signals;

FIG. 11 illustrates a block diagram of an interrogator for linear FMCW two-way TOF ranging;

FIG. 12 illustrates another embodiment of a block diagram of an interrogator for linear FMCW two-way TOF ranging;

FIG. 13 illustrates one embodiment of a system for measuring distance with precision with TOF signals for detecting movement of a user and/or industrial equipment; and

FIG. 14 illustrates another embodiment of a system for measuring distance with precision with TOF signals for detecting movement of a user and/or industrial equipment.

DETAILED DESCRIPTION

It is to be appreciated that embodiments of the methods and apparatuses discussed herein are not limited in application to the details of construction and the arrangement of components set forth in the following description or illustrated in the accompanying drawings. The methods and apparatuses are capable of implementation in other embodiments and of being practiced or of being carried out in various ways. Examples of specific implementations are provided herein for illustrative purposes only and are not intended to be limiting. Also, the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use herein of “including,” “comprising,” “having,” “containing,” “involving,” and variations thereof is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. References to “or” may be construed as inclusive so that any terms described using “or” may indicate any of a single, more than one, and all of the described terms. Any references to front and back, left and right, top and bottom, upper and lower, and vertical and horizontal are intended for convenience of description, not to limit the present systems and methods or their components to any one positional or spatial orientation.

Definitions:

A transceiver is a device comprising both a transmitter (an electronic device that, with the aid of an antenna, produces electromagnetic signals) and a receiver (an electronic device that, with the aid of an antenna, receives electromagnetic signals and converts the information carried by them to a usable form) that share common circuitry.
A transmitter-receiver is a device comprising both a transmitter and a receiver that are combined but do not share common circuitry.
A transmitter is a transmit-only device, but may refer to transmit components of a transmitter-receiver, a transceiver, or a transponder.
A receiver is a receive-only device, but may refer to receive components of a transmitter-receiver, a transceiver, or a transponder.
A transponder is a device that emits a signal in response to receiving an interrogating signal identifying the transponder and received from a transmitter.
Radar (for Radio Detection and Ranging) is an object-detection system that uses electromagnetic signals to determine the range, altitude, direction, or speed of objects. For purposes of this disclosure, “radar” refers to primary or “classical” radar, where a transmitter emits radiofrequency signals in a predetermined direction or directions, and a receiver listens for signals, or echoes, that are reflected back from an object.
Radio frequency signal or “RF signal” refers to electromagnetic signals in the RF signal spectrum that can be CW or pulsed or any form.
Pulse Compression or pulse compressed signal refers to any coded, arbitrary, or otherwise time-varying waveform to be used for Time-of-Flight (TOF) measurements, including but not limited to FMCW, Linear FM, pulsed CW, Impulse, Barker codes, and any other coded waveform.
Wired refers to a network of transmitters, transceivers, receivers, transponders, or any combination thereof, that are connected by a physical waveguide such as a cable to a central processor.
Wireless refers to a network of transmitters, transceivers, receivers, transponders, or any combination thereof that are connected only by electromagnetic signals transmitted and received wirelessly, not by physical waveguide.
Calibrating the network refers to measuring distances between a transmitters, transceivers, receivers, transponders, or any combination thereof.
High precision ranging refers to the use electromagnetic signals to measure distances millimeter or sub-millimeter precision.
One-way travel time or TOF refers to the time it takes an electromagnetic signal to travel from a transmitter or transceiver to a receiver or transponder.
Two-way travel time or TOF refers to the time it takes an electromagnetic signal to travel from a transmitter or transceiver to a transponder plus the time it takes for the signal, or response, to return to the transceiver or a receiver.

Referring to FIG. 1, aspects and embodiments of one embodiment of a system for measuring distance with precision of the present invention are based on a bi-static ranging system configuration, which measures a direct time of flight (TOF) of a transmitted signal between at least one transmitter 10 and at least one receiver 12. This embodiment of a ranging system of the invention can be characterized as an apparatus for measuring TOF of an electromagnetic signal 14. This embodiment of an apparatus is comprised of at least one transmitter 10, which transmits an electromagnetic signal 14 to at least one receiver 12, which receives the transmitted signal 14 and determines a time of flight of the received signal. A time of flight of the electromagnetic signal 14 between the transmission time of the signal 14 transmitted from the transmitter 10 to the time the signal is received by the receiver 12 is measured to determine the TOF of the signal 14 between the transmitter and the receiver. A signal processor within one of the transmitter 10 and the receiver 12 analyzes the received and sampled signal to determine the TOF. The TOF of the signal 14 is indicative of the distance between the transmitter 10 and the receiver 12, and can be used for many purposes, some examples of which are described herein.
A preferred embodiment of the ranging system of the present invention is illustrated and described with reference to FIG. 2. In particular, one embodiment of a ranging system according to the present invention includes a transmitter 10 which can, for example, be mounted on an object for which a position and/or range is to be sensed. The transmitter 10 transmits a frequency modulated continuous wave (FMCW) signal 14′. At least one receiver 12 is coupled to the transmitter 10 by a cable 16. The cable 16 returns the received transmitted signal received by the at least one receiver back to the transmitter 10. In the transmitter 10, the transmitted signal 14′ is split by a splitter 17 prior to being fed to and transmitted by an antenna 18. A portion of the transmitted signal 14′ that has been split by the splitter 16 is fed to a first port of a mixer 20 and is used as local oscillator (LO) signal input signal for the mixer. The transmitted signal 14′ is received by an antenna 22 at the receiver 12 and is output by the at least one receiver 12 to a combiner 24, which combines the received signals from the at least one receiver 12 and forwards the combined received signals with the cable 16 to a second port of the mixer 20. An output signal 21 from the mixer has a beat frequency that corresponds to a time difference between the transmitted signal from the transmitter 10 to the received signal by the receiver 12. Thus, the beat frequency of the output signal 21 of the mixer is representative of the distance between the transmitter and the receiver. The output signal 21 of the mixer 20 is supplied to an input of an Analog to Digital converter 26 to provide a sampled output signal 29. The sampled signal 29 can be provided to a processor 28 configured to determine the beat frequency to indicate a TOF, which is indicative of the distance between the transmitter and receiver.
This embodiment of the ranging system is based on the transmission and reception of an FMCW transmitted signal and determining a beat frequency difference between the transmitted and received signals. The beat frequency signal is proportional to the TOF distance between the transmitter and the receiver. By way of example, the sampled signal from the A/D converter 26 is fed to the Fast Fourier Transform (FFT) device 30 to transform the sampled time signal into the frequency domain x(t)⇒X(k). It will be understood that other transforms or algorithms may be used, such as multiple signal classifiers (MUSIC), estimation of signal parameters via rotational invariance techniques (ESPRIT), discrete Fourier transforms (DFT), and inverse Fourier transforms (IFT), for example. From the FFT, the TOF of the signal 14′ can be determined. In particular, the data output from the A/D converter 26 is a filtered set of amplitudes, with some low frequency noise. According to aspects of this embodiment a minimum amplitude threshold for object detection to occur can be set so that detection is triggered by an amplitude above the minimum threshold. If an amplitude of the sampled signal at a given frequency does not reach the threshold, it may be ignored.
In the system illustrated in FIG. 2, any number of additional receivers 12 can be included in the system. The output signals from the additional receivers 12 are selected by a switch 24 and fed back to the transmitter 10 by the cable 16 to provide selected received signals at the additional receivers for additional time of flight measured signals at additional receivers 12. In an alternate embodiment, the mixer 20 and the A/D converter 26 can be included in each receiver to output a digital signal from each receiver. In this embodiment, the digital signal can be selected and fed back to the transmitter for further processing. It is appreciated that for this embodiment, the FFT processing can be done either in each receiver or at the transmitter. The TOF measured signals resulting from the additional receivers 12 can be processed to indicate the position of the object to which the transmitter 10 is mounted with a number of degrees of freedom and with excellent resolution according to the present invention. Also as is illustrated with reference to FIG. 8, according to aspects and embodiments of this disclosure, it is appreciated that multiple transmitters can be coupled to multiple receivers to produce a sophisticated position-detecting system.
In the ranging system of FIG. 2, at least one transmitter 10 can be mounted on an object to be tracked in distance and position. The receivers each generate a signal for determining a TOF measurement for the signal 14′ transmitted by the transmitter. The receivers 12 are coupled to the processor 28 to produce data indicating the TOF from the transmitter to each of the three receivers, which can be used for precise position detection of the transmitter 10 coupled to the object. It is appreciated that various arrangements of transmitters and receivers may be used to triangulate the position of the object to which the transmitter is attached, providing information such as x, y, z position as well as translation and 3 axes of rotation of the transmitter 10.
It is appreciated that for any of the embodiments and aspects disclosed herein, there can be coordinated timing between the transmitter and receivers to achieve the precise distance measurements. It is also appreciated that the disclosed embodiments of the system are capable of measuring distance by TOP on the order of about a millimeter or sub-millimeter scale in precision, at 1 Hz or less in frequency over a total range of hundreds of meters. It is anticipated that embodiments of the system can be implemented with very low-cost components for less $100.

Modulation Ranging Systems.

Referring to FIG. 3, there is illustrated another embodiment of a ranging system 300 implemented according to the present invention. It is appreciated that various form of modulation such as harmonic modulation, Doppler modulation, amplitude modulation, phase modulation, frequency modulation, signal encoding, and combinations thereof can be used to provide precision navigation and localization. One such example is illustrated in FIG. 3, which illustrates a use of pulsed direct sequence spread spectrum (DSSS) signals 32 to determine range or distance. In direct sequence spread spectrum ranging systems, code modulation of the transmitted signal 32 and demodulation of a received and re-transmitted signal 36 can be done by phase shift modulating a carrier signal. A transmitter portion of a transceiver 38 transmits via an antenna 40 a pseudo-noise code-modulated signal 32 having a frequency F1. It is to be appreciated that in a duplex ranging system, the transceiver 38 and a transponder 42 can operate simultaneously.
As shown in FIG. 3, the transponder 42 receives the transmitted signal 32 having frequency F1, which is fed to and translated by a translator 34 to a different frequency F2, which can be for example 2×F1 and is retransmitted by the transponder 42 as code-modulated signal 36 having frequency F2. A receiver subsystem of the transceiver 38, which is co-located with the transmitter portion of the transceiver 38 receives the retransmitted signal 36 and synchronizes to the return signal. In particular, by measuring the time delay between the transmitted signal 32 being transmitted and received signal 36, the system can determine the range from itself to the transponder. In this embodiment, the time delay corresponds to the two-way propagation delay of the transmitted 32 and retransmitted signals 36.
According to aspects of this embodiment, the system can include two separate PN code generators 44, 46 for the transmitter and receiver subsystems of the transceiver 38, so that the code at the receiver portion of the transceiver can be out of phase with the transmitted code or so that the codes can be different.
The transmitter portion of the transceiver 38 for measuring TOF distance of an electromagnetic signal comprises a 1st pseudo noise generator 44 for generating a first phase shift signal, a first mixer 48 which receives a carrier signal 50, which modulates the carrier signal with a first phase shift signal 52 to provide a pseudo-noise code-modulated signal 32 having a center frequency F1 that is transmitted by the transceiver 38. The transponder apparatus 42 comprises the translator 34 which receives the pseudo-noise code-modulated signal 32 having center frequency F1 and translates the pseudo-noise code-modulated signal of frequency F1 to provide a translated pseudo-noise code-modulated signal having a center frequency F2 or that provides a different coded signal centered at the center frequency F1, and that is transmitted by the transponder back to the transceiver 38. The transceiver apparatus 38 further comprises a second pseudo noise generator 46 for generating a second phase shift signal 56, and a second mixer 54 which receives the second phase shift signal 56 from the pseudo-noise generator 46, which receives the translated pseudo-noise code-modulated signal 36 at frequency F2 and modulates the pseudo-correlated code-modulated signal 36 having center frequency F2 with the second phase shift signal 56 to provide a return signal 60. The apparatus further comprises a detector 62 which detects the return signal 60, and a ranging device/counter 64 that measures the time delay between the transmitted signal 32 and the received signal 36 to determine the round trip range from the transceiver 38 to the transponder 42 and back to the transceiver 38 so as to determine the two-way propagation delay. According to aspects of some embodiments, the first PN generator 44 and the second PN generator 46 can be two separate PN code generators.
It is appreciated that the preciseness of this embodiment of the system depends on the signal-to-noise ratio (SNR) of the signal, the bandwidth, and the sampling rate of the sampled signals. It is also appreciated that this embodiment of the system can use any pulse compressed signal.
FIG. 9 illustrates another embodiment of a modulation ranging system 301. This embodiment can be used to provide a transmitted signal at frequency F1 from interrogator 380, which is received and harmonically modulated by transponder 420 to provide a harmonic return signal 360 at F2, which can be for example 2×F1, that is transmitted by the transponder 420 back to the interrogator 380 to determine precise location of the transponder. With the harmonic ranging system, the doubling of the transmitted signal 320 by the transponder can be used to differentiate the retransmitted transponder signal from a signal reflected for example by scene clutter.
As illustrated by FIGS. 3 and 9-10 along with the discussion above, a transponder 42, 420, 421, 423 may translate a received frequency F1 to a response frequency F2 and the response frequency F2 may be harmonically related to F1. A simple harmonic transponder device capable of doing so may include a single diode used as a frequency doubler, or multiplier, coupled to one or more antennas. FIG. 9 illustrates a simple harmonic transponder 423 that includes a receive antenna RX, a multiplier 422 that can simply be a diode, an optional battery 425, and an optional auxiliary receiver 427. FIG. 3 shows a transponder 42 having a single antenna for both receiving and transmitting signals to and from the transponder 42, while FIG. 9 shows separate antennas (labelled RX,TX) for both receiving and transmitting signals to and from the transponders 420, 423. It is appreciated that embodiments of any transponder 42, 420, 421, and 423 as disclosed herein, may have may have one shared antenna, may have multiple antennas such as a TX and an RX antenna, and may include different antenna arrangements.
An embodiment of transponder 42, 420, 421, 423 can include a frequency multiplying element 422, such as but not limited to a diode, integrated into an antenna structure. For example, a diode may be placed upon and coupled to a conducting structure, such as a patch antenna or microstrip antenna structure, and placed in a configuration so as to match impedance of a received and/or transmitted signal so as to be capable of exciting antenna modes at each of the receive and response frequencies.
An embodiment of a passive harmonic transponder 423 includes a low power source such as a battery 425 (for example a watch battery), which can be used to reverse bias the diode multiplier 422 to normally be off, and the low power source can be turned off to turn the harmonic transponder to an on state (a wake up state) to multiply or otherwise harmonically shift a frequency of a received signal. The low power source can be used to reverse bias the multiplier 422 to turn on and off the transponder, for example in applications like those discussed herein. According to an embodiment of the transponder, the power source 425 can also be configured to forward bias the multiplexer (diode) 422 to increase the sensitivity and increase the range of the transponder to kilometer range up from for example, a 10-100 meter range. In still another embodiment, amplification (LNA, LNA2, LNA3, LNA4) either solely or in combination with forward biasing of the multiplier diode 422, may also or alternatively be used to increase sensitivity of the transponder. It is appreciated that in general, amplification may be employed with any transponder to increase the sensitivity of any of the embodiments of a transponder of any of the ranging systems as disclosed herein.
According to aspects and embodiments, the diode-based transponder 423 can be a passive transponder that is configured to use very little power and may be powered via button-type or watch battery, and/or may be powered by energy harvesting techniques. This embodiment of the transponder is configured to consume low amounts of energy with the transponder in the powered off mode most of the time, and occasionally being switched to a wake up state. It is appreciated that the reverse biasing of the diode and the switching on and off of the diode bias takes little power. This would allow passive embodiments of the transponder 423 to run off of watch batteries or other low power sources, or to even be battery-less by using power harvesting techniques, for example from the TOF electromagnetic signals, or from motion, such as a piezoelectric source, a solenoid, or an inertial generator, or from a light source, e.g., solar. With such an arrangement, the interrogator 38, 380, 381 can include an auxiliary wireless transmitter 429 and the transponder 42, 420, 421, and 423 can include an auxiliary wireless receiver 427 as discussed herein, particularly with respect to FIGS. 3, 9-10, that is used to address each transponder to tell each transponder when to wake up. The auxiliary signal transmitted by auxiliary wireless transmitter 429 and received by auxiliary wireless receiver 427 is used to address each transponder to tell each transponder when to turn on and turn off. One advantage of providing the interrogator with the auxiliary wireless transmitter 429 and each transponder with an auxiliary wireless signal receiver 427 is that it provides for the TOF signal channel to be unburdened by unwanted signal noise such as, for example, communication signals from transponders that are not being used. With that said, it is also appreciated that another embodiment of the TOF system could in fact use the TOF signal channel to send and receive radio/control messages to and from the transponders to tell transponders to turn on and off, etc. With such an arrangement, the auxiliary wireless receiver 427 is optional.
It is appreciated that embodiments of the passive harmonic transponder 423 do not require a battery source that needs to be changed every day/few days. The passive harmonic transponder 423 can either have a long-life battery or for shorter range applications may be wirelessly powered by the main channel signal or by an auxiliary channel signal for longer range (e.g. the interrogator and transponder can operate over the 3-10 GHz range, while power harvesting can occur using either or both of the main signal range and a lower frequency range such as, for example, 900 MHz or 13 MHz. In contrast, classic harmonic radar tags simply respond as a chopper to an incoming signal, such that useful tag output power levels require very strong incoming signals such as >−30 dBm at the tag from a transmitter. It is appreciated that the passive harmonic transponder 423 provides a compact, long/unlimited lifetime long-range transponder by storing energy to bias the diode, drastically increasing the diode sensitivity and range of the transponder to, for example, 1 km scales.
One aspect of the embodiment shown in FIG. 9 of a modulation ranging system, or any of the embodiments of a ranging system as disclosed herein, is that each transponder 420 can be configured with an auxiliary wireless receiver 427 to be uniquely addressable by an auxiliary wireless signal 401 from the auxiliary wireless transmitter 429, such as for example a blue tooth signal, a Wi-Fi signal, a cellular signal, a Zigbee signal and the like, which can be transmitted by the interrogator 380. Thus, the interrogator 380 can be configured with an auxiliary wireless transmitter 429 to transmit an auxiliary wireless signal 401 to identify and turn on a particular transponder 420. For example, the auxiliary wireless signal 401 could be configured to turn on each transponder based on each transponder's serial number. With this arrangement, each transponder could be uniquely addressed by an auxiliary wireless signal provided by the interrogator. Alternately, an auxiliary signal to address and enable individual or groups of transponders may be an embedded control message in the transmitted interrogation signal, which may take the form of command protocols or unique codes. In other embodiments the auxiliary signal to enable a transponder may take various other forms.
As shown in FIG. 9, a transmitter portion of an interrogator 380 transmits via an antenna 400 a signal 320 having a frequency F1. The transponder can be prompted to wake up by auxiliary wireless transmitter 429 transmitting an auxiliary wireless signal and the transponder receiving with an auxiliary wireless receiver 427 the auxiliary wireless signal 401, such that the transponder 420 receives the transmitted signal 320 having frequency F1, which is doubled in frequency by the transponder to frequency F2 (=2×F1) and is retransmitted by the transponder 420 as signal 360 having frequency F2. A receiver subsystem of the interrogator 380, which is co-located with the transmitter portion of the interrogator 380 receives the retransmitted signal 360 and synchronizes the return signal to measure the precise distance and location between the interrogator 380 and the transponder 420. In particular, by measuring the time delay between the transmitted signal 320 being transmitted and the received signal 360, the system can determine the range from the interrogator to the transponder. In this embodiment, the time delay corresponds to the two-way propagation delay of the transmitted 320 and retransmitted signals 360.
For example, the transmitter portion of the interrogator 380 for measuring precise location of a transponder 420 comprises an oscillator 382 that provides a first signal 320 having a center frequency F1 that is transmitted by the interrogator 380. The transponder apparatus 420 comprises a frequency harmonic translator 422 which receives the first signal 320 having center frequency F1 and translates the signal of frequency F1 to provide a harmonic of the signal F1 having a center frequency F2, for example 2×F1 that is transmitted by the transponder 420 back to the interrogator 380. The interrogator 380 as shown further comprises four receive channels 390, 392, 394, 396 for receiving the signal F2. Each receive channel comprises a mixer 391, 393, 395, 397 which receives the second signal 360 at frequency F2 and down converts the return signal 360. The interrogator apparatus further comprises a detector which detects the return signal, an analog-to-digital converter and a processor to determine a precise measurement of the time delay between the transmitted signal 320 and the received signal 360 to determine the round trip range from the interrogator 380 to the transponder 420 and back to the interrogator 380 so as to determine the two-way propagation delay.
According to aspects of this embodiment, the interrogator can include four separate receive channels 390, 392, 394, 396 to receive the harmonic return frequencies of the retransmitted signal 401 in a spatially diverse array for the purpose of navigation. It is appreciated that the first signal 320 having a center frequency F1 can be varied in frequency according to any of the modulation schemes that have been discussed herein, such as, for example FMCW, and that the modulation could also be any of CW pulsed, pulsed, impulse, or any other waveform. It is to be appreciated that any number of channels can be used. It is also to be appreciated that in the four receive channels of the interrogator can either be multiplexed to receive the signal 360 at different times or can be configured to operate simultaneously. It is further appreciated that, at least in part because modulation is being used, the interrogator 380 and the transponder 420 can be configured to operate simultaneously.
It is to be appreciated that according to aspects and embodiments disclosed herein, the modulator can use different forms of modulation. For example, as noted above direct sequence spread spectrum (DSSS) modulation can be used. In addition, other forms of modulation such as Doppler modulation, amplitude modulation, phase modulation, coded modulation such as CDMA, or other known forms of modulation can be used either in combination with a frequency or harmonic translation or instead of a harmonic or frequency translation. In particular, the interrogator signal 320 and the transponder signal 360 can either be at the same frequency, i.e. F1, and a modulation of the interrogator signal by the transponder 420 can be done to provide the signal 360 at the same frequency F1, or the interrogator can also frequency translate the signal 320 to provide the signal 360 at a second frequency F2, which may be at a harmonic of F1, in addition to modulate the signal F1, or the interrogator can only frequency translate the signal 320 to provide the signal 360. As noted above, any of the noted modulation techniques provide the advantage of distinguishing the transponder signal 360 from background clutter reflected signal 320. It is to be appreciated that with some forms of modulation, the transponders can be uniquely identified by the modulation, such as coded modulation, to respond to the interrogation signal so that multiple transponders 420 can be operated simultaneously. In addition, as been noted herein, by using a coded waveform, there need not be a translation of frequency of the retransmitted signal 360, which has the advantage of providing a less expensive solution since no frequency translation is necessary.
It is to be appreciated that according to aspects and embodiments of any of the ranging system as disclosed herein, multiple channels may be used by various of the interrogator and transponder devices, for example, multiple frequency channels, quadrature phase channels, or code channels may be incorporated in either or both of interrogation or response signals. In other embodiments, additional channel schemes may be used. For example, one embodiment of a transponder 42, 420, 421, 423 can have both in phase and 90° out of phase (quadrature) channels with two different diodes where the diodes are modulated in quadrature by reverse biasing of the diodes. With such an arrangement, the interrogator could be configured to send coded waveform signals to different transponders simultaneously. In addition, other methods as discussed herein, such as polarization diversity, time sharing, a code-multiplexed scheme where each transponder has a unique pseudo-random code to make each transponder uniquely addressable, and the like provide for allow increased numbers of transponders to be continuously monitored at full energy sensitivity.
FIG. 10 illustrates another embodiment of a modulation ranging system 310. This embodiment can be used to provide a transmitted signal at frequency F1 from interrogator 381, which is received by transponder 421 and frequency translated by transponder 421 to provide a frequency shifted return signal 361 at F2, which can be arbitrarily related in frequency to F1 of the interrogator signal (it doesn't have to be a harmonic signal), that is transmitted by the transponder 421 back to the interrogator 381 to determine precise location of the transponder 421. With this arrangement illustrated in FIG. 10, for example the signal 321 at F1 can be at the 5.8 GHz Industrial Scientific and Medical band, and the return signal 361 at F2 can be in the 24 GHz ISM band. It is to be appreciated also that with this arrangement of a modulation system, the frequency shifting of the transmitted signal 321 by the transponder 421 can be used to differentiate the retransmitted transponder signal 361 from a signal reflected for example by background clutter.
One aspect of this embodiment 310 of a modulation ranging system or any of the embodiments of a ranging system as disclosed herein is that each transponder 42, 420, 421, 423 can be configured to be uniquely addressable to wake up each transponder by receiving with an auxiliary wireless receiver 427 an auxiliary wireless signal 401 from an auxiliary wireless transmitter 429, such as for example a blue tooth signal, a Wi-Fi signal, a cellular signal, a Zigbee signal, and the like, which auxiliary wireless signal can be transmitted by the interrogator 381. Thus, the interrogator 381 can be configured with an auxiliary signal transmitter 429 to transmit an auxiliary wireless signal 401 to identify and turn on a particular transponder 42, 420, 421, 423. For example, the auxiliary wireless signal could be configured to turn on each transponder based on each transponder's serial number. With this arrangement, each transponder could be uniquely addressed by an auxiliary wireless signal provided by the interrogator or another source.
With respect to FIG. 10, it is appreciated that an oscillator such as OSC3 will have finite frequency error that manifests itself as finite estimated position error. One possible mitigation with a low cost TCXO (temperature controlled crystal oscillator) used for OSC3 is to have a user periodically touch their transponder to a calibration target. This calibration target is equipped with magnetic, optical, radar, or other suitable close range high precision sensors to effectively null out the position error caused by any long-term or short-term drift of the TCXO or other suitable low cost high stability oscillator. The nulling out is retained in the radar and/or transponder as a set of calibration constants that may persist for minutes, hours, or days depending on the users position accuracy needs.
According to aspects and embodiments the interrogator and each transponder of the system can be configured to use a single antenna (same antenna) to both transmit and receive a signal. For example, the interrogator 38, 380, 381 can be configured with one antenna 40, 400, to transmit the interrogator signal 32, 320, 321 and receive the response signal 36, 360, 361. Similarly, the transponder can be configured with one antenna to receive the interrogator signal 32, 320, 321 and transmit the response signal 36, 360, 361. This can be accomplished, for example, if coded waveforms are used for the signals. Alternatively, where the signals are frequency translated but are close in frequency, such as for example 4.9 GHz and 5.8 GHz, the same antenna can be used. Alternatively or in addition, it may be possible to provide the interrogator signal 32, 320, 321 at a first polarization, such as Left Hand Circular Polarization (LHCP), Right Hand Circular Polarization (RHCP), vertical polarization, horizontal polarization, and to provide the interrogator signal 36, 360, 361 at a second polarization. It is appreciated that providing the signals with different polarizations can also enable a system with the interrogator and the transponder each using a single antenna, thereby reducing costs. It is further appreciated that using circular polarization techniques mitigates the reflections from background clutter thereby reducing the effects of multi-path return signals, because when using circular polarization, the reflected signal is flipped in polarization, and so the multipath return signals could be attenuated by using linear polarizations and/or polarization filters.
According to aspects and embodiments of any of the systems disclosed herein, it is further appreciated that there can be selective pinging of each transponder 42, 420, 421, 423 to wake up each transponder by receiving with an auxiliary wireless receiver 427 an auxiliary wireless signal 401, such as for example a blue tooth signal, a Wi-Fi signal, a cellular signal, a Zigbee signal and the like, which can be transmitted by the interrogator 380 to provide for scene data compression. In particular, there can be some latency when using an auxiliary wireless signal to identify and interrogate each transponder 42, 420, 421, 423. As the number of transponders increases, this can result in slowing down of interrogation of all the transponders. However, some transponders may not need to be interrogated as often as other transponders. For example, in an environment where some transponders may be moving and others may be stationary, the stationary transponders need not be interrogated as often as the transponders that are actively moving. Still others may not be moving as fast as other transponders. Thus, by dynamically assessing and pinging more frequently the transponders that are moving or that are moving faster than other transponders, there can be a compression of the transponder signals, which can be analogized for example to MPEG4 compression where only pixels that are changing are sampled.
According to aspects and embodiments disclosed herein, the interrogators and transponders can be configured with their own proprietary micro-location frequency allocation protocol so that the transponders and interrogators can operate at unused frequency bands that exist amongst existing allocated frequency bands. In addition, the interrogators and transponders can be configured so as to inform users of legacy systems at other frequencies for situational awareness, e.g. to use existing frequency allocations in situations that warrant using existing frequency band allocations. Some advantages of these aspects and embodiments are that it enables a control for all modes of travel (foot, car, aerial, boat, etc.) over existing wired and wireless backhaul networks, with the interrogators and the transponders inter-operating with existing smart vehicle and smart phone technologies such as Dedicated Short Range Communications (DSRC) and Bluetooth Low Energy (BLE) radio.
In particular, aspects and embodiments are directed to high power interrogators in license-free bands e.g. 5.8 GHz under U-NII and frequency sharing schemes via dynamic frequency selection and intra-pulse sharing wherein the system detects other loading issues such as system timing and load factor, and the system allocates pulses in between shared system usage. One example of such an arrangement is dynamic intra pulse spectrum notching on the fly. Another aspect of embodiments disclosed herein is dynamic allocation of response frequencies by a lower power transponder at license-free frequency bands (lower power enables wider selection of transponder response frequencies).
Another aspect of embodiments of interrogators and transponders disclosed herein is an area that has been configured with a plurality of interrogators (a localization enabled area) can have each of the transponders enabled with BLE signal emitting beacons (no connection needed), as has been noted herein. With this arrangement, when a user having a transponder, such as a wearable transponder, enters into the localization area, the transponder “wakes up” to listen for the BLE interrogation signal and replies as needed. It is also appreciated that the transponder can be configured to request an update on what's going on, either over the BLE channel or another frequency channel, such as a dynamically allocated channel.
Some examples of applications where this system arrangement can be used are for example as a human or robot walks, drives, or pilots a vehicle or unmanned vehicle through any of for example a dense urban area, a wooded area, or a deep valley area where direct line of sight is problematic and multipath reflections cause GNSS navigation solutions to be highly inaccurate or fail to converge altogether. The human or robot or vehicle or unmanned vehicle can be equipped with such configured with transponders and interrogators can be configured to update the transponders with their current state vector as well as broadcast awareness of their state vector over preselected or dynamically selected frequency using wireless protocols, Bluetooth Low Energy, DSRC, and other appropriate mechanisms for legal traceability (accident insurance claims, legal compliance).
One implementation can be for example with UDP multicasting, wherein the transponders are configured to communicate all known state vectors of target transponders with UDP multicast signals. The UDP multicast encrypted signals can be also be configured to be cybersecurity protected against spoofing, denial of service and the like. One practical realization of the network infrastructure may include: Amazon AWS IoT service, 512 byte packet increments, TCP Port 443, MQTT protocol, designed to be tolerant of intermittent links, late to arrive units, and brokers and logs data for traceability, and machine learning.

Wide-Band or Ultra-Wide-Band Ranging Systems.

FIG. 4 illustrates an embodiment of a wide-band or ultra-wide-band impulse ranging system 800. The system includes an impulse radio transmitter 900. The transmitter 900 comprises a time base 904 that generates a periodic timing signal 908. The time base 904 comprises a voltage controlled oscillator, or the like, which is typically locked to a crystal reference, having a high timing accuracy. The periodic timing signal 908 is supplied to a code source 912 and a code time modulator 916.
The code source 912 comprises a storage device such as a random access memory (RAM), read only memory (ROM), or the like, for storing codes and outputting the codes as code signal 920. For example, orthogonal PN codes are stored in the code source 912. The code source 912 monitors the periodic timing signal 908 to permit the code signal to be synchronized to the code time modulator 916. The code time modulator 916 uses the code signal 920 to modulate the periodic timing signal 908 for channelization and smoothing of the final emitted signal. The output of the code time modulator 916 is a coded timing signal 924.
The coded timing signal 924 is provided to an output stage 928 that uses the coded timing signal as a trigger to generate electromagnetic pulses. The electromagnetic pulses are sent to a transmit antenna 932 via a transmission line 936. The electromagnetic pulses are converted into propagating electromagnetic waves 940 by the transmit antenna 932. The electromagnetic waves propagate to an impulse radio receiver through a propagation medium, such as air.
FIG. 4 further illustrates an impulse radio receiver 1000. The impulse radio receiver 1000 comprises a receive antenna 1004 for receiving a propagating electromagnetic wave 940 and converting it to an electrical received signal 1008. The received signal is provided to a correlator 1016 via a transmission line coupled to the receive antenna 1004. The receiver 1000 comprises a decode source 1020 and an adjustable time base 1024.
The decode source 1020 generates a decode signal 1028 corresponding to the code used by the associated transmitter 900 that transmitted the signal 940. The adjustable time base 1024 generates a periodic timing signal 1032 that comprises a train of template signal pulses having waveforms substantially equivalent to each pulse of the received signal 1008.
The decode signal 1028 and the periodic timing signal 1032 are received by the decode timing modulator 1036. The decode timing modulator 1036 uses the decode signal 1028 to position in time the periodic timing signal 1032 to generate a decode control signal 1040. The decode control signal 1040 is thus matched in time to the known code of the transmitter 900 so that the received signal 1008 can be detected in the correlator 1016.
An output 1044 of the correlator 1016 results from the multiplication of the input pulse 1008 and the signal 1040 and integration of the resulting signal. This is the correlation process. The signal 1044 is filtered by a low pass filter 1048 and a signal 1052 is generated at the output of the low pass filter 1048. The signal 1052 is used to control the adjustable time base 1024 to lock onto the received signal. The signal 1052 corresponds to the average value of the correlator output, and is the lock loop error signal that is used to control the adjustable time base 1024 to maintain a stable lock on the signal. If the received pulse train is slightly early, the output of the low pass filter 1048 will be slightly high and generate a time base correction to shift the adjustable time base slightly earlier to match the incoming pulse train. In this way, the receiver is held in stable relationship with the incoming pulse train.
It is appreciated that this embodiment of the system can use any pulse compressed signal. It is also appreciated that the transmitter 900 and the receiver 1000 can be incorporated into a single transceiver device. First and second transceiver devices according to this embodiment can be used to determine the distance d to and the position of an object. Further reference to functionalities of both a transmitter and a receiver are disclosed in U.S. Pat. No. 6,297,773 System and Method for Position Determination by Impulse Radio, which is herein incorporated by reference.

Linear FM and FHSS FMCW Ranging Systems.

Referring to FIG. 5, there is illustrated another embodiment of a ranging system 400 implemented according to the present invention that can use either linear FMCW ranging or frequency hopping spread spectrum (FHSS) FMCW ranging signals and techniques.
According to one embodiment implementing linear FMCW ranging, a transmitted signal 74 is swept through a linear range of frequencies and transmitted as transmitted signal 74. For one way linear TOF FMCW ranging, at a separate receiver 80, a linear decoding of the received signal 74 and a split version of the linear swept transmitted signal are mixed together at a mixer 82 to provide a coherent received signal corresponding to the TOF of the transmitted signal. Because this is done at a separate receiver 80, it yields a one-way TOF ranging.
FIG. 11 illustrates a block diagram of an embodiment of an interrogator for linear FMCW two-way TOF ranging. In the Embodiment of FIG. 11, an interrogator transmits via antenna 1 (ANT1) a linear FM modulated chirp signal 74 (or FMCW) towards a transponder (not illustrated) as shown for example in FIG. 5. The transponder can for example frequency shift the linear FM modulated chirp signal 74 and re-transmit a frequency shifted signal 75 at different frequency as discussed herein for aspects of various embodiments of a transponder. For example, as discussed herein, a transponder tag is tracked by receiving, amplifying, then frequency mixing the linear FM modulated interrogation signal and re-transmitting it out at a different frequency. This allows the tag to be easily discernable from clutter, or in other words, so it can be detected among other radar reflecting surfaces. The frequency offset return signal 75 and any scattered return signal 74 are collected by receiver antenna 2 (ANT2), antenna 3 (ANT3) and antenna 4 (ANT4), amplified by a low noise amplifier LNA1 and an Amplifier AMP1, and multiplied by the original chirp signal supplied via the circulator CIRC2 in the mixer MXR1. In the illustrated embodiment the antennas are multiplexed by a single-pole multi-throw switch SW1. The product is amplified via a video amplifier fed out to a digitizer where ranging information can be computed. It is appreciated that although linear FM is discussed in this example any arbitrary waveform can be used including but not limited to impulse, barker codes, or any pulse or phase coded waveforms of any kind. The interrogator and the transponder can work with any arbitrary waveforms including but not limited to linear FM (or FMCW), impulse, pulsed CW, barker codes, or any other modulation techniques that fits within the bandwidth of its signal chain.
FIG. 12 illustrates another embodiment of a block diagram of an interrogator for linear FMCW two-way TOF ranging. This embodiment differs from the embodiment of FIG. 11, primarily in that the interrogator has three transmit antennas to allow for three dimensional ranging of the interrogator and four receive channels for receiving the re-transmitted signal. This embodiment was prototyped and tested. The transmitted signal was transmitted with a Linear FM modulation, 10 mS chirp over a 4 GHz bandwidth from 8.5 GHz to 12.5 GHz. The transmitted output power was +14 dBm. With this arrangement, precision localization was measured and achieved to an accuracy of 27 um in Channel 0, 45 um in Channel 1, 32 um in Channel 2 and 59 um in Channel 3.
With FHSS FMCW ranging, the transmitted signal is not linearly swept through a linear range of frequencies as is done with linear FMCW ranging, instead the transmitted signal is frequency modulated with a series of individual frequencies that are varied and transmitted sequentially in some pseudo-random order according to a specific PN code. It might also exclude particular frequency bands, for example, for purposes of regulatory compliance. For FHSS FMCW ranging at a separate receiver 80 for one way TOF ranging, a decoding of the received signal 74 and a split version of the individual frequencies that are varied and transmitted sequentially according to a specific PN code are mixed together at a mixer 82 to provide a coherent received signal corresponding to the TOF of the transmitted signal. For FHSS FMCW, this is done at a separate receiver 80 for one-way TOF ranging.
More specifically, this embodiment of an apparatus 400 for measuring TOF distance via a linear FHSS FMCW electromagnetic signal comprises a transmitter 70 comprising a local oscillator 72 for generating a signal 74 and a linear ramp generator 76 coupled to the local oscillator that sweeps the local oscillator signal to provide a linear modulated transmitted signal 74 for linear modulation. According to the FHSS FMCW embodiment, instead of a linear ramp generator, the signal provided to modulate the local oscillator signal is broken up into discrete frequency signals 78 that modulate the local oscillator signal to provide a series of individual frequencies according to a specific PN code for modulating the local oscillator signal. The modulated transmitted signal 74 modulated with the series of individual frequencies are transmitted sequentially in some pseudo-random order, according to a specific PN code, as the transmitted signal. For one-way TOF measurements, a split off version of the transmitted signal is also fed via a cable 88 to a receiver 80. The receiver 80 receives the transmitted signal at an antenna 90 and forwards the received signal to a first port 91 of the mixer. The mixer also receives the signal on cable 88 at a second port 92 and mixes the signal with the received signal 74, to provide at an output 94 of the mixer a signal corresponding to the time of flight distance between the transmitter 70 and the receiver 80 of the transmitted signal 74 that is either linear modulated (for linear FMCW) or modulated with the PN codes of individual frequencies (for FHSS FMCW). The apparatus further comprises an analog to digital converter 84 coupled to an output 94 of the mixer 82 that receives that signal output from the mixer and provides a sampled output signal 85. The sampled output signal 85 is fed to a processor 86 that performs a FFT on the sampled signal. According to aspects of this embodiment, the ranging apparatus further comprises a frequency generator configured to provide signals at a plurality of discrete frequencies and processor to provide a randomized sequence of the individual frequency signals.
It is appreciated that this embodiment of the system can use any pulse compressed signal.
It is desirable to make the interrogators and the transponders as have been discussed herein as small as possible and as cheap as possible, so that the interrogators and transponders can be used anywhere and for anything. This it is desirable to implement as much of the interrogator structure and functionality and as much of the transponder structure and functionality as can be done on a chip. It is appreciated that one of the most inexpensive forms of manufacturing electronic devices is as a CMOS implementation. Accordingly, aspects and embodiments of the interrogators and transponders as described herein are to be implemented as CMOS.
Multiple Transmitter and/or Transceivers
Referring to FIG. 6, it is to be appreciated that various embodiments of a ranging system 500 according to the invention can comprise multiple transmitters 96, multiple transceivers 98, or a combination of both transmitter and transceivers that transmit a transmitted signal 106 that can be any of the signals according to any of the embodiments described herein. Such embodiments include at least one receiver 102 that either receives the transmitted signal 106 from each transmitter and/or at least one transponder 104 that receives the transmitted signal and re-transmits a signal 108 that is a re-transmitted version of the transmitted signal 106 back to a plurality of transceivers 98, according to any of ranging signals and systems described herein.
One example of a system according to this embodiment includes one transceiver 98 (interrogator) that transmits a first interrogation signal 106 to at least one transponder 104, which transponder can be attached to an object being tracked. The at least one transponder retransmits a second re-transmitted signal 108 that is received by, for example second, third, and fourth transceivers 98 to determine a position and a range of the transponder and the object being tracked. For example two transceivers can be grouped in pairs to do hyperbolic positioning and three transceivers can be grouped to do triangulation position to the transponder/object. It is appreciated that any of the transceivers 98 can be varied to be the interrogator that sends the first transmit interrogation signal to the transponder 104 and that any of the transceivers 98 can be varied to receive the re-transmitted signal from the responder. It is appreciated that where ranging to the transponder is being determined at the transceivers, the range and position determination is a time of flight measurement between the signals transmitted by the transponder 104 and received by at least two of the transceivers 98.
Another example of a system according to this embodiment includes at least one transponder 104, which can be attached to an object being tracked. The at least one transponder 104 receives a signal 106 that is transmitted by any of at least first, second, third, and fourth transceivers 98 (interrogators). The signal can be coded to ping at least one of the transponders. It is appreciated that more than one transponder 104 can be provided. It is appreciated that each transponder can be coded to respond to a different ping of the transmitted signal 106. It is appreciated that multiple transponders can be coded to respond to a same ping of the transmitted signal 106. Thus, it is appreciated that one transponder or any of a plurality of transponders or a plurality of the transponders can be pinged by the signal 106 transmitted by at least one of the transceivers 98. It is appreciated that multiple transceivers can be configured to send a signal 106 having a same code/ping. It is also appreciated that each transceiver can be configured to send a transmitted signal having a different code/ping. It is further appreciated that pairs or more of transceivers can be configured to send a signal having the same code/ping. It is also appreciated that pairs or more of the transponders can be configured to respond to a signal having the same code/ping. It is appreciated that where the range to the transponder is being determined at the transponder (the device being tracked), the range determination is a time difference of arrival measurement between the signal transmitted by at least two of the transceivers 98. For example, where the transponder is pinged by two of the transceivers 98 a hyperbolic positioning of the transponder (object) can be determined. Where the transponder is pinged by three of the transceivers 98, triangulation positioning of the transponder (object) can be determined.
Alternatively, instead of coding each signal with a ping, it is appreciated that according to some embodiments a precise time delay can be introduced between signals transmitted by the transmitters and/or transceivers. Alternatively, a precise time delay can be introduced between signals re-transmitted by the at least one transponder in response to receipt of the transmitted signal. With this arrangement pairs of transceivers can be used to accomplish 3D or hyperbolic positioning or at least three transceivers can be used to perform triangular positioning according to any of the signals described herein.
Another example of a system according to this embodiment includes one transmitter 96 that is a reference transmitter that provides a waveform by which the receivers 102 and/or transponders 104 correlate against to measure a delta in time of the time difference of arrival (TDOA) signal relative to the reference transmitter 96. It is also appreciated that this embodiment of the system can use any pulse compressed signal.
Multiple Receivers and/or Transponders
Various embodiments of a system according to the invention can comprise at least one transmitter 96 or transceiver 98 that transmits a transmitted 106 signal and a plurality of receivers 102 or transponders 104 that receive the transmitted signal from each transmitter or transceiver, according to any of ranging systems and signals described herein. Such embodiments include at least one transmitter 96 or transceiver 98 that transmits the transmitted signal 106 and a plurality of receivers 102 or transponders 104 that either receive the transmitted signal 106 or receive and re-transmit a signal 108 that is a re-transmitted version of the transmitted signal 106 back to the at least one transceivers 98, according to any of ranging signals and systems described herein.
It is appreciated that according to aspects of this embodiment a transmitter 96 can be attached to an object being tracked and can transmit a first signal 106 to a plurality of receivers 102 to perform time of flight positioning and ranging from the transmitter to the receiver. For example, where two receivers receive the transmitted signal, hyperbolic positioning of the transmitter/object can be achieved. Alternatively or in addition, where at least three receivers receive the transmitted signal 106, triangulation positioning to the transmitter 96 and object can be achieved.
According to aspects of another embodiment, at least one transceiver 98 can be attached to an object being tracked and can transmit a first signal 106 to a plurality of transponders 104 to perform positioning and ranging from the transmitter to the receiver. For example, where two transponders receive and re-transmit the transmitted signal 106, hyperbolic positioning of the transmitter/object can be achieved. Alternatively or in addition, where at least three transponders 104 receive and re-transmit the transmitted signal 106, triangulation positioning to the transceiver 98 and object can be achieved.
It is appreciated that any of the transponders can be varied to respond to the interrogator 98 that sends the first transmit interrogation signal to the transponder 104. It is appreciated that the at least one transponder 104 receives a signal 106 that is transmitted by the transceivers 98 (interrogators). The signal can be coded to ping at least one of the transponders. It is appreciated that each transponder can be coded to respond to a different ping of the transmitted signal 106. It is appreciated that multiple transponders can be coded to respond to a same ping of the transmitted signal 106. It is appreciated that one transponder or any of a plurality of transponders or a plurality of the transponders can be pinged by the signal 106 transmitted by at least one transceivers 98. It is also appreciated that pairs or more of the transponders can be configured to respond to a signal having the same code/ping.
Alternatively, instead of coding each signal with a ping, it is appreciated that according to some embodiments a precise time delay can be introduced between signals re-transmitted by the transponders 104 in response to receipt of the transmitted signal. With this arrangement pairs of transponders can be used to accomplish hyperbolic positioning of the at least one transceiver or at least three transponders can be used to perform triangular positioning according to any of the signals described herein. It is also appreciated that this embodiment of the system can use any pulse compressed signal.

Hybrid Ranging Systems

Referring to FIG. 8, various embodiments of a system according to the invention can comprise a plurality of transmitters that transmit a transmitted signal and a plurality of receivers that receive a transmitted signal according to any of the signals and systems disclosed herein. Various embodiments of a system according to the invention can comprise a plurality of transceivers 98 that transmit a transmitted signal and a plurality of transponders 104 that receive the transmitted signal 106 and re-transmit the transmitted signal 108, according to any of ranging signals and ranging systems described herein. It is further appreciated that the plurality of the transmitters 96 or transceiver 98 can be coupled together either by a cable or a plurality of cables e.g. to create a wired mesh of transmitters or transceivers, or coupled together wirelessly to create a wireless mesh of transmitters or transceivers. It is also appreciated that the plurality of the receivers 102 or transponders 104 can be coupled together either by a cable or a plurality of cables e.g. to create a wired mesh of receivers or transponders, or coupled together wirelessly to create a wireless mesh of receivers or transponders. Still further it is appreciated that the system can comprise a mixture of plurality of transmitters and transceivers and/or a mixture of a plurality of receivers or transponders. It is appreciated that the mixture of the plurality of transmitters and transceivers and/or the mixture of a plurality of receivers or transponders can be coupled together either by one or more cables or wirelessly or a combination of one or more cables and wirelessly. Such embodiments can be configured to determine range and positioning to at least one object according to any of the signals and systems that have been described herein.
According to the disclosure above regarding any of the TOF ranging systems disclosed, it will be apparent that a TOF ranging system may be comprised of devices, any of which may transmit, receive, respond, or process signals associated with any of the foregoing TOF ranging systems. In aspects and embodiments, any transceiver, interrogator, transponder, or receiver may determine TOF information in one or more of the manners discussed above in accordance with any of the TOF ranging systems disclosed. Any transmitter, transceiver, interrogator, or transponder may be the source of a signal necessary for determining the TOF information in one or more of the manners discussed above in accordance with any of the TOF ranging systems disclosed.
It is appreciated that in embodiments, the exact position of signal generating and signal processing components may not be significant, but the position of an antenna is germane to precise ranging, namely the position and the location from which an electromagnetic signal is transmitted or received. Accordingly, the TOF ranging systems locations disclosed herein are typically configured to determine by the TOF ranging to antenna positions and locations. For example, the exemplary embodiments discussed above with respect to FIG. 2 and FIGS. 9 to 12 have multi-antenna components, and it is also appreciated that any of the embodiments of interrogators and transponders as disclosed in FIGS. 1-12 can have multiple antennas. In such example embodiments, and others like them, various components may be shared among more than one antenna and TOF ranging can be done to the multiple antenna components. For example, a single oscillator, modulator, combiner, correlator, amplifier, digitizer, or other component may provide functionality to more than one antenna. In such cases, each of the multiple antennas may be considered an individual TOF transmitter, receiver, interrogator, or transponder, to the extent that associated location information may be determined for such antenna.
In aspects and embodiments, multiple antennas may be provided in a single device to take advantage of spatial diversity. For example, an object with any of the TOF ranging components embedded may have multiple antennas to ensure that at least one antenna may be unobstructed at any given time, for example as the orientation of the object changes. In one embodiment, a wristband may have multiple antennas spaced at intervals around a circumference to ensure that one antenna may always receive without being obstructed by a wearer's wrist.
In aspects and embodiments, signal or other processing, such as calculations, for example, to determine distances based on TOF information, and positions of TOF devices, may be performed on a TOF device or may be performed at other suitable locations or by other suitable devices, such as, but not limited to, a central processing unit or a remote or networked computing device.

OTHER EXAMPLES

According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system can be used to accomplish precise distance measurements, to accomplish multiple distance measurements for multilateration, to accomplish highly precise absolute TOF measurements, to accomplish precision localization of a plurality of transponders, transceivers, or receivers, or to accomplish ranging with a hyperbolic time difference of arrival methodology, or any other ranging or localization capability for which TOF measurements may be used.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system can use any pulse compressed signal.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, each transponder can be configured to detect a signal of a unique code and respond only to that unique code.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, a plurality of transmitters or transceivers can be networked together and configured to transmit at regular, precisely timed intervals, and a plurality of transponders or receivers can be configured to receive the transmissions and localize themselves via a hyperbolic time difference of arrival methodology.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, at least one transceiver is carried on a vehicle.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, at least one transceiver may be fixed to a person or animal, or to clothing, or embedded in clothing, a watch, or wristband, or embedded in a cellular or smart phone or other personal electronic device, or a case for a cellular or smart phone or other personal electronic device.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, transceivers can discover each other and make an alert regarding the presence of other transceivers. Such discovery and/or alerts may be triggered by responses to interrogation signals or may be triggered by enabling transceivers via an auxiliary wireless signal as discussed. For example, vehicles could broadcast a BLE signal that activates any TOF transceiver in its path and thereby discover humans, animals, vehicles, or other objects in its path. Similarly, a human, animal, or vehicle in the path may be alerted to the approaching vehicle. In another scenario, people with transceivers on their person may be alerted to other people's presence, e.g., when joining a group or entering a room or otherwise coming in to proximity. In such a scenario, distance and location information may be provided to one or more of the people.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system can comprise a wireless network of wireless transponders in fixed locations, and wherein the element to be tracked includes at least one transceiver that pings the wireless transponders with coded pulses so that the transponders only respond and reply with precisely coded pulses.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system further comprises a wireless network of wireless transceivers or transponders in fixed locations that transmit or interrogate, and reply to each other, for purposes of measuring a baseline between the transceivers or transponders for calibrating the network.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, an object to be tracked includes at least one transceiver that is configured to transmit the first signal to interrogate one of a plurality of transponders in the network, and wherein at least one transponder is configured to respond to the first signal and to transmit a signal to interrogate one or more other transponders in the network, and wherein the one or more other transponders emit a second signal that is received by the original interrogator-transceiver for purposes of calibration.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system comprises at least one transponder that is programmed to send a burst of data and its timing transmission and including data for purposes of revealing any of temperature, battery life, other sensor data, and other characteristics of the transponder.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system can include wireless transponders configured to send ranging signals between each of the transponders for measuring distances between transponders.

Pick and Pack Application of Various Embodiments of Ranging Systems

Referring to FIG. 13, in accordance with various aspects and/or embodiments of the subject disclosure, there is illustrated an example of a system 710 and method for detecting a user's body movement in cooperation with an industrial automation environment. It is also to be appreciated that the system can be used in a variety of environments to interface with industrial machinery 112 or without industrial machinery such as for example for pick and pack work in fulfillment centers and warehouses or combinations thereof. The system and method includes employing a plurality of TOF transmitters 96 or transceivers/interrogators 98 (depicted by an antenna) as have been described herein that transmit and/or receive a signal 110 that detects movement of a transponder 114 mounted to a body part of a user. Any of various embodiments of an interrogator, transponder, transmitter, and transceivers that have been described herein may be used. The transponders hereinafter also referred to as TOF sensors, can be mounted to a body part for any of or any combination of: detecting movement of a body part of the user, ascertaining whether or not the movement of the body part conforms to a recognized movement of the body part, interpreting the recognized movement of the body part as a performable action, actuating industrial machinery to perform a performable action based on and in cooperation with the recognized movement of the body part and/or giving the worker real time feedback on their task performance.
The system includes a plurality of TOF transmitters 96 or transceivers/interrogators 98 (depicted by an antenna) as has been described herein that transmit and/or transmit and receive a signal 110 for measuring movement of a transponder 114 mounted to a body part of a user. The system can be used to measure a position of the user in a pick and pack environment, or a position of a user such as a user's arm proximate to and in cooperation with industrial machinery 112, such as a robotic arm, and proximate to the TOF sensors 96/98. The system may further include at least one transponder 118 mounted to the industrial machinery 112, such as a robotic arm, and proximate to the TOF sensors 96/98. According to aspects of this embodiment, a controller can be configured to receive measurements of movement of the receivers or transponders 114, 118 as measured by the transmitters or transceivers/interrogators 96/98, to determine any or all of whether or not the movement of the body part conforms with a recognized movement of the body part, to determine a precise position and location of the receivers or transponders 114, 118, to predict movement of the human limb, to monitor movement and performance of a user such as in a pick and pack environment and provide feedback to the user, and to control industrial machinery such as the robotic arm 112 to perform an action based at least in part on instructions received from the industrial controller and a position of the receivers or transponders 114, 118 attached to the user, to control the robotic arm to perform an action based at least in part on any of instructions received from the industrial controller and a position of the receivers or transponders 114, 118 so that the human and the robotic arm can work in cooperation and without risk or danger of harm to the human. It is also appreciated that the system can be configured to have a transmitter or transceiver/interrogator on the robotic arm and a transponder or transceiver/interrogator on the limb or appendage of a human so as to have direct time of flight ranging between the robotic arm and the human arm or limb.
According to aspects and embodiments, workers can for example be outfitted with a small wristband or other personal digital device that is configured as a transponder 114. The transponder device can be configured with feedback mechanisms such as colored LEDs, a simple microphone, a wireless beacon and/or a haptic feedback system (e.g. gyroscope) to provide feedback to the user. For example, the device could give the worker real time feedback on their task performance in contemporary pick and pack systems. The pick and pack systems could be configured with a variety of communication mechanisms such as for example a laser pointer that directs the worker to the bin that the worker should place to or pick from. The system could be configured for example such that as the worker moves towards a correct or incorrect movement, the wristband (or other device) could signal this to the user via any of the feedback mechanisms (e.g., a flashing green/red light and slow-weak/fast-intense pulses of the gyroscope). It is appreciated that some signals could be reserved for critical feedback (e.g., unsafe conditions) and other feedback signals could be used for routine task feedback (e.g., correct/incorrect placement). It is also appreciated that the system could be so configured such that if despite feedback from the system the user still engages in some form of incorrect or unsafe behavior, the system can also interact with the equipment involved (e.g., stopping it, moving it out of the user's space, etc.). It is also appreciated that the system and the transponder device can be configured such that users may be able to customize their preferred feedback patterns to a certain extent (as determined by the system operator). It is further appreciated that the system can be used to monitor and catalogue a user's performance for any of a variety of purposes such as analytics, training, and the like.
Referring to FIG. 14, in accordance with various aspects and/or embodiments of the subject disclosure, there is illustrated a further example of an environment for determining the motion of industrial equipment and/or a user's body. The example environment of FIG. 14 is particularly directed to pick and pack work in fulfillment centers, warehouses, etc. The system and method includes employing a plurality of TOF transmitters 96 or transceivers/interrogators 98 (depicted by an antenna) as have been described herein that transmit and/or receive signals to detect movement of a transponder 114 affixed to parts of a user or industrial machinery 112.
In the example of FIG. 14, the work to be tracked is the selection (picking) of items from bins 120 and placing the items in boxes (packing). The user's body motions and industrial machines 112 motions may be tracked and analyzed to determine from which bin 120 an item has been taken and thereby identify the item picked by reference to a database of what items are stored in which bins 120. Further transponders 114 may be affixed to notches on a conveyor belt and thereby the system may determine where the item was placed, and therefore in which box it was placed. Further, with the knowledge of which items were placed in which boxes, the system, with the aid of back-end databases and order processing information, may determine which order is in which box and may thereby further automate the process by, for example, affixing the proper shipping labels to the boxes.
It is appreciated that numerous variations on this example environment are contemplated. With knowledge of the movement of items, users, and machinery, the system could monitor for safety, accuracy, efficiency, etc. Transponders 114 could be affixed to individual boxes in addition to or instead of the conveyor belt, or the system could track conveyor belt motion in an alternate manner. While tracking items out of bins, the system could also track items placed into bins and/or manage inventory. Transponders 114 could be affixed to individual items, which could further allow identification of the contents of a box even after it is sealed closed.
While this particular example is for picking and packing, it is appreciated that the work to be tracked could include any environment or application. For example, the work monitored could be an assembly line function. The system could monitor the regular operation of the assembly line for safety, accuracy, efficiency, and could also control or monitor for options installed or incorporated into particular product builds, etc.
In accordance with yet further aspects or embodiments, the system includes time of flight transmitters and/or transceivers/interrogators and time of flight receivers or transponders (time of flight sensors) in any of the combinations and using any of the signals disclosed herein for constantly monitoring the movement performed by the user, for detecting an appropriate movement performed by the user, for predicting movement of the human limb, for monitoring movement and performance of a user such as in a pick and pack environment and to provide feedback to the user, for controlling industrial machinery in combination with movement of a user for demarcating a safety zone around the industrial equipment for appropriate movement performed by the user and for cooperating with the industrial equipment, and for controlling and actuating the industrial equipment to stay clear of the safety zone and/or to cooperate with and interact with movement of the user.
It is appreciated that in accordance with aspects or embodiments, the TOF systems as have been discussed herein can be used to provide for initial and ongoing engineering of robotic lines to eliminate interference and optimize movement paths of industrial-scale robots operating in an industrial environment. The TOF systems would provide an improvement over systems that require large industrial robots on an assembly line to have to be placed precisely, which requires a great deal of integration effort and time ensuring that the robots don't clash in operation and that their paths have been optimized to maximize production capacity. The TOF systems would provide an improvement over systems that require the precise location of the robots to be checked and fixed on a regular basis, where even small changes to the line can require near-complete reengineering of the entire solution. With the TOF systems as have been discussed herein, interrogator and transponders can be integrated at several points (i.e. on an end effector, one or more joints) which will vary by application on each multi-axis robot. Data from these sensors can be fed to an optimization and machine learning software suite, which can provide one or more sets of interference resolutions that optimize work flow for the line. A User Interface and state machine could be provided that would allow users to plan and execute this process in contextually-appropriate ways. The system could be configured based on the TOF measurements to resolve interferences and optimize itself, and could also be configured to allow users to control the process. The system can also be configured to dynamically optimize itself as ongoing changes to line configurations and robotic technology are required, the system could dynamically optimize for these changes with reduced integration and setup efforts.
It is appreciated that in accordance with aspects or embodiments, the TOF systems as have been discussed herein can be used to provide for location awareness in an automated industrial environment. With the TOF systems as have been discussed herein, a baseline TOF interrogator infrastructure could be installed near important work areas, and transponders can be integrated into various devices (e.g. a drill, a powered exoskeleton, a transport vehicle). Software could be provided for automatic switching between modes of control for the device depending on the location of that tool. For example, a drill might become inactive if taken more than two meters away from a workstation, a vehicle might switch to different speed limits depending on its proximity to certain areas in an automated production facility, and a powered exoskeleton might allow for different modes of activity depending on proximity of certain workstations. Software could further allow users to tailor this mode switching to certain degrees as set by those granted authority in the system (e.g., managers), and the system could also collect users' tailoring/feedback on the current control schemes for representation to those granted authority in the system. An analytics engine could produce reports and visualizations for users to make more informed decisions about control mode switching, error states and optimization opportunities.
It is appreciated that in accordance with aspects or embodiments, the TOF systems as have been discussed herein can be used to provide for a system that provides for precise assembly of large Machinery that has multiple subcomponents (e.g., a 100 meter long molding and assembly machine). Some advantages are that such a system could provide for assembly of such machines within millimeter scale tolerances and allow users to manage the assembly process intuitively and smoothly. Organizations could use TOF systems as disclosed herein to assemble large (100 m+) machinery to tolerance and specification before and after it's taken apart for delivery to a facility. Such an arrangement could provide ease of assembly advantages as compared to processes that involve weeks of intensive, expensive effort on site when the equipment arrives.
Each subcomponent of the machinery could be instrumented with interrogators and/or transponders that would measure precise ranges between these subcomponents at key points. Software could analyze and present the precise range data to users guide assembly processes in real time, to make assessments on assembly quality, to make informed decisions about assembly processes, and to store data for each subcomponent of the machinery to reassemble to tolerance based on micro-location information and analytics.
According to aspects of one embodiment, the time of flight sensors as have been disclosed herein can be used in industrial automation environments of large scale or where, due to distance and/or overwhelming ambient noise, voice commands are futile, it is not uncommon for body movements (e.g., hand gestures, arm motion, or the like) to be employed to direct persons in control of industrial equipment to perform tasks, such as directing a fork lift operator to load a pallet of goods onto a storage shelf, or to inform an overhead gantry operator to raise or lower, move to the right or left, backward or forward, an oversized or heavy component portion (e.g., wing spar or engine) for attachment to the fuselage of an aircraft. These human hand, arm, body gestures, and/or finger gesticulations can have universal meaning to human observers, and/or if they are not immediately understood, they typically are sufficiently intuitive that they can easily be learned without a great investment in training, and moreover they can be repeated, by most, with a great deal of uniformity and/or precision. In the same manner that a human observer can understand consistently repeatable body motion or movement to convey secondary meaning, a system 710 can also utilize human body movement, body gestures, and/or finger gesticulations to have conveyed meaningful information in the form of commands, and can therefore perform subsequent actions based at least in part on the interpreted body movement and the underlying command.
In accordance with one embodiment, TOF sensors can monitor or detect motion associated with the torso of the user located proximate the TOF sensor. In accordance with another embodiment, TOF sensors can detect or monitor motion associated with the hands and/or arms of the user situated within the TOF sensors line of sight. In accordance with another embodiment, TOF sensors can detect or monitor movement associated with the hand and/or digits (e.g., fingers) of the user positioned proximate to automated machinery.
It is understood that TOF sensors in conjunction or cooperation with other components (e.g., a controller and a logic component) can perceive motion of an object in at least three-dimensions. In accordance with embodiments, a TOF sensor can perceive lateral body movement (e.g., movement in the x-y plane) taking place within its line of sight, and also discern body movement in the z-axis as well.
Additionally it is appreciated, in cooperation with further components such as controller and/or associated logic component, a TOF sensor as disclosed herein can gauge the velocity with which a body movement, gesticulation, or gesture is performed. For example, where the user is configured with one or more TOF sensors and is moving their hands with vigor or velocity, the time of flight sensors in conjunction with a controller and/or logic component, can comprehend the velocity and/or vigor with which the user is moving their hands to connote urgency or aggressiveness. Accordingly, in one embodiment, TOF sensors can perceive the vigor and/or velocity of the body movement. For instance, in an industrial automated environment, where a forklift operator is receiving directions from a colleague, the colleague can have initially commenced his/her directions by gently waving his/her arm back and forth (indicating to the operator of the forklift that he/she is clear to move the forklift in reverse). The colleague on perceiving that the forklift operator is reversing too rapidly and/or that there is a possibility of a collision with on-coming traffic can either start waving his/her arm back and forth with great velocity (e.g., informing the forklift operator to hurry up) or hold up their arm with great emphasis (e.g., informing the forklift operator to come to an abrupt halt) in order to avoid the impending collision. According to aspects of embodiments of this disclosure, the systems disclosed herein can be used to interpret such hand commands and transmit instructions for example to a fork lift operator, where the fork lift operator may not be able to see or hear instructions from the human providing the instructions.
It is also appreciated that according to aspects of such embodiment, the TOF sensors in conjunction with a controller and/or logic component, can detect the sluggishness or cautiousness with which the user is moving their hands. Such time-of-flight measurements of sluggishness, cautiousness, or lack of emphasis can be interpreted by the controller and/or logic component to convey uncertainty, warning, or caution, and once again can provide instructions for previously perceived body movements or future body movements. Thus, continuing with the foregoing forklift operator example, the colleague can, after having waved his/her arm back and forth with great velocity, vigor, and/or emphasis can now commence moving his/her arm in a much more languid or tentative manner, indicating to the forklift operator that caution should be used to reverse the forklift.
It is appreciated without limitation or loss of generality that TOF sensors, controller (and associated logic component), and industrial machinery 112 can be located in disparate locations within an automated industrial environment. For instance, in accordance with an embodiment, TOF sensors and industrial machinery 112 can be situated in close proximity to one another, while controller and associated logic component can be located in an environmentally controlled (e.g., air-conditioned, dust free, etc.) environment. In accordance with a further embodiment, time of flight sensors, a controller and logic components can be located in an environmentally controlled safe environment (e.g., a safety control room) while industrial machinery can be positioned in an environmentally hazardous environment.
It can be appreciated from the foregoing, the sequences and/or series of body/movements, signals, gestures, or gesticulations utilized by the subject application can be limitless, and as such a complex command structure or set of commands can be developed for use in a warehouse and/or industrial environment. Moreover, one need only contemplate established human sign language (e.g. American Sign Language) to realize that a great deal of complex information can be conveyed merely through use of hand movements. Accordingly, as will have been observed in connection with the foregoing, in particular contexts, certain gestures, movements, motions, etc. in a sequence or set of commands can act as modifiers to previous or prospective gestures, movements, motions, gesticulations, etc.
According to aspects of certain embodiments, a controller and/or logic component can further be configured to distinguish valid body movement (or patterns of body movement) intended to convey meaning from invalid body movement (or patterns of body movement) not intended to communicate information, parse and/or interpret recognized and/or valid body movement (or patterns of body movement), and translate recognized and/or valid body movement (or patterns of body movement) into a command or sequence of commands or instructions necessary to actuate or effectuate industrial machinery to perform tasks. For example, to aid a controller and/or associated logic component in differentiating valid body movement from invalid or unrecognized body movement, a controller and/or logic component can consult a persisted library or dictionary of pre-established or recognized body movements (e.g., individual hand gestures, finger movement sequences, etc.) in order to ascertain or correlate the body movement supplied by, and received from, TOF sensors with recognized body movement, and thereafter to utilize the recognized body movement to interpret whether or not the recognized body movement is capable of one or more performable action a warehouse environment and/or in cooperation with industrial machinery 112.
It should be noted without limitation or loss of generality that a library or dictionary of pre-established or recognized body movements and translations or correlations thereof to commands or sequences of commands can be persisted to a memory or storage media. While storage devices (e.g., memory, storage media, and the like) are not depicted, typical examples of these devices include computer readable media including, but not limited to, an ASIC (application specific integrated circuit), CD (compact disc), DVD (digital video disk), read only memory (ROM), random access memory (RAM), programmable ROM (PROM), floppy disk, hard disk, EEPROM (electrically erasable programmable read only memory), memory stick, and the like.
In order to facilitate communication between the various and disparately located component parts of any of the herein disclosed systems, a network topology or network infrastructure can be utilized. Typically the network topology and/or network infrastructure can include any viable communication and/or broadcast technology, for example, wired and/or wireless modalities and/or technologies can be utilized to effectuate the subject application. Moreover, the network topology and/or network infrastructure can include utilization of Personal Area Networks (PANs), Local Area Networks (LANs), Campus Area Networks (CANs), Metropolitan Area Networks (MANs), extranets, intranets, the Internet, Wide Area Networks (WANs)—both centralized and/or distributed—and/or any combination, permutation, and/or aggregation thereof.
Having described above several aspects of at least one embodiment, it is to be appreciated various alterations, modifications, and improvements will readily occur to those skilled in the art. Such alterations, modifications, and improvements are intended to be part of this disclosure and are intended to be within the scope of the invention. Accordingly, the foregoing description and drawings are by way of example only, and the scope of the invention should be determined from proper construction of the appended claims, and their equivalents.

Claims

What is claimed is:

1. A system comprising:

at least one first radio frequency transceiver configured to be mounted to a body part of a user;

at least one second radio frequency transceiver mounted to a portion of a robot;

a plurality of interrogators configured to determine a position of the at least one first radio frequency transceiver and configured to determine a position of the at least one second radio frequency transceiver; and

at least one controller configured to track, using the determined position of the at least one first radio frequency transceiver, movement of the body part of the user, and configured to track, using the determined position of the at least one second radio frequency transceiver, movement of the portion of the robot relative to the movement of the body part of the user.

2. The system of claim 1, further comprising at least one feedback mechanism to provide feedback to the user about the position of the body part relative to the position of the portion of the robot.

3. The system of claim 2, wherein the at least one feedback mechanism comprises haptic feedback.

4. The system of claim 2, wherein the at least one feedback mechanism comprises at least one light emitting diode.

5. The system of claim 1, wherein the at least one controller is configured to stop movement of the portion of the robot based on the determined position of the body part of the user relative to the determined position of the portion of the robot.

6. The system of claim 1, wherein the at least one controller is configured to move the portion of the robot away from the body part of the user based on the determined position of the body part of the user relative to the determined position of the portion of the robot.

7. The system of claim 1, wherein the at least one first radio frequency transceiver is affixed to a wristband configured to be worn by the user.

8. The system of claim 1, wherein the at least one controller is configured to track, using the determined position of the at least one first radio frequency transceiver, movement of the body part of the user while picking items from, and/or placing items into, a plurality of bins.

9. The system of claim 8, further comprising at least one feedback mechanism to provide feedback to the user in picking items from and/or placing items into the plurality of bins.

10. The system of claim 9, wherein the at least one feedback mechanism is configured to signal to the user a correct one of the plurality of bins to pick an item from and/or to place an item into.

11. The system of claim 9, wherein the at least one feedback mechanism is configured to signal to the user that an item has been correctly placed and/or correctly picked.

12. The system of claim 9, wherein the at least one feedback mechanism is configured to signal to the user that an item has been incorrectly placed and/or incorrectly picked.

13. The system of claim 9, wherein the at least one feedback mechanism provides an indication of an unsafe condition.

14. A method comprising:

determining a position of at least one first radio frequency transceiver mounted to a body part of a user using a plurality of interrogators;

determining a position of at least one second radio frequency transceiver mounted to a portion of a robot using the plurality of interrogators;

tracking, using the determined position of the at least one first radio frequency transceiver, movement of the body part of the user; and

tracking, using the determined position of the at least one second radio frequency transceiver, movement of the portion of the robot relative to the movement of the body part of the user.

15. The method of claim 14, further comprising providing feedback to the user about the position of the body part relative to the position of the portion of the robot using at least one feedback mechanism.

16. The method of claim 14, further comprising stopping movement of the portion of the robot based on the determined position of the body part of the user relative to the determined position of the portion of the robot.

17. The method of claim 14, further comprising moving the portion of the robot away from the body part of the user based on the determined position of the body part of the user relative to the determined position of the portion of the robot.

18. The method of claim 14, further comprising tracking, using the determined position of the at least one first radio frequency transceiver, movement of the body part of the user while picking items from, and/or placing items into, a plurality of bins.

19. The method of claim 18, further comprising providing feedback to the user in picking items from and/or placing items into the plurality of bins using at least one feedback mechanism.

20. The method of claim 19, further comprising signaling to the user a correct one of the plurality of bins to pick an item from and/or to place an item into using the at least one feedback mechanism.