US20070269177A1 - Tracking System Using Fixed Optical Radiators - Google Patents
Tracking System Using Fixed Optical Radiators Download PDFInfo
- Publication number
- US20070269177A1 US20070269177A1 US11/574,381 US57438105A US2007269177A1 US 20070269177 A1 US20070269177 A1 US 20070269177A1 US 57438105 A US57438105 A US 57438105A US 2007269177 A1 US2007269177 A1 US 2007269177A1
- Authority
- US
- United States
- Prior art keywords
- modules
- location
- optical
- locations
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/16—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using electromagnetic waves other than radio waves
Definitions
- the present invention relates generally to object location systems, and specifically to optical systems for tracking one or more movable objects.
- radio frequency (RF) identification tags may be fixed to objects in the area.
- Each tag typically comprises an RF transceiver, which transmits a unique identification code when queried by a signal from a central antenna.
- RF radio frequency
- Such systems may be capable of identifying multiple objects, but they generally give only a rough indication of the location of each object.
- Optical markers can be tracked using video cameras to obtain more accurate position information. Optical systems of this sort, however, generally require the use of sophisticated and costly image processing equipment, and are limited in the number of objects that they can track simultaneously.
- a location system tracks, within a defined region, an object which is able to move.
- a plurality of optical radiator modules are fixedly located so as to radiate optical radiation into the region.
- Each module is programmed to emit optical radiation of a certain color during a predetermined time slot, among a number of different colors and a plurality of synchronized time slots that are available.
- An optical location unit is fixed to the object, the unit comprising at least one camera which captures a sequence of electronic images of a region wherein the modules are fixed, so as to image at least two of the modules.
- a processing unit processes the images and identifies the imaged modules from their color and time slot.
- the unit determines a location of the object by comparing the imaged positions of the identified modules with known fixed locations of the modules.
- the location system is able to track a substantially unlimited number of such objects as they move within the region, using a relatively small number of radiator modules.
- the optical location unit for the object is configured, and the radiator modules are located, so that the images formed by the unit comprise at least three modules.
- apparatus for tracking an object including:
- each module including:
- At least one optical emitter which is adapted to emit optical radiation of a respective color, selected from among a first plurality of colors emittable by the modules;
- a controller which is coupled to drive the at least one optical emitter to emit the optical radiation during a respective time slot, selected from among a second plurality of time slots during which the modules may emit the optical radiation;
- an optical location unit adapted to be fixed to the object and comprising at least one camera, which is adapted to capture a sequence of electronic images containing at least some of the locations of the modules;
- a processing unit which is adapted to process the electronic images in the sequence in order to determine, responsively to the colors of the optical radiation emitted by the modules and the time slots in which the optical radiation is emitted, a location of the object.
- the processing unit may transmit signals to the optical radiator modules which determine the respective color and the respective time slot of each of the modules, and which synchronize the time slots, and the signals may determine that the respective color and the respective time slot form a unique combination for each of the modules.
- the processing unit may transmit the signals to the optical location unit so as to synchronize the time slots with the sequence of electronic images.
- the signals may consist of a radio frequency (RF) signal, and may include a synchronization signal chosen from at least one of an infrared (IR) synchronization signal, a cellular communication network synchronization beacon, and a Global Positioning System (GPS) synchronization beacon.
- RF radio frequency
- IR infrared
- GPS Global Positioning System
- the location of the object includes a locus of possible locations of the object, and the processing unit is adapted to determine the locus in response to the at least some locations of the modules.
- the at least some of the locations of the modules include two locations of the modules, and the processing unit applies one or more limiting regions for the object so as to determine the location of the object as a unique location.
- the at least some of the locations of the modules consists of three locations of the modules, the location of the object is a unique location, the unique location is a unique intersection of three loci of possible locations of the object, and the processing unit is adapted to determine the three loci in response to the three locations of the modules.
- the optical location unit includes a microprocessor which performs an initial processing of the sequence of electronic images so as to determine pixel coordinates of the at least some locations of the modules, the optical location unit conveys the pixel coordinates to the processing unit, and the processing unit processes the pixel coordinates to determine the location of the object.
- the at least one optical emitter includes at least first and second optical emitters of different, first and second colors
- the controller is configurable to select one of the first and second colors to be emitted by the module.
- the region includes a ceiling and at least one wall, and the multiplicity of modules are fixed to at least one of the ceiling and the at least one wall, and are configured to radiate the optical radiation into the region.
- the at least one optical emitter includes at least one light-emitting diode (LED).
- LED light-emitting diode
- the processing unit is coupled to a memory, and is adapted to create a tracking database in the memory containing records of the location of the object in the region.
- the optical location unit is fixed to the object so that the at least one camera is in a predetermined direction on capturing the sequence of electronic images.
- a method for tracking an object including:
- each module including:
- At least one optical emitter which is adapted to emit optical radiation of a respective color, selected from among a first plurality of colors emittable by the modules, and
- a controller which is coupled to drive the at least one optical emitter to emit the optical radiation during a respective time slot, selected from among a second plurality of time slots during which the modules may emit the optical radiation;
- processing the electronic images in the sequence in order to determine, responsively to the colors of the optical radiation emitted by the modules and the time slots in which the optical radiation is emitted, a location of the object.
- the method also includes transmitting signals to the optical radiator modules which determine the respective color and the respective time slot of each of the modules, and which synchronize the time slots.
- the signals typically determine that the respective color and the respective time slot form a unique combination for each of the modules.
- the method may also include transmitting the signals to the optical location unit so as to synchronize the time slots with the sequence of electronic images, and the signals are typically radio frequency (RF) signals.
- RF radio frequency
- the signals include a synchronization signal chosen from at least one of infrared (IR) synchronization signal, a cellular communication network synchronization beacon, and a Global Positioning System (GPS) synchronization beacon.
- IR infrared
- GPS Global Positioning System
- the location of the object includes a locus of possible locations of the object, and determining the location of the object includes determining the locus in response to the at least some locations of the modules.
- the at least some of the locations of the modules includes two locations of the modules, and the method includes applying one or more limiting regions for the object so as to determine the location of the object as a unique location.
- the at least some of the locations of the modules includes three locations of the modules, and the location of the object includes a unique location.
- the unique location typically includes a unique intersection of three loci of possible locations of the object, and the method includes determining the three loci in response to the three locations of the modules.
- the optical location unit includes a microprocessor which performs an initial processing of the sequence of electronic images so as to determine pixel coordinates of the at least some locations of the modules, and processing the electronic images includes processing the pixel coordinates to determine the location of the object.
- the at least one optical emitter includes at least first and second optical emitters of different, first and second colors, and the controller is configurable to select one of the first and second colors to be emitted by the module.
- the region includes at least one of a ceiling and at least one wall, and the multiplicity of modules are fixed to at least one of the ceiling and the at least one wall, and are configured to radiate the optical radiation into the region.
- the at least one optical emitter includes at least one light-emitting diode (LED).
- LED light-emitting diode
- Processing the electronic images typically includes creating a tracking database in a memory containing records of the location of the object in the region.
- fixing the optical location unit to the object includes fixing the unit so that the at least one camera is in a predetermined direction on capturing the sequence of electronic images.
- FIG. 1 is a schematic, pictorial illustration of a system for tracking movable objects within a region, according to an embodiment of the present invention
- FIG. 2 is a block diagram that schematically shows details of an optical radiator module used in the system of FIG. 1 , according to an embodiment of the present invention
- FIG. 3 is a block diagram that schematically shows details of an optical location unit used in the system of FIG. 1 , according to an embodiment of the present invention
- FIG. 4 is a block diagram that schematically shows details of a central processing and control unit of the system of FIG. 1 , according to an embodiment of the present invention.
- FIG. 5 is a schematic illustration of a locus of regions generated in the system of FIG. 1 , according to an embodiment of the present invention.
- FIG. 1 is a schematic, pictorial illustration of a system 10 for tracking movable objects 12 A, 12 B, 12 C, . . . , within a region 13 , according to an embodiment of the present invention.
- Objects 12 A, 12 B, 12 C, . . . are also generically referred to hereinbelow as objects 12 .
- region 13 is assumed to comprise a warehouse 14 having horizontal dimensions of the order of 50 m ⁇ 100 m, and a height of the order of 5 m, and objects 12 are assumed to comprise forklift trucks that move within the warehouse.
- An optical location unit 22 is mounted on each object 12 .
- Substantially similar optical radiator modules 16 A, 16 B, 16 C, . . . are fixed to a ceiling 18 of warehouse 14 , or to one or more fixtures attached to the ceiling, so that the modules radiate optical radiation in a generally unobstructed downward direction.
- Modules 16 A, 16 B, 16 C, . . . are also generically referred to hereinbelow as modules 16 .
- the actual spacing and method of distribution of modules 16 is dependent on the mounting height of the modules, on the height and the field of view of the optical location units 22 , and on the resolution required of system 10 .
- Modules 16 and optical location units 22 are described in more detail below.
- All modules 16 and optical location units 22 operate in mutual synchronization with a system clock, in accordance with radio frequency (RF) system synchronization signals broadcast by an antenna 20 , from a central system control and processing unit 26 generating the system clock.
- Modules 16 each comprise an antenna module 25
- units 22 each comprise an antenna 23 , the antenna modules and antennas 23 communicating with antenna 20 , as described in more detail below.
- Unit 26 is typically located within warehouse 14 .
- antenna 20 transmits the system synchronization signals at approximately 433 MHz in the ISM band, with 1.5 MHz bandwidth.
- antenna 20 may transmit in the 846 MHz band, or in any other suitable band permitted by regulatory authorities.
- system 10 may use optical system synchronization signals, such as infrared (IR) pulses transmitted by a suitable IR transmitter in place of antenna 20 .
- IR infrared
- modules 16 , optical location units 22 , and/or the system clock may synchronize on an external signal, such as a beacon provided by a cellular communication network or a Global Positioning System (GPS).
- an external signal such as a beacon provided by a cellular communication network or a Global Positioning System (GPS).
- GPS Global Positioning System
- each module 16 transmits radiation of an assigned color in an assigned time slot.
- Each module is programmed in advance with its time slot and color assignment, so that the combination of time slot and color is unique for each module. For example, if there are 150 modules 16 , each module may be programmed to transmit in one of 50 successive time slots, each typically of the order of 200 msec long, during which the module emits either red, green or blue light. Alternatively, there may be a larger or smaller number of available time slots, which may be longer or shorter in duration, and a larger or smaller number of colors may be used. Further alternatively, modules 16 may be configured to emit IR or ultraviolet (UV) radiation.
- UV radiation ultraviolet
- Each optical location unit 22 generates images of radiating modules 16 within a field of view of the unit.
- the images are analyzed to identify which modules 16 are present in the image, based on the time slot and color combination of each of the modules.
- the images are also analyzed to determine angles subtended at each object 12 by pairs of identified modules 16 present in the images.
- modules 16 A, 16 B, and 16 C are assumed to be present in the field of view of the unit 22 on object 12 A, and the modules are determined to subtend angles ⁇ , ⁇ , and ⁇ at the object.
- Angle ⁇ corresponds to a base angle of a triangle 21 formed by modules 16 A, 16 B, and object 12 A.
- processing unit 26 uses the subtended angles, and knowledge of the spatial distribution of modules 16 A, 16 B, and 16 C, to determine a location of object 12 A.
- Unit 26 applies the same location determination process individually to each of the objects 12 present in warehouse 14 , so that it will be appreciated that there is substantially no limit to the number of objects 12 that may be tracked.
- FIG. 2 is a block diagram that schematically shows details of module 16 , according to an embodiment of the present invention.
- a controller 32 determines the color and time slot in which module 16 is to emit radiation, wherein the time slot is determined in relation to the system synchronization signals transmitted by antenna 20 .
- the time slot and color assignments of module 16 are input to controller 32 via a microprocessor 34 .
- Operating power for the components of module 16 is typically supplied by line power, although power may alternatively be supplied by other means known in the art, such as a battery.
- the components of the module may be integrated into a single microelectronic chip.
- module 16 may comprise a circuit board or other substrate on which two or more chips are mounted.
- An RF synchronization module 36 receives the system synchronization signals from antenna 20 via antenna module 25 . Based on these signals, synchronization module 36 generates a synchronization input to controller 32 .
- the system synchronization signal transmitted by antenna 20 comprises a pulse or a train of pulses in a predetermined pattern, indicating the beginning of a global synchronization period (GSP) for all of modules 16 .
- GSP global synchronization period
- Synchronization module 36 filters, amplifies and discriminates the RF signals received by antenna module 25 in order to detect the pulse or pattern of pulses transmitted by antenna 20 .
- module 36 correlates the pattern of received pulses with a predetermined reference pattern in order to detect the exact synchronization, and accordingly signals the beginning of the GSP to controller 32 . It is generally desirable that synchronization modules 36 in all of optical modules 16 synchronize on the signals from antenna 20 with a maximum module-to-module deviation no greater than 1/10 of a time slot.
- Controller 32 uses a clock provided by a local oscillator 40 in order to determine when its assigned time slot occurs within the GSP, relative to the synchronization input from module 36 .
- controller 32 triggers a LED driver circuit 42 to actuate one of LEDs 44 , 46 and 48 .
- each of the LEDs emits radiation of a different color.
- LED 44 may emit red light, LED 46 green light, and LED 48 blue light.
- the choice of which LED to actuate is typically pre-programmed via microprocessor 34 , so that no more than one module 16 emits radiation of a given color during any given time slot.
- system 10 may comprise different groups of modules 16 , wherein each module has a single LED, and a different color LED is used in the modules of each group. Further alternatively, other types of variable-wavelength or fixed-wavelength light sources may be used.
- Microprocessor 34 receives control signals from central unit 26 via antenna 20 , antenna module 25 and RF module 36 .
- the microprocessor uses the control signals to program controller 32 , and to configure the timing parameters of each module 16 , including:
- the GSP duration (typically between 20 seconds and 8 minutes).
- Time slot duration (typically between 100 msec and 1 sec).
- Time slot selection (typically from time slot # 1 to # 50 ).
- microprocessor 34 may also be used to set other operating parameters of module 16 , such as color selection. Although certain ranges of GSP and time slot duration are listed above by way of example, larger or smaller durations may also be used.
- FIG. 3 is a block diagram that schematically shows details of optical location unit 22 , according to an embodiment of the present invention.
- Each unit 22 comprises one or more video cameras 72 , and the units are mounted on objects 12 so that the one or more video cameras 72 point in a generally upward direction, towards ceiling 18 .
- cameras 72 comprise standard CCD- or CMOS-based solid state image sensors, depending on the resolution required of system 10 .
- cameras 72 may comprise model CV7017H CCD cameras, produced by Appro Technologies (Taiwan), typically having, for a lens of focal length 2.5 mm, a generally rectangular field of view of 90° ⁇ 120°. It will be appreciated that the field of view may be made larger or smaller than that given here, by respectively using a shorter or longer focal length lens.
- Each video camera 72 operates at a standard rate, typically approximately 25 frames/second, and is synchronized to the system clock by a frame synchronization signal received from a video interface 64 , such as the PV 143 WDM video capture card, produced by Professional Video (Taiwan).
- the frame synchronization signal is generated from the system synchronizing signal received from unit 26 , via an antenna 23 , an RF interface 62 , and a microprocessor 68 .
- Video interface 64 also acts as a frame grabber, receiving and digitizing inputs from cameras 72 , and conveying its digital output to microprocessor 68 for analysis.
- Microprocessor 68 processes the digitized video image output from each of cameras 72 in turn, in order to determine the coordinates of the pixel (or group of pixels) associated with the bright, colored lights of different modules 16 during successive time slots. For each optical location unit 22 , the pixel coordinates and their color values are transmitted from microprocessor 68 via interface 62 and antenna 23 , to central unit 26 .
- FIG. 4 is a block diagram that schematically shows details of central processing and control unit 26 , according to an embodiment of the present invention.
- Unit 26 is built around a server 80 , which typically comprises a personal computer running the Microsoft Windows® operating system.
- Server 80 controls an RF synchronization interface 82 , comprising an RF transmitter, which transmits the RF synchronization signals via antenna 20 , as described above.
- Server 80 receives the pixel coordinates and color values from each unit 22 , and compares the times and the color values received with stored values of time slots and colors emitted by modules 16 . Thus, when server 80 finds that radiation of a particular color was detected in the image received by a specific optical unit 22 during a particular time slot, the server is able to determine unequivocally the identity of the module that emitted the radiation to the specific unit.
- Server 80 records the module identity, the pixel or group of pixel coordinates associated with the module, and an identity of the specific unit, in a tracking database 88 , which is typically held in disk memory.
- server 80 determines an angle subtended at the respective optical location unit 22 by each pair of different modules 16 imaged by the camera. Alternatively, server 80 determines the angle subtended from the pixel coordinates of the module pairs by pre-calibrating the one or more cameras 72 comprised in each optical location unit 22 .
- server 80 is able to determine a distance between each pair of modules 16 .
- server 80 is able to associate the distance between the pair with the angle subtended by the pair at the unit.
- Server 80 is thus able to determine a locus of regions where the object 12 , onto which the specific optical location unit 22 is mounted, may be.
- server 80 determines a corresponding multiplicity of loci, and finds a unique value for the location of the object 12 from the intersection of the loci.
- the locations of each object 12 are stored in database 88 .
- microprocessors 68 of units 22 and server 80 of the computation to find the locations of each object, is described hereinabove by way of example, and other distributions are possible. For example, if a specific unit 22 is given the locations of modules 16 , then the microprocessor 68 of the specific unit may determine the location of the object 12 on which the unit is mounted, and transmit the location to server 80 . Other computation distributions will be apparent to those skilled in the art, and all are to be assumed as comprised within the scope of the present invention.
- the server may have a communication interface to a network 92 , allowing a client computer 90 to access the information remotely, via the network.
- the information in database 88 indicates to the user which objects 12 were located in region 13 of system 10 at any point in time, and also provides a record of the locations and movements of the objects within the region.
- the user may similarly access server 80 in order to find the current locations of particular objects 12 in real time.
- FIG. 5 is a schematic illustration 100 of a locus 102 of regions generated in system 10 , according to an embodiment of the present invention.
- Illustration 100 corresponds to a top view of a section of system 10 , through ceiling 18 , and depicts modules 16 A and 16 B and object 12 A forming triangle 21 ( FIG. 1 ).
- Triangle 21 has sides of length a, b, and c; c is the distance between modules 16 A and 16 B, and the angle ⁇ is formed between sides a and b.
- server 80 typically uses one or more other pairs of modules 16 imaged by the unit 22 of the object, to determine respective loci of the one or more other pairs, and finds a unique intersection of the loci.
- modules 16 are arranged on ceiling 18 so that three or more pairs of modules are imaged by each unit 22 , so that three or more loci may be used to determine the unique location of the unit.
- determining the unique location of object 12 A within locus 102 may be used, such as storing in database 88 certain limiting sections of region 13 that are or are not accessible to object 12 A. For example, if object 12 A is only able to move on relatively narrow aisles within region 13 , the paths of the aisles may be stored and used to determine the unique location of the object within locus 102 .
- optical radiator modules such as modules 16
- the objects may be able to move, and may be tracked in, one, two, or three dimensions.
- the optical radiator modules may be fixed to any suitable location, such as on walls outside, surrounding and/or within the region wherein the objects are being tracked.
- units 22 are fixed on respective objects 12 so that a direction of the one or more cameras within the units is predetermined when the units image modules 16 .
- Each imaged module 16 then defines a locus for the unit which forms the image.
- units 22 may be fixed to objects 12 to point in an upward vertical direction.
- An elevation angle of an imaged module may then be calculated from the pixel coordinates of the image, and a locus—typically a circle—for the unit determined.
- a unique location for the unit may then be found by determining intersections of loci, typically intersections of three loci.
- other methods for determining the unique location on one locus substantially as described above, may be used. All such methods for determining a unique location of the unit, using cameras which are mounted so as to have a predetermined direction, are assumed to be comprised within the scope of the present invention.
Landscapes
- Physics & Mathematics (AREA)
- Electromagnetism (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Optical Communication System (AREA)
- Studio Devices (AREA)
- Image Analysis (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Mounting And Adjusting Of Optical Elements (AREA)
- Semiconductor Lasers (AREA)
Abstract
Description
- The present invention relates generally to object location systems, and specifically to optical systems for tracking one or more movable objects.
- Various methods are known in the art for remote tracking of a movable object within a controlled area. For example, radio frequency (RF) identification tags may be fixed to objects in the area. Each tag typically comprises an RF transceiver, which transmits a unique identification code when queried by a signal from a central antenna. Such systems may be capable of identifying multiple objects, but they generally give only a rough indication of the location of each object. Optical markers can be tracked using video cameras to obtain more accurate position information. Optical systems of this sort, however, generally require the use of sophisticated and costly image processing equipment, and are limited in the number of objects that they can track simultaneously.
- In embodiments of the present invention, a location system tracks, within a defined region, an object which is able to move. A plurality of optical radiator modules are fixedly located so as to radiate optical radiation into the region. Each module is programmed to emit optical radiation of a certain color during a predetermined time slot, among a number of different colors and a plurality of synchronized time slots that are available. An optical location unit is fixed to the object, the unit comprising at least one camera which captures a sequence of electronic images of a region wherein the modules are fixed, so as to image at least two of the modules. A processing unit processes the images and identifies the imaged modules from their color and time slot. The unit determines a location of the object by comparing the imaged positions of the identified modules with known fixed locations of the modules. In a similar manner, by fixing a respective optical location unit to other objects, the location system is able to track a substantially unlimited number of such objects as they move within the region, using a relatively small number of radiator modules.
- Typically, the optical location unit for the object is configured, and the radiator modules are located, so that the images formed by the unit comprise at least three modules.
- There is therefore provided, according to an embodiment of the present invention, apparatus for tracking an object, including:
- a multiplicity of optical radiator modules, disposed in an array of known locations adjoining a region in which the object is to move, each module including:
- at least one optical emitter, which is adapted to emit optical radiation of a respective color, selected from among a first plurality of colors emittable by the modules; and
- a controller, which is coupled to drive the at least one optical emitter to emit the optical radiation during a respective time slot, selected from among a second plurality of time slots during which the modules may emit the optical radiation;
- an optical location unit, adapted to be fixed to the object and comprising at least one camera, which is adapted to capture a sequence of electronic images containing at least some of the locations of the modules; and
- a processing unit, which is adapted to process the electronic images in the sequence in order to determine, responsively to the colors of the optical radiation emitted by the modules and the time slots in which the optical radiation is emitted, a location of the object.
- The processing unit may transmit signals to the optical radiator modules which determine the respective color and the respective time slot of each of the modules, and which synchronize the time slots, and the signals may determine that the respective color and the respective time slot form a unique combination for each of the modules. The processing unit may transmit the signals to the optical location unit so as to synchronize the time slots with the sequence of electronic images. The signals may consist of a radio frequency (RF) signal, and may include a synchronization signal chosen from at least one of an infrared (IR) synchronization signal, a cellular communication network synchronization beacon, and a Global Positioning System (GPS) synchronization beacon.
- Typically, the location of the object includes a locus of possible locations of the object, and the processing unit is adapted to determine the locus in response to the at least some locations of the modules.
- In an aspect of the invention, the at least some of the locations of the modules include two locations of the modules, and the processing unit applies one or more limiting regions for the object so as to determine the location of the object as a unique location.
- Typically, the at least some of the locations of the modules consists of three locations of the modules, the location of the object is a unique location, the unique location is a unique intersection of three loci of possible locations of the object, and the processing unit is adapted to determine the three loci in response to the three locations of the modules.
- In some embodiments, the optical location unit includes a microprocessor which performs an initial processing of the sequence of electronic images so as to determine pixel coordinates of the at least some locations of the modules, the optical location unit conveys the pixel coordinates to the processing unit, and the processing unit processes the pixel coordinates to determine the location of the object.
- In a disclosed embodiment, for each module, the at least one optical emitter includes at least first and second optical emitters of different, first and second colors, and the controller is configurable to select one of the first and second colors to be emitted by the module.
- Typically, the region includes a ceiling and at least one wall, and the multiplicity of modules are fixed to at least one of the ceiling and the at least one wall, and are configured to radiate the optical radiation into the region.
- Typically, the at least one optical emitter includes at least one light-emitting diode (LED).
- Typically, the processing unit is coupled to a memory, and is adapted to create a tracking database in the memory containing records of the location of the object in the region.
- In an aspect of the invention, the optical location unit is fixed to the object so that the at least one camera is in a predetermined direction on capturing the sequence of electronic images.
- There is further provided, according to an embodiment of the present invention, a method for tracking an object, including:
- disposing a multiplicity of optical radiator modules in an array of known locations adjoining a region in which the object is to move, each module including:
- at least one optical emitter, which is adapted to emit optical radiation of a respective color, selected from among a first plurality of colors emittable by the modules, and
- a controller, which is coupled to drive the at least one optical emitter to emit the optical radiation during a respective time slot, selected from among a second plurality of time slots during which the modules may emit the optical radiation;
- fixing an optical location unit including at least one camera to the object;
- capturing from the at least one camera a sequence of electronic images containing at least some of the locations of the modules; and
- processing the electronic images in the sequence in order to determine, responsively to the colors of the optical radiation emitted by the modules and the time slots in which the optical radiation is emitted, a location of the object.
- Typically, the method also includes transmitting signals to the optical radiator modules which determine the respective color and the respective time slot of each of the modules, and which synchronize the time slots. The signals typically determine that the respective color and the respective time slot form a unique combination for each of the modules. The method may also include transmitting the signals to the optical location unit so as to synchronize the time slots with the sequence of electronic images, and the signals are typically radio frequency (RF) signals.
- In an aspect of the invention, the signals include a synchronization signal chosen from at least one of infrared (IR) synchronization signal, a cellular communication network synchronization beacon, and a Global Positioning System (GPS) synchronization beacon.
- In one embodiment, the location of the object includes a locus of possible locations of the object, and determining the location of the object includes determining the locus in response to the at least some locations of the modules.
- Typically, the at least some of the locations of the modules includes two locations of the modules, and the method includes applying one or more limiting regions for the object so as to determine the location of the object as a unique location.
- In an aspect of the invention, the at least some of the locations of the modules includes three locations of the modules, and the location of the object includes a unique location. The unique location typically includes a unique intersection of three loci of possible locations of the object, and the method includes determining the three loci in response to the three locations of the modules.
- Typically, the optical location unit includes a microprocessor which performs an initial processing of the sequence of electronic images so as to determine pixel coordinates of the at least some locations of the modules, and processing the electronic images includes processing the pixel coordinates to determine the location of the object.
- In one embodiment, for each module, the at least one optical emitter includes at least first and second optical emitters of different, first and second colors, and the controller is configurable to select one of the first and second colors to be emitted by the module.
- In an aspect of the invention, the region includes at least one of a ceiling and at least one wall, and the multiplicity of modules are fixed to at least one of the ceiling and the at least one wall, and are configured to radiate the optical radiation into the region.
- Typically, the at least one optical emitter includes at least one light-emitting diode (LED).
- Processing the electronic images typically includes creating a tracking database in a memory containing records of the location of the object in the region.
- In an aspect of the invention, fixing the optical location unit to the object includes fixing the unit so that the at least one camera is in a predetermined direction on capturing the sequence of electronic images.
- The present invention will be more fully understood from the following detailed description of the embodiments thereof, taken together with the drawings, a brief description of which follows.
-
FIG. 1 is a schematic, pictorial illustration of a system for tracking movable objects within a region, according to an embodiment of the present invention; -
FIG. 2 is a block diagram that schematically shows details of an optical radiator module used in the system ofFIG. 1 , according to an embodiment of the present invention; -
FIG. 3 is a block diagram that schematically shows details of an optical location unit used in the system ofFIG. 1 , according to an embodiment of the present invention; -
FIG. 4 is a block diagram that schematically shows details of a central processing and control unit of the system ofFIG. 1 , according to an embodiment of the present invention; and -
FIG. 5 is a schematic illustration of a locus of regions generated in the system ofFIG. 1 , according to an embodiment of the present invention. - Reference is now made to
FIG. 1 which is a schematic, pictorial illustration of asystem 10 for trackingmovable objects region 13, according to an embodiment of the present invention.Objects region 13 is assumed to comprise a warehouse 14 having horizontal dimensions of the order of 50 m×100 m, and a height of the order of 5 m, and objects 12 are assumed to comprise forklift trucks that move within the warehouse. It will be appreciated, however, that this application of the present invention is given solely by way of example, and the principles ofsystem 10 may be applied to tracking other movable objects, including people and animals, within a defined region. Anoptical location unit 22 is mounted on each object 12. - Substantially similar
optical radiator modules ceiling 18 of warehouse 14, or to one or more fixtures attached to the ceiling, so that the modules radiate optical radiation in a generally unobstructed downward direction.Modules modules 16. The actual spacing and method of distribution ofmodules 16 is dependent on the mounting height of the modules, on the height and the field of view of theoptical location units 22, and on the resolution required ofsystem 10.Modules 16 andoptical location units 22 are described in more detail below. - All
modules 16 andoptical location units 22 operate in mutual synchronization with a system clock, in accordance with radio frequency (RF) system synchronization signals broadcast by anantenna 20, from a central system control andprocessing unit 26 generating the system clock.Modules 16 each comprise anantenna module 25, andunits 22 each comprise anantenna 23, the antenna modules andantennas 23 communicating withantenna 20, as described in more detail below.Unit 26 is typically located within warehouse 14. Typically,antenna 20 transmits the system synchronization signals at approximately 433 MHz in the ISM band, with 1.5 MHz bandwidth. Alternatively,antenna 20 may transmit in the 846 MHz band, or in any other suitable band permitted by regulatory authorities. Further alternatively,system 10 may use optical system synchronization signals, such as infrared (IR) pulses transmitted by a suitable IR transmitter in place ofantenna 20. - As yet another alternative,
modules 16,optical location units 22, and/or the system clock may synchronize on an external signal, such as a beacon provided by a cellular communication network or a Global Positioning System (GPS). - In response to the system synchronization signal, each
module 16 transmits radiation of an assigned color in an assigned time slot. Each module is programmed in advance with its time slot and color assignment, so that the combination of time slot and color is unique for each module. For example, if there are 150modules 16, each module may be programmed to transmit in one of 50 successive time slots, each typically of the order of 200 msec long, during which the module emits either red, green or blue light. Alternatively, there may be a larger or smaller number of available time slots, which may be longer or shorter in duration, and a larger or smaller number of colors may be used. Further alternatively,modules 16 may be configured to emit IR or ultraviolet (UV) radiation. The term “optical radiation,” as used in the present patent application and in the claims, should thus be understood to refer to any radiation in the visible, IR or UV range, while the term “color” refers to any distinguishable wavelength band in any of these ranges. - Each
optical location unit 22 generates images of radiatingmodules 16 within a field of view of the unit. The images are analyzed to identify whichmodules 16 are present in the image, based on the time slot and color combination of each of the modules. The images are also analyzed to determine angles subtended at each object 12 by pairs of identifiedmodules 16 present in the images. By way of example,modules unit 22 onobject 12A, and the modules are determined to subtend angles α, β, and γ at the object. Angle γ corresponds to a base angle of atriangle 21 formed bymodules - As is also described in more detail below, processing
unit 26 uses the subtended angles, and knowledge of the spatial distribution ofmodules object 12A.Unit 26 applies the same location determination process individually to each of the objects 12 present in warehouse 14, so that it will be appreciated that there is substantially no limit to the number of objects 12 that may be tracked. -
FIG. 2 is a block diagram that schematically shows details ofmodule 16, according to an embodiment of the present invention. Acontroller 32 determines the color and time slot in whichmodule 16 is to emit radiation, wherein the time slot is determined in relation to the system synchronization signals transmitted byantenna 20. The time slot and color assignments ofmodule 16, and possibly other configurable operating parameters as well, are input tocontroller 32 via amicroprocessor 34. - Operating power for the components of
module 16 is typically supplied by line power, although power may alternatively be supplied by other means known in the art, such as a battery. The components of the module may be integrated into a single microelectronic chip. Alternatively,module 16 may comprise a circuit board or other substrate on which two or more chips are mounted. - An
RF synchronization module 36 receives the system synchronization signals fromantenna 20 viaantenna module 25. Based on these signals,synchronization module 36 generates a synchronization input tocontroller 32. Typically, the system synchronization signal transmitted byantenna 20 comprises a pulse or a train of pulses in a predetermined pattern, indicating the beginning of a global synchronization period (GSP) for all ofmodules 16. (Different pulse trains may also be used to encode data representing the current time slot number.)Synchronization module 36 filters, amplifies and discriminates the RF signals received byantenna module 25 in order to detect the pulse or pattern of pulses transmitted byantenna 20. When the system synchronization signal comprises a pulse train (for synchronization purposes and possibly to represent the current time slot number),module 36 correlates the pattern of received pulses with a predetermined reference pattern in order to detect the exact synchronization, and accordingly signals the beginning of the GSP tocontroller 32. It is generally desirable thatsynchronization modules 36 in all ofoptical modules 16 synchronize on the signals fromantenna 20 with a maximum module-to-module deviation no greater than 1/10 of a time slot. -
Controller 32 uses a clock provided by alocal oscillator 40 in order to determine when its assigned time slot occurs within the GSP, relative to the synchronization input frommodule 36. - When the assigned time slot arrives,
controller 32 triggers a LED driver circuit 42 to actuate one ofLEDs LED 44 may emit red light,LED 46 green light, andLED 48 blue light. The choice of which LED to actuate is typically pre-programmed viamicroprocessor 34, so that no more than onemodule 16 emits radiation of a given color during any given time slot. Alternatively or additionally,system 10 may comprise different groups ofmodules 16, wherein each module has a single LED, and a different color LED is used in the modules of each group. Further alternatively, other types of variable-wavelength or fixed-wavelength light sources may be used. -
Microprocessor 34 receives control signals fromcentral unit 26 viaantenna 20,antenna module 25 andRF module 36. The microprocessor uses the control signals toprogram controller 32, and to configure the timing parameters of eachmodule 16, including: - The GSP duration (typically between 20 seconds and 8 minutes).
- Time slot duration (typically between 100 msec and 1 sec).
- Time slot selection (typically from time slot #1 to #50).
- As noted above,
microprocessor 34 may also be used to set other operating parameters ofmodule 16, such as color selection. Although certain ranges of GSP and time slot duration are listed above by way of example, larger or smaller durations may also be used. -
FIG. 3 is a block diagram that schematically shows details ofoptical location unit 22, according to an embodiment of the present invention. Eachunit 22 comprises one ormore video cameras 72, and the units are mounted on objects 12 so that the one ormore video cameras 72 point in a generally upward direction, towardsceiling 18. Typically,cameras 72 comprise standard CCD- or CMOS-based solid state image sensors, depending on the resolution required ofsystem 10. For example,cameras 72 may comprise model CV7017H CCD cameras, produced by Appro Technologies (Taiwan), typically having, for a lens of focal length 2.5 mm, a generally rectangular field of view of 90°×120°. It will be appreciated that the field of view may be made larger or smaller than that given here, by respectively using a shorter or longer focal length lens. - Each
video camera 72 operates at a standard rate, typically approximately 25 frames/second, and is synchronized to the system clock by a frame synchronization signal received from avideo interface 64, such as the PV 143 WDM video capture card, produced by Professional Video (Taiwan). The frame synchronization signal is generated from the system synchronizing signal received fromunit 26, via anantenna 23, anRF interface 62, and amicroprocessor 68.Video interface 64 also acts as a frame grabber, receiving and digitizing inputs fromcameras 72, and conveying its digital output tomicroprocessor 68 for analysis. -
Microprocessor 68 processes the digitized video image output from each ofcameras 72 in turn, in order to determine the coordinates of the pixel (or group of pixels) associated with the bright, colored lights ofdifferent modules 16 during successive time slots. For eachoptical location unit 22, the pixel coordinates and their color values are transmitted frommicroprocessor 68 viainterface 62 andantenna 23, tocentral unit 26. -
FIG. 4 is a block diagram that schematically shows details of central processing andcontrol unit 26, according to an embodiment of the present invention.Unit 26 is built around aserver 80, which typically comprises a personal computer running the Microsoft Windows® operating system.Server 80 controls anRF synchronization interface 82, comprising an RF transmitter, which transmits the RF synchronization signals viaantenna 20, as described above. -
Server 80 receives the pixel coordinates and color values from eachunit 22, and compares the times and the color values received with stored values of time slots and colors emitted bymodules 16. Thus, whenserver 80 finds that radiation of a particular color was detected in the image received by a specificoptical unit 22 during a particular time slot, the server is able to determine unequivocally the identity of the module that emitted the radiation to the specific unit.Server 80 records the module identity, the pixel or group of pixel coordinates associated with the module, and an identity of the specific unit, in atracking database 88, which is typically held in disk memory. - For each
camera 72, from a knowledge of the focal length and possibly other parameters of the camera, and from the pixel coordinates of the images of the modules,server 80 determines an angle subtended at the respectiveoptical location unit 22 by each pair ofdifferent modules 16 imaged by the camera. Alternatively,server 80 determines the angle subtended from the pixel coordinates of the module pairs by pre-calibrating the one ormore cameras 72 comprised in eachoptical location unit 22. - Locations of
modules 16 are registered indatabase 88, so thatserver 80 is able to determine a distance between each pair ofmodules 16. For each pair of the modules imaged by a specificoptical location unit 22,server 80 is able to associate the distance between the pair with the angle subtended by the pair at the unit.Server 80 is thus able to determine a locus of regions where the object 12, onto which the specificoptical location unit 22 is mounted, may be. In an embodiment of the present invention, and as is described in more detail below, by using a multiplicity of different pairs of imagedmodules 16,server 80 determines a corresponding multiplicity of loci, and finds a unique value for the location of the object 12 from the intersection of the loci. The locations of each object 12 are stored indatabase 88. - It will be appreciated that the distribution between the
microprocessors 68 ofunits 22 andserver 80, of the computation to find the locations of each object, is described hereinabove by way of example, and other distributions are possible. For example, if aspecific unit 22 is given the locations ofmodules 16, then themicroprocessor 68 of the specific unit may determine the location of the object 12 on which the unit is mounted, and transmit the location toserver 80. Other computation distributions will be apparent to those skilled in the art, and all are to be assumed as comprised within the scope of the present invention. - Users of
system 10 may access the information indatabase 88 viaserver 80. The server may have a communication interface to anetwork 92, allowing aclient computer 90 to access the information remotely, via the network. The information indatabase 88 indicates to the user which objects 12 were located inregion 13 ofsystem 10 at any point in time, and also provides a record of the locations and movements of the objects within the region. The user may similarly accessserver 80 in order to find the current locations of particular objects 12 in real time. -
FIG. 5 is aschematic illustration 100 of alocus 102 of regions generated insystem 10, according to an embodiment of the present invention.Illustration 100 corresponds to a top view of a section ofsystem 10, throughceiling 18, and depictsmodules FIG. 1 ).Triangle 21 has sides of length a, b, and c; c is the distance betweenmodules
c 2 =a 2 +b 2−2ab cos γ (1) - For a given c and angle γ, a
locus 102 of regions exists, corresponding to different possible values of sides a and b. Thus, object 12A is located onlocus 102. To determine a unique location forobject 12A,server 80 typically uses one or more other pairs ofmodules 16 imaged by theunit 22 of the object, to determine respective loci of the one or more other pairs, and finds a unique intersection of the loci. Typically,modules 16 are arranged onceiling 18 so that three or more pairs of modules are imaged by eachunit 22, so that three or more loci may be used to determine the unique location of the unit. Alternatively, other methods for determining the unique location ofobject 12A withinlocus 102 may be used, such as storing indatabase 88 certain limiting sections ofregion 13 that are or are not accessible to object 12A. For example, ifobject 12A is only able to move on relatively narrow aisles withinregion 13, the paths of the aisles may be stored and used to determine the unique location of the object withinlocus 102. - It will be appreciated that the principles of the present invention may be applied to tracking the positions of movable objects within substantially any region that may be illuminated by optical radiator modules such as
modules 16, and that the objects may be able to move, and may be tracked in, one, two, or three dimensions. It will be further appreciated that the optical radiator modules may be fixed to any suitable location, such as on walls outside, surrounding and/or within the region wherein the objects are being tracked. - In an alternative embodiment of the present invention,
units 22 are fixed on respective objects 12 so that a direction of the one or more cameras within the units is predetermined when theunits image modules 16. Each imagedmodule 16 then defines a locus for the unit which forms the image. For example,units 22 may be fixed to objects 12 to point in an upward vertical direction. An elevation angle of an imaged module may then be calculated from the pixel coordinates of the image, and a locus—typically a circle—for the unit determined. A unique location for the unit may then be found by determining intersections of loci, typically intersections of three loci. Alternatively, other methods for determining the unique location on one locus, substantially as described above, may be used. All such methods for determining a unique location of the unit, using cameras which are mounted so as to have a predetermined direction, are assumed to be comprised within the scope of the present invention. - It will thus be appreciated that the embodiments described above are cited by way of example, and that the present invention is not limited to what has been particularly shown and described hereinabove. Rather, the scope of the present invention includes both combinations and subcombinations of the various features described hereinabove, as well as variations and modifications thereof which would occur to persons skilled in the art upon reading the foregoing description and which are not disclosed in the prior art.
Claims (33)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
IL162612A IL162612A (en) | 2004-06-17 | 2004-06-17 | Tracking system using fixed optical radiators and method thereof |
IL162612 | 2004-06-17 | ||
PCT/IL2005/000629 WO2005124476A2 (en) | 2004-06-17 | 2005-06-15 | Tracking system using fixed optical radiators |
Publications (2)
Publication Number | Publication Date |
---|---|
US20070269177A1 true US20070269177A1 (en) | 2007-11-22 |
US7920276B2 US7920276B2 (en) | 2011-04-05 |
Family
ID=35510378
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/574,381 Expired - Fee Related US7920276B2 (en) | 2004-06-17 | 2005-06-15 | Tracking system using fixed optical radiators |
Country Status (5)
Country | Link |
---|---|
US (1) | US7920276B2 (en) |
EP (1) | EP1771778B1 (en) |
AT (1) | ATE521024T1 (en) |
IL (1) | IL162612A (en) |
WO (1) | WO2005124476A2 (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090115686A1 (en) * | 2007-11-05 | 2009-05-07 | Samsung Electronics Co., Ltd. | Display system, display apparatus and control method thereof |
US20130300541A1 (en) * | 2012-05-10 | 2013-11-14 | 9Solutions Oy | Improving positioning accuracy of location tracking system |
US20150263806A1 (en) * | 2012-11-16 | 2015-09-17 | Flir Systems, Inc. | Synchronized infrared beacon / infrared detection system |
GB2572083A (en) * | 2015-03-06 | 2019-09-18 | Walmart Apollo Llc | Shopping facility assistance systems, devices and methods |
US10597270B2 (en) | 2015-03-06 | 2020-03-24 | Walmart Apollo, Llc | Shopping facility track system and method of routing motorized transport units |
US11046562B2 (en) | 2015-03-06 | 2021-06-29 | Walmart Apollo, Llc | Shopping facility assistance systems, devices and methods |
US12084824B2 (en) | 2015-03-06 | 2024-09-10 | Walmart Apollo, Llc | Shopping facility assistance systems, devices and methods |
US12123155B2 (en) | 2023-07-25 | 2024-10-22 | Walmart Apollo, Llc | Apparatus and method of monitoring product placement within a shopping facility |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1887313A1 (en) * | 2006-07-31 | 2008-02-13 | Agilent Technologies, Inc. | Location determination system and method of location determination |
US9857040B1 (en) | 2015-08-20 | 2018-01-02 | X Development Llc | Kinematically linked optical components for light redirection |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020101197A1 (en) * | 1997-08-26 | 2002-08-01 | Lys Ihor A. | Packaged information systems |
US20040202351A1 (en) * | 2003-01-11 | 2004-10-14 | Samsung Electronics Co., Ltd. | Mobile robot, and system and method for autnomous navigation of the same |
US7456742B2 (en) * | 2006-08-29 | 2008-11-25 | International Business Machines Corporation | Apparatus and method for determining the position of a mobile platform |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
SE411400B (en) * | 1977-11-02 | 1979-12-17 | Saab Scania Ab | FOR FOLLOWING AN OBJECT INTENDED CORRELATION FOLLOWER |
SE504846C2 (en) | 1994-09-28 | 1997-05-12 | Jan G Faeger | Control equipment with a movable control means |
US5590059A (en) * | 1995-03-14 | 1996-12-31 | Schier; J. Alan | Position encoder system which utilites the fundamental frequency of a ruled scale on an object |
SE506517C3 (en) | 1995-06-19 | 1998-02-05 | Jan G Faeger | Procedure for saturating objects and apparatus for obtaining a set of objects with kaenda laegen |
EP0814344A3 (en) | 1996-06-19 | 1998-12-30 | Matsushita Electric Works, Ltd. | Automatic tracking lighting equipment |
JP2002213920A (en) * | 2001-01-23 | 2002-07-31 | Yamatake Corp | Method and device for confirming position of moving body |
SE523510C2 (en) * | 2001-05-18 | 2004-04-27 | Jan G Faeger | Method for determining the position and / or orientation of a creature in relation to an environment |
CA2451196A1 (en) * | 2001-06-19 | 2003-01-03 | Jan G. Faeger | A device and a method for creating an environment for a creature |
-
2004
- 2004-06-17 IL IL162612A patent/IL162612A/en not_active IP Right Cessation
-
2005
- 2005-06-15 AT AT05750318T patent/ATE521024T1/en not_active IP Right Cessation
- 2005-06-15 EP EP05750318A patent/EP1771778B1/en not_active Not-in-force
- 2005-06-15 US US11/574,381 patent/US7920276B2/en not_active Expired - Fee Related
- 2005-06-15 WO PCT/IL2005/000629 patent/WO2005124476A2/en active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020101197A1 (en) * | 1997-08-26 | 2002-08-01 | Lys Ihor A. | Packaged information systems |
US20040202351A1 (en) * | 2003-01-11 | 2004-10-14 | Samsung Electronics Co., Ltd. | Mobile robot, and system and method for autnomous navigation of the same |
US7456742B2 (en) * | 2006-08-29 | 2008-11-25 | International Business Machines Corporation | Apparatus and method for determining the position of a mobile platform |
Cited By (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090115686A1 (en) * | 2007-11-05 | 2009-05-07 | Samsung Electronics Co., Ltd. | Display system, display apparatus and control method thereof |
US20130300541A1 (en) * | 2012-05-10 | 2013-11-14 | 9Solutions Oy | Improving positioning accuracy of location tracking system |
US20150263806A1 (en) * | 2012-11-16 | 2015-09-17 | Flir Systems, Inc. | Synchronized infrared beacon / infrared detection system |
US9887775B2 (en) * | 2012-11-16 | 2018-02-06 | Flir Systems, Inc. | Synchronized infrared beacon / infrared detection system |
GB2572083A (en) * | 2015-03-06 | 2019-09-18 | Walmart Apollo Llc | Shopping facility assistance systems, devices and methods |
GB2572083B (en) * | 2015-03-06 | 2020-02-19 | Walmart Apollo Llc | Shopping facility assistance systems, devices and methods |
US10597270B2 (en) | 2015-03-06 | 2020-03-24 | Walmart Apollo, Llc | Shopping facility track system and method of routing motorized transport units |
US10611614B2 (en) | 2015-03-06 | 2020-04-07 | Walmart Apollo, Llc | Shopping facility assistance systems, devices and methods to drive movable item containers |
US10633231B2 (en) | 2015-03-06 | 2020-04-28 | Walmart Apollo, Llc | Apparatus and method of monitoring product placement within a shopping facility |
US10669140B2 (en) | 2015-03-06 | 2020-06-02 | Walmart Apollo, Llc | Shopping facility assistance systems, devices and methods to detect and handle incorrectly placed items |
US10815104B2 (en) | 2015-03-06 | 2020-10-27 | Walmart Apollo, Llc | Recharging apparatus and method |
US10875752B2 (en) | 2015-03-06 | 2020-12-29 | Walmart Apollo, Llc | Systems, devices and methods of providing customer support in locating products |
US11034563B2 (en) | 2015-03-06 | 2021-06-15 | Walmart Apollo, Llc | Apparatus and method of monitoring product placement within a shopping facility |
US11046562B2 (en) | 2015-03-06 | 2021-06-29 | Walmart Apollo, Llc | Shopping facility assistance systems, devices and methods |
US11679969B2 (en) | 2015-03-06 | 2023-06-20 | Walmart Apollo, Llc | Shopping facility assistance systems, devices and methods |
US11761160B2 (en) | 2015-03-06 | 2023-09-19 | Walmart Apollo, Llc | Apparatus and method of monitoring product placement within a shopping facility |
US11840814B2 (en) | 2015-03-06 | 2023-12-12 | Walmart Apollo, Llc | Overriding control of motorized transport unit systems, devices and methods |
US12084824B2 (en) | 2015-03-06 | 2024-09-10 | Walmart Apollo, Llc | Shopping facility assistance systems, devices and methods |
US12123155B2 (en) | 2023-07-25 | 2024-10-22 | Walmart Apollo, Llc | Apparatus and method of monitoring product placement within a shopping facility |
Also Published As
Publication number | Publication date |
---|---|
IL162612A (en) | 2010-12-30 |
IL162612A0 (en) | 2005-11-20 |
US7920276B2 (en) | 2011-04-05 |
ATE521024T1 (en) | 2011-09-15 |
WO2005124476A2 (en) | 2005-12-29 |
EP1771778A2 (en) | 2007-04-11 |
WO2005124476A3 (en) | 2006-02-09 |
EP1771778A4 (en) | 2008-06-11 |
EP1771778B1 (en) | 2011-08-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7395966B2 (en) | Tracking system using optical tags | |
US7920276B2 (en) | Tracking system using fixed optical radiators | |
US10371504B2 (en) | Light fixture commissioning using depth sensing device | |
JP3779308B2 (en) | Camera calibration system and three-dimensional measurement system | |
US8194913B2 (en) | Character recognition system and method | |
CN101171833B (en) | Digital cameras with triangulation autofocus systems and related methods | |
RU2699177C2 (en) | Dynamic tracking system and automatic control method using three-dimensional time-of-flight cameras | |
US20140198206A1 (en) | System and Method for Estimating the Position and Orientation of an Object using Optical Beacons | |
WO2017045467A1 (en) | Position determination method, device, system and processing center | |
TWI746973B (en) | Method for guiding a machine capable of autonomous movement through optical communication device | |
CN111955054B (en) | Lighting system | |
TWI702805B (en) | System and method for guiding a machine capable of autonomous movement | |
Pang et al. | LED location beacon system based on processing of digital images | |
US20190187065A1 (en) | Lighting apparatus, method for providing lighting system, and road management system | |
US20180054876A1 (en) | Out of plane sensor or emitter for commissioning lighting devices | |
GB2380883A (en) | Location and identification of participants in a sporting event by means of optically readable tags | |
WO2021110966A1 (en) | Positioning and identification of electronic labels using a camera | |
TWI704503B (en) | System of recognizing identity of objects and method of automatically recognizing identity of objects | |
CN110942115A (en) | Service providing method and system based on optical label | |
AU2022452474A1 (en) | Position determination method or system, for determining the position of objects | |
US20220108460A1 (en) | System and method for use in geo-spatial registration | |
KR20240004953A (en) | Method and system for determining the position of shelf rail equipment | |
RU2271608C2 (en) | Method for combined radio-optical communications between parties | |
CN109188357A (en) | A kind of indoor locating system and method based on structure optical arrays |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: PARELEC ISRAEL LTD., ISRAEL Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BRAIMAN, MICHAEL;EIZENBERG, ROM;EFRAT, ITAI;REEL/FRAME:021954/0887 Effective date: 20070701 |
|
AS | Assignment |
Owner name: P.W. PRECYSE WIRELESS LTD,ISRAEL Free format text: CHANGE OF NAME;ASSIGNOR:PARELEC ISRAEL LTD;REEL/FRAME:024536/0093 Effective date: 20091021 Owner name: P.W. PRECYSE WIRELESS LTD, ISRAEL Free format text: CHANGE OF NAME;ASSIGNOR:PARELEC ISRAEL LTD;REEL/FRAME:024536/0093 Effective date: 20091021 |
|
AS | Assignment |
Owner name: PRECYSE INVESTMENT PARTNERS, LLC, GEORGIA Free format text: SECURITY AGREEMENT;ASSIGNOR:P.W. PRECYSE WIRELESS LTD.;REEL/FRAME:024806/0079 Effective date: 20100716 |
|
AS | Assignment |
Owner name: P.W. PRECYSE WIRELESS LTD., ISRAEL Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:PRECYSE INVESTMENT PARTNERS, LLC;REEL/FRAME:025039/0751 Effective date: 20100817 |
|
AS | Assignment |
Owner name: PRECYSE TECHNOLOGIES, INC., GEORGIA Free format text: CHANGE OF NAME;ASSIGNOR:P.W. PRECYSE WIRELESS LTD;REEL/FRAME:025870/0181 Effective date: 20110227 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
AS | Assignment |
Owner name: P.W. PRECYSE WIRELESS LTD., ISRAEL Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PRECYSE TECHNOLOGIES, INC.;REEL/FRAME:034047/0141 Effective date: 20141028 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20190405 |
|
AS | Assignment |
Owner name: THE ASSETS NET LLC, VIRGINIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:P.W PRECYSE WIRELESS LTD;PRECYSE INC;REEL/FRAME:053636/0894 Effective date: 20200828 |