US20180324550A1 - Pick and put location verification utilizing rf received signal strength - Google Patents

Pick and put location verification utilizing rf received signal strength Download PDF

Info

Publication number
US20180324550A1
US20180324550A1 US15/585,844 US201715585844A US2018324550A1 US 20180324550 A1 US20180324550 A1 US 20180324550A1 US 201715585844 A US201715585844 A US 201715585844A US 2018324550 A1 US2018324550 A1 US 2018324550A1
Authority
US
United States
Prior art keywords
mobile device
emitter
wireless signal
distance
storage area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US15/585,844
Other versions
US10136259B1 (en
Inventor
Erik Todeschini
Mehul Patel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Intermec Inc
Original Assignee
Intermec Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intermec Inc filed Critical Intermec Inc
Assigned to INTERMEC, INC. reassignment INTERMEC, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: PATEL, MEHUL, TODESCHINI, ERIK
Priority to US15/585,844 priority Critical patent/US10136259B1/en
Priority to EP18170469.3A priority patent/EP3399329B1/en
Priority to EP20156377.2A priority patent/EP3667356B1/en
Priority to CN202111411731.1A priority patent/CN113890649A/en
Priority to CN201810414711.1A priority patent/CN108832941B/en
Priority to US16/142,088 priority patent/US10440513B2/en
Publication of US20180324550A1 publication Critical patent/US20180324550A1/en
Publication of US10136259B1 publication Critical patent/US10136259B1/en
Application granted granted Critical
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/025Services making use of location information using location based information parameters
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S11/00Systems for determining distance or velocity not using reflection or reradiation
    • G01S11/02Systems for determining distance or velocity not using reflection or reradiation using radio waves
    • G01S11/06Systems for determining distance or velocity not using reflection or reradiation using radio waves using intensity measurements
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/02Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
    • G01S5/0252Radio frequency fingerprinting
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/02Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
    • G01S5/0252Radio frequency fingerprinting
    • G01S5/02521Radio frequency fingerprinting using a radio-map
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/02Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
    • G01S5/0295Proximity-based methods, e.g. position inferred from reception of particular signals
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/02Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
    • G01S5/14Determining absolute distances from a plurality of spaced points of known location
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/08Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087Inventory or stock management, e.g. order filling, procurement or balancing against orders
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B1/00Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/02Transmitters
    • H04B1/04Circuits
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B17/00Monitoring; Testing
    • H04B17/10Monitoring; Testing of transmitters
    • H04B17/11Monitoring; Testing of transmitters for calibration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B17/00Monitoring; Testing
    • H04B17/30Monitoring; Testing of propagation channels
    • H04B17/309Measuring or estimating channel quality parameters
    • H04B17/318Received signal strength
    • H04L61/6022
    • H04W4/008
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/023Services making use of location information using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W48/00Access restriction; Network selection; Access point selection
    • H04W48/16Discovering, processing access restriction or access information
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/08Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q50/28
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L2101/00Indexing scheme associated with group H04L61/00
    • H04L2101/60Types of network addresses
    • H04L2101/618Details of network addresses
    • H04L2101/622Layer-2 addresses, e.g. medium access control [MAC] addresses

Definitions

  • a common source of inaccuracy is caused by a stocker or material handler stocking (or picking) a product at an incorrect location.
  • Some systems such as pick to voice, address this by requiring the material handler to read a confirmation code that is printed at each location to verify that they are in fact at the correct spot, picking or stocking the correct item.
  • This solution is fallible as it is common for the material handlers to memorize these confirmation codes and speak back the correct code to the system while picking/placing at an incorrect location.
  • a warehouse including a plurality of storage areas where items are stored, and a plurality of emitters that each emit a wireless signal and are placed at known locations relative to the plurality of storage areas, including a first storage area that is one of the plurality of storage areas, the first storage area being for storage of a specified item.
  • the warehouse further includes a mobile device that travels with a material handler.
  • the mobile device receives a first wireless signal from a first emitter that is one of the plurality of emitters; calculates a first distance between the material handler and the first emitter based on the first wireless signal; determines that the material handler is located at a stocking location for the first storage area based on the first distance and the known location of the first emitter; and sends a message indicating that the material handler is at the stocking location for the first storage area.
  • An inventory tracking system includes a plurality of emitters that each emit a wireless signal and are placed at known locations relative to a plurality of storage areas in a warehouse, including a first storage area for storage of a specified item.
  • the system further includes a mobile device that travels with a material handler.
  • the mobile device receives a first wireless signal from a first emitter that is one of the plurality of emitters; calculates a first distance between the material handler and the first emitter based on the first wireless signal; determines that the material handler is located at a stocking location for the first storage area based on the first distance and the known location of the first emitter; and sends a message indicating that the material handler is at the stocking location for the first storage area.
  • the mobile device determines that the material handler is located at the stocking location for the first storage area when the first distance is below a predetermined threshold, and determines that the material handler is located at the stocking location for a predetermined period of time before sending the message.
  • the mobile device receives a second wireless signal from a second emitter that is one of the plurality of emitters, calculates a second distance to the second emitter based on the second wireless signal, and uses the second distance and the known location of the second emitter to determine that the material handler is located at the stocking location for the first storage area.
  • the mobile device determines the location of the material handler using multilateration.
  • the mobile device receives a third wireless signal from a third emitter that is one of the plurality of emitters, calculates a third distance to the third emitter based on the third wireless signal, and uses the third distance and the known location of the third emitter to determine that the material handler is located at the stocking location for the first storage area.
  • the mobile device calculates the first distance based on a received strength of the first wireless signal.
  • the mobile device calculates the first distance based on a time of flight of the first wireless signal. In some embodiments, the mobile device determines an identity of the first emitter based on the first wireless signal, and uses the identity to determine the known location of the first emitter. In some embodiments, the mobile device determines the identity based on a MAC (media access control) address of the first emitter, obtained from the first wireless signal. In some embodiments, the mobile device determines the identity based on a beacon ID of the first emitter, obtained from the first wireless signal. In some embodiments, the plurality of emitters are Bluetooth low-energy (BLE) beacons.
  • BLE Bluetooth low-energy
  • the message includes an instruction to the material handler to remove a quantity of the specified item from the first storage area, or add a quantity of the specified item to the first storage area.
  • the mobile device instructs the material handler to go to the stocking location for the first storage area prior to receiving the first wireless signal.
  • Embodiments herein provide a solution to the above-described stocking problems by using received signal strength of wireless (sometimes radio-frequency) beacons as a confirmation of correct pick location.
  • wireless sometimes radio-frequency
  • Several embodiments utilize small, inexpensive Bluetooth low-energy (BLE) beacons that can be mounted at each pick location. These beacons need not be equipped with any other features other than a simple BLE radio, making them quite inexpensive and useful in other ways, such as indoor positioning for other purposes such as tracking and productivity metrics analysis of material handlers.
  • Some embodiments also use a smart device that is carried by the material handler or mounted on the forklift that contains a BLE radio. When a material handler is directed to their next stocking location (via voice, light or other mechanism) they navigate their forklift to the stocking location. Their smart device software is aware of the Bluetooth MAC address that belongs to the beacon located at the next stocking location.
  • This mapping is done ahead of time when the warehouse is outfitted with these beacons.
  • the smart device listens to all BLE devices until it finds the one it is looking for. Once found, it monitors the received signal strength of the beacon's advertising packet.
  • This packet contains the transmit power of the beacon, which along with the received signal strength can be used to estimate the distance to the beacon, as RF signal strength decreases in a predictable/measureable way the greater the separation between the transmitter and the receiver. It is this property that is the basis of some types of indoor positioning techniques, such as Multilateration and RF fingerprinting.
  • the received signal strength of the beacon increases.
  • the signal strength and transmit power are used to compute a distance to the beacon.
  • a distance to the beacon Once the material handler has sustained a distance to the beacon below a predetermined threshold (e.g. 1.5 meters) for a predetermined amount of time (e.g. 5 seconds) the business logic app (or other software) running on the material handler's smart phone (or other mobile device) will consider the location to be verified. Once the location has been confirmed, the material handler can be told the pick count (via software graphical-user interface (GUI), verbally, or other means) and can continue their stocking operation.
  • GUI software graphical-user interface
  • FIG. 1 is an isometric drawing of a warehouse according to one embodiment.
  • FIG. 2 is a two-dimensional drawing of a storage area according to one embodiment.
  • FIG. 3 is a flow chart of functions of a mobile device according to one embodiment.
  • FIG. 4 is a diagram of a warehouse according to one embodiment.
  • FIG. 1 shows a warehouse 100 according to one embodiment, implementing an embodiment of an inventory management system 160 described herein.
  • warehouse 100 contains a rack 150 where items, such as parts or merchandise, are stored.
  • Rack 150 includes a plurality of storage areas 140 , which in some embodiments are particular locations on a shelf of rack 150 . As shown in FIG. 2 , each storage area 140 contains a specified item 200 stored therein.
  • Warehouse 100 contains several emitters 130 , whose locations are known relative to the storage areas 140 . Emitters 130 emit wireless signals 132 . In this embodiment, emitters 130 are mounted on rack 150 .
  • emitters 130 are small BLE beacon devices with power supplies.
  • An off-the-shelf BLE beacon is used in some embodiments, and almost any type of wireless beacon can be used.
  • an emitter 130 is mounted at each stocking location 160 , for each storage area 140 , and its BLE MAC (media access control) address is stored in a database and associated with that particular stocking location 160 . In several embodiments, even where an emitter 130 is not located at each stocking location 160 , the relative location of emitters 130 relative to stocking locations 160 or storage areas 140 is known.
  • Material handler 120 is a forklift operator. However, in other embodiments, material handler 120 is a worker without a vehicle, a machine, a robot, or a drone. Material handler 120 can be anything capable of stowing items 200 in or retrieving items 200 from storage areas 140 . In order to retrieve (pick) or stock an item 200 from a particular storage area 140 , material handler 120 should be located at the storage location 160 associated with that particular storage area 140 . Material handler 120 is equipped with a mobile device 110 that travels with the material handler 120 and determines the location of material handler 120 relative to storage areas 140 and storage locations 160 .
  • mobile device 110 has a processor executing software or instructions on a computer-readable storage medium. As shown in FIG. 3 , when an order is received by mobile device 110 , mobile device 110 instructs material handler 120 to go to stocking location 160 associated with the storage area 140 containing a specified item 200 that is the subject of the order. The software instructs mobile device 110 to listen for signals 132 from all emitters 130 using a receiver connected thereto. Material handler 120 then travels toward the stocking location 160 indicated by mobile device 110 .
  • mobile device 110 continues to listen for signals 132 in its vicinity while looking for a particular Bluetooth MAC address (or other identifying information obtained from signals 132 ) corresponding to the intended emitter 130 (which corresponds to the desired stocking location 160 , storage area 140 , and item 200 ). When found, mobile device 110 reads the transmit power contained within the advertisement packet of emitter 130 and notes the received signal strength of the signal 132 emitted from emitter 130 . In some embodiments, mobile device then calculates the approximate distance to emitter 130 using the following formula:
  • the signal propagation constant n is approximately 2 in free space, but n can be adjusted for measurements through walls, as a wall could reduce the received signal strength by approximately ⁇ 3 dBm.
  • the calibrated tx (transmission) Power is the measured signal strength at one meter and is what emitter 130 transmits within its advertisement packet (e.g. signal 132 ) in several embodiments.
  • mobile device 110 calculates the time of flight of the signal 132 to determine the distance to the emitter 130 .
  • the software on mobile device 110 continuously calculates this distance each time it reads an advertisement packet in a signal 132 . Once the calculated distance is at or below a certain threshold value (e.g. 1.5 meters) for a certain amount of time (e.g. 5 seconds) the software signals that the stocking location has been confirmed.
  • the software in some embodiments a business logic application
  • the threshold values used for this pick confirmation are configurable for the specific use case.
  • Storage areas 140 containing bins that are further apart might allow for a greater distance from an emitter to confirm that the material handler 120 is in the desired stocking location 160 , where denser storage areas 140 may require a tighter tolerance.
  • this system is used to increase the accuracy of many different types of picking & stocking systems (pick to voice, pick to light, etc.).
  • emitters 130 are not placed at every stocking location 160 , but are distributed throughout warehouse 150 at locations relative to stocking locations 160 that are known.
  • mobile device 110 uses the calculated distances to and identities of two or more emitters 130 to determine the location of material handler 120 within warehouse 100 (and relative to stocking locations 160 ). This is achieved by receiving signals 132 from two or more emitters 130 and multilateration. More accurate location information can be obtained by receiving signals 132 from three or more emitters 130 and multilateration (i.e. using calculated distances and identities of three or more emitters).
  • FIG. 4 where three emitters 130 are placed in warehouse 100 , and mobile device 110 calculates distances 430 to each of the three emitters.
  • Mobile device 110 calculates location of material handler 120 based on known locations of emitters 130 . This determined location is then used to confirm that material handler 120 is at desired stocking location 160 , so that the stocking operation can proceed.
  • the warehouse, system, and mobile device functionality described herein represent a technological improvement to the field of digital inventory management.
  • various computerized solutions have been devised to prevent errors by material handlers in stocking and retrieving goods in storage.
  • these solutions are easily circumvented.
  • the present systems solve this problem using a property unique to the field of wireless communication; namely, that a distance to an emitter can be determined based on received signal strength. Accordingly, this is a solution necessarily rooted in technology.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Economics (AREA)
  • Quality & Reliability (AREA)
  • Finance (AREA)
  • Marketing (AREA)
  • Theoretical Computer Science (AREA)
  • Development Economics (AREA)
  • Electromagnetism (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Human Resources & Organizations (AREA)
  • Accounting & Taxation (AREA)
  • Operations Research (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Computer Security & Cryptography (AREA)
  • Warehouses Or Storage Devices (AREA)
  • Position Fixing By Use Of Radio Waves (AREA)

Abstract

An inventory tracking system includes a plurality of emitters that each emit a wireless signal and are placed at known locations relative to a plurality of storage areas in a warehouse, including a first storage area for storage of a specified item. The system further includes a mobile device that travels with a material handler. The mobile device: receives a first wireless signal from a first emitter that is one of the plurality of emitters; calculates a first distance between the material handler and the first emitter based on the first wireless signal; determines that the material handler is located at a stocking location for the first storage area based on the first distance and the known location of the first emitter; and sends a message indicating that the material handler is at the stocking location for the first storage area.

Description

    BACKGROUND
  • During order fulfillment operations such as stocking and picking in a storage location such as a warehouse, a common source of inaccuracy is caused by a stocker or material handler stocking (or picking) a product at an incorrect location.
  • Some systems, such as pick to voice, address this by requiring the material handler to read a confirmation code that is printed at each location to verify that they are in fact at the correct spot, picking or stocking the correct item. This solution however, is fallible as it is common for the material handlers to memorize these confirmation codes and speak back the correct code to the system while picking/placing at an incorrect location.
  • SUMMARY
  • The above problems are solved in several embodiments by a warehouse including a plurality of storage areas where items are stored, and a plurality of emitters that each emit a wireless signal and are placed at known locations relative to the plurality of storage areas, including a first storage area that is one of the plurality of storage areas, the first storage area being for storage of a specified item. The warehouse further includes a mobile device that travels with a material handler. The mobile device: receives a first wireless signal from a first emitter that is one of the plurality of emitters; calculates a first distance between the material handler and the first emitter based on the first wireless signal; determines that the material handler is located at a stocking location for the first storage area based on the first distance and the known location of the first emitter; and sends a message indicating that the material handler is at the stocking location for the first storage area.
  • An inventory tracking system includes a plurality of emitters that each emit a wireless signal and are placed at known locations relative to a plurality of storage areas in a warehouse, including a first storage area for storage of a specified item. The system further includes a mobile device that travels with a material handler. The mobile device: receives a first wireless signal from a first emitter that is one of the plurality of emitters; calculates a first distance between the material handler and the first emitter based on the first wireless signal; determines that the material handler is located at a stocking location for the first storage area based on the first distance and the known location of the first emitter; and sends a message indicating that the material handler is at the stocking location for the first storage area.
  • In some embodiments, the mobile device determines that the material handler is located at the stocking location for the first storage area when the first distance is below a predetermined threshold, and determines that the material handler is located at the stocking location for a predetermined period of time before sending the message. In some embodiments, the mobile device receives a second wireless signal from a second emitter that is one of the plurality of emitters, calculates a second distance to the second emitter based on the second wireless signal, and uses the second distance and the known location of the second emitter to determine that the material handler is located at the stocking location for the first storage area. In some embodiments, the mobile device determines the location of the material handler using multilateration. In some embodiments, the mobile device receives a third wireless signal from a third emitter that is one of the plurality of emitters, calculates a third distance to the third emitter based on the third wireless signal, and uses the third distance and the known location of the third emitter to determine that the material handler is located at the stocking location for the first storage area. In some embodiments, the mobile device calculates the first distance based on a received strength of the first wireless signal. In some embodiments, the mobile device calculates the first distance based on the following formula (1): (1) RSSI=−10*n*log(d)+A, where: d is the distance, A is a calibrated transmission power, n is a signal propagation constant, and RSSI is the received strength of the first wireless signal. In some embodiments, the mobile device calculates the first distance based on a time of flight of the first wireless signal. In some embodiments, the mobile device determines an identity of the first emitter based on the first wireless signal, and uses the identity to determine the known location of the first emitter. In some embodiments, the mobile device determines the identity based on a MAC (media access control) address of the first emitter, obtained from the first wireless signal. In some embodiments, the mobile device determines the identity based on a beacon ID of the first emitter, obtained from the first wireless signal. In some embodiments, the plurality of emitters are Bluetooth low-energy (BLE) beacons. In some embodiments, the message includes an instruction to the material handler to remove a quantity of the specified item from the first storage area, or add a quantity of the specified item to the first storage area. In some embodiments, the mobile device instructs the material handler to go to the stocking location for the first storage area prior to receiving the first wireless signal.
  • Embodiments herein provide a solution to the above-described stocking problems by using received signal strength of wireless (sometimes radio-frequency) beacons as a confirmation of correct pick location. Several embodiments utilize small, inexpensive Bluetooth low-energy (BLE) beacons that can be mounted at each pick location. These beacons need not be equipped with any other features other than a simple BLE radio, making them quite inexpensive and useful in other ways, such as indoor positioning for other purposes such as tracking and productivity metrics analysis of material handlers. Some embodiments also use a smart device that is carried by the material handler or mounted on the forklift that contains a BLE radio. When a material handler is directed to their next stocking location (via voice, light or other mechanism) they navigate their forklift to the stocking location. Their smart device software is aware of the Bluetooth MAC address that belongs to the beacon located at the next stocking location.
  • This mapping is done ahead of time when the warehouse is outfitted with these beacons. The smart device listens to all BLE devices until it finds the one it is looking for. Once found, it monitors the received signal strength of the beacon's advertising packet. This packet contains the transmit power of the beacon, which along with the received signal strength can be used to estimate the distance to the beacon, as RF signal strength decreases in a predictable/measureable way the greater the separation between the transmitter and the receiver. It is this property that is the basis of some types of indoor positioning techniques, such as Multilateration and RF fingerprinting.
  • As the material handler approaches the stocking location, the received signal strength of the beacon increases. The signal strength and transmit power are used to compute a distance to the beacon. Once the material handler has sustained a distance to the beacon below a predetermined threshold (e.g. 1.5 meters) for a predetermined amount of time (e.g. 5 seconds) the business logic app (or other software) running on the material handler's smart phone (or other mobile device) will consider the location to be verified. Once the location has been confirmed, the material handler can be told the pick count (via software graphical-user interface (GUI), verbally, or other means) and can continue their stocking operation.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is an isometric drawing of a warehouse according to one embodiment.
  • FIG. 2 is a two-dimensional drawing of a storage area according to one embodiment.
  • FIG. 3 is a flow chart of functions of a mobile device according to one embodiment.
  • FIG. 4 is a diagram of a warehouse according to one embodiment.
  • DETAILED DESCRIPTION OF EMBODIMENTS
  • FIG. 1 shows a warehouse 100 according to one embodiment, implementing an embodiment of an inventory management system 160 described herein. Warehouse 100 contains a rack 150 where items, such as parts or merchandise, are stored. Rack 150 includes a plurality of storage areas 140, which in some embodiments are particular locations on a shelf of rack 150. As shown in FIG. 2, each storage area 140 contains a specified item 200 stored therein. Warehouse 100 contains several emitters 130, whose locations are known relative to the storage areas 140. Emitters 130 emit wireless signals 132. In this embodiment, emitters 130 are mounted on rack 150.
  • In some embodiments, emitters 130 are small BLE beacon devices with power supplies. An off-the-shelf BLE beacon is used in some embodiments, and almost any type of wireless beacon can be used. In some embodiments, an emitter 130 is mounted at each stocking location 160, for each storage area 140, and its BLE MAC (media access control) address is stored in a database and associated with that particular stocking location 160. In several embodiments, even where an emitter 130 is not located at each stocking location 160, the relative location of emitters 130 relative to stocking locations 160 or storage areas 140 is known.
  • Items 200 are removed from and stocked in storage areas 140 by a material handler 120. In this embodiment, material handler 120 is a forklift operator. However, in other embodiments, material handler 120 is a worker without a vehicle, a machine, a robot, or a drone. Material handler 120 can be anything capable of stowing items 200 in or retrieving items 200 from storage areas 140. In order to retrieve (pick) or stock an item 200 from a particular storage area 140, material handler 120 should be located at the storage location 160 associated with that particular storage area 140. Material handler 120 is equipped with a mobile device 110 that travels with the material handler 120 and determines the location of material handler 120 relative to storage areas 140 and storage locations 160.
  • In this embodiment, mobile device 110 has a processor executing software or instructions on a computer-readable storage medium. As shown in FIG. 3, when an order is received by mobile device 110, mobile device 110 instructs material handler 120 to go to stocking location 160 associated with the storage area 140 containing a specified item 200 that is the subject of the order. The software instructs mobile device 110 to listen for signals 132 from all emitters 130 using a receiver connected thereto. Material handler 120 then travels toward the stocking location 160 indicated by mobile device 110. Meanwhile, mobile device 110 continues to listen for signals 132 in its vicinity while looking for a particular Bluetooth MAC address (or other identifying information obtained from signals 132) corresponding to the intended emitter 130 (which corresponds to the desired stocking location 160, storage area 140, and item 200). When found, mobile device 110 reads the transmit power contained within the advertisement packet of emitter 130 and notes the received signal strength of the signal 132 emitted from emitter 130. In some embodiments, mobile device then calculates the approximate distance to emitter 130 using the following formula:

  • RSSI=−10*n*log(d)+A   (1)
  • where d=distance, A=calibrated tx Power, n=signal propagation constant and [RSSI]=dBm.
  • The signal propagation constant n is approximately 2 in free space, but n can be adjusted for measurements through walls, as a wall could reduce the received signal strength by approximately ˜3 dBm. The calibrated tx (transmission) Power is the measured signal strength at one meter and is what emitter 130 transmits within its advertisement packet (e.g. signal 132) in several embodiments.
  • In other embodiments, such as those using ultra-wide band beacons for emitters 130, mobile device 110 calculates the time of flight of the signal 132 to determine the distance to the emitter 130.
  • In some embodiments, the software on mobile device 110 continuously calculates this distance each time it reads an advertisement packet in a signal 132. Once the calculated distance is at or below a certain threshold value (e.g. 1.5 meters) for a certain amount of time (e.g. 5 seconds) the software signals that the stocking location has been confirmed. The software (in some embodiments a business logic application) then communicates the pick or stock quantity to the material handler and the stocking operation continues. After the quantity is messages to the material handler, the material handler performs the stocking operation (i.e. loading the quantity of the specified item 200 into the storage area 140, or removing the quantity of the specified item 200 from the storage area 140). The threshold values used for this pick confirmation are configurable for the specific use case. Storage areas 140 containing bins that are further apart might allow for a greater distance from an emitter to confirm that the material handler 120 is in the desired stocking location 160, where denser storage areas 140 may require a tighter tolerance. In some embodiments, this system is used to increase the accuracy of many different types of picking & stocking systems (pick to voice, pick to light, etc.).
  • In another embodiment, emitters 130 are not placed at every stocking location 160, but are distributed throughout warehouse 150 at locations relative to stocking locations 160 that are known. In this embodiment, mobile device 110 uses the calculated distances to and identities of two or more emitters 130 to determine the location of material handler 120 within warehouse 100 (and relative to stocking locations 160). This is achieved by receiving signals 132 from two or more emitters 130 and multilateration. More accurate location information can be obtained by receiving signals 132 from three or more emitters 130 and multilateration (i.e. using calculated distances and identities of three or more emitters). Such an embodiment is shown in FIG. 4, where three emitters 130 are placed in warehouse 100, and mobile device 110 calculates distances 430 to each of the three emitters. Mobile device 110 then calculates location of material handler 120 based on known locations of emitters 130. This determined location is then used to confirm that material handler 120 is at desired stocking location 160, so that the stocking operation can proceed.
  • The warehouse, system, and mobile device functionality described herein represent a technological improvement to the field of digital inventory management. As discussed previously, various computerized solutions have been devised to prevent errors by material handlers in stocking and retrieving goods in storage. However, these solutions are easily circumvented. The present systems solve this problem using a property unique to the field of wireless communication; namely, that a distance to an emitter can be determined based on received signal strength. Accordingly, this is a solution necessarily rooted in technology.
  • Although the invention has been described with reference to embodiments herein, those embodiments do not limit the scope of the invention. Modifications to those embodiments or different embodiments may fall within the scope of the invention.

Claims (20)

1. A system, comprising:
a plurality of emitters that each emit a wireless signal and are placed at known locations relative to a plurality of storage areas where items are stored;
a mobile device comprising an antenna and being configured for:
receiving a first wireless signal from a first emitter of the plurality of emitters;
calculating a first distance between the mobile device and the first emitter based on the first wireless signal;
determining that the mobile device is located at a stocking location for a first storage area of the plurality of storage areas based on the first distance between the mobile device and the first emitter, the known location of the first emitter and a comparison of the calculated first distance with a threshold, wherein the threshold is configurable based on density of bins in the first storage area; and
sending a message indicating that the mobile device is at the stocking location for the first storage area in response to the determining that the mobile device is located at the stocking location.
2. The system of claim 1, wherein the mobile device determines that a material handler is located at the stocking location for the first storage area when the first distance is below the threshold, and determines that the material handler is located at the stocking location for a predetermined period of time before sending the message.
3. The system of claim 1, wherein the mobile device calculates the first distance based on a received strength of the first wireless signal.
4. The system of claim 3, wherein the mobile device calculates the first distance based on the following formula (1):

RSSI=−10*n*log(d)+A   (1)
where: d is the distance, A is a calibrated transmission power, n is a signal propagation constant, and RSSI is the received strength of the first wireless signal.
5. The system of claim 1, wherein the mobile device determines an identity of the first emitter based on the first wireless signal, and uses the identity to determine the known location of the first emitter.
6. The system of claim 1, wherein the mobile device instructs a material handler to go to the stocking location for the first storage area prior to receiving the first wireless signal.
7. An inventory management system, comprising:
a plurality of emitters that each emit a wireless signal and are placed at known locations relative to a plurality of storage areas in a warehouse, including a first storage area for storage of a specified item;
a mobile device that travels with a material handler, the mobile device:
receiving a first wireless signal from a first emitter that is one of the plurality of emitters;
calculating a first distance between the material handler and the first emitter based on the first wireless signal;
determining that the material handler is located at a stocking location for the first storage area based on the first distance, the known location of the first emitter and a comparison of the calculated first distance with a threshold,
wherein the threshold is configurable based on density of bins in the first storage area; and
sending a message indicating that the material handler is at the stocking location for the first storage area.
8. The system of claim 7, wherein the mobile device determines that the material handler is located at the stocking location for the first storage area when the first distance is below the threshold, and determines that the material handler is located at the stocking location for a predetermined period of time before sending the message.
9. The system of claim 8, wherein the mobile device receives a second wireless signal from a second emitter that is one of the plurality of emitters, calculates a second distance to the second emitter based on the second wireless signal, and uses the second distance and the known location of the second emitter to determine that the material handler is located at the stocking location for the first storage area.
10. The system of claim 9, wherein the mobile device determines that the material handler is located at the stocking location for the first storage area using multilateration.
11. The system of claim 10, wherein the mobile device receives a third wireless signal from a third emitter that is one of the plurality of emitters, calculates a third distance to the third emitter based on the third wireless signal, and uses the third distance and the known location of the third emitter to determine that the material handler is located at the stocking location for the first storage area.
12. The system of claim 9, wherein the mobile device calculates the first distance based on a received strength of the first wireless signal.
13. The system of claim 7, wherein the mobile device calculates the first distance based on the following formula (1):

RSSI=−10*n*log(d)+A   (1)
where: d is the distance, A is a calibrated transmission power, n is a signal propagation constant, and RSSI is the received strength of the first wireless signal.
14. The system of claim 9, wherein the mobile device calculates the first distance based on a time of flight of the first wireless signal.
15. The system of claim 7, wherein the mobile device determines an identity of the first emitter based on the first wireless signal, and uses the identity to determine the known location of the first emitter.
16. The system of claim 15, wherein the mobile device determines the identity based on a MAC (media access control) address of the first emitter, obtained from the first wireless signal.
17. The system of claim 15, wherein the mobile device determines the identity based on a beacon ID of the first emitter, obtained from the first wireless signal.
18. The system of claim 7, wherein the plurality of emitters are Bluetooth low-energy (BLE) beacons.
19. The system of claim 7, wherein the message includes an instruction to the material handler to remove a quantity of a specified item from the first storage area, or add a quantity of the specified item to the first storage area, the first storage area being for storage of the specified item.
20. A mobile device:
comprising an antenna; and
a processor configured to:
receive, from the antenna, a first wireless signal from a first emitter of a plurality of emitters, each of the plurality of emitters emit a wireless signal and are placed at known locations relative to a plurality of storage areas where items are stored;
calculate a first distance between the mobile device and the first emitter based on the first wireless signal;
determine that the mobile device is located at a stocking location for a first storage area of the plurality of storage areas based on the first distance between the mobile device and the first emitter, the known location of the first emitter and a comparison of the calculated first distance with a threshold, wherein the threshold is configurable based on density of bins in the first storage area; and
send a message indicating that the mobile device is at the stocking location for the first storage area in response to the determining that the mobile device is located at the stocking location.
US15/585,844 2017-05-03 2017-05-03 Pick and put location verification utilizing RF received signal strength Active US10136259B1 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
US15/585,844 US10136259B1 (en) 2017-05-03 2017-05-03 Pick and put location verification utilizing RF received signal strength
EP18170469.3A EP3399329B1 (en) 2017-05-03 2018-05-02 Pick and put location verification utilizing rf received signal strength
EP20156377.2A EP3667356B1 (en) 2017-05-03 2018-05-02 Pick and put location verification utilizing rf received signal strength
CN201810414711.1A CN108832941B (en) 2017-05-03 2018-05-03 Pick and place location confirmation using radio frequency received signal strength
CN202111411731.1A CN113890649A (en) 2017-05-03 2018-05-03 Pick and place location confirmation using radio frequency received signal strength
US16/142,088 US10440513B2 (en) 2017-05-03 2018-09-26 Pick and put location verification utilizing RF received signal strength

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US15/585,844 US10136259B1 (en) 2017-05-03 2017-05-03 Pick and put location verification utilizing RF received signal strength

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/142,088 Continuation US10440513B2 (en) 2017-05-03 2018-09-26 Pick and put location verification utilizing RF received signal strength

Publications (2)

Publication Number Publication Date
US20180324550A1 true US20180324550A1 (en) 2018-11-08
US10136259B1 US10136259B1 (en) 2018-11-20

Family

ID=62110932

Family Applications (2)

Application Number Title Priority Date Filing Date
US15/585,844 Active US10136259B1 (en) 2017-05-03 2017-05-03 Pick and put location verification utilizing RF received signal strength
US16/142,088 Active US10440513B2 (en) 2017-05-03 2018-09-26 Pick and put location verification utilizing RF received signal strength

Family Applications After (1)

Application Number Title Priority Date Filing Date
US16/142,088 Active US10440513B2 (en) 2017-05-03 2018-09-26 Pick and put location verification utilizing RF received signal strength

Country Status (3)

Country Link
US (2) US10136259B1 (en)
EP (2) EP3399329B1 (en)
CN (2) CN108832941B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11037101B2 (en) * 2019-05-17 2021-06-15 Direct Supply, Inc. Systems, methods, and media for managing inventory associated with a facility
US11282129B2 (en) 2017-06-29 2022-03-22 Alibaba Group Holding Limited Order processing and order-picking task processing method, server, order-picking terminal, and electronic price tag

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2565142B (en) * 2017-08-04 2020-08-12 Sony Interactive Entertainment Inc Use of a camera to locate a wirelessly connected device
CN116458070A (en) * 2020-09-01 2023-07-18 上海诺基亚贝尔股份有限公司 Mechanism for enhanced positioning scheme for devices
AU2021454460A1 (en) * 2021-07-02 2023-09-21 Vusiongroup Gmbh Method of guiding a person to products
EP4339634A1 (en) * 2022-09-15 2024-03-20 Siemens Aktiengesellschaft Method for determining a position of a movable and/or movable unit for configuring the same within a communication network

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3572810A (en) * 1968-12-23 1971-03-30 Walter W Arakelian Automobile operator{3 s cabin
GB0110085D0 (en) * 2001-04-25 2001-06-20 Henlid Ltd Automatic stock replenishment system
US6799099B2 (en) 2001-08-02 2004-09-28 Rapistan Systems Advertising Corp. Material handling systems with high frequency radio location devices
US8321302B2 (en) * 2002-01-23 2012-11-27 Sensormatic Electronics, LLC Inventory management system
US7383284B2 (en) * 2002-04-30 2008-06-03 Sap Aktiengesellschaft Inventory management
GB0217707D0 (en) * 2002-07-31 2002-09-11 Koninkl Philips Electronics Nv System for locating a mobile unit
US7980808B2 (en) * 2004-05-03 2011-07-19 Jervis B. Webb Company Automatic transport loading system and method
US7543744B2 (en) * 2005-02-24 2009-06-09 Intuit Inc. Combined multi-set inventory and employee tracking using location based tracking device system
US8417591B2 (en) * 2005-12-30 2013-04-09 Sap Ag Stock flow management system and method
CN100507600C (en) * 2006-12-01 2009-07-01 清华大学 Indoor precision orientation method of following multi-moving target
CN101017199B (en) * 2007-03-09 2012-07-18 汪秉文 Container locating method, system and application based on wireless sensor network
US8437769B1 (en) * 2008-02-19 2013-05-07 Sprint Spectrum L.P. Method and system for selecting a length of a preamble transmitted in an access probe
US8618932B2 (en) 2011-03-18 2013-12-31 Microsoft Corporation Device location detection
GB201117723D0 (en) * 2011-10-13 2011-11-23 Sensewhere Ltd Method of estimating the position of a user device using radio beacons and radio beacons adapted to facilitate the methods of the invention
US9656804B2 (en) * 2011-12-20 2017-05-23 Hoj Engineering & Sales Co., Inc. Warehouse management system
US20130203436A1 (en) 2012-02-03 2013-08-08 Rapidblue Solutions Oy Method and system for retailing premises
US9544075B2 (en) * 2012-02-22 2017-01-10 Qualcomm Incorporated Platform for wireless identity transmitter and system using short range wireless broadcast
US20140111380A1 (en) 2012-10-22 2014-04-24 Cambridge Silicon Radio Limited Method for short-range proximity derivation and tracking
US8712690B1 (en) 2013-01-11 2014-04-29 Intermec Ip Corp. Systems, methods, and apparatus to determine physical location and routing within a field of low power beacons
US9800429B2 (en) * 2013-03-15 2017-10-24 Smartbotics Inc. Adaptive home and commercial automation devices, methods and systems based on the proximity of controlling elements
US10268983B2 (en) * 2013-06-26 2019-04-23 Amazon Technologies, Inc. Detecting item interaction and movement
US9307355B2 (en) * 2013-06-27 2016-04-05 Bluecats Australia Pty Limited Location enabled service for enhancement of smart device and enterprise software applications
US9767430B2 (en) * 2013-11-11 2017-09-19 International Business Machines Corporation Contextual searching via a mobile computing device
CN103686613A (en) * 2013-12-31 2014-03-26 何海英 System and method for intelligent information pushing based on wireless beacons
US9174800B1 (en) * 2014-03-25 2015-11-03 Amazon Technologies, Inc. Verifying bin content in a materials handling facility
US9510154B2 (en) * 2014-04-28 2016-11-29 Samsung Electronics Co., Ltd Location determination, mapping, and data management through crowdsourcing
US10362455B2 (en) * 2014-08-29 2019-07-23 Huawei Technologies Co., Ltd. Message pushing and displaying method and apparatus
US9641964B2 (en) * 2014-09-03 2017-05-02 CloudLeaf, Inc. Systems, methods and devices for asset status determination
CN104599354A (en) * 2014-12-03 2015-05-06 朗曦科技(上海)有限公司 Intelligence control system based on mobile terminal identity verification and position perception and method
GB2540661A (en) * 2015-05-27 2017-01-25 Wal Mart Stores Inc Customer-triggered store management
US20170185933A1 (en) * 2015-06-14 2017-06-29 Jda Software Group, Inc. Distribution-Independent Inventory Approach under Multiple Service Level Targets
US9756607B1 (en) * 2016-10-26 2017-09-05 International Business Machines Corporation Automated notification muting responsive to predicted location

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11282129B2 (en) 2017-06-29 2022-03-22 Alibaba Group Holding Limited Order processing and order-picking task processing method, server, order-picking terminal, and electronic price tag
US11037101B2 (en) * 2019-05-17 2021-06-15 Direct Supply, Inc. Systems, methods, and media for managing inventory associated with a facility
US20210357855A1 (en) * 2019-05-17 2021-11-18 Direct Supply, Inc. Systems, Methods, and Media for Managing Inventory Associated With a Facility
US11836677B2 (en) * 2019-05-17 2023-12-05 Direct Supply, Inc. Systems, methods, and media for managing inventory associated with a facility
US20240029022A1 (en) * 2019-05-17 2024-01-25 Direct Supply, Inc. Systems, Methods, and Media for Managing Inventory Associated With a Facility

Also Published As

Publication number Publication date
US20190028842A1 (en) 2019-01-24
EP3667356A1 (en) 2020-06-17
EP3399329B1 (en) 2020-02-12
US10440513B2 (en) 2019-10-08
CN108832941A (en) 2018-11-16
CN113890649A (en) 2022-01-04
US10136259B1 (en) 2018-11-20
CN108832941B (en) 2021-12-03
EP3399329A1 (en) 2018-11-07
EP3667356B1 (en) 2021-04-28

Similar Documents

Publication Publication Date Title
US10440513B2 (en) Pick and put location verification utilizing RF received signal strength
US10634762B2 (en) Tracking system with mobile reader
CA2599406C (en) System and method for asset location in wireless networks
US20160212579A1 (en) Method, system, and apparatus for determining and provisioning location information of wireless devices
EP2341361B1 (en) Method and system for locating a hand-held terminal
US8918118B2 (en) Method, apparatus and system for addressing operating devices for luminaires
US10346657B1 (en) RFID system with antenna integrated in a luminaire
US8228171B2 (en) Methods and systems for RFID tag geographical location using beacon tags and listening tags
CN101194528B (en) Localization system and localization method and mobile position data transmitter
US20110260922A1 (en) Mapping locations based on received signal strengths
US10565410B1 (en) Overhead RFID antenna
US11023696B2 (en) Methods, systems and apparatus for detecting object location and generating alerts
CN106412816A (en) Positioning method, apparatus and server
US10121118B1 (en) Confirming delivery of multiple packages to a delivery location using package tags
US20210036739A1 (en) Electronic label apparatus, inductive base station, electronic label system and method of locating electronic label apparatus
CN104200351A (en) Logistics management system and positioning method based on RFID rapid positioning
CN110458257B (en) Label checking method and device based on RFID system
US20180121777A1 (en) Systems and methods for an automated, near real-time, and mobile identification and localization approach with a combination of battery-less identification marking technologies and pseudo range-free localization algorithms
CN103167608A (en) Positioning method and base station for estimating distance based on feedback radio frequency losses
US8633803B2 (en) Apparatus and method for locating RFID tag
CN111461594A (en) Intelligent logistics box tracking method and device and intelligent logistics box
US20240104318A1 (en) Systems and methods for tracking assets using a moving device
CN109409450A (en) A kind of storehouse item location system based on RFID
CN117336663A (en) Asset positioning method and device, electronic equipment and storage medium
TW202304229A (en) Indoor positioning system and indoor positioning method

Legal Events

Date Code Title Description
AS Assignment

Owner name: INTERMEC, INC., WASHINGTON

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TODESCHINI, ERIK;PATEL, MEHUL;SIGNING DATES FROM 20170427 TO 20170428;REEL/FRAME:042228/0430

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4