NL2023307B1 - method and device arranged to determine an amount of items - Google Patents

method and device arranged to determine an amount of items Download PDF

Info

Publication number
NL2023307B1
NL2023307B1 NL2023307A NL2023307A NL2023307B1 NL 2023307 B1 NL2023307 B1 NL 2023307B1 NL 2023307 A NL2023307 A NL 2023307A NL 2023307 A NL2023307 A NL 2023307A NL 2023307 B1 NL2023307 B1 NL 2023307B1
Authority
NL
Netherlands
Prior art keywords
sensor
sensor data
item
distance
storage space
Prior art date
Application number
NL2023307A
Other languages
Dutch (nl)
Inventor
Van Alphen Dorien
Van Der Ark Danny
Loïc Eelen Yannis
Lourantos George
T'sas Charlotte
Theodoor Stamhuis Cornelis
Original Assignee
Heineken Supply Chain Bv
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Heineken Supply Chain Bv filed Critical Heineken Supply Chain Bv
Priority to NL2023307A priority Critical patent/NL2023307B1/en
Priority to EP20743888.8A priority patent/EP3983972A1/en
Priority to PCT/NL2020/050382 priority patent/WO2020251362A1/en
Application granted granted Critical
Publication of NL2023307B1 publication Critical patent/NL2023307B1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/08Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087Inventory or stock management, e.g. order filling, procurement or balancing against orders

Landscapes

  • Business, Economics & Management (AREA)
  • Economics (AREA)
  • Engineering & Computer Science (AREA)
  • Marketing (AREA)
  • Quality & Reliability (AREA)
  • Finance (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Human Resources & Organizations (AREA)
  • Accounting & Taxation (AREA)
  • Operations Research (AREA)
  • Development Economics (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Arrangements For Transmission Of Measured Signals (AREA)

Abstract

Title: method and device arranged to determine an amount of items Abstract A method of determining a quantity of items in a storage space, based on sensor data obtained from an array of ranging sensors having a ranging direction directed to storage locations, the sensor data providing an indication of distance between the sensor and an item. The method comprises obtaining a first set of sensor data acquired at a first moment in time, obtaining a first set of sensor data acquired at a second moment in time, comparing sensor data of the first set to sensor data of the second set. Based on the comparing, an amount of items at the second moment in time is determined. By comparing two sets, additional information is available. Furthermore, static data of one set is enhanced by dynamic effects derived from change of sensor data in time. Such dynamic effects provide increased spatial resolution and further data to determine the amount of items.

Description

P123490NL00 Title: method and device arranged to determine an amount of items
TECHNICAL FIELD The various aspects and implementations thereof relate to methods, devices and systems for determining an amount of items in a storage space, 1n particular at a specific area on a shelf of a gondola in a supermarket.
BACKGROUND Various methods of determining stock on shelves of gondolas in a supermarket are known. Some systems use image processing and allow collecting data in such detail and which such accuracy that systems may be used to charge customers for the shopping. Yet, such systems are complex.
Systems with proximity sensors are known as well, but they are known to pose challenges as view to products may be obscured by other products.
SUMMARY It is preferred to provide a relatively simple data acquisition device and processing procedure for processing acquired data for monitoring an amount of items in a storage space.
A first aspect provides a method of determining a quantity of items in a storage space, based on sensor data values obtained from an array of ranging sensors having a ranging direction directed at or to storage locations in the storage space, the sensor data values providing an indication of distance between the sensor and an item. The method comprises obtaining a first set of sensor data values acquired at a first moment in time, obtaining a second set of sensor data values acquired at a second moment in time, comparing, per sensor, sensor data values of the first set to sensor data values of the second set. Subsequently, based on the comparing, an amount of items in the storage space at the second moment in time is determined.
By comparing two sets of data, additional information is available for the same storage space, thus increasing resolution of the data. This increased resolution may provide an increased accuracy in determining the amount of items. Furthermore, static data of one set may be enhanced by dynamic effects detected or derived from change of certain sensor data values of particular sensors in time. Such dynamic effects may provide an increased spatial resolution, as well as further data to determine the amount of items in the storage space.
An embodiment comprises defining a path in the storage space, based on the comparing, wherein the determining 1s based on the path. Sensor data values varying over time may provide an indication of change of an item at a particular location, but also of how an item is being moved or has been moved within the storage space. This may provide (additional) information on where items are stored in the storage space or whether items are being added or removed.
In a further embodiment, the path is defined based on a first sensor data value in the first set associated with a first sensor in the array indicating a distance between the sensor and an item below a pre- determined value and a based on a second sensor data value in the second set associated with a second sensor in the array indicating a distance between the sensor and an item below a pre-determined value, the first sensor and the second sensor being located within a pre-determined range relative to one another.
In this particular implementation, an item is tracked, assuming the item being moved is closer to the sensors than other stationary items at a lower level.
In another embodiment, the path 1s a directional path. In most cases, a storage space and a shelf location on a gondola has a one opening used to put items in the storage space and to withdraw the items. Hence, the direction of the path may provide information whether an item is added or withdrawn.
Yet a further embodiment comprises based on the direction of the path, determining an increment or a decrease of a value indicating an amount of items in the storage space, the value being stored in an electronic memory. If the path is directed to the opening, withdrawal of an item may be detected; if the path is directed away from the opening, inside the storage space, addition of an item may be detected.
Again another embodiment, in which the storage space comprises an opening providing an inlet and/or outlet for items, comprises determining a direction of the path, determining, if the path is directed away from the opening, an endpoint of the path. The embodiment further comprises associating an endpoint sensor with the endpoint of the path, determining, based on a sensor data value associated with the endpoint sensor, whether a first distance between the endpoint sensor and an item sensable by the endpoint sensor determined after the path has been determined is less than a second distance between the endpoint sensor and an item sensable by the endpoint sensor and, if the first distance is less than the second distance, determining that an item has been placed at a location sensable by the endpoint sensor. This implementation provides an example of a practical implementation of this aspect.
Yet another implementation comprises receiving item data, comprising at least one of item height, item width and item depth and wherein the amount of items is based on the item data. Such data may be combined with data on distances between ranging sensors and/or locations of ranging sensors. In this way, it may be determined whether an item may be detected by one sensor, two sensors, three sensors in a particular spatial relation relative to one another or otherwise. Such implementation may be used to identify individual items in the storage space even if they are beyond the detection range of the ranging sensors. Beyond the detection range means in this implementation outside a volume defined by the array of sensor - preferably substantially planar -, a sensing volume in which sensors receive signals from items and a background. Such background may be a shelf on which items are placed, if the sensors are mounted above the items.
A second aspect provides a processing server, arranged to determine a quantity of items in a storage space, based on sensor data values obtained from an array of ranging sensors having a ranging direction directed at or to storage locations in the storage space, the sensor data values providing an indication of distance between the sensor and an item. The processing server comprises a communication module arranged to receive a first set of sensor data values acquired at a first moment in time; and receive a second set of sensor data values acquired at a second moment in time. The server further comprises a processing unit arranged to compare, per sensor, sensor data values of the first set to sensor data values of the second set and based on the comparing, determine an amount of items in the storage space at the second moment in time.
The server may be integrated with a device comprising the array of ranging sensors, may be placed adjacent or in close vicinity of such device or may be placed at a location remote from such device, which latter scenario may be popularly referred to as "the cloud".
A third aspect provides a device arranged for determining distances between the device and items stored in a storage space, the device comprising a casing and an array of ranging sensors arranged to monitor a sensing volume for a ranging signal and to provide a sensor signal based on the ranging signal, upon receiving a ranging signal, the array being provided in the casing. The device further comprises a processing unit arranged to receive sensor signals from the ranging sensors, calculate, based on the received signals, per sensor a sensor data value indicating a distance between the sensor and an object provided in the sensing volume, construct a data message comprising sensor data values associated with the sensors. The device also comprises a communication unit for transmitting the data message to a processing server. 5
BRIEF DESCRIPTION OF THE DRAWINGS The various aspects and implementations thereof will now be discussed in further detail in conjunction with drawings. In the drawings: Figure 1: shows a system for monitoring stock on a supermarket shelf; Figure 2: shows a procedure for handling of data acquired by means of ranging sensors that monitor the supermarket shelf; Figure 3 A through Figure 3 D: shows sensor data values mapped to item size data and the shelf; and Figure 4 A through Figure 4 D: shows sensor data values mapped to the shelf, indicating a path.
DETAILED DESCRIPTION Figure 1 shows a shop shelf monitoring device 120 as an implementation of the third aspect. The monitoring device 120 forms part of an inventory management system 100. The monitoring device 120 comprises multiple ranging sensors 130. The ranging sensors 130 are - optionally - arranged on or in the monitoring device 120 in lines, preferably about 10 centimetres apart. It 1s well noted that other distances may be used as well, ranging from 1 centimetre to 20 centimetre, including values in between. Furthermore, the ranging sensors 130 may be located at specific gridlines. Alternatively, ranging sensors 130 on adjacent lines are provided in a staggered way, as for example depicted by Figure 3 A.
The monitoring device 120 is provide above a shelf 112 that is arranged to carry items 190 for sale in a shop that are arranged in a storage space 110 between the shelf 112 and the monitoring device 120. The ranging sensor 130 are arranged to provide a data signal having one or more values, which values provide an indication of a distance between the sensor 130 and the items 190. The ranging sensor 130 may comprise, without limitation, time-of-flight sensor, stereoscopic optical sensors, ultrasound ranging sensors, other sensors having similar or equivalent functionality or a combination thereof. The ranging sensor 130 may comprise a receiver as well as a transmitter or only one of these.
The monitoring device 120 comprises one or more Sensor processors 122, a central processing unit 124, a shelf communication module 126 and a location determining module 128. The sensor processor 122 received raw data from the ranging sensor 130 and converts the raw data to one or more values that provide an indication of the distance between the items 190 and the ranging sensors 130. For example, in case time-of-flight sensors are used, the sensor processors 122 convert, per sensor 130, the time between emission of an optical signal and receipt of a reflected optical signal to a value providing indication of the distance. In case stereoscopic optical sensors are used, the sensor processors 122 comprise image processors for determining the distance.
The central processing unit 124 receives the processed sensor data for some or, preferably, all of the ranging sensors 130 and constructs a data message comprising these value. Optionally, the central processing unit 124 obtains location data from the location determining module 128 and adds information indicating the geographical location of the monitoring device 120 in the data message. To that end, the location determining module 128 may be implemented by means of a GPS receiver - or a receiver compatible with any other geolocation service, like GLONAS or Galileo. Alternatively or additionally, location may be obtained by means of a network communication unit like the shelf communication module 126. The shelf communication unit 126 is arranged to send the data message with sensor data as prepared by the central processing unit 124 to a server communication module 146 of a data processing server 140. The communication of the sensor data message preferably takes place using at least one of WiFi (IEEE 802.11), any standard for cellular communication like WCDMA, GPRS, 3G, HSDPA, LTE, LoRa, LTE cat-m1, LTE NB-IoT or any other type of eM2Mtc (enhanced machine-machine type communication), wired networks and applicable protocols like xDSL, other or a combination thereof. Over such networks, data is preferably transmitted using the IP protocol. The IP protocol relies on IP addresses to send and relay messages and databases are available to link an IP address to a geographical location.
The data processing server 140 receives the data message and processes the data using server central processing unit 142 and, preferably, a computer program stored on a server memory module 144 comprised by the server. The processing of data by the server central processing unit 142 is discussed in further detail below.
The server communication module 146 is also arranged to send any data processed by the server processing unit 142 to a user communication module 166 user presentation device like a handheld tablet computer, a laptop computer, a desktop computer, an electronics wearable device or similar or equivalent. The received processed data may be further processed by means of a user central processing unit 162 and the data thus processed is provided to a user rendering module 168 for providing data ready to display at an electronic display device 170 like an LCD screen or optical data projector.
Figure 2 shows a flowchart 200 depicting an implementation of the first aspect. The list below provides brief summaries of the various parts of the flowchart 200, which will be discussed in detail following the list. 202 start procedure 204 receive sensor data message 206 store location data 208 receive product size data 210 receive further sensor data messages 212 compare subsequent sensor data messages 214 distance different for one or more sensors? 216 map sensor data to product size data 218 determine amount of products changed 220 adjust amount of products on shelf 232 define path 234 path outbound for storage space? 236 adjust product amount by minus one 238 adjust product amount by plus one The procedure starts in a terminator 202 in which the system 100 is initialised. For example, the stock may be set to full or to zero. In step 204, the data processing server 140 receives a sensor data message. The sensor data message comprises sensor data values providing data on distance between the ranging sensors 130 and anything beneath them, like the shelf 112, items 190 or both. The sensor data message may furthermore comprise a sensor identifier identifying the shop shelf monitoring device
120. In the data message, sensor values are organised in a pre-determined way, such that the data processing server is aware of the locations of the ranging sensors 130 in the shop shelf monitoring device 120 and the location of values of each individual sensor in the data message.
In step 206, a location identifier identifying the shop shelf monitoring device 120 of the is stored in the server storage module 144. The availability of the location of the shop shelf monitoring device 120 allows for restocking action to be taken if the amount of items 190 detected in the storage space 110 drops below a particular threshold - or is nil; a message may be send to a supplier, with the location of the shop shelf monitoring device 120.
In step 208, size data related to the items 190 may be received. The size data may comprise data on the height, length and depth of the item
190. Optionally, further data may be included like shape, volume, colour, texture, weight, other, or a combination thereof.
In step 210, further sensor data messages are received by the data processing server 140 and in step 212, sensor data values of at least two sensor data messages are compared. Optionally, data of three, four, five, six or more sensor data messages may be compared. During the comparing process, data is compared on a per-sensor basis, which allows a short history of development of sensor data values to be set up. Based on the comparing, several actions may be taken, which is visualised by the fork in the flowchart 200. The left part of the flowchart 200 will be discussed first, in conjunction with Figure 3 A, Figure 3 B, Figure 3 C and Figure 3 D.
Figure 3 A shows a top view of the storage space 110 (Figure 1). The circles indicate locations of the sensors 130 in the monitoring device 120 relative to the storage space 110. The dashed lines indicate where the items 190 are located in the storage space 110. The front of the storage space, where an inlet and outlet opening is provided allowing a consumer to take a product or a shop servant to fill the storage space with items, is located at the top. A white circle indicates a large distance between a sensor 130 and either an item 190 or the shelf 112 and a black circle indicates a short distance between a sensor 130 and either an item 190 or the shelf 112.
Figure 3 B, Figure 3 C and figure 3 D depict the same data, albeit with different distances detected by certain ranging sensors 130. Figure 3 A, Figure 3 B, Figure 3 C and figure 3 D depict data acquired at different subsequent moments in time. The data may be acquired at pre-determined intervals of tens of milliseconds, hundreds of milliseconds or seconds; intervals of 0.1, 0.2, 0.3, 0.5, 0.6, 0.7, 0.8, 0.9 or 1 second are preferred. It is noted that for the case depicted in Figure 3 A, Figure 3 B, Figure 3 C and figure 3 D at most a single layer of items 190 on the shelf 112 is assumed to be present: either one product is present in an area defined by the dashed lines or not. In other scenarios, products may also be present at other locations than depicted by the dashed lines; the various aspects may be applied in such scenarios as well. In step 214, the results of the comparing in step 212 is assessed. If there is no substantial change in any of the sensor data values, it is determined that the amount of items 190 on the shelf 112 and in the storage space 110 has not changed. If no change in sensor data values has been detected, the procedure branches back to step 210 above. In case a change in at least one sensor data value has been determined, the process maps sensor data values to product size data in step
216. In the implementation depicted, this means that the sensor data values are mapped to the shelf 112 and that the product width and depth is mapped to the same - basically virtual - shelf space; this is depicted by the dashed lines in Figure 3 A. In case more than one layer of product items is available, also the depth information received from any of the sensors 130 is mapped to the product height. This may for example be executed by rounding off the value received for each sensor to the nearest multiple of the product height. In Figure 3 A, empty locations show large distances - white circles - and filled locations show short distances - black circles. Figure 3 B shows white circles and black circles for two product locations, at the left of the third line of sensors from the bottom. In such case, the situation may be considered as ambiguous. In the case of Figure 3 B, two sensors covering only the product locations at the left of the second line from the bottom, whereas two other sensors cover only an edge of the locations indicate a large distance. In such case, the data of the sensor that covers only one mapped product storage space prevails in the applied algorithm.
Figure 3 C also shows a situation that is clear by applying the voting algorithm as discussed, in which the value of a sensor covering a single mapped product storage space determines whether a product is present or not. The situation of Figure 3 D is less clear for the mapped product storage space at the bottom right: there is no single sensor covering the single product mapped storage space. In such case, alternative or additional algorithms may optionally be used. Such alternative or additional algorithm is provided by the second branch of the flowchart 200, which is discussed in conjunction with Figure 4 A, Figure 4 B, Figure 4 C and Figure 4D.
Based on assessing change of sensor data values and the mapping using the product size information, it is determined in step 218 by what amount the total amount of items 190 in the storage space 110 has changed.
In step 220, an amount of total products determined to be stored in the storage space 110 is adjusted accordingly. It is noted that this procedure may also be use when stocking the storage space 110. After the adjustment, the procedure branches back to step 210.
As discussed above, the flowchart 200 forks after step 212. In step 232, a path is defined in the storage space 110 - either two dimensional or three dimensional - or on the shelf 112 - two dimensional - based on comparing subsequent sensor data values on a per-sensor basis.
Figure 4 A, Figure 4 B, Figure 4 C and Figure 4 D depict change of sensor data values in time while an item is placed in the storage space
110. Item size data is not indicated in these Figures, but may be used.
Values change from long distance to small distance in a path from upper left (front and inlet of the storage space 110) to about the centre of the storage space 110. This path is accordingly defined in step 232. With an assumption that one item 190 is placed into or withdrawn from the storage space 110, a directional path defined, from the front of the storage space 110 further into the storage space 110 indicates that the amount of items 190 held by the storage space has increased by one.
Hence, having determined the path in step 232, the procedure continues to step 234 in which the direction of the path is assessed: inward or outward. If the path is detected to be inward in step 234, the amount of items as stored in the server memory module 144 is increased by one in step
238. Otherwise, if the path is determined to be directed outward, the amount of products is decreased by one in step 236. After adjustment of the amount of products as kept by the server 140, the procedure branches back to step 210, in which further data is received for the comparing.
The left and right branch of the fork may be executed simultaneously or sequentially. The results of execution of the two branches may be combined, in which the results of one branch may be used to validate results of another branch - or the other way around. In that case, priority may be assigned to a particular branch upfront or on an ad hoc basis.
In certain scenarios, it may be envisaged that the storage space 110 is wider or deeper than the projected reach of the ranging sensors 130. In such case, the inventory may be higher than determined by one or two of the branches, as there may be items beyond the scanning range of any of the ranging sensors 130. Mostly, such scanning range is shaped as a (truncated) cone or pyramid or as a cylinder or a cuboid. In such scenarios, the second branch, described in conjunction with Figure 4 A, Figure 4 B, Figure 4 C and Figure 4 D, may provide information: if a directional path is defined form the inlet of the storage space 110 to an area in the storage space 110 that ends at an edge of the storage space 110 and the left branch does not yield an increase in the amount of items, and embodiment of first aspects vields as output that the amount of items is increased, for example by one or two.
Above, various scenarios and implementation of the various aspects have been discussed in which the shop shelf monitoring device 120 is located above the shelf 112. This provides advantages that this may provide a more accurate counting of items as to sensing in horizontal directions, as empty spaces are obscured in vertical direction by other items.
Furthermore, paths of items being moved in and out of the storage space 110 may be better determined. Yet, it is possible nonetheless that at least some of the embodiments are used with the shop shelf monitoring device 120 being arranged such that the storage space 110 is monitored over horizontal ranging ranges.
In summary, A method of determining a quantity of items in a storage space is provided, based on sensor data obtained from an array of ranging sensors having a ranging direction directed at or to storage locations, the sensor data providing an indication of distance between the sensor and an item. The method comprises obtaining a first set of sensor data acquired at a first moment in time, obtaining a second set of sensor data acquired at a second moment in time, comparing sensor data of the first set to sensor data of the second set. Based on the comparing, an amount of items at the second moment in time is determined. By comparing two sets, additional information is available. Furthermore, static data of one set is enhanced by dynamic effects derived from change of sensor data in time. Such dynamic effects provide increased spatial resolution and further data to determine the amount of items.
In the description above, it will be understood that when an element such as layer, region or substrate is referred to as being “on” or “onto” another element, the element is either directly on the other element,
or intervening elements may also be present. Also, it will be understood that the values given in the description above, are given by way of example and that other values may be possible and/or may be strived for. Furthermore, the invention may also be embodied with less components than provided in the embodiments described here, wherein one component carries out multiple functions. Just as well may the invention be embodied using more elements than depicted in the Figures, wherein functions carried out by one component in the embodiment provided are distributed over multiple components.
It is to be noted that the figures are only schematic representations of embodiments of the invention that are given by way of non-limiting examples. For the purpose of clarity and a concise description, features are described herein as part of the same or separate embodiments, however, it will be appreciated that the scope of the invention may include embodiments having combinations of all or some of the features described.
The word ‘comprising’ does not exclude the presence of other features or steps than those listed in a claim. Furthermore, the words 'a' and 'an' shall not be construed as limited to 'only one’, but instead are used to mean 'at least one’, and do not exclude a plurality.
A person skilled in the art will readily appreciate that various parameters and values thereof disclosed in the description may be modified and that various embodiments disclosed and/or claimed may be combined without departing from the scope of the invention. Furthermore, the skilled person will understand that the values named may vary with an appropriate margin, approximately 5%, unless it is clear from the description that an exact value 1s required.
It is stipulated that the reference signs in the claims do not limit the scope of the claims, but are merely inserted to enhance the legibility of the claims.
The various aspects and embodiments thereof may be summarised, in a non-limitative way, by means of the following numbered embodiments:
1. Method of determining a quantity of items in a storage space, based on sensor data values obtained from an array of ranging sensors having a ranging direction directed at or to storage locations in the storage space, the sensor data values providing an indication of distance between the sensor and an item, the method comprising: Obtaining a first set of sensor data values acquired at a first moment in time; Obtaining a second set of sensor data values acquired at a second moment in time; Comparing, per sensor, sensor data values of the first set to sensor data values of the second set; Based on the comparing, determining an amount of items in the storage space at the second moment in time.
2. Method according to embodiment 1, further comprising, defining a path in the storage space, based on the comparing, wherein the determining is based on the path.
3. Method according to embodiment 2, wherein the path is defined based on: - a first sensor data value in the first set associated with a first sensor in the array indicating a distance between the sensor and an item below a pre-determined value, and - a second sensor data value in the second set associated with a second sensor in the array indicating a distance between the sensor and an item below a pre-determined value, the first sensor and the second sensor being located within a pre-determined range relative to one another.
4. Method according to embodiment 2 or embodiment 3, wherein the path is a directional path.
5. Method according to embodiment 4 to the extent dependent on embodiment 3, wherein the path is directed from the first sensor to the second sensor.
6. Method according to embodiment 4 or 5, further comprising, based on the direction of the path, determining an increment or a decrease of a value indicating an amount of items in the storage space, the value being stored in an electronic memory.
7. Method according to any of the embodiments 4-6, wherein the storage space comprises an opening providing an inlet and/or outlet for items, the method further comprising: Determining a direction of the path; Determining, if the path is directed away from the opening, an endpoint of the path; Associating a endpoint sensor with the endpoint of the path; Determining, based on a sensor data value associated with the endpoint sensor, whether a first distance between the endpoint sensor and an item sensable by the endpoint sensor determined after the path has been determined is less than a second distance between the endpoint sensor and an item sensable by the endpoint sensor; If the first distance is less than the second distance, determining that an item has been placed at a location sensable by the endpoint Sensor.
8. Method according to embodiment 7, further comprising, if the first distance is substantially the same as the second distance, determining an item has been placed in the storage space at a location beyond sensing capabilities of the array of ranging sensors.
9. Method according to any of the preceding embodiments, further comprising receiving item data, comprising at least one of item height, item width and item depth and wherein the amount of items is based on the item data.
10. Method according to embodiment 9, further comprising mapping the item data to at least one of the array of ranging sensors, the sensor data values and the storage space.
11. Method according to embodiment 10, wherein the comparing comprises assessing differences at a mapped item location.
12. Processing server arranged to determine a quantity of items in a storage space, based on sensor data values obtained from an array of ranging sensors having a ranging direction directed at orto storage locations in the storage space, the sensor data values providing an indication of distance between the sensor and an item, the processing server comprising: - a communication module arranged to: - receive a first set of sensor data values acquired at a first moment in time; and -receive a second set of sensor data values acquired at a second moment in time; - a processing unit arranged to: - compare, per sensor, sensor data values of the first set to sensor data values of the second set; and - based on the comparing, determine an amount of items in the storage space at the second moment in time.
13. Device arranged for determining distances between the device and items stored in a storage space, the device comprising: - a casing; - an array of ranging sensors arranged to monitor a sensing volume for a ranging signal and to provide a sensor signal based on the ranging signal, upon receiving a ranging signal, the array being provided in the casing; - a processing unit arranged to: - receive sensor signals from the ranging sensors; - calculate, based on the received signals, per sensor a sensor data value indicating a distance between the sensor and an object provided in the sensing volume; and - construct a data message comprising sensor data values associated with the sensors; - and a communication unit for transmitting the data message to a processing server.
14. Device according to embodiment 13, further comprising a location identification module for identifying a location of the device, wherein the communication unit is further arranged to transmit a location message to the processing server.
15. Device according to embodiment 13 or 14, wherein the sensors are arranged at regular distance intervals along substantially parallel lines.
16. Device according to embodiment 15, wherein the sensors of adjacent lines are provided in a staggered way.

Claims (16)

ConclusiesConclusions 1. Werkwijze voor bepalen van een hoeveelheid items in een opslagruimte, op basis van sensordatawaardes verkregen uit een array van afstandssensoren met een afstandsrichting gericht op opslaglocaties in de opslagruimte, waarin de sensordatawaardes een indicatie voorzien van afstand tussen de sensor en een item, de werkwijze omvattende: - verkrijgen van een eerste set sensordatawaardes verkregen op een eerste tijdstip; - verkrijgen van een tweede set sensordatawaardes verkregen op een tweede tijdstip; - vergelijken, per sensor, van sensordatawaardes van de eerste set met sensordatawaardes van de tweede set; - gebaseerd op de vergelijking, bepalen van een hoeveelheid items in de opslagruimte op het tweede tijdstip.A method for determining an amount of items in a storage space, based on sensor data values obtained from an array of distance sensors with a distance direction directed to storage locations in the storage space, wherein the sensor data values provide an indication of the distance between the sensor and an item, the method comprising: - obtaining a first set of sensor data values obtained at a first time point; - obtaining a second set of sensor data values obtained at a second time point; - comparing, per sensor, sensor data values of the first set with sensor data values of the second set; based on the comparison, determining an amount of items in the storage space at the second time. 2. Werkwijze volgens conclusie 1, verder omvattende, definiëren van een pad in de opslagruimte, op basis van het vergelijken, waarin het bepalen gebaseerd is op het pad.The method of claim 1, further comprising defining a path in the repository, based on the comparison, wherein the determining is based on the path. 3. Werkwijze volgens conclusie 2, waarin het pad wordt gedefinieerd op basis van: - een eerste sensordatawaarde in de eerste set welke geassocieerd is met een eerste sensor in de array welke een afstand aangeeft tussen de sensor en een item onder een vooraf bepaalde waarde, en - een tweede sensordatawaarde in de tweede set welke geassocieerd 1s met een tweede sensor in de array welke een afstand aangeeft tussen de sensor en een item onder een vooraf bepaalde waarde,A method according to claim 2, wherein the path is defined based on: - a first sensor data value in the first set associated with a first sensor in the array indicating a distance between the sensor and an item below a predetermined value, and - a second sensor data value in the second set associated with a second sensor in the array indicating a distance between the sensor and an item below a predetermined value, de eerste sensor en de tweede sensor zijnde gepositioneerd binnen een vooraf bepaalde afstand ten opzichte van elkaar.the first sensor and the second sensor being positioned within a predetermined distance from each other. 4. Werkwijze volgens conclusie 2 of 3, waarin het pad een gericht pad is.The method of claim 2 or 3, wherein the path is a directed path. 5. Werkwijze volgens conclusie 4 voor zover afhankelijk van conclusie 3, waarin het pad gericht is vanaf de eerste sensor naar de tweede sensor.The method of claim 4 when dependent on claim 3, wherein the path is directed from the first sensor to the second sensor. 6. Werkwijze volgens conclusie 4 of conclusie 5, verder omvattende, bepalen van een toename of een afname van een waarde welke een hoeveelheid items in de opslagruimte aangeeft, op basis van de richting van het pad, waarin de waarde opgeslagen wordt in een elektronisch geheugen.A method according to claim 4 or claim 5, further comprising determining an increase or decrease in a value indicating an amount of items in the storage space, based on the direction of the path in which the value is stored in an electronic memory. . 7. Werkwijze volgens conclusie 4, waarin de opslagruimte een opening omvat welke een ingang en/of uitgang voor items voorziet, de werkwijze verder omvattende: - bepalen van een richting van het pad; - bepalen van een eindpunt van het pad, als het pad weg van de opening is gericht; - associëren van een eindpuntsensor met het eindpunt van het pad; - bepalen, gebaseerd op een sensordatawaarde geassocieerd met de eindpuntsensor, of een eerste afstand tussen de eindpuntsensor en een door de eindpuntsensor bemerkbaar item bepaald nadat het pad bepaald is kleiner is dan een tweede afstand tussen de eindpuntsensor en een item bemerkbaar door de eindpuntsensor; - als de eerste afstand kleiner is dan de tweede afstand, bepalen dat een item geplaatst is op een locatie bemerkbaar door de eindpuntsensor.Method according to claim 4, wherein the storage space comprises an opening which provides an entrance and / or exit for items, the method further comprising: - determining a direction of the path; - determining an end point of the path, if the path is directed away from the opening; - associating an end point sensor with the end point of the path; - determining, based on a sensor data value associated with the end point sensor, whether a first distance between the end point sensor and an item sensible by the end point sensor determined after the path has been determined is less than a second distance between the end point sensor and an item sensible by the end point sensor; - if the first distance is less than the second distance, determine that an item is placed at a location detectable by the endpoint sensor. 8. Werkwijze volgens conclusie 7, verder omvattende, als de eerste afstand in hoofdzaak hetzelfde is als de tweede afstand, bepalen dat een item geplaatst is in de opslagruimte op een locatie buiten de bemerkingsmogelijkheden van de array van afstandssensoren.The method of claim 7, further comprising, if the first distance is substantially the same as the second distance, determining that an item is placed in the storage space at a location outside the sensing capabilities of the array of remote sensors. 9. Werkwijze volgens een van de voorgaande conclusies, verder omvattende ontvangen van itemdata, omvattende ten minste een van itemhoogte, 1tembreedte en itemdiepte en waarin de hoeveelheid items gebaseerd is op de itemdata.The method of any preceding claim, further comprising receiving item data comprising at least one of item height, item width and item depth and wherein the amount of items is based on the item data. 10. Werkwijze volgens conclusie 9, verder omvattende toewijzen van de itemdata naar ten minste een van de array van afstandssensoren, de sensordatawaardes en de opslagruimte.The method of claim 9, further comprising assigning the item data to at least one of the array of remote sensors, the sensor data values and the storage space. 11. Werkwijze volgens conclusie 10, waarin het vergelijken beoordelen van verschillen op een toegewezen itemlocatie.The method of claim 10, wherein the comparing assesses differences at an assigned item location. 12. Verwerkingsserver ingericht om een hoeveelheid items in een opslagruimte te bepalen, op basis van sensordatawaardes verkregen van een array van afstandssensoren met een afstandsrichting gericht op opslaglocaties in de opslagruimte, waarin de sensordatawaardes een indicatie voorzien van afstand tussen de sensor en een item, de verwerkingsserver omvattende: - een communicatiemodule ingericht om: - een eerste set sensordatawaardes verkregen op een eerste tijdstip te ontvangen; en - een tweede set sensordatawaardes verkregen op een tweede tijdstip te ontvangen; - een verwerkingseenheid ingericht om: - per sensor, sensordatawaardes van de eerste set te vergelijken met sensordatawaardes van de tweede set; en12. Processing server arranged to determine an amount of items in a storage space, on the basis of sensor data values obtained from an array of remote sensors with a distance direction directed to storage locations in the storage space, wherein the sensor data values provide an indication of the distance between the sensor and an item, the processing server comprising: - a communication module arranged to: - receive a first set of sensor data values obtained at a first time; and - receive a second set of sensor data values obtained at a second time; - a processing unit adapted to: - per sensor, compare sensor data values of the first set with sensor data values of the second set; and - gebaseerd op de vergelijking, een hoeveelheid items in de opslagruimte te bepalen op het tweede tijdstip.based on the comparison, an amount of items in the storage space to be determined at the second time. 13. Apparaat ingericht voor bepalen van afstanden tussen het apparaat en items opgeslagen in een opslagruimte, het apparaat omvattende: - een behuizing; - een array van afstandssensoren ingericht om een sensorvolume te monitoren voor een afstandssignaal en om een sensorsignaal te voorzien op basis van het afstandssignaal, na ontvangen van een afstandssignaal, de array zijnde voorzien in de behuizing; - een verwerkingseenheid ingericht om: - sensorsignalen te ontvangen van de afstandssensoren; - per sensor een sensordatawaarde uit te rekenen, gebaseerd op de ontvangen signalen, welke waarde een afstand aangeeft tussen de sensor en een object voorzien in het sensorvolume; en - construeren van een databericht omvattende sensordatawaardes geassocieerd met de sensoren; - en een communicatie-eenheid voor uitzenden van het databericht naar een verwerkingsserver.Device adapted for determining distances between the device and items stored in a storage space, the device comprising: - a housing; - an array of remote sensors arranged to monitor a sensor volume for a remote signal and to provide a sensor signal based on the remote signal, after receiving a remote signal, the array being provided in the housing; - a processing unit arranged to: - receive sensor signals from the remote sensors; - calculate a sensor data value per sensor, based on the received signals, which value indicates a distance between the sensor and an object provided in the sensor volume; and - constructing a data message including sensor data values associated with the sensors; and a communication unit for transmitting the data message to a processing server. 14. Apparaat volgens conclusie 13, verder omvattende een locatie- identificatiemodule voor identificeren van een locatie van het apparaat, waarin de communicatie-eenheid verder is ingericht voor uitzenden van een locatiebericht naar de verwerkingsserver.The device of claim 13, further comprising a location identification module for identifying a location of the device, wherein the communication unit is further configured to send a location message to the processing server. 15. Apparaat volgens conclusie 13 of 14, waarin de sensoren zijn gerangschikt op constante afstandsintervallen langs in hoofdzaak parallelle lijnenThe apparatus of claim 13 or 14, wherein the sensors are arranged at constant distance intervals along substantially parallel lines 16. Apparaat volgens conclusie 15, waarin de sensoren van naburige lijnen voorzien zijn op een verspringende wijze.The device of claim 15, wherein the sensors are provided with adjacent lines in a staggered manner.
NL2023307A 2019-06-13 2019-06-13 method and device arranged to determine an amount of items NL2023307B1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
NL2023307A NL2023307B1 (en) 2019-06-13 2019-06-13 method and device arranged to determine an amount of items
EP20743888.8A EP3983972A1 (en) 2019-06-13 2020-06-15 Method and device arranged to determine an amount of items
PCT/NL2020/050382 WO2020251362A1 (en) 2019-06-13 2020-06-15 Method and device arranged to determine an amount of items

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
NL2023307A NL2023307B1 (en) 2019-06-13 2019-06-13 method and device arranged to determine an amount of items

Publications (1)

Publication Number Publication Date
NL2023307B1 true NL2023307B1 (en) 2021-01-21

Family

ID=68138742

Family Applications (1)

Application Number Title Priority Date Filing Date
NL2023307A NL2023307B1 (en) 2019-06-13 2019-06-13 method and device arranged to determine an amount of items

Country Status (3)

Country Link
EP (1) EP3983972A1 (en)
NL (1) NL2023307B1 (en)
WO (1) WO2020251362A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11460333B2 (en) 2019-10-31 2022-10-04 United States Postal Service Container management device
DE102021118874A1 (en) 2021-07-21 2023-01-26 Zf Cv Systems Global Gmbh Procedure for monitoring a cargo hold
WO2023007387A1 (en) * 2021-07-29 2023-02-02 Jio Platforms Limited System and method of automatic monitoring of rack space usage in a data centre

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150052029A1 (en) * 2013-08-19 2015-02-19 Xerox Corporation Method and apparatus for automated inventory management using depth sensing
US20160239799A1 (en) * 2015-02-18 2016-08-18 Fedex Corporate Services, Inc. Methods, apparatus, and systems for generating a content-related notification using a container interface display apparatus
US10169677B1 (en) * 2014-12-19 2019-01-01 Amazon Technologies, Inc. Counting stacked inventory using image analysis

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150052029A1 (en) * 2013-08-19 2015-02-19 Xerox Corporation Method and apparatus for automated inventory management using depth sensing
US10169677B1 (en) * 2014-12-19 2019-01-01 Amazon Technologies, Inc. Counting stacked inventory using image analysis
US20160239799A1 (en) * 2015-02-18 2016-08-18 Fedex Corporate Services, Inc. Methods, apparatus, and systems for generating a content-related notification using a container interface display apparatus

Also Published As

Publication number Publication date
EP3983972A1 (en) 2022-04-20
WO2020251362A1 (en) 2020-12-17

Similar Documents

Publication Publication Date Title
NL2023307B1 (en) method and device arranged to determine an amount of items
US10915910B2 (en) Passive analysis of shopping behavior in a physical shopping area using shopping carts and shopping trays
US10318837B2 (en) Distinguishing between stock keeping units using a physical dimension of a region depicted in an image
US9538330B2 (en) System and method for selecting a Wi-Fi access point for position determination
US8996413B2 (en) Techniques for detecting depleted stock
US20140365307A1 (en) Transmitting listings based on detected location
JP2009126660A (en) Article management system and information processing apparatus
CN109155082A (en) Information processing equipment, information processing method and storage medium
US20160034924A1 (en) Estimating distribution of persons in a physical environment
US10963150B2 (en) System for designing and configuring a home improvement installation
US20140358712A1 (en) Shopping guide system, shopping guide management device and method
US20230062061A1 (en) Control method, communication terminal, non-transitory computer-readable recording medium, and information providing method
JP2017138865A (en) Purchase activity management apparatus, purchase activity management method, and program
CN108876249A (en) Goods monitoring system and method
JP6246446B1 (en) Computer system, vacant seat detection method and program
EP3779842A1 (en) Commodity information query method and system
CN108154139B (en) Commodity hot area detection system and method, electronic device and storage medium
CN112648791B (en) Determination of the object weight of a cooling object
US20240070606A1 (en) Container touch-pairing device
CN106919247A (en) Virtual image methods of exhibiting and device
US20200126097A1 (en) Item level 3d localization and imaging using radio frequency waves
CN110231033B (en) Merchant navigation method, device, server and storage medium
CN110348926B (en) Store system, display cabinet, and article information display method and device
JP2016103208A (en) Measurement method, information processing apparatus, program, and commodity counting system
JP2017138955A (en) Purchase activity management apparatus, purchase activity management method, and program