FR3131010A1 - Method and device for locating an object - Google Patents

Abstract

The invention relates to a method for locating an object from a plurality of objects located in a physical store, each object of said plurality being attached to at least one beacon capable of transmitting and receiving data, said method being implemented implemented by a location device and characterized in that it comprises, for at least one object of the plurality:- a step of receiving, from said at least one beacon, at least one identifier of said at least one object and at least one associated datum,- a step of calculating the distance between said at least one object and said device as a function of said at least one datum received. Figure for the abstract: Figure 2

Description

Method and device for locating an object

1. Field of the invention

The invention relates to the general field of telecommunications networks and more particularly to the technology allowing the localization of products within a physical store via the use of a mobile terminal.

2. Prior art

Like online sales sites, the user experience in a physical store has evolved considerably in recent years. New generations of automated shops (eg Amazon Go) have emerged. These are most often equipped with a camera system able to follow each customer located in the store in order to deduce the basket made and the associated invoice.

Alternatively or cumulatively, these new generation shops can use product marking systems via, for example, RFID chips allowing automatic recognition of the contents of the customer's basket during checkout.

These new user paths relate to the collection of customer purchases but do not help them during the initial stage of creating the basket. This step can sometimes be tedious. This is the case, for example, when a customer is looking for a book in a department that includes many cultural products (records, books, etc.) and whose storage is complex and imperfect.

There is therefore a need for a technical solution allowing a customer to be guided in his search for a product during his visit to the store.

3. Disclosure of Invention

The invention improves the state of the art and proposes a method for locating an object from a plurality of objects located in a physical store, each object of said plurality being attached to at least one beacon capable of transmitting and receiving data, said method being implemented by a location device and characterized in that it comprises, for at least one object of the plurality:

• a step of receiving, from said at least one beacon, at least one identifier of said at least one object and at least one associated data item,
• a step of calculating the distance between said at least one object and said device as a function of said at least one datum received.

Advantageously, according to the invention, it is possible to obtain information on the location of a product present in a physical store. Concretely, the method collects an identifier and data from the products located on the shelves of the store and more particularly from a beacon attached to them, the beacons being capable of transmitting and receiving data/messages via radio waves . The identifier is, for example, the name of the product, an alphanumeric identification code or any other sequence of characters used to identify the object. Note that the identifier can identify a single object or a group of objects. Optionally, the identifier can be partially or totally encrypted.

Once the information has been collected, the method calculates the distance between an object and the device, thanks to the data emitted by this object. Concretely, the process determines the distance between the object and the device via the so-called “time-of-flight” method. This method is known per se and is not described in more detail here. The data is for example the current date obtained at the time of issue by the object of the identifier.

By date, we mean a sequence of characters that indicates a specific moment in a day. Note that the precision of this date must be high enough to allow the most exact possible calculation of the distance at which the selected object is located (for example, a precision to the second, to the millisecond, to the nanosecond or even finer still). Of course the wave propagation speed is known.

Furthermore, it assumes that the clocks of the products and the device are synchronized. This synchronization is for example carried out via an NTP (Network Time Protocol) request prior to the reception stage.

According to a particular embodiment of the invention, a method as described above is characterized in that the receiving step is followed by a step of selecting at least one first object from said plurality via the selection of at least one received identifier and in that the calculation step is carried out only for said at least one first object.

This embodiment makes it possible to restrict the distance calculation to one or more selected objects. The method selects an object or a subset via, for example, the identifier of the object or of the group of objects. Alternatively, the selection can be random.

According to a particular mode of implementation of the invention, a method as described above is characterized in that the calculation step is followed by a step of restoring said at least one identifier and said distance calculated via a man-machine interface.

This embodiment makes it possible, once the distance has been calculated, to restore via a man-machine interface the identifier and the calculated distance of the selected object. Thus, the user has the possibility of approaching and locating the product in question thanks to his movements (close to close).

According to a particular embodiment of the invention, a method as described above is characterized in that said at least one datum comprises a second distance value between said beacon emitting said datum and at least one second object of said plurality from which said at least one identifier has been received and in that the calculating step comprises calculating the relative position of said at least one object.

This embodiment makes it possible to locate the objects/beacons via, for example, the so-called trilateration method. This method allows the determination, by the device, of the relative position of the selected object via in particular the distance information recorded and communicated step by step by the objects and transmitted to the process.

According to a particular embodiment of the invention, a method as described above is characterized in that the restitution step further comprises the restitution of said relative position of said at least one object.

This embodiment makes it possible to restore via a man-machine interface the relative position of the selected object. Thus, the user has the possibility of knowing the location of the object in question and of moving towards it.

According to a particular embodiment of the invention, a method as described above is characterized in that the selection of said at least one first object is carried out according to at least one second datum obtained.

This embodiment makes it possible to select objects located in the store, by obtaining data which may include an identifier or a list of identifiers of objects. The second datum is for example obtained from a server via for example a network connection or else via point-to-point communication (WiFi, Bluetooth, Zigbee, NFC, RFID) with a suitable device.

According to a particular embodiment of the invention, a method as described above is characterized in that said at least one second datum is obtained through a man-machine interface.

This mode of implementation allows a user who is in the store to specify the product that he wishes to locate. For this, he can for example enter / pronounce the name or the identifier of the product at the level of a man-machine interface (vocal or textual) connected to the device.

According to a particular embodiment of the invention, a method as described above is characterized in that said at least one second datum is obtained from a digital storage space.

This mode of implementation allows the device to obtain from a digital storage space such as a database or a chain of blocks one or more data allowing the selection of one or more objects. The data is, for example, metadata associated with each product such as composition, instructions for use, etc.

According to a particular embodiment of the invention, a method as described above is characterized in that the calculation step is repeated at regular intervals and in that, when the calculated distance is less than a threshold , said at least one identifier is added to a list.

This embodiment allows, for example, a user to build a basket of products to buy (shopping list).

According to a particular embodiment of the invention, a method as described above is characterized in that said list is sent to a cash register system or a server.

This embodiment allows a user to pay for the products present in his basket at the level of the checkout system without having to handle the products. Indeed, the list is already known to the cash register system, the user can directly proceed to the payment.

This embodiment also allows real-time management of store inventory when the shopping list is sent to a server capable of managing store inventory. Indeed, the server can deduct from the stocks of the shop the articles added by the user in his basket. The transmission of the list can be automatic or on the initiative of the user.

According to a particular embodiment of the invention, a method as described above is characterized in that the calculation step is repeated at regular intervals and in that, when the calculated distance is less than a threshold and that said at least one identifier is included in a list obtained, said at least one tag attached to said at least one object is detached or deactivated.

This embodiment makes it possible, when a user passes through a security gate located in the store, to detach the tags from the selected objects. Of course, this assumes that the object identifier is included in a shopping list, for example, obtained from the store's checkout system.

According to a particular mode of implementation of the invention, a method as described above is characterized in that said at least one beacon transmits and receives data according to UWB technology

The invention also relates to a device for locating an object of a plurality of objects located in a physical store, each object of said plurality being attached to at least one beacon capable of transmitting and receiving data, said device being characterized in that it includes:

• a module for receiving, from said at least one beacon, at least one identifier of said at least one object and at least one associated data item,
• a module for calculating the distance between said at least one object and said device as a function of said at least one datum received.

The term module can correspond to a software component as well as to a hardware component or a set of hardware and software components, a software component itself corresponding to one or more computer programs or subroutines or more generally to any element of a program able to implement a function or a set of functions as described for the modules concerned. In the same way, a hardware component corresponds to any element of a hardware (or hardware) assembly capable of implementing a function or a set of functions for the module concerned (integrated circuit, smart card, memory card, etc. .).

The invention also relates to a mobile terminal characterized in that it comprises a location device as described previously.

The invention also relates to a computer program comprising instructions for implementing the above method according to any one of the particular embodiments described previously, when said program is executed by a processor. The method can be implemented in various ways, in particular in wired form or in software form. This program may use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in partially compiled form, or in any other desirable form.

The invention also relates to a recording medium or information medium readable by a computer, and comprising instructions of a computer program as mentioned above. The recording media mentioned above can be any entity or device capable of storing the program. For example, the medium may comprise a storage means, such as a ROM, for example a CD ROM or a microelectronic circuit ROM, or even a magnetic recording means, for example a hard disk. On the other hand, the recording media may correspond to a transmissible medium such as an electrical or optical signal, which may be conveyed via an electrical or optical cable, by radio or by other means. The programs according to the invention can in particular be downloaded from an Internet-type network.

Alternatively, the recording media may correspond to an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the method in question.

This location device and this computer program have characteristics and advantages similar to those described above in relation to the location method.

4. List of Figures

Other characteristics and advantages of the invention will appear more clearly on reading the following description of particular embodiments, given by way of simple illustrative and non-limiting examples, and the appended drawings, among which:

There illustrates the architecture of a device suitable for implementing the location method according to a particular embodiment,

There represents an example of an environment for implementing the invention according to a particular embodiment of the invention,

There represents the main steps of the location method, according to a particular embodiment,

5. Description of an embodiment of the invention

There represents the hardware architecture of a recording device DISP according to the invention. In the embodiment described here, this device has the hardware architecture of a computer. It notably comprises a processor PROC1, a random access memory MV1, a read only memory MEM1 and a non-volatile flash memory MF1. Such means are known per se and are not described in more detail here. The ROM constitutes a recording medium in accordance with the invention, readable by the processor PROC1 and on which is recorded here a computer program PG1 in accordance with the invention, this program comprising instructions for implementing the steps of the location method as described previously, when the program is executed by the processor PROC1.

On initialization, the code instructions of the computer program PG1 are for example loaded into a memory before being executed by the processor PROC1. The processor PROC1 of the processing unit UT1 notably implements the steps of the location method according to any one of the particular embodiments described in relation to FIGS. 2 and 3, according to the instructions of the computer program PG1.

The device DISP also comprises a module RECV capable of receiving, from one or more objects (more particularly from a beacon attached to the object) an identifier and associated data. The identifier received makes it possible to identify the object on which the tag is placed (attached) and the data is for example the date on which the identifier was issued by the tag. This issue date can be encoded in the form of a character string and optionally be encrypted using a symmetric or asymmetric encryption key.

The DISP device further comprises a CALC module capable of calculating, based on said data received (via the RECV module), the distance at which the object (and therefore its beacon) is located. To perform this calculation, the CALC module is based on the so-called "time of flight" method which makes it possible to determine the distance of an object by knowing the propagation speed of the waves emitted by the beacon and the propagation time of the wave. between the beacon and the device. In the case of a UWB (Ultra WideBand) beacon, the speed of propagation is known and the data received makes it possible to know precisely (for example to the nanosecond or even more finely) the date on which the data and the identifier were emitted by the beacon. Thus, the device has the possibility of knowing the propagation time by subtracting from the date contained in the data received, the current date retrieved (for example via an internal clock) at the time of receipt of the identifier and the data ( i.e the date of issue).

According to a particular embodiment of the invention, the CALC module is also capable of calculating the location of an object. This calculation is for example carried out using the so-called “trilateration” method. This method is a mathematical method which makes it possible to determine the relative position of a beacon and therefore of an object via the distances between a minimum of two beacons. Concretely, the device receives (via the RECV module) a value of the distance between the beacon (first object) which transmitted the data and the identifier and a second beacon (second object) whose identifier and the associated data have also received by the device. The device also calculates the distance between the device and the second object and the distance between the first object and the device. Thus, the device will be able to determine the relative position of the first object via the so-called trilateration method. This method being known, the detailed mathematical calculations are not described in more detail here.

According to a particular embodiment of the invention, the DISP device may comprise a SELECT module capable of selecting an object identifier from among a plurality of identifiers received via the RECV module. The selection can be made via the reception of data from, for example, a server / terminal or via a man-machine interface located on the device or connected to it.

According to a particular embodiment of the invention, the DISP device can comprise a module for restoring a distance and/or a location calculated by the CALC module. The restitution device may be a vibrator motor module (not shown) suitable for restoring distance information using specific vibrations, for example by generating more or less intense vibrations depending on the location and proximity of the object. (of the beacon). The restitution device can also be an audio module (not shown), such as for example a loudspeaker, suitable for restoring distance information using a voice synthesis module. The restitution device can also be a display module (not shown) such as for example a screen (touch or not) suitable for displaying at least one location and/or distance information and/or at least one identifier of object. In the case of a restitution via a display, the restitution may depend on the density of the objects located within a given perimeter.

There illustrates an example of an environment for implementing the invention according to a particular embodiment of the invention. The implementation environment includes a physical store (100) in which storage bins and/or shelves (102) are arranged. Objects (products for sale) 101 are stored in these bins/storage shelves. These objects 101 break down into two parts. The first (101a) is the product sold as such and the second 101b is a tag that is physically attached to the product and potentially detachable. Optionally, a beacon can also be attached to the storage bins / shelves (102).

In concrete terms, the beacon is, for example, an anti-theft device capable of transmitting and receiving radio waves according to UWB, WiFi or Bluetooth technology. In addition, the beacon includes a digital storage space in which at least one identifier of the object to which it is attached is stored and a clock capable of providing the current time with high precision (for example to the microsecond). The clock is for example calibrated in the factory so that all the beacons have exactly the same time at the same time.

According to a particular embodiment of the invention, the clocks of the beacons can be synchronized via a network request intended for the same NTP server or else via a request intended for a device (not represented) which is located in the shop.

According to a particular embodiment of the invention, the current date can be obtained by the beacon via a network request intended for an NTP server.

The environment further comprises a cash register system 103 making it possible to collect (pay) the purchases of the customer(s) of the shop and a security gate 104 capable of verifying that the products leaving the store have indeed been paid for by the customer(s). customers. The security gate is able to communicate with beacons using UWB, WiFi or Bluetooth technology. In addition, the security gate is also capable of communicating with the cash register system 103 via a wired (for example IP) or wireless (for example UWB, WiFi or Bluetooth) connection.

According to a particular embodiment of the invention, the cash register system can be a server located in the network.

There illustrates steps of the location method according to a particular embodiment of the invention. The method can be implemented by a device (DISP) such as the security gate (104) and/or the cash register system (103) and/or a terminal of a customer present in the shop. The terminal is, for example, a mobile terminal such as a computer, a smartphone, a connected watch, equipment made available to the customer by the store (a shower/scanner) able to communicate with the beacons of objects and/or shelves located in the store via, for example, UWB, WiFi or Bluetooth technology.

It should be noted that in mobile communication systems, a proximity communication technology (eg UWB (Ultra Wide Band) IEEE 802.15.4a standard or Bluetooth 5.1) allows the relative positioning of two devices within a radius of several meters. The accuracy of these systems is a few centimeters and only requires two reference points (i.e. two beacons).

During the GET step, the method receives from a transmitter tag located in the store (100) an identifier of the object attached to the tag and data corresponding to the date on which the identifier was issued by the tag. Note that the beacon can repeat the transmission step at regular intervals.

Once the data and the identifier have been received by the process, it calculates (step COMP) the distance at which the beacon (the object) is located. This calculation is carried out using the so-called “time-of-flight” method. Concretely, upon receipt of the identifier and the data from the beacon, the process obtains the current date (for example via an internal clock). He can then, by subtracting the data received (date of issue of the identifier) from the current date obtained, determine the propagation time of the radio wave between the beacon and the device (DISP). Optionally, a data conversion step is performed before the subtraction. Knowing that the propagation speed of the wave is known for a given technology (UWB, Bluetooth, etc.), the process obtains the distance at which the beacon and therefore the object is located.

According to a particular embodiment of the invention, the method is also able to calculate (COMP) the location of an object. This calculation is for example carried out using the so-called “trilateration” method. Concretely, the method receives from a first beacon, in addition to the object identifier and the associated data, a distance value between this same beacon (first beacon) and a second beacon whose identifier and the associated data have also been received by the method. Once the first beacon/device and second beacon/device distances have been calculated by the method, the latter can determine the relative position of the first object via the so-called trilateration method. This method being known, the detailed mathematical calculations are not described in more detail here.

According to a particular embodiment of the invention, the method is also capable of selecting an object identifier from among a plurality of identifiers received from a plurality of beacons.

In the case where the method is implemented by a mobile user terminal, the invention proposes to guide the user in his search for a product when the latter is in a shop (100). Concretely, a mobile application provided by the merchant is for example downloaded by the customer onto his mobile terminal prior to his coming to the store (100). When the customer enters the store, he starts / launches the mobile application on his terminal. The application activates, if necessary, the transmitting/receiving antenna of the customer's mobile terminal in order to communicate with the beacons (101b) attached to the products (101a) placed in the display shelves (102) and potentially accessible to the customer.

According to a particular embodiment of the invention, the mobile terminal is capable of restoring the identifier of an object and/or the distance between the beacon of the object and the mobile terminal and/or the position of the object (tag). This restitution can be carried out via a man-machine interface such as a screen, a loudspeaker or a vibrator motor. In addition, the restitution can be a function of the density of objects or of a type of objects in a given space. Thus, the size and / or color of the identifier font may vary depending on the density of objects. Likewise, the sequence and/or strength of vibrations can vary depending on the density of objects or type of object in a given space. When the restitution is carried out via a loudspeaker and more precisely via a voice synthesis, the vocalized text can also vary according to the density of objects or a type of object in a given space. Once the information has been returned to the user, he can, if he wishes, select an object (product) identifier. Once the identifier has been selected, only this identifier and the distance and/or the calculated position of the object are kept at the restitution level. This allows him to select a particular product and to focus on the search for this product (to be guided towards the product). Alternatively, the user can select an object identifier before the calculation step so that only the distance and/or the location of this object are calculated and therefore returned. This makes it possible to limit the calculation times and the CPU power used by the process. The selection can for example be made via a voice command (the user pronounces the chosen identifier) or by entering the identifier using a physical or virtual keyboard.

According to a particular embodiment of the invention, the selection of the identifier by the user can be a function of data (meta-data) obtained by the mobile terminal and associated with the identifiers of objects. The mobile application can include these metadata (composition of products, nutritional value, number of remaining items of the same product in a store, instructions for use, etc.) or obtain them via a network request from 'a waiter. The server can be a Web server hosted in the network or located in the store, such as the cash register system, for example.

According to a particular embodiment of the invention, the restitution may include the metadata of a product.

According to a particular embodiment of the invention, the method can select the objects to be restored as a function of the calculated distance. Thus, if the objects are at a distance less than a threshold (for example 10 centimeters), they are returned at the level of the device's human-machine interface. This embodiment is particularly suitable for people with a visual handicap (visually impaired, blind) when the restitution is done via voice synthesis.

According to a particular embodiment of the invention, the method implemented by the mobile terminal can reiterate at regular intervals the step of calculating (for example every second) the distance and/or the relative position of the objects. This embodiment allows the user to add an item identifier to a list when the item (object) is brought into contact with the mobile terminal (distance equal to zero between the mobile terminal and the beacon of the product (object)). This list is for example a basket (shopping list) including all the items taken by the user (customer) in the shop.

According to a particular embodiment of the invention, when a product is added to the shopping list, the mobile application can send a request to a server indicating that the product has been taken by the customer. The server is for example located in the network or else present in the shop (for example the cash register system) and capable of managing the store's stocks. Thus, the server knows in real time the stock status of the store and can automatically order new goods if these were to run out.

According to a particular embodiment of the invention, when an item from the list is brought into contact with the mobile terminal (distance equal to zero between the mobile terminal and the tag of the product/object), it is deleted from the shopping list. In addition, the mobile application can send a request to a server managing the store's inventory indicating that the product has been put back on the shelf by the customer. Thus, the server can return the item "returned" / returned by the customer to the store's product inventory.

The list can then be sent to the cash register system or to a server located in the network allowing payment for the products listed. If the payment is validated then the cash system or the server sends one or more requests to the tags of the products purchased so that they are physically detached from the products and / or deactivated. Thus, the customer can leave the store with his purchases by leaving the tags in a suitable place. Note that the tags can be collected by a store employee, for example at the checkout system.

It goes without saying that the embodiment which has been described above has been given purely as an indication and in no way limiting, and that many modifications can be easily made by those skilled in the art without departing from the scope. of the invention. According to other specific embodiments of the invention, the invention also applies to a store security gate. Indeed, when a user has paid for his purchases, for example at the level of the checkout system, the method can obtain from the checkout system the identifier(s) of paid objects (second data within the meaning of the invention).

In addition, the localization process executed by the gantry can reiterate at regular intervals (for example every second) the step of calculating the distance and/or the relative position of the object(s). Thus, this embodiment makes it possible to detect when a user approaches the portal with paid objects (products). The portal can then send one or more requests to the tags of the purchased products so that they are physically detached from the products or else deactivated. The customer can then leave the store with his purchases by leaving the tags in a suitable place.

According to a particular embodiment of the invention, the portal can also transmit to a server capable of managing the store's stocks, the list of objects for which the beacon(s) have been deactivated/detached. The server can be located in the network (private or public) or present in the shop (for example the cash register system).

Claims (15)

Method for locating an object (101a) of a plurality of objects located in a physical store (100), each object of said plurality being attached to at least one beacon (101b) capable of transmitting and receiving data, said method being implemented by a location device and characterized in that it comprises, for at least one object of the plurality:
- a step of receiving (GET), from said at least one beacon, at least one identifier of said at least one object and at least one associated data item,
- a calculation step (COMP) of the distance between said at least one object and said device as a function of said at least one datum received. Locating method according to Claim 1, in which the step of receiving is followed by a step of selecting (SEL) at least one first object of the said plurality via the selection of at least one identifier received and in that the The calculation step (COMP) is carried out only for said at least one first object. Location method according to claim 1, in which the step of calculating is followed by a step of restoring said at least one identifier and said distance calculated via a man-machine interface. Locating method according to Claim 1, in which the said at least one datum comprises a second distance value between the said beacon transmitting the said datum and at least one second object of the said plurality from which the said at least one identifier has been received and in that the the calculation step comprises the calculation of the relative position of said at least one object. Locating method according to claim 3 wherein the step of restoring further comprises restoring said relative position of said at least one object. Locating method according to Claim 2, in which the selection of the said at least one first object is carried out as a function of at least one second datum obtained. Location method according to claim 6 wherein said at least one second datum is obtained through a man-machine interface. Locating method according to Claim 6, in which the said at least one second datum is obtained from a digital storage space. Location method according to Claim 1, in which the calculation step is repeated at regular intervals and in that, when the distance calculated is less than a threshold, the said at least one identifier is added to a list. Locating method according to Claim 9, in which the said list is transmitted to a cash register system or to a server. Locating method according to Claim 1, in which the calculation step is repeated at regular intervals and in that the calculation step is repeated at regular intervals and in that, when the calculated distance is less than a threshold and that said at least one identifier is included in a list obtained, said at least one tag attached to said at least one object is detached or deactivated. Locating method according to claim 1 wherein said at least one beacon transmits and receives data according to UWB technology. Device for locating an object (101a) of a plurality of objects located in a physical store, each object of said plurality being attached to at least one beacon (101b) capable of transmitting and receiving data, said device being characterized in that it includes:
- a module for receiving (RECV), from said at least one beacon, at least one identifier of said at least one object and at least one associated data item,
- a calculation module (CALC) of the distance between said at least one object and said device as a function of said at least one datum received. Mobile terminal characterized in that it includes a location device according to claim 13. Computer program comprising instructions for implementing the method according to any one of Claims 1 to 12, when the program is executed by a processor.