EP3473023A1 - Überwachung von objekten mit fähigkeit zu drahtlosen kommunikationen - Google Patents

Überwachung von objekten mit fähigkeit zu drahtlosen kommunikationen

Info

Publication number
EP3473023A1
EP3473023A1 EP16906200.7A EP16906200A EP3473023A1 EP 3473023 A1 EP3473023 A1 EP 3473023A1 EP 16906200 A EP16906200 A EP 16906200A EP 3473023 A1 EP3473023 A1 EP 3473023A1
Authority
EP
European Patent Office
Prior art keywords
objects
user
wireless communications
expected set
communications device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP16906200.7A
Other languages
English (en)
French (fr)
Other versions
EP3473023B1 (de
EP3473023A4 (de
Inventor
Swarup Kumar Mohalik
Mahesh Babu JAYARAMAN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Telefonaktiebolaget LM Ericsson AB
Original Assignee
Telefonaktiebolaget LM Ericsson AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Telefonaktiebolaget LM Ericsson AB filed Critical Telefonaktiebolaget LM Ericsson AB
Priority to EP22206968.4A priority Critical patent/EP4156724B1/de
Publication of EP3473023A1 publication Critical patent/EP3473023A1/de
Publication of EP3473023A4 publication Critical patent/EP3473023A4/de
Application granted granted Critical
Publication of EP3473023B1 publication Critical patent/EP3473023B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/021Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/50Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
    • G06F21/55Detecting local intrusion or implementing counter-measures
    • G06F21/554Detecting local intrusion or implementing counter-measures involving event detection and direct action
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/70Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer
    • G06F21/88Detecting or preventing theft or loss
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • G08B21/24Reminder alarms, e.g. anti-loss alarms
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W12/00Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/12Detection or prevention of fraud
    • H04W12/126Anti-theft arrangements, e.g. protection against subscriber identity module [SIM] cloning
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/023Services making use of location information using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/029Location-based management or tracking services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W64/00Locating users or terminals or network equipment for network management purposes, e.g. mobility management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W8/00Network data management
    • H04W8/005Discovery of network devices, e.g. terminals
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/02Mechanical actuation
    • G08B13/14Mechanical actuation by lifting or attempted removal of hand-portable articles
    • G08B13/1427Mechanical actuation by lifting or attempted removal of hand-portable articles with transmitter-receiver for distance detection
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/0202Child monitoring systems using a transmitter-receiver system carried by the parent and the child
    • G08B21/0227System arrangements with a plurality of child units
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/0202Child monitoring systems using a transmitter-receiver system carried by the parent and the child
    • G08B21/0277Communication between units on a local network, e.g. Bluetooth, piconet, zigbee, Wireless Personal Area Networks [WPAN]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/535Tracking the activity of the user
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W12/00Security arrangements; Authentication; Protecting privacy or anonymity
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W12/00Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/60Context-dependent security
    • H04W12/63Location-dependent; Proximity-dependent
    • H04W12/64Location-dependent; Proximity-dependent using geofenced areas
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/70Services for machine-to-machine communication [M2M] or machine type communication [MTC]

Definitions

  • the invention relates to a method of monitoring objects capable of wireless communications, a device for monitoring objects capable of wireless
  • NFC Near-Field Communication
  • RFID RFID
  • the user has to configure a tracker application/device and the device(s) to be tracked, after which the tracker issues alarms if the tracked device(s) is/are not in proximity of the tracker, i.e., is/are outside a predetermined range from the tracker.
  • a tracker application/device and the device(s) to be tracked, after which the tracker issues alarms if the tracked device(s) is/are not in proximity of the tracker, i.e., is/are outside a predetermined range from the tracker.
  • a child may be provided with a tracked device in the form of a small radio transmitter, and the tracker device will sound an alarm if the child moves outside of a pre-defined area.
  • An object of the present invention is to solve, or at least mitigate, this problem in the art and to provide an improved method of monitoring objects capable of wireless communications .
  • This object is attained in a first aspect of the invention by a method of monitoring objects capable of wireless communications.
  • the method comprises detecting an activity performed by a user of a wireless communications device, acquiring information identifying an expected set of objects which are associated with the detected activity, determining whether at least one of the objects in the expected set is not in proximity of the wireless communications device, and if so notifying the user that at least one of the objects in the expected set is not in proximity of the wireless communications device.
  • a device for monitoring objects capable of wireless communications
  • the device comprising a processing unit and a memory.
  • the memory contains instructions executable by the processing unit, whereby the device is operative to detect an activity performed by a user of a wireless communications device, acquire information identifying an expected set of objects which are associated with the detected activity, determine whether at least one of the objects in the expected set is not in proximity of the wireless
  • a device referred to as a tracker device being for instance a mobile phone, a mobile terminal, a User Equipment (UE), or a smartphone of a user, detects that a certain activity is performed by the user. For instance, it may be detected that the user performs an activity such as "Go To Work” upon leaving her home premises during a time window specified for the activity ("Any Weekday, 07:00-08:00").
  • an activity such as "Go To Work” upon leaving her home premises during a time window specified for the activity ("Any Weekday, 07:00-08:00").
  • a change in location of the user may, e.g., be detected using a Global Positioning System (GPS) of the tracker device (from a first location "on home premises” to a second location “off home premises", or “leaving home premises”).
  • GPS Global Positioning System
  • NFC Near Field Communication
  • RFID Radio-Frequency Identification
  • Bluetooth transmitter any other short-range radio transmitter
  • the user is notified accordingly.
  • the user is advantageously notified accordingly.
  • the user is thus made aware that she forgot one or more of the objects of the expected set associated with this particular activity and can go back into her house to pick up any forgotten object of the expected set before leaving for work.
  • the user is notified by the tracker device emitting an audible sound, displaying a message, generating a haptic notification such as a vibration, etc.
  • the tracker device may signal another wireless communications device that the user should be notified, for instance by requesting the user's smartwatch to vibrate, or requesting the user's car to not start the engine and/or display a message on the dashboard.
  • the method of monitoring the objects may be performed by the tracker device, a node of a communications network which is accessible by the wireless
  • the communications device e.g., an application server, or one or more nodes of a cloud environment which is accessible by the wireless communications device. It is envisaged that a distributed solution may be provided, wherein the tracker device performs one or more steps of the method, while one or more cloud devices performs any further steps.
  • an actual set of objects which are in proximity of the wireless communications device is determined, and it is further determined whether at least one of the objects in the expected set is not in the actual set. If so, the user is notified accordingly.
  • an updated expected set may be stored in a database comprising activities and corresponding expected sets of objects.
  • an updated expected set may be stored in a database comprising activities and corresponding expected sets of objects.
  • the activity which is performed by the user of the wireless communications device is detected based on at least one of, a combination, or a pattern, of: a location of the wireless communications device or a change thereof, a motion pattern of the wireless communications device or a change thereof, a date, a time of day, a calendar event, a communication event, sensor readings, and current weather conditions.
  • a behaviour of the user is registered, and if it is concluded that the registered behaviour is a frequently occurring behaviour of the user, the registered behaviour is specified as an activity.
  • a group of objects are registered as being carried by the user when the frequently occurring behaviour of the user is registered, the group of objects being specified as the expected set of objects associated with the specified activity.
  • a computer program comprising computer-executable instructions for causing the device to perform steps according to an embodiment of the first aspect of the invention, when the computer-executable instructions are executed on a processing unit included in the device.
  • a computer program product comprising a computer readable medium, the computer readable medium having an embodiment of the computer program embodied thereon.
  • Figure 1 illustrates a scenario where a user of a wireless communications device is monitored leaving the home premises for work, in accordance with embodiments of the invention.
  • Figure 2 shows a flowchart illustrating an embodiment of a method of monitoring objects capable of wireless communications.
  • Figure 3 shows a sequence diagram illustrating the embodiment of the method of monitoring objects capable of wireless communications according to Figure 2, performed by the wireless communications device of the user.
  • Figure 4 shows a sequence diagram illustrating an embodiment of the method of monitoring objects capable of wireless communications, performed by a remotely located network node.
  • Figure 5 shows a sequence diagram illustrating another embodiment of the method of monitoring objects capable of wireless communications.
  • Figure 6 shows a sequence diagram illustrating yet another embodiment of the method of monitoring objects capable of wireless communications.
  • Figure 7 shows a sequence diagram illustrating still another embodiment of the method of monitoring objects capable of wireless communications.
  • Figure 8 shows a sequence diagram illustrating still a further embodiment of the method of monitoring objects capable of wireless communications.
  • Figure 9 shows a sequence diagram illustrating yet a further embodiment of the method of monitoring objects capable of wireless communications.
  • Figure 10 shows a device for monitoring objects capable of wireless
  • Figure 11 shows a device configured to monitor objects capable of wireless communications, in accordance with another embodiment of the invention.
  • Figure 1 illustrates an exemplifying embodiment of the invention.
  • an individual or user 10 leaves home 11 for work every morning, she will want to bring with her a set of objects that she will need during her work day, which set in this particular example is exemplified as comprising her wallet 12, home key 13, and work pass 14 to be used for entering work premises.
  • This set 15 of objects is referred to as the expected set of objects. That is, when the individual 10 with which the objects 12, 13, 14 are associated leaves home for work, she 10 is expected to carry the objects in the expected set 15 with her.
  • Individual 10 further carries a wireless communications device 16, in Figure 1 exemplified as a smartphone 16.
  • This wireless communications device 16 is referred to as a tracker device.
  • NFC Near Field Communication
  • RFID Radio-Frequency Identification
  • wireless communications means such as an RFID tag, a Bluetooth or 6L0WPAN ("IPv6 over Low Power Wireless Personal Area Networks”) transmitter, or the like.
  • the objects 12, 13, 14 included in the expected set 15 are capable of communicating wirelessly with the tracker device 16, in the form of a mobile phone, a smartphone, a mobile terminal, a UE, a tablet, a smartwatch, or any other appropriate wireless communications device, being equipped with a processing unit and a wireless communications interface.
  • the tracker device 16 may communicate with objects capable of wireless communications via any appropriate wireless technology, such as RFID, Bluetooth, 6L0WPAN, any cellular
  • the tracker device 16 communicates with one or more remotely located network nodes, such as for instance an application server 17 or one or more nodes of a cloud environment which is/are accessible by the tracker device 16, for fetching stored data, for storing data, or for having the network node perform any computing functions on behalf of the tracker device 16.
  • network nodes such as for instance an application server 17 or one or more nodes of a cloud environment which is/are accessible by the tracker device 16, for fetching stored data, for storing data, or for having the network node perform any computing functions on behalf of the tracker device 16.
  • the expected set 15 of objects is associated with a particular activity in which the user 10 of the tracker device 16 is to partake, in this exemplifying embodiment an activity defined as "going to work".
  • an activity defined as "going to work” is associated with the tracker device 16 and/or the server 17:
  • Expected_Set_of_Devices "Wallet, Key, Work Pass”
  • the activity can be specified in many different ways, e.g., as a time window set to "Any Weekday, 07:00-08:00".
  • the activity may further specify a location criterion which is associated with the tracker device 16 used by the user 10.
  • the location criterion comprised in the activity can be specified in numerous ways depending on the particular implementation, in this exemplifying embodiment for instance as "Leave Home”.
  • the tracker device 16 will accordingly detect indirectly whether at least one of the objects 12, 13, 14 in the expected set 15 complies with this predetermined location criterion by determining whether it complies with this predetermined location criterion itself.
  • a specified activity is performed by the user 10.
  • the user 10 is considered to perform the activity upon leaving the home premises 11, which is detected by means of the tracker device 16 leaving the home premises 11 during the time window specified for the activity ("Any Weekday, 07:00-08:00").
  • a change in location is detected, by detection a change in location of the tracker device 16 from a first location ("on home premises") to a second location (“off home premises”).
  • step S 102 information is acquired identifying an expected set 15 of objects which are associated with the detected activity, in this case the wallet 12, the home key 13, and the work pass 14. It can be envisaged that each object is given a unique numerical identifier.
  • step S103 If it is determined in step S103 that any one or more of the objects included in the expected set 15, e.g., the wallet 12, is not in proximity to the tracker device 16 when the tracker device leaves the home premises 11 of the user 10 during the time window specified for the activity, the user 10 is notified thereof in step S 104.
  • the respective locations of the objects 12, 13, 14 and the tracker device 16 may be tracked using, e.g., Global Positioning System (GPS).
  • GPS Global Positioning System
  • the location or position of tracker device 16 is determined using GPS, while the proximity of the objects 12, 13, 14 to the tracker device is detected using, e.g., NFC or any other short-range radio technology between the tracker device 16 and the objects 12, 13, 14.
  • the user 10 is advantageously notified accordingly.
  • the user 10 is thus made aware that she forgot one or more of the objects of the expected set 15 associated with this particular activity and can go back into her house 11 to pick up any forgotten object of the expected set 15 before leaving for work.
  • the user 10 is not notified, even though it could be envisaged that the user 10 is notified that all objects of the expected set 15 have been successfully detected.
  • the user 10 is notified by tracker device 16 emitting an audible sound, displaying a message, generating a haptic notification such as a vibration, etc.
  • the tracker device 16 may signal another wireless communications device that the user 10 should be notified, for instance by requesting the user's smartwatch to vibrate, or requesting the user's car to not start the engine and/or display a message on the dashboard.
  • step S 101 that it is located outside of the home premises 11 (i.e., by detecting a change in its location from a first location to a second location as previously described) on a weekday at 07:00-08:00.
  • the tracker device 16 requests from a local data storage in step S 102 information identifying the expected set 15 of objects which are associated with the detected activity, and determines whether it is capable of communicating, e.g., by NFC, with all the objects 12, 13, 14 in the expected set 15 in step S 103.
  • the tracker device 16 may measure the strength of a signal submitted by the respective object, and if the signal strength is sufficient, i.e., exceeds a threshold value, the object is considered to be in proximity of the tracker device 16.
  • the tracker device 16 notifies the user, and the user 10 is thus advantageously made aware that she forgot one or more of the objects of the expected set 15 associated with this particular activity and can go back into her house 11 to pick up any forgotten object of the expected set 15 before leaving for work.
  • Figure 3 illustrates a sequence diagram where the method of monitoring is performed in its entirety by the tracker device 16 according to an embodiment of the invention.
  • the tracker device 16 has access to one or more specified activities of the user 10, for instance fetched from a calendar app executing on the user's smartphone
  • An alternative approach is to have the tracker device 16 learn activities of the user, and even to associate a learned expected set of objects with each learned activity.
  • the tracker device 16 After the tracker device 16 has (1) left the home premises on (2) a weekday at (3) 07:00-08:00 at a number of occasions, it will define the activity "Go To Work" based on these three criteria. Further, by repeatedly detecting a set of objects in its proximity at these occasions, the tracker device 16 will form the expected set of objects and associate the expected set with this activity.
  • a database may be maintained at the tracker device 16 specifying a number of activities and an expected set of objects associated with each of the activities:
  • Table la Database comprising activities and associated objects.
  • At least one object is associated with each activity, thereby creating the expected set of objects.
  • One and the same object may be associated with different activities.
  • Objectl is comprised in the expected set both for Activity 1 and Activity2.
  • the tracker device 16 detects in step S lOl its location, e.g., using GPS, or by detecting that it leaves a coverage area of the user's WLAN. If the location of the tracker device 16 changes from a first location ("on home premises") to a second location ("off home premises") on any weekday at 07:00-08:00, the user is considered to partake in this particular activity ("Go To Work”). It is assumed that this corresponds to Activity 1 in Table la.
  • step S102 the tracker device 16 acquires information identifying an expected set of objects which are associated with the detected activity from the stored database. To this end, the tracker device 16 maps the detected activity
  • the expected set 15 comprises Objectl, Object2, and Object3, in this example corresponding to the wallet 12, the home key 13, and the work pass 14, respectively.
  • the tracker device 16 determines in step S103 whether at least one of the objects 12, 13, 14 in the expected set is not in its proximity, upon the user performing the activity of going to work ("Activityl"). It is in this example assumed that the tracker device 16 communicates with the objects utilizing NFC.
  • the tracker device 16 determines whether the objects 12, 13, 14 are in its proximity, for instance by making an attempt to communicate with the objects, or by measuring the strength of a respective signal received from the objects. If the communication attempt is successful, or if the signal strength exceeds a threshold value, the object is considered to be in proximity of the tracker device 16.
  • indicator indicating "proximity" for each object can be stored in the database, e.g., in the form of a signal strength threshold defining "proximity" for that specific object.
  • the home key 13 and the work pass 14 are in proximity to the tracker device 16, while the wallet 12 is not.
  • the tracker device 16 determines in step S103 that the home key 13 ("Object2") and the work pass 14 ("Object3") are in proximity to the tracker device 16, but that the wallet 12 ("Objectl”) is not, thereby concluding from Table la that not all the objects in the expected set for Activityl are in proximity to the tracker device 16.
  • the tracker device 16 notifies the user 10 in step S 104 by emitting an audio alert to the user 10, informing her about the lacking wallet 12.
  • the tracker device 16 may optionally display a message notifying the user that an expected object is not in the user's 10 proximity, preferably also identifying the missing object by name (e.g., "You forgot your wallet.”).
  • Figure 4 illustrates a sequence diagram where the method of monitoring is performed partly or fully at one or more remotely located network nodes, thereby facilitating a cloud solution.
  • the network node(s) is/are embodied by the server 17.
  • the server 17 has access to one or more specified activities of the user 10, for instance fetched from a calendar app executing on the user's smartphone (exemplified as being the tracker device 16) or from a cloud storage.
  • sensor readings such as position or location data may be transmitted from the tracker device 16 to the server 17.
  • a database may be maintained at the server 17 specifying a number of activities and an expected set of objects associated with each of the activities, as previously described with reference to Table la.
  • the server 17 detects in step S 101 the location of the tracker device 16 using GPS. If the tracker device 16 is leaving the user's 10 home premises 11 on any weekday at 07:00-08:00, the activity ("Go To Work") is detected. Again, it is assumed that this corresponds to Activity 1 in Table la.
  • step S102 the server 17 acquires information identifying an expected set of objects which are associated with the detected activity, from the stored database.
  • the server 17 maps the detected activity ("Activity 1") to the entries in Table la and concludes that the expected set 15 comprises Objectl, Object2 and Object3, in this example corresponding to the wallet 12, the home key 13, and the work pass 14, respectively.
  • the server 17 communicates directly with the objects capable of wireless communication, i.e., the wallet 12, the home key 13 and the work pass 14, for determining their proximity to the tracker device 16 based on, e.g., GPS readings
  • the tracker device 16 communicates with the respective object utilizing, e.g., NFC, and provides resulting information to the server 17.
  • the server 17 would communicate directly with the objects 12, 13, 14, the method may be undertaken in its entirety "in the cloud", either by the server 17 solely or in cooperation with other remote nodes.
  • the server 17 acquires in step S103a information as to which objects actually are in proximity to the tracker device 16 upon the user performing the activity of going to work ("Activity 1").
  • the tracker device 16 concludes that the home key 13 and the work pass 14 are in proximity to the tracker device 16, but that the wallet 12 is not, which the tracker device 16 reports accordingly to the server 17.
  • the server 17 determines in step S 103 that the home key 13 ("Object2") and the work pass 14 ("Object3") are in proximity to the tracker device 16, but that the wallet 12 ("Objectl”) is not, thereby concluding from Table la that not all the objects in the expected set for Activityl are in proximity to the tracker device 16. As a consequence, the server 17 sends a notification to the user 10 via the tracker device 16 in step S 104, whereby the tracker device 16 emits an audio alert to the user 10 advantageously informing her about her lacking wallet 12.
  • the server 17 would communicate directly with the objects 12, 13, 14, and notify the user 10 via, e.g., her smartwatch (not shown), the tracker device 16 need not take any active part in the monitoring, not even causing an audio alert.
  • Figure 5 illustrates a sequence diagram where the method of monitoring is performed in its entirety by the tracker device 16 according to another embodiment.
  • this embodiment may also be implemented by a remotely located network node, such as the server 17.
  • all objects which are in proximity to the tracker device 16 are determined upon detecting that the user 10 partakes in a specified activity.
  • only the objects comprised in the expected set are detected as being in proximity to the tracker device 16. Accordingly, as soon as all objects 12, 13, 14 of the expected set have been detected, there is no need to continue and detect any further proximate objects.
  • the objects determined to be in proximity to the tracker device 16 are referred to as an actual set of objects.
  • the tracker device 16 detects in step S101 its location, e.g., using GPS. If the tracker device 16 is leaving the user's 10 home premises 11 on any weekday at 07:00-08:00, the user is considered to partake in the activity ("Go To Work"). It is assumed that this corresponds to Activity 1 in Table la.
  • step S102 the tracker device 16 acquires information identifying an expected set of objects which are associated with the detected activity from the stored database. To this end, the tracker device 16 maps the detected activity ("Activityl") to the entries in Table la and concludes that the expected set 15 comprises Objectl, Object2 and Object3, in this example corresponding to the wallet
  • the tracker device 16 determines in step S103b the actual set of objects being in proximity of the tracker device 16. As is illustrated in Figure 5, the tracker device 16 determines that the home key 13 and the work pass 14 are in proximity to the tracker device 16, but that the wallet 12 is not.
  • the tracker device 16 further determines that a smartwatch 18 ("Object4") is in proximity of the tracker device 16, for instance by signalling based on Bluetooth or even via a Wireless Local Area Network (WLAN), commonly referred to as "WiFi”.
  • a smartwatch 18 (“Object4") is in proximity of the tracker device 16, for instance by signalling based on Bluetooth or even via a Wireless Local Area Network (WLAN), commonly referred to as "WiFi”.
  • WLAN Wireless Local Area Network
  • step S 103 the tracker device 16 determines whether any object
  • the tracker device 16 notifies the user 10 in step S 104 by emitting an audio alert and/or displaying a notification to the user 10, advantageously informing her about the lacking wallet 12.
  • Figure 6 illustrates a sequence diagram where the method of monitoring is performed in its entirety by the tracker device 16 according to still another embodiment.
  • this embodiment may also be implemented at a remotely located network node, such as the server 17.
  • step S104 As in the embodiment of Figure 5, all objects being in proximity to the tracker device 16 upon detection of the user 10 performing a specified activity are determined, thereby forming an actual set. However, in addition to the steps of the embodiment described with reference to Figure 5, after (or before) having notified the user 10 in step S104 that the wallet 12 included in the expected set has not been detected as being in proximity to the tracker device 16, the user is queried in step S 105 as to whether any objects of the determined actual set are to be added to the expected set which is associated with the detected activity.
  • step S 106 The user responds in step S 106, in this particular example with the response that the smartwatch 18 is to be added to the expected set for Activity 1.
  • the tracker device 16 will thus update its database of Table la in step S 107, resulting in updated Table lb:
  • Table lb Updated database comprising activities and associated objects.
  • Figure 7 illustrates a sequence diagram where the method of monitoring is performed in its entirety by the tracker device 16 according to still a further embodiment.
  • this embodiment may also be implemented at a remotely located network node, such as the server 17.
  • step S 104 after having notified the user 10 in step S 104 that the wallet 12 included in the expected set has not been detected as being in proximity to the tracker device 16, the
  • step S108 to indicate as to whether one or more objects of the expected set associated with the detected activity are to be removed from the expected set to create an updated expected set for the detected activity.
  • the user 10 indicates that the wallet 12 ("Objectl") is to be removed from the expected set illustrated in Table la, wherein the tracker device 16 updates its database of Table la in step S 109, resulting in updated Table lc:
  • Table lc Updated database comprising activities and associated objects.
  • Figure 8 illustrates a sequence diagram where the method of monitoring is performed in its entirety by the tracker device 16 according to yet another embodiment.
  • this embodiment may also be implemented at a remotely located network node, such as the server 17.
  • a remotely located network node such as the server 17.
  • all objects being in proximity to the tracker device 16 upon detection of the user 10 performing a specified activity is determined, thereby forming an actual set.
  • This embodiment is advantageous since it facilitates machine learning, as will be described in detail in the following.
  • Table 2a Database comprising activities and associated objects.
  • the tracker device 16 again has access to one or more specified activities of the user 10, for instance fetched from a calendar app executing on the user's smartphone (exemplified here as being the tracker device 16), or learned by means of machine learning as previously discussed.
  • the tracker device 16 detects in step S 101 its location using, e.g., GPS. If the tracker device 16 is leaving the user's 10 home premises 11 on any weekday at 07:00-08:00, the user is considered to partake in new Activity 1, which is learned by the tracker device 16 and added to Table 2a. Thereafter, in step S102, the tracker device 16 acquires information identifying an expected set of objects which are associated with the detected activity from the stored database. To this end, the tracker device 16 maps the detected activity ("Activity 1") to the entries in Table 2a and concludes that expected set associated with Activity 1 not yet comprises any objects.
  • Activity 1 the detected activity
  • the tracker device 16 determines in step S103b the actual set of objects being in proximity of the tracker device 16. As is illustrated in Figure 8, the tracker device 16 concludes that the wallet 12, the home key 13, and the work pass 14, are in proximity to the tracker device 16.
  • step S 103c the tracker device 16 advantageously associates the actual set of objects 12, 13, 14 with the detected activity as a new expected set of objects, and thus updates Table 2a, resulting in Table 2b:
  • Table 2b Updated database comprising activities and associated objects.
  • machine learning can be applied to record activities and objects in the database as illustrated in Tables 2and b, and to create appropriate associations between expected sets and corresponding activities.
  • machine learning such as association rule mining and/or frequent itemsets (discussed, e.g., in Chapter 6 of "Mining of Massive Datasets" by
  • J. Leskovec A. Rajaraman, and J. D. Ullman
  • J. Leskovec A. Rajaraman, and J. D. Ullman
  • a trackder device 16 such as a mobile phone or smartphone of a user, possibly in combination with further sensing devices, is used for building a database of activities and corresponding expected sets of devices to be associated with the activities.
  • the tracker device 16 registers that when the user leaves at home during a weekday at 07:00-08:00, she usually brings her wallet 12, home key 13, and work pass 14. Upon having registered that
  • the tracker device 16 may for instance stipulate that any object to be included in the expected set must fulfill a certain probability threshold, such as having been carried by the user at 80% of the occasions when the user performed the activity.
  • Figure 9 illustrates a sequence diagram where the method of monitoring is performed in its entirety by the tracker device 16 according to still another embodiment.
  • this embodiment may also be implemented at a remotely located network node, such as the server 17.
  • the tracker device 16 queries the user 10 in step S 103d whether the objects 12, 13, 14 of the determined actual of objects are to be stored as a new expected set for the detected activity.
  • the user 10 responds to the query in step S103e, for instance by indicating on a screen of the tracker device 16 (being, e.g., a smartphone) whether all determined objects of the actual set are to be associated with the detected activity as the new expected set, or whether a subset of the objects of the actual set is to be associated with the detected activity as the new expected set, in response to which the tracker device 16 advantageously associates the objects 12, 13, 14 indicated by the user 10 with the detected activity as the new expected set of objects, and thus updates Table 2a, resulting in Table 2b.
  • the tracker device 16 advantageously associates the objects 12, 13, 14 indicated by the user 10 with the detected activity as the new expected set of objects, and thus updates Table 2a, resulting in Table 2b.
  • a doctor is called upon to deal with an activity in the form of an emergency situation where a patient experiences high blood sugar (hyperglycaemia).
  • the expected set associated with this activity may thus comprise (a) a dose of insulin and (b) an injection device (e.g., being RFID-tagged). If the doctor has forgotten to pack the insulin and injection upon leaving his clinic, his mobile phone detects the absence and raises an alarm, so that the doctor realizes this before he leaves his clinic.
  • the case file may be RFID-tagged to ensure that his smartwatch will sound an alarm if he leaves his office for the court proceedings without the case file.
  • the activity may thus specify a date and time of the picnic, and further weather conditions acquired for instance from a weather forecast. Hence, if she leaves home at the specified date and time, and the forecast predicts bad weather, her smartphone will notify her if she does not bring the handy-cam and/or the umbrella.
  • the communications device may be detected based on at least one, a combination, or a pattern, of: a location of the wireless communications device or a change thereof, a motion pattern of the wireless communications device or a change thereof, a date, a time of day, a calendar event, a communication event, or even current weather conditions.
  • a location of the wireless communications device or a change thereof a motion pattern of the wireless communications device or a change thereof
  • a date a time of day
  • a calendar event a communication event, or even current weather conditions.
  • time windows such as a particular time of the day, or a particular weekday derived for instance from a meeting event or itinerary
  • the user's smartwatch alerts the user in case skin temperature measured by an IoT-type temperatures arranged in a garment of the user exceeds a threshold value, the activity being defined e.g. as "User Catching Fever”.
  • the steps of the method performed by the tracker device 16, or the server 17, or a distributed cloud solution are in practice performed by a processing unit 20 embodied in the form of one or more microprocessors arranged to execute a computer program 21 downloaded to a suitable storage medium 22 associated with the microprocessor, such as a Random Access Memory (RAM), a Flash memory or a hard disk drive.
  • the processing unit 20 is arranged to cause the device 16 to carry out the method according to embodiments when the appropriate computer program 31 comprising computer- executable instructions is downloaded to the storage medium 32 and executed by the processing unit 30.
  • the storage medium 32 may also be a computer program product comprising the computer program 31.
  • the computer program 31 may be transferred to the storage medium 32 by means of a suitable computer program product, such as a Digital Versatile Disc (DVD) or a memory stick.
  • a suitable computer program product such as a Digital Versatile Disc (DVD) or a memory stick.
  • the computer program 31 may be downloaded to the storage medium 32 over a network.
  • the processing unit 30 may alternatively be embodied in the form of a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a complex programmable logic device (CPLD), etc.
  • Figure 11 illustrates a device 16 configured to monitor objects capable of wireless communication.
  • the device 16 comprises detecting means 30 adapted to detect an activity performed by a user of a wireless communications device, acquiring means 31 adapted to acquire information identifying an expected set of objects which are associated with the detected activity, and determining means 32 adapted to determine whether at least one of the objects in the expected set is not in proximity of the wireless communications device. Further, the device 16 comprises notifying means 33 adapted to notify the user that at least one of the objects in the expected set is not in proximity of the wireless communications device
  • the device 16 may further comprise a communications interface for receiving and providing information, and further a local storage for storing data, and may (in analogy with that previously discussed) be implemented by a processor embodied in the form of one or more microprocessors arranged to execute a computer program downloaded to a suitable storage medium associated with the microprocessor, such as a RAM, a Flash memory or a hard disk drive.
  • a processor embodied in the form of one or more microprocessors arranged to execute a computer program downloaded to a suitable storage medium associated with the microprocessor, such as a RAM, a Flash memory or a hard disk drive.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Emergency Management (AREA)
  • General Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Databases & Information Systems (AREA)
  • Environmental & Geological Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Emergency Alarm Devices (AREA)
  • Telephone Function (AREA)
  • Telephonic Communication Services (AREA)
  • Alarm Systems (AREA)
EP16906200.7A 2016-06-20 2016-06-20 Überwachung von objekten mit fähigkeit zu drahtlosen kommunikationen Active EP3473023B1 (de)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP22206968.4A EP4156724B1 (de) 2016-06-20 2016-06-20 Überwachung von objekten mit fähigkeit zur drahtlosen kommunikation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IN2016/050190 WO2017221260A1 (en) 2016-06-20 2016-06-20 Monitoring objects capable of wireless communications

Related Child Applications (2)

Application Number Title Priority Date Filing Date
EP22206968.4A Division EP4156724B1 (de) 2016-06-20 2016-06-20 Überwachung von objekten mit fähigkeit zur drahtlosen kommunikation
EP22206968.4A Division-Into EP4156724B1 (de) 2016-06-20 2016-06-20 Überwachung von objekten mit fähigkeit zur drahtlosen kommunikation

Publications (3)

Publication Number Publication Date
EP3473023A1 true EP3473023A1 (de) 2019-04-24
EP3473023A4 EP3473023A4 (de) 2019-04-24
EP3473023B1 EP3473023B1 (de) 2022-12-21

Family

ID=60783955

Family Applications (2)

Application Number Title Priority Date Filing Date
EP22206968.4A Active EP4156724B1 (de) 2016-06-20 2016-06-20 Überwachung von objekten mit fähigkeit zur drahtlosen kommunikation
EP16906200.7A Active EP3473023B1 (de) 2016-06-20 2016-06-20 Überwachung von objekten mit fähigkeit zu drahtlosen kommunikationen

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP22206968.4A Active EP4156724B1 (de) 2016-06-20 2016-06-20 Überwachung von objekten mit fähigkeit zur drahtlosen kommunikation

Country Status (5)

Country Link
US (2) US11595784B2 (de)
EP (2) EP4156724B1 (de)
CN (2) CN109417680B (de)
DK (1) DK3473023T3 (de)
WO (1) WO2017221260A1 (de)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10735576B1 (en) * 2005-07-14 2020-08-04 Binj Laboratories, Inc. Systems and methods for detecting and controlling transmission devices
US9779596B2 (en) 2012-10-24 2017-10-03 Apple Inc. Devices and methods for locating accessories of an electronic device
US11581725B2 (en) 2018-07-07 2023-02-14 Intelesol, Llc Solid-state power interrupters
US11056981B2 (en) 2018-07-07 2021-07-06 Intelesol, Llc Method and apparatus for signal extraction with sample and hold and release
US11671029B2 (en) 2018-07-07 2023-06-06 Intelesol, Llc AC to DC converters
US11205011B2 (en) * 2018-09-27 2021-12-21 Amber Solutions, Inc. Privacy and the management of permissions
US10993082B2 (en) * 2018-09-27 2021-04-27 Amber Solutions, Inc. Methods and apparatus for device location services
US11641563B2 (en) 2018-09-28 2023-05-02 Apple Inc. System and method for locating wireless accessories
US11349296B2 (en) 2018-10-01 2022-05-31 Intelesol, Llc Solid-state circuit interrupters
CN109587712B (zh) * 2018-11-23 2021-12-14 南京极域信息科技有限公司 一种WiFi-Display性能优化系统
JP7475351B2 (ja) 2018-12-17 2024-04-26 インテレソール エルエルシー Ac駆動型の発光ダイオードシステム
EP3957089A1 (de) * 2019-04-17 2022-02-23 Apple Inc. Gemeinsame schlüssel für ein drahtloses zubehör
US11551899B2 (en) 2019-05-18 2023-01-10 Amber Semiconductor, Inc. Intelligent circuit breakers with solid-state bidirectional switches
US11349297B2 (en) 2020-01-21 2022-05-31 Amber Solutions, Inc. Intelligent circuit interruption
EP4197086A4 (de) 2020-08-11 2024-09-04 Amber Semiconductor Inc Intelligentes energiequellenüberwachungs- und auswahlsteuersystem
US11210925B1 (en) * 2020-08-21 2021-12-28 L'oreal Methods for determining presence of bluetooth device
CN112929814B (zh) * 2020-12-29 2022-09-23 杭州中芯微电子有限公司 适用于室内定位的uwb穿戴标签装置
US12073705B2 (en) * 2021-05-07 2024-08-27 Apple Inc. Separation alerts for notification while traveling
US12113525B2 (en) 2021-09-30 2024-10-08 Amber Semiconductor, Inc. Intelligent electrical switches

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7880613B1 (en) * 2005-02-07 2011-02-01 Joon Maeng System, device and method for reminding a user of a forgotten article
CN101064022A (zh) * 2006-04-27 2007-10-31 广东中大讯通信息有限公司 一种基于rfid技术的物品备忘与提醒系统
CN101071468B (zh) 2006-05-09 2010-10-13 普诚科技股份有限公司 无线频率辨识系统及其控制方法
CN101295423A (zh) * 2008-06-18 2008-10-29 北京邮电大学 利用移动电话上的rfid系统防止随身物品丢失的方法
CN101324979B (zh) * 2008-07-22 2010-06-23 中兴通讯股份有限公司 一种基于手机的随身物品防盗网络及防盗方法
US9297882B1 (en) * 2010-12-30 2016-03-29 Symantec Corporation Systems and methods for tracking paired computing devices
CN102289916B (zh) * 2011-05-09 2013-06-05 浙江大学 基于射频识别的车内物品携带提醒方法及装置
US9142116B2 (en) * 2012-11-27 2015-09-22 Ashkan Sattari Smart caregiver platform methods, apparatuses and media
US9602963B2 (en) * 2013-03-15 2017-03-21 Apple Inc. Facilitating access to location-specific information using wireless devices
CN104238903A (zh) * 2013-06-06 2014-12-24 富泰华工业(深圳)有限公司 行事历事件提示系统及方法
ES2569705T3 (es) * 2013-07-05 2016-05-12 Stanley Works (Europe) Gmbh Un recipiente con un sistema de detección
CN103870856A (zh) * 2013-11-05 2014-06-18 高贤荣 一种基于无线射频识别技术的微型个人物品管理智能系统及方法
US9344546B2 (en) * 2014-05-06 2016-05-17 Fitbit, Inc. Fitness activity related messaging
CN104794863A (zh) * 2014-06-05 2015-07-22 合肥星服信息科技有限责任公司 基于rfid技术的物品防落下装置
US9467825B2 (en) * 2014-06-25 2016-10-11 Verizon Patent And Licensing Inc. Alerts based on vehicle and device telematics
JP6373680B2 (ja) * 2014-07-29 2018-08-15 株式会社東芝 電子機器、セキュリティ処理方法およびプログラム
US10452253B2 (en) * 2014-08-15 2019-10-22 Apple Inc. Weather user interface
US9473892B2 (en) * 2014-12-11 2016-10-18 Whirlpool Corporation Appliances that trigger applications on consumer devices based on user proximity to appliance
US9351122B1 (en) * 2014-12-23 2016-05-24 Intel Corporation Location grouping
CN104615766B (zh) * 2015-02-13 2018-10-12 联想(北京)有限公司 一种显示方法及电子设备
CN104754493B (zh) * 2015-02-26 2019-01-22 刘川民 一种基于固定位置的信息提示系统和方法
CN105632123A (zh) * 2015-03-27 2016-06-01 酷派软件技术(深圳)有限公司 提醒方法、提醒系统和移动终端
US9852597B2 (en) * 2015-09-23 2017-12-26 RedCritter Corp. Proximity based ad-hoc messaging, alerting, and tracking system

Also Published As

Publication number Publication date
US11595784B2 (en) 2023-02-28
DK3473023T3 (da) 2023-02-06
EP4156724B1 (de) 2024-05-22
WO2017221260A1 (en) 2017-12-28
EP4156724A1 (de) 2023-03-29
US11902859B2 (en) 2024-02-13
US20230156433A1 (en) 2023-05-18
EP3473023B1 (de) 2022-12-21
CN113543029A (zh) 2021-10-22
CN113543029B (zh) 2024-06-11
CN109417680A (zh) 2019-03-01
EP4156724C0 (de) 2024-05-22
US20200314233A1 (en) 2020-10-01
CN109417680B (zh) 2021-08-06
EP3473023A4 (de) 2019-04-24

Similar Documents

Publication Publication Date Title
US11902859B2 (en) Monitoring objects capable of wireless communications
US10163318B2 (en) Comprehensive system and method of universal real-time linking of real objects to a machine, network, internet, or software service
US9467825B2 (en) Alerts based on vehicle and device telematics
EP2876616B1 (de) Vorrichtungsortungsüberwachung
US8872655B2 (en) System, method and network for monitoring of location of items
US9824568B2 (en) Systems and methods for monitoring a proximity of a personal item and automatically assigning safe and unsafe zones
US7274292B2 (en) Proximity management system and method using radio-frequency identification tags
US20160373929A1 (en) Ibeacon compatible bluetooth low energy device monitoring system
US20140173439A1 (en) User interface for object tracking
BR102013023307A2 (pt) Dispositivo de comunicação móvel, método , e, aparelho sem fio
US9706380B1 (en) Providing emergency notification and tracking data from a mobile device
US20100164714A1 (en) Device monitoring
US9215578B2 (en) Monitoring systems and methods
US10475326B2 (en) System and method for tracking interaction between monitored population and unmonitored population
US11610465B2 (en) Comprehensive system and method of universal real-time linking of real objects to a machine, network, internet, or software service
US11576036B1 (en) Unauthorized tracking device detection and prevention
US10972875B2 (en) System and method of alternative tracking upon disabling of monitoring device
WO2019043746A1 (ja) 忘れ物報知システムおよび報知処理装置
JP2015179406A (ja) 端末装置、管理システム及び通知方法
JP2009296114A (ja) 監視システム、情報端末、監視システムのサービス提供方法およびそのプログラム

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20190117

A4 Supplementary search report drawn up and despatched

Effective date: 20190228

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20210222

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: H04W 64/00 20090101ALI20220201BHEP

Ipc: G06F 21/88 20130101ALI20220201BHEP

Ipc: G06F 21/55 20130101ALI20220201BHEP

Ipc: G08B 21/24 20060101ALI20220201BHEP

Ipc: H04W 12/00 20090101ALI20220201BHEP

Ipc: H04W 4/80 20180101ALI20220201BHEP

Ipc: H04W 4/021 20180101ALI20220201BHEP

Ipc: H04W 12/126 20210101ALI20220201BHEP

Ipc: G08B 21/02 20060101ALI20220201BHEP

Ipc: G08B 13/14 20060101ALI20220201BHEP

Ipc: H04L 67/50 20220101ALI20220201BHEP

Ipc: H04W 4/02 20180101AFI20220201BHEP

INTG Intention to grant announced

Effective date: 20220223

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTC Intention to grant announced (deleted)
INTG Intention to grant announced

Effective date: 20220720

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602016077072

Country of ref document: DE

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1539768

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230115

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20230131

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230321

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1539768

Country of ref document: AT

Kind code of ref document: T

Effective date: 20221221

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230322

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230523

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230421

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230421

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602016077072

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20230922

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20230630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20230630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230620

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230620

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230620

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230620

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221221

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230630

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240627

Year of fee payment: 9

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240627

Year of fee payment: 9

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230630

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20240626

Year of fee payment: 9

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230630

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240625

Year of fee payment: 9