WO2023128709A1 - Procédé et système de gestion d'une notification pour des événements manqués dans un environnement ido - Google Patents

Procédé et système de gestion d'une notification pour des événements manqués dans un environnement ido Download PDF

Info

Publication number
WO2023128709A1
WO2023128709A1 PCT/KR2022/021747 KR2022021747W WO2023128709A1 WO 2023128709 A1 WO2023128709 A1 WO 2023128709A1 KR 2022021747 W KR2022021747 W KR 2022021747W WO 2023128709 A1 WO2023128709 A1 WO 2023128709A1
Authority
WO
WIPO (PCT)
Prior art keywords
event
missed
user
iot
user command
Prior art date
Application number
PCT/KR2022/021747
Other languages
English (en)
Inventor
Shruti MARY
Pankaj TANWAR
Original Assignee
Samsung Electronics Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co., Ltd. filed Critical Samsung Electronics Co., Ltd.
Priority to US18/187,317 priority Critical patent/US20230224375A1/en
Publication of WO2023128709A1 publication Critical patent/WO2023128709A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/55—Push-based network services
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y10/00—Economic sectors
    • G16Y10/75—Information technology; Communication
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y40/00—IoT characterised by the purpose of the information processing
    • G16Y40/10—Detection; Monitoring

Definitions

  • the disclosure relates to system and method for managing a notification for missed events in an Internet of things (IoT) environment.
  • IoT Internet of things
  • Smart homes have become a widely accepted system.
  • voice assistants users find it easy to make task executed on different smart appliances by being at any location.
  • Many user commands require user to attend IoT appliances after command execution. However, several times the user can forget about it or be busy.
  • Most IoT appliances keep on reminding users through signals or notifications after an instructed task has been executed, until the user attends it.
  • the IoT appliances keep providing repetitive reminders until the user attends to the executed command.
  • the user may not need repetitive reminders for certain tasks. Hence, the user may get annoyed to get repetitive reminders.
  • Some existing systems prioritize reminders based on user history choices or user's busy state and choose suitable time for reminding, but in both cases the system does not look into the nature of the reminder to check its importance at present time and save user from unnecessary reminders, if any.
  • an aspect of the disclosure is to provide an apparatus and method for improving notifications to a user regarding missed events.
  • a method for managing a notification for missed events in an IoT environment includes determining, by a missed-event detection module, at least one missed event in response to a user command to an IoT appliance after an expiry of a threshold wait time.
  • the method further comprises determining, by a missed-event importance module, a plurality of attributes associated with at least one of appliance settings and environment properties after the detection of at least one missed event based on a processing of the user command to obtain an attribute report corresponding to the plurality of attributes respective to each of the IoT appliance, Thereafter, the method comprises predicting, by a prediction module, a requirement for notifying the user with respect to the determined at least one missed event based on the attribute report. Then, the method comprises managing, by an event notifying manager module, the notification corresponding to the at least one missed event based on the predicted requirement for notifying the user.
  • a system for managing a notification for missed events in an IoT environment includes a missed-event detection module configured to determine, at least one missed event in response to a user command to an IoT appliance after an expiry of a threshold wait time.
  • the system further comprises a missed-event importance module configured to determine, a plurality of attributes associated with at least one of appliance settings and environment properties after the detection of at least one missed event based on a processing of the user command to obtain an attribute report corresponding to the plurality of attributes respective to each of the IoT appliance.
  • the system also comprises a prediction module configured to predict a requirement for notifying the user with respect to the determined at least one missed event based on the attribute report.
  • the system further comprises an event notifying manager module configured to manage, the notification corresponding to the at least one missed event based on the predicted requirement for notifying the user.
  • the disclosed techniques intelligently decide to give a reminder or not of the missed IoT event to the user. It uses the nature and importance of the missed event at that instant of time to understand if it is necessary for the user to know about it. This saves the unnecessary annoying flow of multiple reminders to the user.
  • FIG. 1 illustrates examples of notifications provided by IoT devices, according to the related art
  • FIG. 2 illustrates a flow diagram depicting a method for managing a notification for missed events in an IoT environment, according to an embodiment of the disclosure
  • FIG. 3 illustrates a block diagram of a system for managing a notification for missed events in an IoT environment, according to an embodiment of the disclosure.
  • FIGS. 4A, 4B, 5A, 5B, 6A, 6B, 7A, and 7B illustrate various use cases based on the present mechanism, according to various embodiments of the disclosure.
  • any terms used herein such as but not limited to “includes,” “comprises,” “has,” “consists,” and grammatical variants thereof do NOT specify an exact limitation or restriction and certainly do NOT exclude the possible addition of one or more features or elements, unless otherwise stated, and furthermore must NOT be taken to exclude the possible removal of one or more of the listed features and elements, unless otherwise stated with the limiting language “MUST comprise” or “NEEDS TO include.”
  • FIG. 1 illustrates few examples of such scenarios according to the related art.
  • the user has instructed its smart television (TV) to turn on at 7 pm and play TV show "FRIENDS” on Netflix. Accordingly, at 7 pm, the smart TV is turned on and start playing TV show "FRIENDS” on Netflix. Also, the smart TV starts providing notifications to the user about the start of TV show. However, the user may have guests to attend and may get irritated with the notifications. In another example, the user may have instructed an Oven to start and microwave a cake for 10 minutes. After 10 minutes, the oven may start providing notifications to the user about the completion of cake. However, the user may want the cake to cool down for a bit and may be annoyed with repetitive notifications from its oven. Hence, the available systems do not identify the importance of missed events to a user and accordingly, decide whether to provide notifications to the user.
  • TV smart television
  • the smart TV is turned on and start playing TV show "FRIENDS” on Netflix.
  • the smart TV starts providing notifications to the user about the start of TV show.
  • the user may have guests to attend and may get irritated with
  • FIG. 2 illustrates method-operations according to an embodiment of the disclosure.
  • the subject matter refers to a method for managing a notification for missed events in an IoT environment.
  • a method 200 comprises determining, at operation 201, at least one missed event in response to a user command to an IoT appliance after an expiry of a threshold wait time.
  • the appliance waits for a threshold wait time expecting the user to attend the appliance, after which it decides if user has missed the event. If the user attends the appliance till the threshold wait time, the method 200 terminates. However, if the user does not attend the appliance till the threshold wait time, it is detected as a missed event case.
  • the method 200 comprises receiving the user command for instructing the IoT appliance to execute the instruction, such as instructing an oven to bake cake for 10 minutes. Then, the instruction is executed to obtain at least one event as a result of the execution based on the received user command. In an example, the event being baking of the cake. Then, the appliance waits for the user to attend the at least one event for the threshold wait time. If the user does not attend to the at least one event within the threshold wait time, then it is determined that the event is missed. In other words, the at least one missed event is determined after the expiry of the threshold wait time.
  • the threshold wait time may be determined based on the processing of the user command. Also, the threshold wait time is specific to a type of IoT appliance and a type of task executed by the IoT appliance. Hence, the threshold wait time may be specific to the appliance and task done. In other words, the threshold wait time is configurable and specific to the appliance and the task.
  • the user command may be converted in an expression format after the execution of the instruction. Below are few examples to convert the user command into expression format:
  • Model X car engine is idling
  • subject parameters may be extracted from the expression format.
  • the subject parameters may comprise a resultant output of the execution of the user command.
  • a context of a delay for the user to attend the at least one event based on the extracted subject parameters may be determined.
  • the context of delay may be determined using a database which may comprise the factors due to which users mostly delay in using or consuming the results of IoT tasks.
  • Model X car engine is idling
  • a time period for which the user's absence to attend the at least one event is acceptable may be obtained.
  • the obtained time period may correspond to the threshold wait time that is specific to the IoT appliance, and the type of task executed by the IoT appliance.
  • the time period may be obtained by querying to a search engine about a time required by the extracted subject parameter for completion of the context of the delay.
  • the search engine may provide a response about the queried required time, wherein the received response includes information about the time period.
  • the method 200 may provide a query to the search engine i.e. what is time taken by introduction and may get a result as 120 second.
  • the threshold wait time would be 120 seconds.
  • the method 200 may provide a query to the search engine i.e. "What is the time taken to reduce get edible rice temperature from 120 degree Celsius?' and may receive a result as 60 seconds. Hence, the threshold wait time would be 160 seconds.
  • the method 200 may provide a query to the search engine i.e. "What is the time taken by model X car engine for warm up” and may receive a result as 10 seconds. Hence, the threshold wait time would be 10 seconds.
  • the threshold wait time would be 0 seconds.
  • the method 200 comprises determining a plurality of attributes associated with at least one of appliance settings and environment properties after the detection of at least one missed event.
  • the plurality of attributes may be determined based on a processing of the user command to obtain an attribute report corresponding to the plurality of attributes respective to each of the IoT appliance.
  • the attribute report may describe nature and situation of the event which can determine the importance of attending it.
  • the attribute report may be obtained by extracting subject parameters and object parameters from the user command.
  • extracting subject parameters and object parameters form a user command:
  • each smart appliance has implemented an Appliance Understanding Interface which queries details about the task executed by the appliance.
  • the appliances return exclusive sets of attribute values describing the status of the appliance through its current settings, and of its inner-outer environment through the distinct properties of different components in the environment.
  • the attributes lead to understanding the nature of the task executed and how the task output importance may change over time. Thus, these attributes become decisive features to determine user's attention necessity towards task output.
  • the interface For every query, the interface generates dictionary report of attribute values.
  • the attribute report may be obtained based on the obtained plurality of attributes and the extracted subject parameters and object parameters.
  • Smart TV The importance of attending a content on TV at an instant majorly depends on the fact that it is a one-time show, or can be re-watched later with ease, like if recorded or app casted.
  • ATTRIBUTE VALUE Type All possible: Convection/OTG, etc.
  • Cooking Mode All possible: Re-heat, Sun dry, Microwave, etc.
  • Cooking Food All possible: Food dish like cake, rice, etc.
  • Self-Driving Car The importance of attending a parked Car at an instant majorly depends on the fact that it is not creating chaotic traffic for others nor has any security threat.
  • Smart Door The importance of attending an opened Door at an instant majorly depends on the fact that the opening does not invite any uninvited peep or security threat.
  • the method 200 comprises, at operation 205, predicting a requirement for notifying the user with respect to the determined at least one missed event based on the attribute report.
  • the attribute report is feed to a neural network as a dataset corresponding to the plurality of attributes respective to each of the IoT appliances to predict the requirement for notifying the user with respect to the determined at least one missed event.
  • datasets are created for each smart appliance by surveying user if their attention is required to attend missed IoT event in different scenarios. The different scenarios arise from different combination of values of the obtained attributes.
  • the dataset input features are these attributes, and the target variable is user attention necessity (yes or no). Feed forward neural networks are trained on these datasets which predicts user attention necessity.
  • the interface provides the feature values.
  • the method 200 comprises, at operation 207, managing the notification corresponding to the at least one missed event based on the predicted requirement for notifying the user. For example, if the user attention necessity towards attending the missed IoT event is predicted to be yes, the reminder is sent to the user. The user then attends the appliance. This case signifies that the value/ quality of the IoT output would have been deteriorated or diminished or endangered at a later time, so user needs to attend it at the present moment itself. However, if the user attention necessity towards attending the missed IoT event is predicted to be No, the user is not reminded. The user can continue with his current state, either free or busy, without any disturbance. The appliance is switched off or closed stopping wastage of resources. This case signifies that the value/ quality of the IoT output remains intact at a later time, so user need hurry to not attend it at the present moment itself.
  • a IoT device such as smart appliance A is in idle condition. Then, capability is checked for required processing planned on server. If it is found that the idle IoT device i.e. smart appliance A is capable of required processing then the sensor data processing is re-directed to Smart Appliance A.
  • the IoT system may be de-centralized, bringing all possible processing from cloud servers to the edge devices.
  • FIG. 3 illustrates a block diagram of a system for managing a notification for missed events in an IoT environment, according to an embodiment of the disclosure.
  • a system 300 may comprise a missed-event detection module 301 configured to determine, at least one missed event in response to a user command to an IoT appliance after an expiry of a threshold wait time.
  • the system 300 may further comprise a missed-event importance module 303 configured to determine a plurality of attributes associated with at least one of appliance settings and environment properties after the detection of at least one missed event based on a processing of the user command to obtain an attribute report corresponding to the plurality of attributes respective to each of the IoT appliance.
  • the system 300 may further comprise a prediction module 305 configured to predict a requirement for notifying the user with respect to the determined at least one missed event based on the attribute report.
  • the system 300 may also comprise an event notifying manager module 307 configured to manage, the notification corresponding to the at least one missed event based on the predicted requirement for notifying the user.
  • the system 300 may be configured to perform the method as discussed in respect to FIG. 2.
  • the various modules 301-307 may be a single processing unit or a number of units, all of which could include multiple computing units.
  • Modules 301-307 may be implemented as one or more microprocessors, microcomputers, microcontrollers, digital signal processors, central processing units, state machines, logic circuitries, and/or any devices that manipulate signals based on operational instructions.
  • the modules 301-307 may be configured to fetch and execute computer-readable instructions and data stored in a memory.
  • the modules 301-307 may include one or a plurality of processors.
  • one or a plurality of processors may be a general-purpose processor, such as a central processing unit (CPU), an application processor (AP), or the like, a graphics-only processing unit such as a graphics processing unit (GPU), a visual processing unit (VPU), and/or an AI-dedicated processor such as a neural processing unit (NPU).
  • processors control the processing of the input data in accordance with a predefined operating rule or artificial intelligence (AI) model stored in the non-volatile memory and the volatile memory.
  • the predefined operating rule or artificial intelligence model is provided through training or learning.
  • FIGS. 4A, 4B, 5A, 5B, 6A, 6B, 7A, and 7B illustrate various uses cases based on the present mechanism, according to various embodiments of the disclosure.
  • a user gave a command to smart TV to open at 7 pm and stream FRIENDS on NETFLIX.
  • the command is directed to the smart TV.
  • the smart TV started streaming FRIENDS.
  • a threshold wait time is determined to detect a missed event. For example, the threshold wait time is determined as 120 seconds. After 120 seconds, the user did not attend TV and a missed event is detected.
  • subject and object parameters are extracted as TV and FRIENDS, Netflix respectively. Also, a plurality of attributes (as shown below) are obtained.
  • the plurality of attributes Based on the plurality of attributes, it is predicted if the user attention is necessary. In this example, it is predicted that the user attention is not necessary. Hence, no reminder is sent to user. Similarly referring to FIG. 4B, the below plurality of attributes may be considered in determining that user shall not be notified:
  • the below plurality of attributes may be considered in determining that user shall be notified:
  • the below plurality of attributes may be considered in determining that user shall not be notified:
  • the below plurality of attributes may be considered in determining that user shall be notified:
  • necessity of user attention may be predicted based on plurality of attributes and accordingly reminder may be provided to user.
  • the disclosed techniques intelligently decide to give a reminder or not of the missed IoT event to the user.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • General Business, Economics & Management (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Telephonic Communication Services (AREA)
  • Alarm Systems (AREA)

Abstract

L'invention concerne un procédé et un système de gestion d'une notification pour des événements manqués dans un environnement de l'Internet des objets (IdO). Le procédé consiste à déterminer au moins un événement manqué en réponse à une commande d'utilisateur à un appareil IdO après la fin d'une période d'attente seuil, à déterminer une pluralité d'attributs associés à des réglages d'appareil et/ou à des propriétés d'environnement après la détection d'au moins un événement manqué sur la base d'un traitement de la commande d'utilisateur pour obtenir un rapport d'attribut correspondant à la pluralité d'attributs respectifs à chaque appareil IdO, à prédire une exigence pour envoyer une notification à l'utilisateur concernant le ou les événements manqués déterminés sur la base du rapport d'attribut, et à gérer la notification correspondant au ou aux événements manqués sur la base de l'exigence prédite de notification de l'utilisateur.
PCT/KR2022/021747 2021-12-30 2022-12-30 Procédé et système de gestion d'une notification pour des événements manqués dans un environnement ido WO2023128709A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US18/187,317 US20230224375A1 (en) 2021-12-30 2023-03-21 Method and system for managing a notification for missed events in an iot environment

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IN202111061908 2021-12-30
IN202111061908 2021-12-30

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/187,317 Continuation US20230224375A1 (en) 2021-12-30 2023-03-21 Method and system for managing a notification for missed events in an iot environment

Publications (1)

Publication Number Publication Date
WO2023128709A1 true WO2023128709A1 (fr) 2023-07-06

Family

ID=86999742

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2022/021747 WO2023128709A1 (fr) 2021-12-30 2022-12-30 Procédé et système de gestion d'une notification pour des événements manqués dans un environnement ido

Country Status (2)

Country Link
US (1) US20230224375A1 (fr)
WO (1) WO2023128709A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130252591A1 (en) * 2012-03-20 2013-09-26 Samsung Electronics Co., Ltd. Smart alarm
US20140223311A1 (en) * 2013-02-05 2014-08-07 Microsoft Corporation Threshold View
US20140372525A1 (en) * 2013-06-18 2014-12-18 Microsoft Corporation Smart notifications using a calendar
US20170013111A1 (en) * 2015-07-09 2017-01-12 Asustek Computer Inc. Intelligent notification device and intelligent notification method
US20200076637A1 (en) * 2018-08-30 2020-03-05 Samsung Electronics Co., Ltd. Method and apparatus for managing missed events

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130252591A1 (en) * 2012-03-20 2013-09-26 Samsung Electronics Co., Ltd. Smart alarm
US20140223311A1 (en) * 2013-02-05 2014-08-07 Microsoft Corporation Threshold View
US20140372525A1 (en) * 2013-06-18 2014-12-18 Microsoft Corporation Smart notifications using a calendar
US20170013111A1 (en) * 2015-07-09 2017-01-12 Asustek Computer Inc. Intelligent notification device and intelligent notification method
US20200076637A1 (en) * 2018-08-30 2020-03-05 Samsung Electronics Co., Ltd. Method and apparatus for managing missed events

Also Published As

Publication number Publication date
US20230224375A1 (en) 2023-07-13

Similar Documents

Publication Publication Date Title
WO2015041436A1 (fr) Procédé de gestion de droit de commande, dispositif client associé et dispositif maître associé
WO2016076540A1 (fr) Appareil électronique de génération de contenus de résumé et procédé associé
WO2015167180A1 (fr) Dispositif électronique et procédé à des fins de communication avec un contact de celui-ci
WO2018068533A1 (fr) Procédé et dispositif de détection de visage humain
WO2015020417A1 (fr) Procédé d'affichage et dispositif électronique associé
WO2010071269A1 (fr) Signal de requête d'un programme d'image, selon des sources d'entrée spécifiques basées sur une liste reçue, pour des dispositifs d'affichage externes
WO2015046899A1 (fr) Appareil d'affichage et procédé de commande d'appareil d'affichage
WO2018090465A1 (fr) Procédé et système de surveillance vidéo, et dispositif de surveillance
EP3472699A1 (fr) Procédé et dispositif électronique pour gérer des fonctionnalités d'applications
EP3138306A1 (fr) Dispositif électronique et procédé de fourniture de service d'appel vidéo d'urgence
WO2019137217A1 (fr) Procédé de saut de page dans un programme d'application, terminal et support de stockage
WO2016190652A1 (fr) Dispositif électronique, système de fourniture d'informations et procédé de fourniture d'informations associé
WO2021012481A1 (fr) Procédé et appareil de surveillance de performances de système, dispositif et support d'informations
EP3053348A1 (fr) Appareil de traitement et procédé de commande associé
EP4248619A1 (fr) Procédés et systèmes de commande d'opérations de dispositifs dans un environnement de l'internet des objets (ido)
WO2019184436A1 (fr) Procédé et appareil de diffusion sélective de vidéo, et support d'informations lisible par ordinateur
WO2018062974A1 (fr) Dispositif électronique et procédé de gestion de notifications associé
WO2023128709A1 (fr) Procédé et système de gestion d'une notification pour des événements manqués dans un environnement ido
WO2013027879A1 (fr) Dispositif de contenu et procédé de commande associé
WO2021206413A1 (fr) Dispositif, procédé et programme informatique pour réaliser des actions sur des dispositifs de l'ido
WO2020046044A1 (fr) Procédé et appareil de gestion d'évènements manqués
WO2018124464A1 (fr) Dispositif électronique et procédé de fourniture de service de recherche de dispositif électronique
WO2015122725A1 (fr) Procédé et appareil pour créer un groupe de communication
WO2020013579A1 (fr) Procédé et dispositif de récupération de contenu
WO2020105992A1 (fr) Procédé et système de prédiction de recommandations basées sur le contenu

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22916850

Country of ref document: EP

Kind code of ref document: A1