WO2021154011A1

WO2021154011A1 - Method and electronic device for delivering notification information in iot enabled environment

Info

Publication number: WO2021154011A1
Application number: PCT/KR2021/001160
Authority: WO
Inventors: Kaushik Das; Prakhar SHUKLA; Prabhat Mishra; Parnab Kumar CHANDA; Prateek Singh CHAUHAN; Nitin VISHWARI
Original assignee: Samsung Electronics Co., Ltd.
Priority date: 2020-01-29
Filing date: 2021-01-28
Publication date: 2021-08-05

Abstract

A method for delivering notification information by an electronic device is disclose. The method includes receiving at least one notification. The method includes determining a current context of a user and a historical data associated with the at least one notification. The method includes identifying at least one notification, determining notification information to be delivered to a user based on identified at least one notification, and transmitting notification information to at least one of IoT device with a delivery plan, so that IoT device delivers notification information to a user according to delivery plan.

Description

METHOD AND ELECTRONIC DEVICE FOR DELIVERING NOTIFICATION INFORMATION IN IOT ENABLED ENVIRONMENT

The present disclosure relates to electronic devices, and more specifically to a method and electronic device for delivering notification information in an IoT enabled environment.

Notifications in an electronic device convey a small amount of information regarding an event such as a text message, a missed call, an application update, an incoming call and the like, detected at the electronic device to a user. The small amount of information can be an initial line in the text message, a sender of the text message, a time of reception of the text message, an availability of the application update, an incoming call of a friend etc. The user may miss few notifications from the electronic device due to the presence of a large number of notifications in the electronic device and a consumption of large amount of time for sorting all the notifications. Further, when the user is not in proximity of the electronic device, the user may miss a few notifications in the electronic device. Therefore, the user may miss an important notification such as a notification of an email from a company head, a notification of a SMS message from the user’s mother, an incoming call of the friend and the like, etc when the important notification is among in the large number of notifications.

Consider the user opens a notification panel and accesses the notifications. The notifications may indicate the user to perform an action such as replying to the email, switch off a fan in a bedroom, and the like. The user may forget to perform the indicated action due to a mental inability or engagement in multiple activities. Thus, it is desired to provide a useful alternative.

Accordingly the embodiments herein provide a method for delivering notification informtion by an electronic device in an IoT enabled environment.

This method and electronic device is illustrated in the accompanying drawings, throughout which like reference letters indicate corresponding parts in the various figures. The embodiments herein will be better understood from the following description with reference to the drawings, in which:

Fig. 1 is a diagram illustrating an example of transmitting notification information to a user by an electronic device using an IoT device.

FIG. 2A is a block diagram of an electronic device according to an embodiment of the disclosure.

FIG. 2B is a specific block diagram of an electronic device 100 for delivering notification information in an Internet of Things (IoT) network 1000, according to an embodiment.

FIG. 3 illustrates an example scenario of notifying the incoming call received at the smartphone 200D to the user by the voice assistant 100, when the user missed to attend the incoming call, according to an embodiment.

FIG. 4A illustrates operations performed by the hardware components of the voice assistant 100 for notifying the information of the incoming call received at the smartphone 200D to the user, when the user missed to attend the incoming call, according to an embodiment.

FIG. 4B illustrates operations performed by the hardware components of the voice assistant 100 to inform the user of the incoming call information received from the smart phone 200D when the user misses an incoming call, following FIG. 4A.

FIG. 4C illustrates operations performed by the hardware components of the voice assistant 100 to inform the user of the incoming call information received from the smart phone 200D when the user misses an incoming call, following FIG. 4B.

FIG. 4D illustrates operations performed by the hardware components of the voice assistant 100 to inform the user of the incoming call information received from the smart phone 200D when the user misses an incoming call, following FIG. 4C.

FIG. 4E illustrates operations performed by the hardware components of the voice assistant 100 to inform the user of the incoming call information received from the smart phone 200D when the user misses an incoming call, following FIG. 4D.

FIG. 4F illustrates operations performed by the hardware components of the voice assistant 100 to inform the user of the incoming call information received from the smart phone 200D when the user misses an incoming call, following FIG. 4E.

FIG. 5 illustrates an example scenario of reminding the user to consume a medicine by the voice assistant 100, when the user missed to consume the medicine, according to an embodiment.

FIG. 6A illustrates operations performed by the hardware components of the voice assistant 100 to remind the user to take the medicine, when the user misses to take the medicine, according to an embodiment.

FIG. 6B illustrates operations performed by the hardware components of the voice assistant 100 to remind the user to take the medicine when the user does not take the medicine, according to an embodiment disclosed herein, following FIG. 6A.

FIG. 6C illustrates operations performed by the hardware components of the voice assistant 100 to remind the user to take the medicine when the user does not take the medicine, according to an embodiment disclosed herein, following FIG. 6B.

FIG. 6D illustrates operations performed by the hardware components of the voice assistant 100 to remind the user to take the medicine when the user does not take the medicine, according to an embodiment disclosed herein, following FIG. 6C.

FIG. 6E illustrates operations performed by the hardware components of the voice assistant 100 to remind the user to take the medicine when the user does not take the medicine, according to an embodiment disclosed herein, following FIG. 4D.

FIG. 7 illustrates an example scenario of delivering each portion of the information of an email received at the smartphone 200D by the voice assistant 100 based on the current context of the user and the historical data, according to an embodiment.

FIG. 8A illustrates operations performed by the hardware components of the voice assistant 100 to deliver each portion of the information of the email received at the smartphone 200D by the voice assistant 100 based on the current context of the user and the historical data, according to an embodiment.

FIG. 8B illustrates operations performed by the hardware components of the voice assistant 100 to deliver each portion of the information of the email received at the smartphone 200D by the voice assistant 100, following FIG. 8A.

FIG. 8C illustrates operations performed by the hardware components of the voice assistant 100 to deliver each portion of the information of the email received at the smartphone 200D by the voice assistant 100, following FIG. 8B.

FIG. 8D illustrates operations performed by the hardware components of the voice assistant 100 to deliver each portion of the information of the email received at the smartphone 200D by the voice assistant 100, following FIG. 8C.

FIG. 8E illustrates operations performed by the hardware components of the voice assistant 100 to deliver each portion of the information of the email received at the smartphone 200D by the voice assistant 100, following FIG. 8D.

FIG. 8F illustrates operations performed by the hardware components of the voice assistant 100 to deliver each portion of the information of the email received at the smartphone 200D by the voice assistant 100, following FIG. 8E.

FIG. 8G illustrates operations performed by the hardware components of the voice assistant 100 to deliver each portion of the information of the email received at the smartphone 200D by the voice assistant 100, following FIG. 8F.

FIG. 9 illustrates an example scenario of dynamically delivering each portion of the information of the email with the continuation filler by the voice assistant 100 based on the current context of the user, according to an embodiment.

FIG. 10 illustrates an example scenario of delivering the information of the SMS message and the email received at the smartphone 200D by the voice assistant 100 based on the current context of the user and the priority of each notification, according to an embodiment.

FIG. 11A illustrates operations performed by the hardware components of the voice assistant 100 to deliver the information of the SMS message and the email received at the smartphone 200D based on the current context of the user and the priority of each notification, according to an embodiment.

FIG. 11B illustrates operations performed by the hardware components of the voice assistant 100 to deliver the information of the SMS message and the email received at the smartphone 200D based on the current context of the user and the priority of each notification, according to an embodiment, following FIG. 11A.

FIG. 11C illustrates operations performed by the hardware components of the voice assistant 100 to deliver the information of the SMS message and the email received at the smartphone 200D based on the current context of the user and the priority of each notification, according to an embodiment, following FIG. 11B.

FIG. 11D illustrates operations performed by the hardware components of the voice assistant 100 to deliver the information of the SMS message and the email received at the smartphone 200D based on the current context of the user and the priority of each notification, according to an embodiment, following FIG. 11C.

FIG. 11E illustrates operations performed by the hardware components of the voice assistant 100 to deliver the information of the SMS message and the email received at the smartphone 200D based on the current context of the user and the priority of each notification, according to an embodiment, following FIG. 11D.

FIG. 11F illustrates operations performed by the hardware components of the voice assistant 100 to deliver the information of the SMS message and the email received at the smartphone 200D based on the current context of the user and the priority of each notification, according to an embodiment, following FIG. 11E.

FIG. 11G illustrates operations performed by the hardware components of the voice assistant 100 to deliver the information of the SMS message and the email received at the smartphone 200D based on the current context of the user and the priority of each notification, according to an embodiment, following FIG. 11F.

FIG. 12 is a flowchart illustrating a process of operating method of an electronic device according to an embodiment of the disclosure.

FIG. 13A is a flow diagram 2000 illustrating a method for delivering the notification information by the electronic device 100 in the IoT network 1000, according to an embodiment.

FIG. 13B is a flow diagram 2000 illustrating a method for delivering the notification information by the electronic device 100 in the IoT network 1000, according to an embodiment, following FIG. 13A.

FIG. 14 is a block diagram of an electronic device 1400 according to an embodiment of the disclosure.

This application is based on and claims priority to Indian Patent Application No. 1202041003991, filed on January 29, 2020, in the Indian Patent Office, the disclosure of which is incorporated by reference herein in its entirety.

According to an embodiment of the disclosure, an electronic device includes a communicator, a memory storing one or more instructions, and a processor configured to execute the one or more instructions stored in the memory to identify notification, provide notification information to be delivered to a user based on the notification, and transmit the notification information to at least one of IoT device (200) with a delivery plan using the communicator (130), so that the IoT device (200) delivers the notification information to the user according to the delivery plan.

The processor may be further configured to execute the one or more instructions to determine a current context of the user, determine a historical data related to the notification, and provide the notification information based on at least one of the notification, the current context of the user, or the historical data related to the notification.

The notification information may include at least one of the notification's sender, the notification's recipient, a time of receipt of the notification, or contents of the notification.

The current context of the user may be determined based on at least one of the user's current location, a current time, the at least one IoT device close to the user, at least one person close to the user, the user's current mood, the user's current activity or a situation requiring privacy.

The historical data related to the notification may include at least one of other previous notifications, activities performed by the user, routines of the user's daily activities, a location where each activity is performed, IoT device near to the user while the activity is being performed, user preferences, or user profiles.

The processor may be further configured to execute the one or more instructions to track whether the IoT device (200) has delivered the notification information to the user, determine at least one task related to the notification information when it is determined that the IoT device (200) has delivered the notification information to the user, track whether the at least one task has been performed, and transmit a reminder to the at least one of IoT device (200) so that the IoT device (200) delivers the reminder to the user, in response to determining that the at least one task has not been performed.

The at least one task may include an action to be performed by the user, and the at least one task is determined based on at least one of the notification, the current context of the user, or the historical data related to the notification.

The processor may be further configured to execute the one or more instructions to provide the delivery plan based on at least one of the notification, the current context of the user, the historical data related to the notification, or a priority of the notification.

The priority of the notification may be determined based on at least one of the notification's sender, the notification's recipient, a type of the notification, an importance of the notification or a relationship of the notification with the historical data related to the notification.

Tthe delivery plan may include information on at least one IoT device (200) identified among a plurality of IoT devices, and the identified at least one IoT device (200) is a device close to the user's current location at the time the notification is delivered to the user.

According to another embodiment of the disclosure, an operating method of an electronic device may include identifying notification, providing notification information to be delivered to a user based on the notification; and transmitting the notification information to at least one of IoT device with a delivery plan, so that the IoT device (200) delivers the notification information to the user according to the delivery plan.

These and other aspects of the embodiments herein will be better appreciated and understood when considered in conjunction with the following description and the accompanying drawings. It should be understood, however, that the following descriptions, while indicating preferred embodiments and numerous specific details thereof, are given by way of illustration and not of limitation. Many changes and modifications may be made within the scope of the embodiments herein without departing from the spirit thereof, and the embodiments herein include all such modifications.

The embodiments herein and the various features and advantageous details thereof are explained more fully with reference to the non-limiting embodiments that are illustrated in the accompanying drawings and detailed in the following description. Descriptions of well-known components and processing techniques are omitted so as to not unnecessarily obscure the embodiments herein. Also, the various embodiments described herein are not necessarily mutually exclusive, as some embodiments can be combined with one or more other embodiments to form new embodiments. The term “or” as used herein, refers to a non-exclusive or, unless otherwise indicated. The examples used herein are intended merely to facilitate an understanding of ways in which the embodiments herein can be practiced and to further enable those skilled in the art to practice the embodiments herein. Accordingly, the examples should not be construed as limiting the scope of the embodiments herein.

As is traditional in the field, embodiments may be described and illustrated in terms of blocks which carry out a described function or functions. These blocks, which may be referred to herein as managers, units, modules, hardware components or the like, are physically implemented by analog and/or digital circuits such as logic gates, integrated circuits, microprocessors, microcontrollers, memory circuits, passive electronic components, active electronic components, optical components, hardwired circuits and the like, and may optionally be driven by firmware and software. The circuits may, for example, be embodied in one or more semiconductor chips, or on substrate supports such as printed circuit boards and the like. The circuits constituting a block may be implemented by dedicated hardware, or by a processor (e.g., one or more programmed microprocessors and associated circuitry), or by a combination of dedicated hardware to perform some functions of the block and a processor to perform other functions of the block. Each block of the embodiments may be physically separated into two or more interacting and discrete blocks without departing from the scope of the disclosure. Likewise, the blocks of the embodiments may be physically combined into more complex blocks without departing from the scope of the disclosure.

Accordingly the embodiments herein provide a method for delivering notification information by an electronic device in an IoT enabled environment. The method includes receiving, by the electronic device, at least one notification. Further, the method includes determining, by the electronic device, a current context of a user and a historical data associated with the at least one notification. Further, the method includes determining, by the electronic device, at least one portion of information of the at least one notification to be delivered to the user based on the at least one notification, history data associated with the at least one notification and the current context of the user. Further, the method includes creating, by the electronic device, a delivery plan for delivering the at least one portion of the notification information. Further, the method includes delivering, by the electronic device, the at least one portion of the notification information based on the delivery plan.

Unlike existing methods and systems, the electronic device dynamically generates a delivery plan to deliver the notification information (e.g. a Short Message Service (SMS) message) based on the current context (e.g. a current location, a current user activity) of the user and a priority (i.e. importance) of the notification. The electronic device identifies a nearby IoT device which is capable to delivering the notification information based on the current context of the user. Further, the electronic device delivers the notification information through the nearby IoT device and ensures that the user receives the notification information. Further, the electronic device reminds the user to perform an action intended in the notification to be done by the user, which improves a user experience in using the IoT devices in the IoT network.

Referring now to the drawings, and more particularly to FIGS. 1 through 14, there are shown preferred embodiments

Referring to FIG. 1, the electronic device 100 may receive a notification from the outside through a wired or wireless communication network. For example, the electronic device 100 may receive an email or text message from an external server or an external terminal. Alternatively, the electronic device 100 may generate a predetermined notification from the electronic device 100 itself. For example, the electronic device 100 may generate a notification such as announcing a reservation date set in advance by a user or a preset time. Alternatively, when a program or app installed in the electronic device 100 needs to be updated, a notification about the app update may be generated in the electronic device 100.

The electronic device 100 may generate notification information to be delivered to the user based on the notification. The electronic device 100 may transmit notification information to the user through the Iot device 200. To this end, the electronic device 100 may establish a delivery plan to deliver notification information. The electronic device 100 may establish a delivery plan in consideration of the nature of the notification, a current context of the user, and a history related to the notification. The electronic device 100 may transmit the delivery plan and notification information to the IoT device 200. The electronic device 100 may identify one or a plurality of Iot devices among the plurality of iot devices 200. For example, the electronic device 100 may identify one or more iot devices located near the current user. The electronic device 100 may transmit notification information and a delivery plan to the identified IOT device. The electronic device 100 may control the identified IoT device so that the identified IoT device transmits notification information to the user according to a delivery plan.

FIG. 2A is a block diagram of an electronic device according to an embodiment of the disclosure. Referring to FIG. 2A, the electronic device 100 according to an embodiment of the disclosure may include a processor 110, a memory 12, and a communicator 130.

The electronic device 100 may be any of various electronic devices capable of transmitting a notification information to an IoT device 200.

In an embodiment of the disclosure, the electronic device 100 may be fixed or mobile. The electronic device 100 may include at least one of, but is not limited to, a voice assistant, a desktop, a digital TV, a smartphone, a tablet personal computer (PC), a mobile phone, a videophone, an e-book reader, a laptop PC, a netbook computer, a digital camera, a personal digital assistant (PDA), a portable multimedia player (PMP), a camcorder, a navigation system, a wearable device, a smart watch, a home network system, a security system, a medical device, or any other device which may transmit a notification information to an IoT device 200.

In an embodiment of the disclosure, the memory 120 according to an embodiment of the disclosure may store at least one instruction. The memory 120 may store at least one program executed by the processor 110. Also, the memory 120 may store data input to the electronic device 100 or output from the electronic device 100. The memory 120 may include at least one type of storage medium of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., an SD or XD memory), a random-access memory (RAM), a static random-access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable ROM (EEPROM), a programmable ROM (PROM), a magnetic memory, a magnetic disk, or an optical disk.

In an embodiment of the disclosure, the communicator 130 may communicate with external devices through a wired and/or wireless network. In detail, the communicator 130 may transmit to and/or receive a signal from an external device connected through the wired and/or wireless network under the control of the processor 110. Examples of the external device may include a terminal, a server, a server system, and a server-based device capable of processing data transmitted/received through the communicator 130. The communicator 130 may include at least one communication module. The at least one communication module may include a communication module capable of transmitting and/or receiving data through a network according to a communication standard.

The processor 110 controls an overall operation of the electronic device 100. The processor 110 may control the electronic device 100 to perform a function, by executing at least one instruction stored in the memory 120.

FIG. 2B is a specific block diagram of an electronic device 100 for delivering notification information in an Internet of Things (IoT) network 1000, according to an embodiment. In an embodiment, the IoT network 1000 may refer to an environment whereIoT devices can communicate. In an embodiment, the IoT network 1000 includes the electronic device 100 and at least one IoT device 200, where the IoT devices are connected to the electronic device 100 by wire or wirelessly. Examples for the electronic device 100 are, but not limited to a smart phone, a tablet computer, a personal computer, a desktop computer, a personal digital assistance (PDA), a multimedia device, an IoT device, a voice assistant or the like.

In an embodiment, the electronic device 100 includes a processor 110, a memory 120 and a communicator 130, where the processor 110 is coupled to the memory 120. The processor 110 is configured to execute instructions stored in the memory 120. In an embodiment, the processor 110 includes a notification and event engine 111, a context engine 112, a historical data determiner 113, a user activity determiner 114, an information delivery engine 115, a delivery plan engine 116 and a priority determiner 117.

In an embodiment, the memory 120 includes a context knowledge database 121, a historical knowledge database 122 and a delivery ontology database 123, where the delivery ontology database 123 includes a delivery ontology model. The memory 120 may include non-volatile storage elements. Examples of such non-volatile storage elements may include magnetic hard discs, optical discs, floppy discs, flash memories, or forms of an Electrically Programmable Memory (EPROM) or an Electrically Erasable and Programmable Memory (EEPROM).In addition, the memory 120 may, in some examples, be considered a non-transitory storage medium. The term “non-transitory” may indicate that the storage medium is not embodied in a carrier wave or a propagated signal. However, the term “non-transitory” should not be interpreted that the memory 120 is non-movable. In some examples, the memory 120 can be configured to store larger amounts of information than the memory 120. In certain examples, a non-transitory storage medium may store data that can, over time, change (e.g., in Random Access Memory (RAM) or cache).

The communicator 130 is configured to communicate internally between hardware components in the electronic device 100. Further, the communicator 130 is configured to facilitate the communication between the electronic device 100 and the at least one IoT device 200A using communication techniques such as Bluetooth, ZigBee, Near Field Communication (NFC), etc. Further, the communicator 130 is configured to facilitate the communication between the electronic device 100 and an electronic device (not shown) of other users.

The processor 110 is configured to receive at least one notification. Examples for the notification are, but not limited to an indication of a received a Short Message Service (SMS) message, an indication of a received instant message, an indication of a received email, an indication of a missed call, an indication of an incoming call, an indication of a received multimedia message, a calendar notification, preset time notification, an update available to an application and the like. In an embodiment, the notification and event engine 111 receives the at least one notification. Further, the notification and event engine 111 determines notification information of the at least one notification. The notification information includes at least one of a sender of the notification, a time of sending and receiving the notification, an intent of the notification, or contents of the notification. In an embodiment, the notification and event engine 111 receives the at least one notification from at least one IoT device 200 or electronic devices of other users. Further, the notification and event engine 111 parses the at least one notification to determine the notification information from the notification..

The processor 110 is configured to determine a current context of a user of the electronic device 100 and a historical data associated with the at least one notification. In an embodiment, the current context of the user is determined based on at least one of a current location of the user, a current time, the at least one IoT device 200 in the IoT network 1000 currently near to the user, at least one person currently near to the user, a current mood of the user, an activity currently being done by the user and a situation requiring privacy. The electronic device may consider whether privacy is required according to the user's location, for example, whether the user is in a personal space or an office. In an example, when the user is present at home, the user may like to view only personal messages and may not like to view official messages. Similarly, when the user is present at office, the user may like to view only the official messages and may not like to view personal messages.

In an embodiment, the notification and event engine 111 tracks a location information of the user, an information on the at least one another person or the at least one IoT device 200 near to the user and a video or audio of the user. Further, the context engine 112 uses the information tracked by the notification and event engine 111 and determines the current context. The context engine 112 determines the current context using the location information of the user, the information on the at least one person or the at least one IoT device 200 near to the user and the video or audio of the user.

The processor 110 detects the user's mood based on the type and/or contents of an app that the electronic device 100 is running. For example, the electronic device 100 may determine that the user feels good when the user runs a game app to play a game and continues to enter the next stage due to a high score. The processor 110 may determine the user's mood according to the genre or type of the video or audio that the user has watched or listened. For example, the processor 110 may determine that the user's mood is depressed when the user continues to listen only to sad music about the breakup using the electronic device 100. Further, the context knowledge database 121 stores contextual information including the current context of the user and current location data of at least one IoT device 200.

In an embodiment historical data determiner 113 determines the historical data associated with the at least one notification. Further, the historical knowledge database 122 stores the historical data associated with the at least one notification. In an embodiment, the historical data associated with the at least one notification includes an information of another notification received, a user profile, an activity performed by the user, a daily activity routine of the user, a location where each activity performed, an IoT device near to the user while the activity performed and a user preference. In an embodiment, the user profile may include information associated with the user such as age of the user, weight of the user, height of the user, health condition of the user, gender of the user, the user’s work place, the user’s hometown, and the number of family members, etc. In an embodiment, the user preference includes a preferred IoT device, a preferred location, a preferred app, a preferred time and a preferred person.

The processor 110 is configured to determine at least one portion of information of the at least one notification based on the at least one notification, the current context of the user and the historical data associated with the at least one notification. In an embodiment, the notification information includes a message in the notification, a sender of the notification, a time at which the notification is sent or received, an intent or contents of the message in the notification. The information delivery engine 115 delivers the at least one portion of the at least one notification information based on the at least one notification, the current context of the user and the historical data associated with the at least one notification. In an embodiment, the information delivery engine 115 delivers the at least one portion of the at least one notification information based on the contextual information retried form the context knowledge database 121 and the historical data associated with the at least one notification. In an embodiment, the at least one portion of the notification information information is delivered using at least one IoT device 200 located in vicinity of the user.

In another embodiment, the processor 110 is configured to determine at least one task related to the at least one notification based on the current context of the user and the historical data associated with the at least one notification. In an embodiment, the at least one task includes at least one action needs to be performed by the user as indicated in the notification. In an example scenario, “consuming medicine after supper and setting alarm for 6 AM before sleeping” are tasks, where “consuming medicine” and “setting alarm for 6 AM” are the actions in the task which the user needs to perform. In an embodiment, the at least one task related to the at least one notification is determined based on the notification information. In an embodiment, the user activity determiner 114 determines the at least one task related to the at least one notification. The processor 110 is configured to create a delivery plan for delivering the at least one portion of the notification information information. In an embodiment, the at least one portion of the notification information may be related to the at least one task. In an embodiment, the delivery plan engine 116 creates the delivery plan for delivering the at least one portion of the notification information information.

The delivery plan includes one or more delivery modes to deliver the at least one portion of the notification information information, wherein a delivery mode comprises at least one tracking procedure to track a status of delivery of the at least one portion of the notification information information that is in progress and to re-attempt the delivery of the at least one portion of the notification information in response to detecting that the delivery of the at least one portion of the notification information to the user is incomplete, and at least one tracking follow-up procedure to follow-up with the user after the delivery of the at least one portion of the at least one notification information.

In an embodiment, the context engine 112 checks whether the notification information being delivered has any prior context or not. When the information has no prior context, the delivery plan engine 116 may generate the delivery plan with one mode called a regular delivery mode. When the notification information has the prior context, the delivery plan engine 116 may generates delivery plan with two delivery modes called as the regular delivery mode and a special delivery mode. For example, when the user misses an incoming call and the context engine 112 cannot finds the prior context with the missed call, then the delivery plan engine 116 may generates the delivery plan with the regular delivery mode, where the information delivery engine 115 may deliver a regular missed call notification. But, when the context engine 112 finds the prior context to the missed call, the delivery plan engine 116 may generates the delivery plan in two modes: the regular delivery mode and the special delivery mode. In the regular delivery mode. The information delivery engine 115 may deliver the regular missed called notification. Also, in the special delivery mode, the information delivery engine 115 may deliver the information of the missed call notification based on different delivery rules.

Each delivery rule is associated with the information to be delivered or an action to be taken by the information delivery engine 115 and a tracking procedure to track change in the user context or the IoT device context. In an embodiment, the delivery plan engine 116 generates at least one delivery rule based on at least one of the at least one notification, the current context of the user, the historical data of the at least one notification, and a priority of the at least one notification. Further, the delivery plan engine 116 creates the delivery plan for delivering the at least one portion of the notification information based on the at least one delivery rule.

In another embodiment, the delivery plan engine 116 generates at least one delivery rule based on the at least one task and a priority of the notification information under the special delivery mode. In an embodiment, the at least one task includes a set of activities to be performed by the user, and/or an activity currently performed by the user.

In an embodiment, the delivery plan engine 116 generates the at least one delivery rule using the historical data and various possible context of the user.

Each delivery rule may include a tracking procedure during the delivery of the at least one portion of the notification information information, or a tracking procedure to follow-up with the user after delivering the notification information. The notification and event engine 111 tracks the delivery of the at least one portion of the notification information information according to the delivery rule.

The priority determiner 117 determines the priority of the at least one notification based on at least one of a sender of the notification, a recipient of notification, a type of the notification, a criticality of the notification and a relationship of the notification with the historical data associated with the notification. In an example scenario, a notification of a message from the boss may be prioritized by the priority determiner 117 over the notification of a message from a team member. Further, the notification of a message from team member may be prioritized by the priority determiner 117 over the notification of a message from the mother. Further, the notification of a message from the mother may be prioritized by the priority determiner 117 over the notification of a message from a friend. Examples for the type of the at least one notification are, but not limited to a message notification, a call notification, a low battery notification from the IoT device 200, a personal email notification, an official meeting notification, a notification of an advertisement and the like. For example, suppose the content of messages received by the user are “Tell my boss that I am on vacation” and “Tell mom that I am on my way”. In the message “Tell my boss that I am on vacation” the recipient to receive the message is “my boss”. In the message “Tell mom that I am on my way” the recipient to receive the message is “mom”. Therefore, the message “Tell my boss that I am on vacation” is prioritized by the priority determiner 117 based on the recipient of the notification, where the message related to official matters may have higher priority. In an example scenario, one notification received by the user is related to a doctor consultation and other notification received by the user is related to an advertisement. The priority determiner 117 prioritizes the notification related to the doctor consultation over the notification related to advertisement. Similarly, priority may be given to notifications related to personal financial transactions than to advertisements.

The delivery ontology database 123 stores the at least one delivery rule. Each delivery rule may be stored as a template at the delivery ontology database 123. In an embodiment, the at least one delivery rule defines a condition for which the at least one delivery rule is applicable and the action needs to be performed when the condition is satisfied.

In an example scenario, the delivery rules which are created for delivery of the information is given below:

When: after user <wakes up>

What: deliver <message> and track user actions.

How: using <bedroom speaker>

Example for the set of trackers and corresponding handler functions are given below:

Tracker: Track if user <leaves the bed room>

Handler function: stop message delivery and update next part of information to be delivered, if any.

In an example scenario, the delivery rules which are created for follow-up is given below:

When: after delivering SMS <reminding to take medicine>

What: track <user actions to check if he takes medicine>

where, the delivery rules are mapped to a set of trackers and corresponding handler functions. Example for the set of trackers and corresponding handler functions are given below:

Tracker: Track if user <opens medicine box> and is <near medicine box>

Handler function: <Remind> user to <take medicine> after <30 minutes> using <Bixby speaker> (if medicine is not taken)

The delivery plan engine 116 creates the delivery plan for delivering the at least one portion of the notification information information based on the at least one delivery rule.

In another embodiment, the delivery plan engine 116 fetches the current context of the user and the historical data associated with the at least one notification from the context knowledge database 121 and the historical knowledge database 122 respectively. Further, the delivery plan engine 116 dynamically creates the delivery plan for delivering the at least one portion of the notification information based on the current context of the user and the historical data associated with the at least one notification.

The notification and event engine 111 detects an event in response to detecting an action of the user, a user input from the user, a reception of the at least one notification and a change in a circumstantial event. Examples for the circumstantial event is, but not limited to an entry of another person to user’s home, a power loss or connection loss occurred at the IoT device 200, a capability of the IoT device to deliver the information to the user, and the like. The context engine 112 determines the current context considering the event. Further, the delivery plan engine 116 dynamically modifies the delivery plan by updating the trackers and the handler functions based on the event.

The processor 110 is configured to deliver the at least one portion of the notification information based on the delivery plan. In an embodiment, the information delivery engine 115 delivers the at least one portion of the notification information based on the delivery plan. The information delivery engine 115 tracks a status of delivery of the at least one portion of the notification information that is in progress. Further, the information delivery engine 115 re-attempts the delivery of the at least one portion of the information in response to detecting that the delivery of the at least one portion of the information to the user is incomplete. In an embodiment, the delivery plan is updated while the delivery of the at least one portion of the information is in progress based on the current context of the user, and a current context of the electronic device 100 and the at least one IoT device 200 for re-attempting the delivery of the at least one portion of the information. The information delivery engine 115 performs least one tracking follow-up procedure to follow-up with the user after the delivery of the at least one portion of information of the at least one notification. In another embodiment, the information delivery engine 115 delivers the at least one portion of the notification information based on appropriate delivery rule picked up from the delivery plan.

The processor 110 is configured to determine the at least one action to be performed by the user based on the at least one delivered portion of the notification information. In an embodiment, the user activity determiner 114 determines the at least one action needs to be performed by the user based on the at least one portion of the notification information.

The processor 110 is configured to track whether the user has performed the at least one action based on at least one tracking follow-up procedure specified in the delivery plan. In an embodiment, the notification and event engine 111 tracks the user’s action, and the notification and event engine 111 or/and the context engine 112 determines whether the user has performed the at least one action based on the at least one tracking follow-up procedure specified in the delivery plan.

The processor 110 is configured to deliver a reminder to the user, in response to determining that the user has not performed the at least one action. In an embodiment, the reminder indicates the user to perform complete tasks related to the notification. In an embodiment, the reminder may be delivered in the form of a voice response, a text, an image, a video and the like. In an embodiment, the information delivery engine 115 generates the reminder for the user, in response to determining that the user does not perform the at least one action. Further, the information delivery engine 115 determines the time interval for delivering the reminder based on the contextual information. Further, the information delivery engine 115 delivers the reminder to the user after each time interval.

The processor 110 is configured to terminate a delivery of the reminder to the user, in response to determining that the user performs the at least one action. In an embodiment, the information delivery engine 115 terminates generating the reminder and delivery of the reminder, in response to determining that the user performs the at least one action. In another embodiment, information delivery engine 115 terminates the step of generating the reminder and delivery of the reminder to the user based on a user input to discontinue the follow-up. A voice query of the user an example for the user input.

In an embodiment, the reminder is delivered using at least one IoT device 200 in the IoT network 1000 located in vicinity of the user.

Although the FIG. 1 shows the hardware components of the electronic device 100 but it is to be understood that other embodiments are not limited thereon. In other embodiments, the electronic device 100 may include less or more number of components. Further, the labels or names of the components are used only for illustrative purpose and does not limit the scope of the application. One or more components can be combined together to perform same or substantially similar function for delivering the notification information.

In following example scenarios, a voice assistant operates as the electronic device 100 and the smartphone operates as an IoT device 200D.

FIG. 3 illustrates an example scenario of notifying the incoming call received at the smartphone 200D to the user by the voice assistant 100, when the user missed to attend the incoming call, according to an embodiment . The voice assistant 100 includes the speaker (not shown) to provide the response to the user. Further, the voice assistant 100 includes a mic (not shown) to receive the voice query of the user. The voice assistant 100 tracks the current location of the user and the current activity of the user based on a motion sensor data generated due to the user activity. The voice assistant 100 is connected to the smartphone 200D. The voice assistant 100 is configured to control the smartphone 200D and access the smartphone 200D to determine the notification information received at the smartphone 200D.

Consider, the smartphone 200D receives (301) the SMS message from Arthur on Saturday. The voice assistant 100 retrieves the information in the SMS message includes the sender of the SMS message and the intent of the SMS message. The voice assistant 100 determines “Arthur” as the sender of the SMS message and “Arthur will call the user on Monday morning for reminding to carry the cheque” as the intent of the SMS message. Further, the voice assistant 100 creates the delivery plan for the regular delivery of the incoming call, where displaying the name and contact number of Arthur and playing a ringtone for the incoming call is the delivery plan for the regular delivery. Further, the voice assistant 100 stores the information of the SMS message.

Consider, the user is bathing (302) in a bathroom on a Monday morning. The smartphone 200D and the voice assistant 100 are kept in a bedroom. The voice assistant 100 detects that the smartphone 200D is present in the bedroom based on a strength of a wireless signal from the smartphone 200D. Further, the voice assistant 100 detects that the user is bathing in the bathroom based on the motion sensor data generated during bathing. The context knowledge database 121 stores the current location details of the user and the smartphone 200D.

Consider, the voice assistant 100 does not have any existing plan for a missed call notification of Arthur. Consider, the smartphone 200D receives (303) the incoming call from Arthur while the user is bathing. The voice assistant 100 performs the regular delivery of the incoming call, in response to receiving the call. However, the user is unavailable to attend the incoming call. Further, the voice assistant 100 detects the missed call notification generated at the smartphone 200D after an incoming call session. The voice assistant 100 determines the historical data of the missed call notification, where the historical data of the missed call notification is the information in the SMS message. Further, the voice assistant 100 retrieves the contextual information of the missed call notification, where the contextual information includes the current location details of the user and the smartphone 200D.

Further, the voice assistant 100 updates the delivery plan by creating the special delivery, where that special delivery is created by referring to the delivery ontology database 123 and using the historical data of the missed call notification. Consider, the user asks to the voice assistant 100 regarding the incoming call due to hearing the ringtone. The notification and event engine 111 detects (304) the voice query “Hello, who called me” from the user. The voice assistant 100 delivers (305) the historical data of the missed call notification based on the delivery plan, in response to receiving the voice query. Further, the voice assistant 100 asks to the user for replying to Arthur that the user will carry the cheque.

Consider, the user provides confirmation to the voice assistant 100 to reply to Arthur that the user will carry the cheque. Further, the voice assistant 100 detects (306) the user confirmation. Further, the voice assistant 100 replies (307) to Arthur that the user will carry the cheque by sending the SMS message based on the delivery plan. Further, the voice assistant 100 updates the delivery plan by modifying the special delivery by referring to the delivery ontology database 123. Consider, the user comes out from the bathroom to the bedroom. The voice assistant 100 detects (308) that the user comes out from the bathroom to the bedroom. The voice assistant 100 provides (309) the reminder to the user to carry the cheque based on the delivery plan, in response to detecting the presence of the user in the bedroom.

FIG. 4A illustrates operations performed by the hardware components of the voice assistant 100 for notifying the information of the incoming call received at the smartphone 200D to the user, when the user missed to attend the incoming call, according to an embodiment . The voice assistant 100 includes the speaker (not shown) to provide the response to the user. Further, the voice assistant 100 includes the mic (not shown) to receive the voice query of the user. The voice assistant 100 tracks the current location of the user and the current activity of the user based on the motion sensor data generated due to the user activity. The voice assistant 100 is connected to the smartphone 200D. The voice assistant 100 is configured to control the smartphone 200D and access the smartphone 200D to determine the notification information received at the smartphone 200D.

Consider, the smartphone 200D receives (401) the SMS message from on Saturday. The notification and event engine 111 parses (402) the SMS message to retrieve the information in the SMS message includes the sender of the SMS message and the intent of the SMS message. The notification and event engine 111 determines “Arthur” as the sender of the SMS message and “Arthur will call the user on Monday morning for reminding to carry the cheque” as the intent of the SMS message.

Consider, the delivery plan engine 116 does not have any existing plan of the SMS message. Further, the historical knowledge database 122 does not store any historical data of the SMS message and the contextual knowledge database 121 does not store the contextual information. The information delivery engine 115 checks (403) for availability of existing delivery plans of the SMS message. The information delivery engine 115 refers (404) to the historical knowledge database 122 for determining the availability of the historical data of the SMS message and the contextual knowledge database 121 for determining the availability of the contextual information, in response to determining that the existing delivery plans are unavailable. The information delivery engine 115 detects (405) that the historical data of the SMS message and the contextual information is unavailable.

Further, the delivery plan engine 116 creates (406) the delivery plan for the regular delivery of the incoming call, where displaying the name and contact number of Arthur and playing a ringtone for the incoming call is the delivery plan for regular delivery. Further, the historical knowledge database 122 stores (407) the information of the SMS message.

Consider, the user is bathing (408) in the bathroom on Monday morning. The smartphone 200D and the voice assistant 100 are kept in the bedroom. The context engine 112 detects that the smartphone 200D is present in the bedroom based on the strength of wireless signal from the smartphone 200D. Further, the context engine 112 detects that the user is bathing in the bathroom based on the motion sensor data generated during bathing. The context knowledge database 121 stores the current location details of the user and the smartphone 200D.

Consider the delivery plan engine 116 does not have any existing plan for a missed call notification of Arthur. Consider, the smartphone 200D receives (409) the incoming call from Arthur while the user is bathing. The information delivery engine 115 performs (410) the regular delivery of the incoming call, in response to receiving the call. However, the user is unavailable to attend the incoming call. Further, the notification and event engine 111 detects (411) the missed call notification generated at the smartphone 200D after the incoming call session. The information delivery engine 115 checks (421) for the availability of any existing delivery plan for the missed call notification and the historical data of the missed call notification. The information delivery engine 115 detects (413) that the existing delivery plans are unavailable for the missed call notification. The information delivery engine 115 determines (414) the historical data of the missed call notification from historical knowledge database 122, where the historical data is the information in the SMS message. Further, the information delivery engine 115 retrieves the contextual information of the missed call notification from context knowledge database 121, where the contextual information includes the current location details of the user and the smartphone 200D.

Further, the delivery plan engine 116 updates (415) the delivery plan by creating the special delivery, where that special delivery is created by referring to the delivery ontology database 123 and using the contextual information and the historical data. The special delivery includes a first plan and a second plan. The information delivery engine 115 performs the first plan when the voice query regarding the incoming call is received by the voice assistant 100. While performing the first plan, the information delivery engine 115 notifies the user about the historical data of the missed call notification, asks to the user for sending a reply to Arthur, sends reply to Arthur upon a user’s confirmation and updates the delivery plan. The information delivery engine 115 performs the second plan when the user comes out from the bathroom to the bedroom. While performing the second plan, the information delivery engine 115 notifies the user about the historical data of the missed call notification and reminds the user to carry the cheque. Consider, the user asks to the voice assistant 100 regarding the incoming call due to hearing the ringtone. The notification and event engine 111 detects (416) the voice query “Hello, who calls me” from the user and this triggers a delivery rule from already create special delivery plan. The information delivery engine 115 performs (417) the first plan by delivering (418) the historical data of the missed call notification, in response to receiving the voice query.

Consider, the user provides confirmation to the voice assistant 100 to reply to Arthur that the user will carry the cheque. Further, the notification and event engine 111 detects (419) the user confirmation. Further, the information delivery engine 115 replies (420) to Arthur that the user will carry the cheque by sending the SMS message as per the first plan. Further, the delivery plan engine 116 updates (421) the delivery plan by modifying the special delivery by referring to the delivery ontology database 123 as per the first plan. Further, the special delivery plan includes a third plan. The information delivery engine 115 performs the third plan when the user comes out from the bathroom to the bedroom. The information delivery engine 115 reminds the user to carry the cheque for performing the third plan.

Consider, the user comes out from the bathroom into the bedroom. The notification and event engine 111 and/or context engine 112 detects (422) that the user comes out from the bathroom to the bedroom. The information delivery engine 115 performs (423) the third plan by providing (424) the reminder to the user to carry the cheque, in response to detecting the presence of the user in the bedroom.

FIG. 5 illustrates an example scenario of reminding the user to consume a medicine by the voice assistant 100, when the user missed to consume the medicine, according to an embodiment. The voice assistant 100 includes the speaker (not shown) to provide the response to the user. Further, the voice assistant 100 includes the mic (not shown) to receive the voice query of the user. The voice assistant 100 is connected to the smartphone 200D, the TV 200A and a medicine box 200E for determining the operation condition, where the medicine box 200E is the IoT device in the IoT network 1000. The voice assistant 100 tracks the current location of the user and the current activity of the user based on the motion sensor data generated due to the user activity. The smartphone 200D is connected to the TV 200A. The medicine box 200E contains the medicine of the user. . The voice assistant 100 is configured to control the smartphone 200D, TV 200A and the medicine box 200E. Further, the voice assistant 100 is configured to access the smartphone 200D to determine the notification information received at the smartphone 200D. The voice assistant 100 stores the user profile includes the age of the user.

Consider, the user is having the breakfast while watching the TV 200A in the dining room. The smartphone 200D and the voice assistant 100 are kept in the bedroom. The TV 200A is located in the dining room and the medicine box 200E located in the bedroom. The voice assistant 100 detects that the user is an aged person based on the user profile. The voice assistant 100 detects that the smartphone 200D is present in the bedroom based on the strength of the wireless signal from the smartphone 200D. The voice assistant 100 stores the current location details of the user, the TV 200A, the medicine box 200E and the smartphone 200D. The voice assistant 100 stores a medication routine of the user. Sometime the user forgets the medication after the breakfast. The historical knowledge database 122 notes and stores that the user sometime forgets the medication after the breakfast. The voice assistant 100 (501) detects that the user is having the breakfast while watching the TV 200A in the dining room based on the motion sensor data generated during eating food and the operating condition (i.e. switched on) of the TV 200A.

Consider, the smartphone 200D receives (502) the SMS message from the daughter while the user is having the breakfast and watching the TV 200A at the dining room. The TV 200A displays (503) the SMS message received at the smartphone 200D. Further, the voice assistant 100 determines that the regular delivery of the SMS message has been completed. The voice assistant 100 retrieves the information in the SMS message includes the sender of the SMS message and the intent of the SMS message. The voice assistant 100 determines “daughter” as the sender of the SMS message and “reminding the user about medication after breakfast” as the intent of the SMS message. Further, the voice assistant 100 stores the information in the SMS message.

The voice assistant 100 retrieves the historical data and the contextual information of the SMS message, where the contextual information includes the current activity of the user and the current location details of the user, the TV 200A, the medicine box 200E and the smartphone 200D.

Consider, the user reaches the bedroom after having the breakfast. The voice assistant 100 detects (504) that the user is available in the bedroom based on the motion sensor data. The voice assistant 100 initiates the tracker to check whether the user consumed the medicine after 30 minutes of coming to the bedroom after breakfast based on the operation condition of the medicine box 200E. Consider, the user forgets to consume the medicine after 30 minutes of coming to the bedroom after breakfast. The voice assistant 100 determines that the medicine box 200E is not opened even after 30 minutes of delivery of the SMS message at TV 200A. The voice assistant 100 detects (505) that the user missed to consume the medicine after 30 minutes. The voice assistant 100 initiates (506) the follow-up by sending the reminder to the user to consume the medicine, in response to detecting that the user has missed to consume the medicine even after 30 minutes of coming to the bedroom after breakfast. The voice assistant 100 continues the follow-up after every 30 minutes until the medicine box 200E is opened by the user.

FIG. 6A illustrates operations performed by the hardware components of the voice assistant 100 to remind the user to take the medicine, when the user misses to take the medicine, according to an embodiment. The voice assistant 100 includes the speaker (not shown) to provide the response to the user. Further, the voice assistant 100 includes the mic (not shown) to receive the voice query of the user. The voice assistant 100 is connected to the smartphone 200D, the TV 200A and a medicine box 200E for determining the operation condition, where the medicine box 200E is the IoT device in the IoT network 1000. The smartphone 200D is connected to the TV 200A. The medicine box 200E contains the medicine of the user. The voice assistant 100 tracks the current location of the user and the current activity of the user based on the motion sensor data generated due to the user activity. The voice assistant 100 is configured to control the smartphone 200D, TV 200A and the medicine box 200E. Further, the voice assistant 100 is configured to access the smartphone 200D to determine the notification information received at the smartphone 200D. The historical knowledge database 122 stores the user profile including the age of the user.

Consider, the user is having the breakfast while watching the TV 200A in the dining room. The smartphone 200D and the voice assistant 100 are kept in the bedroom. The TV 200A is located in the dining room and the medicine box 200E located in the bedroom. The context engine 112 detects that the user is an aged person based on the user profile. The context engine 112 detects that the smartphone 200D is present in the bedroom based on the strength of the wireless signal from the smartphone 200D. The context knowledge database 121 stores the current location details of the user, the TV 200A, the medicine box 200E and the smartphone 200D. The historical knowledge database 122 stores a medication routine of the user. Sometime the user forgets to take the medicine after the breakfast. The historical knowledge database 122 notes and stores that the user forgets the medicine after the breakfast. The context engine 112 detects (601) that the user is having the breakfast while watching the TV 200A in the dining room based on the motion sensor data generated during eating food and the operating condition (i.e. switched on) of the TV 200A.

FIG. 6B illustrates operations performed by the hardware components of the voice assistant 100 to remind the user to take the medicine when the user does not take the medicine, according to an embodiment disclosed herein, following FIG. 6A. Consider, the smartphone 200D receives (602) the SMS message from the daughter while the user is having the breakfast and watching the TV 200A at the dining room. The TV 200A displays (603) the SMS message received at the smartphone 200D.

FIG. 6C illustrates operations performed by the hardware components of the voice assistant 100 to remind the user to take the medicine when the user does not take the medicine, according to an embodiment disclosed herein, following FIG. 6B. Further, the information delivery engine 115 and/or the notification and event engine 111 detects (604) that the regular delivery of the SMS message has been completed. The notification and event engine 111 parses (605) the SMS message to retrieve the information in the SMS message includes the sender of the SMS message and the intent of the SMS message. The notification and event engine 111 determines “daughter” as the sender of the SMS message and “reminding the user about medication after breakfast” as the intent of the SMS message. Further, the historical knowledge database 122 stores (606) the information in the SMS message.

The information delivery engine 115 retrieves (607) the historical data of the SMS message from the historical knowledge database 122, where the historical data is the information in the SMS message and the medication routine of the user. Further, the information delivery engine 115 retrieves the contextual information of the SMS message from the context knowledge database 121, where the contextual information includes the current activity of the user and the current location details of the user, the TV 200A, the medicine box 200E and the smartphone 200D. Consider, the user reaches the bedroom after having the breakfast.

FIG. 6D illustrates operations performed by the hardware components of the voice assistant 100 to remind the user to take the medicine when the user does not take the medicine, according to an embodiment disclosed herein, following FIG. 6C. The notification and event engine 111 and/or context engine 112 detects (608) that the user reaches the bedroom after having the breakfast. Further, the delivery plan engine 116 creates (609) the delivery plan for the special delivery, where the special delivery is created by referring to the delivery ontology database 123 and using the historical data and the contextual information.

The special delivery includes initiating the tracker to detect the operation condition of the medicine box 200E. The tracker configures the information delivery engine 115to send the reminder to the user after every 30 minutes, when the medicine box is not opened. The tracker configures the information delivery engine 115 to stop reminding the user, when the medicine box is opened. The special delivery includes initiating the tracker to detect the user input to stop the reminder. The tracker configures the information delivery engine 115 to stop reminding the user, in response to detecting the user input to stop the reminder. Further, the delivery plan engine 116 initiates the tracker.

FIG. 6E illustrates operations performed by the hardware components of the voice assistant 100 to remind the user to take the medicine when the user does not take the medicine, according to an embodiment disclosed herein, following FIG. 6D. Consider, the user forgets to consume the medicine after 30 minutes of coming to the bedroom after breakfast. The context engine 112 determines that the medicine box 200E is not opened even after 30 minutes of coming to the bedroom after breakfast. The context engine 112 detects (610) that the user missed to consume the medicine after 30 minutes based on the operation condition of the medicine box 200E. The information delivery engine 115 starts (611) the follows up by sending the reminder to the user for consuming the medicine, in response to detecting that the user missed to consume the medicine after 30 minutes of coming to the bedroom after breakfast.

FIG. 7 illustrates an example scenario of delivering each portion of the information of an email received at the smartphone 200D by the voice assistant 100 based on the current context of the user and the historical data, according to an embodiment. The voice assistant 100 includes the speaker (not shown) to provide the response to the user. Further, the voice assistant 100 includes the mic (not shown) to receive the voice query of the user. The voice assistant 100 is connected to the smartphone 200D, the TV 200A and the fridge 200B for determining the operation condition. The fridge 200B includes the touch display to display a content (e.g. text, image etc.) and receive the user touch input.

The voice assistant 100 tracks the current location of the user and the current activity of the user based on the motion sensor data generated due to the user activity. The voice assistant 100 is configured to control the smartphone 200D, TV 200A and the fridge 200B. Further, the voice assistant 100 is configured to access the smartphone 200D to determine the notification information received at the smartphone 200D. The voice assistant 100 stores (701) the historical data includes the daily routine of the user, the time of each activity in the daily routine, the location at which the user performs each activity and a device near to the user while performing the activity.

Consider, the user is sleeping in the bedroom at night. The smartphone 200D and the voice assistant 100 are kept in the bedroom. The TV 200A is located in the dining room and the fridge 200B is located in kitchen. The voice assistant 100 determines that the user is sleeping in the bedroom and the time is night time. The voice assistant 100 stores the current context of the user. The voice assistant 100 detects that the smartphone 200D is present in the bedroom based on the strength of the wireless signal from the smartphone 200D. The voice assistant 100 stores the current location details of the user, the smartphone 200D, the TV 200A and the fridge 200B.

The voice assistant 100 detects (702) that the user is sleeping in the bedroom based on the motion sensor data. Consider, the smartphone 200D receives (703) the email from John while the user is sleeping. The notification and event engine 111 retrieves the information in the email includes the sender of the email and the intent of the email. The voice assistant 100 determines “John” as the sender of the email and “client meeting is scheduled for today at 4.30 PM at Malibu club and reminding the user to take case file” as the intent of the email. Further, the historical knowledge database 122 stores the information in the email.

The information delivery engine 115 performs the regular delivery of the email by configuring the smartphone 200D to display the email and provide the notification tone. However, the user is unavailable to view the email received at smartphone 200D. Further, the voice assistant 100 detects that the user missed to view the email.

The voice assistant 100 retrieves the historical data and the contextual information of the email, where the contextual information includes the current activity of the user and the current location details of the user, the TV 200A, the fridge 200B and the smartphone 200D.

Further, the voice assistant 100 creates the delivery plan for the special delivery of the email to the user, where that special delivery is created by referring to the delivery ontology database 123 and using the historical data and the contextual information.

Consider, the user wakes up at morning. The voice assistant 100 detects (704) that the user wakes up based on the motion sensor data. The voice assistant 100 notifies (705) to the user about the email received from John and starts delivering the information of the email based on the delivery plan, in response to detecting that the user wakes up. Consider, the user enters to the bathroom before completing the delivery of the information of the email by the voice assistant 100. The voice assistant 100 detects (706) that the user left the bedroom and went to the bathroom for bathing based on the motion sensor data. The voice assistant 100 suspends (707) the delivery of the information of the email, updates the remaining information of the email to be delivered to the user based on the delivery plan, in response to detecting that the user left the bedroom. Further, the voice assistant 100 checks whether the user reaches the kitchen.

Consider, the user reaches at the kitchen and opens the fridge 200B after the bathing. The voice assistant 100 detects (708) that the user reaches the kitchen and opens the fridge 200B based on the motion sensor data and the change in operation condition of the fridge 200B while opening the fridge 200D. The voice assistant 100 checks with the user to show the remaining information of the email on the TV 200A while having the breakfast at the dining room based on the delivery plan, in response to detecting that the user reaches the kitchen and opens the fridge 200B. The voice assistant 100 checks (709) with the user by displaying the query on the display of the fridge 200B. Consider, the user accept to show the remaining information of the email with a continuation filler on the TV 200A while having the breakfast at the dining room. The voice assistant 100 detects (710) the user confirmation to show the remaining information of the email on the TV 200A while having the breakfast at the dining room. Further, the voice assistant 100 configures the TV 200A to deliver the remaining message with the continuation filler based on the delivery plan, in response to receiving the user confirmation.

Consider, the user starts having breakfast and watching TV 200A at dining room after leaving the kitchen. The voice assistant 100 detects (711) that the user is watching the TV 200A while having breakfast in the dining room based on the ambience noise in the dining room and the change in the operation condition of the TV 200A (i.e. the TV 200A is switched on by the user). The voice assistant 100 displays (823) the remaining information of the email on the TV 200A based on the delivery plan, in response to detecting that the user is watching the TV 200A.

FIG. 8A illustrates operations performed by the hardware components of the voice assistant 100 to deliver each portion of the information of the email received at the smartphone 200D by the voice assistant 100 based on the current context of the user and the historical data, according to an embodiment. The voice assistant 100 includes the speaker (not shown) to provide the response to the user. Further, the voice assistant 100 includes the mic (not shown) to receive the voice query of the user. The voice assistant 100 is connected to the smartphone 200D, the TV 200A and the fridge 200B for determining the operation condition. The fridge 200B includes the touch display to display a content (e.g. text, image etc.) and receive the user touch input. The voice assistant 100 tracks the current location of the user and the current activity of the user based on the motion sensor data generated due to the user activity. The voice assistant 100 is configured to control the smartphone 200D, TV 200A and the fridge 200B. Further, the voice assistant 100 is configured to access the smartphone 200D to determine the notification information received at the smartphone 200D.

Consider, the user is sleeping in the bedroom at night. The smartphone 200D and the voice assistant 100 are kept in the bedroom. The TV 200A is located in the dining room and the fridge 200B is located in the kitchen. The context engine 112 determines that the user is sleeping in the bedroom and the time is night time. The context knowledge database 121 stores the current context of the user. The context engine 112 detects that the smartphone 200D is present in the bedroom based on the strength of the wireless signal from the smartphone 200D. The context knowledge database 121 stores the current location details of the user, the smartphone 200D, the TV 200A and the fridge 200B. The historical knowledge database 122 stores the historical data includes the daily routine of the user, the time of each activity in the daily routine, the location at which the user performs each activity and a device near to the user while performing the activity.

The context engine 112 detects (801) that the user is sleeping in the bedroom based on the motion sensor data generated during sleeping. Consider, the delivery plan engine 116 does not have any existing plan for special delivery of the email received from John, when the user missed to view the email of John.

FIG. 8B illustrates operations performed by the hardware components of the voice assistant 100 to deliver each portion of the information of the email received at the smartphone 200D by the voice assistant 100, following FIG. 8A. Consider, the smartphone 200D receives (802) the email from John while the user is sleeping. The notification and event engine 111 parses (803) the email to retrieve the information in the email includes the sender of the email and the intent of the email. The notification and event engine 111 determines “John” as the sender of the email and “client meeting is scheduled for today at 4.30 PM at Malibu club and reminding the user to take case file” as the intent of the email. Further, the historical knowledge database 122 stores (804) the information in the email.

The information delivery engine 115 performs (805) the regular delivery of the email by configuring the smartphone 200D to display the email and provide the notification tone. However, the user is unavailable to view the email received at smartphone 200D. Further, the notification and event engine 111 detects (806) that the user missed to view the email.

Further, the information delivery engine 115 detects (807) that the existing delivery plan for the special delivery of the email is unavailable. The information delivery engine 115 retrieves (808) the historical data from the historical knowledge database 122. Further, the information delivery engine 115 retrieves the contextual information of the email from the context knowledge database 121, where the contextual information includes the current activity of the user and the current location details of the user, the TV 200A, the fridge 200B and the smartphone 200D.

FIG. 8C illustrates operations performed by the hardware components of the voice assistant 100 to deliver each portion of the information of the email received at the smartphone 200D by the voice assistant 100, following FIG. 8B. Further, the delivery plan engine 116 creates (809) the delivery plan for the special delivery of the email to the user, where that special delivery is created by referring to the delivery ontology database 123 and using the historical data and the contextual information. The special delivery includes the first plan, the second plan, the third plan and a fourth plan. The information delivery engine 115 performs the first plan when the user wakes up. While performing the first plan, the information delivery engine 115 inform user about the email received from John. The information delivery engine 115 performs the second plan when the user left the bedroom and entered to the bathroom. While performing the second plan, the information delivery engine 115 suspends the delivery of the information in the email, update the remaining information of the email to be delivered to the user and checks whether user reaches the kitchen.

The information delivery engine 115 performs the third plan when the user reaches the kitchen and opens the fridge 200B. While performing the third plan, the information delivery engine 115 configures the fridge 200B to check with the user for showing the remaining information of the email on the TV 200A while the user is having the breakfast and configures the TV 200A to deliver remaining information of the email upon the user confirmation. The information delivery engine 115 performs the fourth plan when the user watches the TV 200A while having the breakfast at dining room. While performing the third plan, the information delivery engine 115 configures the TV 200A to display the remaining information of the email.

FIG. 8D illustrates operations performed by the hardware components of the voice assistant 100 to deliver each portion of the information of the email received at the smartphone 200D by the voice assistant 100, following FIG. 8C. Consider, the user wakes up at morning. The notification and event engine 111 and/or the context engine 112 detects (810) that the user wakes up based on the motion sensor data. The information delivery engine 115 performs (811) the first plan by notifying (812) the user about the email received from John and starts delivering the information of the email, in response to detecting that the user wakes up. Consider, the user enters to the bathroom before completing the delivery of the information of the email by the voice assistant 100.

FIG. 8E illustrates operations performed by the hardware components of the voice assistant 100 to deliver each portion of the information of the email received at the smartphone 200D by the voice assistant 100, following FIG. 8D. The notification and event engine 111 and/or the context engine 112 detects (813) that the user left the bedroom and went to the bathroom for bathing based on the motion sensor data. The information delivery engine 115 performs (814) the second plan by suspending (815) the delivery of the information of the email, updates the remaining information of the email to be delivered to the user, in response to detecting that the user left the bedroom. Further, the notification and event engine 111 checks whether the user reaches the kitchen as per the second plan.

FIG. 8F illustrates operations performed by the hardware components of the voice assistant 100 to deliver each portion of the information of the email received at the smartphone 200D by the voice assistant 100, following FIG. 8E. Consider, the user reaches at the kitchen and opens the fridge 200B after the bathing. The notification and event engine 111 detects (816) that the user reaches the kitchen and opens the fridge 200B based on the motion sensor data and the change in operation condition of the fridge 200B while opening the fridge 200D. The information delivery engine 115 performs (817) the third plan by checking with user to show the remaining information of the email on the TV 200A while having the breakfast at the dining room, in response to detecting that the user reaches the kitchen and opens the fridge 200B. The information delivery engine 115 checks (818) with the user by displaying the query on the display of the fridge 200B. consider, the user accept to show the remaining information of the email on the TV 200A while having the breakfast at the dining room. The notification and event engine 111 detects (819) the user confirmation to show the remaining information of the email on the TV 200A while having the breakfast at the dining room. Further, the information delivery engine 115 configures (820) the TV 200A to deliver the remaining message, in response to receiving the user confirmation.

FIG. 8G illustrates operations performed by the hardware components of the voice assistant 100 to deliver each portion of the information of the email received at the smartphone 200D by the voice assistant 100, following FIG. 8F. Consider, the user starts having breakfast and watching TV 200A at dining room after leaving the kitchen. The notification and event engine 111 detects (821) that the user is watching the TV 200A while having breakfast in the dining room based on the ambience noise in the dining room and the change in the operation condition of the TV 200A (i.e. the TV 200A is switched on by the user). The information delivery engine 115 performs (822) the fourth plan by displaying (823) the remaining information of the email on the TV 200A, in response to detecting that the user is watching the TV 200A.

FIG. 9 illustrates an example scenario of dynamically delivering each portion of the information of the email with the continuation filler by the voice assistant 100 based on the current context of the user, according to an embodiment. The voice assistant 100, TV 200A and the fridge 200B includes the speaker (not shown) to provide the response to the user. The voice assistant 100, TV 200A and the fridge 200B is located in the bedroom, dining room and the kitchen respectively. The voice assistant 100 is connected to the smartphone 200D, TV 200A and the fridge 200B. Further, the voice assistant 100 tracks the current location of the user and the current activity of the user based on the motion sensor data generated due to the user activity. The voice assistant 100 is configured to control the smartphone 200D, the TV 200A and the fridge 200B. Further, the voice assistant 100 is configured to access the smartphone 200D to determine the notification information received at the smartphone 200D.

Consider, the smartphone 200D receives the email from Arthur, where the “The meeting with Martin is scheduled for 4:30 pm today, at Malibu club” is the information in the email. The voice assistant 100 retrieves the information in the email by parsing the email. Consider, the user is walking from dining room to the kitchen. The voice assistant 100 detects that the presence of the user in the dining room based on the motion sensor data. The voice assistant 100 detects that the user is near to the TV 200A based on the motion sensor data. Further, the voice assistant 100 starts to deliver the information of email to the user through the TV 200A, until the presence of the user in detected in the dining room. Consider, the user reaches the kitchen.

The voice assistant 100 detects the presence of user in the kitchen based on the motion sensor data. The voice assistant 100 detects that the user is near to the fridge 200B based on the motion sensor data. Further, the voice assistant 100 continues to deliver the remaining information of email with continuation filler through the fridge 200B, until the presence of user in the kitchen.

FIG. 10 illustrates an example scenario of delivering the information of the SMS message and the email received at the smartphone 200D by the voice assistant 100 based on the current context of the user and the priority of each notification, according to an embodiment. The voice assistant 100 includes the speaker (not shown) to provide the response to the user. Further, the voice assistant 100 includes the mic (not shown) to receive the voice query of the user. The voice assistant 100 is connected to the smartphone 200D and the fridge 200B for determining the operation condition. The fridge 200B includes the touch display to display the content (e.g. text, image etc.) and receive the user touch input. The voice assistant 100 tracks the current location of the user and the current activity of the user based on the motion sensor data generated due to the user activity. The voice assistant 100 is configured to control the smartphone 200D and the fridge 200B. Further, the voice assistant 100 is configured to access the smartphone 200D to determine the notification information received at the smartphone 200D.

The voice assistant 100 stores (1001) the historical data includes the daily routine of the user, the time of each activity in the daily routine, the location at which the user performs each activity and a device near to the user while performing the activity. Consider, the user is sleeping in the bedroom at night. The smartphone 200D and the voice assistant 100 are kept in the bedroom. The fridge 200B is located in the kitchen. The voice assistant 100 determines that the user is sleeping in the bedroom and the time is night time. The voice assistant 100 stores the current context of the user. The voice assistant 100 detects that the smartphone 200D is present in the bedroom based on the strength of the wireless signal from the smartphone 200D. The voice assistant 100 stores the current location details of the user, the smartphone 200D, the fridge 200B.

The voice assistant 100 detects (1002) that the user is sleeping in the bedroom based on the motion sensor data. Consider, the smartphone 200D receives (1003) the email from the advertiser and the SMS from the mother while the user is sleeping. The voice assistant 100 parses the notifications to retrieve the information in each notification includes the sender of the notification and the intent of the notification. The voice assistant 100 determines “mother” as the sender of the SMS message and “mother will come to home by today” as the intent of the SMS message. The voice assistant 100 determines “advertiser” as the sender of the email and “MOVIE200 is the promocode to book movie ticket” as the intent of the email. The priority determiner 117 assigns high priority to the SMS message and low priority to the email based on the sender of the notifications. Further, the voice assistant 100 stores the information in the email.

The voice assistant 100 performs the regular delivery of the email by configuring the smartphone 200D to display the notifications and provide the notification tone. However, the user is unavailable to view the notifications received at smartphone 200D. Further, the voice assistant 100 detects that the user missed to view the notifications.

Further, the delivery plan engine 116 creates the delivery plan for the special delivery of the notification information to the user, where the special delivery is created by referring to the delivery ontology database 123 and using the contextual information and the historical data.

Consider, the user wakes up at morning. The voice assistant 100 detects (1004) that the user wakes up at morning based on the motion sensor data. The voice assistant 100 notifies (1005) the user about the email and the SMS message and starts delivering the information of the SMS message at first based on the delivery plan, in response to detecting that the user wakes up. Consider, the user left the bedroom and enters to the bathroom after completing the delivery of the information of the SMS message by the voice assistant 100. The voice assistant 100 detects (1006) that the user left the bedroom and went to the bathroom for bathing based on the motion sensor data.

The voice assistant 100 suspends (1007) the delivery of the notification information based on the delivery plan, in response to detecting that the user left the bedroom. Further, the voice assistant 100 checks whether the user reaches the kitchen. Consider, the user reaches the kitchen and opens the fridge 200B after the bathing. The voice assistant 100 detects (1008) that the user reaches the kitchen and opens the fridge 200B based on the motion sensor data and the change in operation condition of the fridge 200B while opening the fridge 200D. The voice assistant 100 checks (1009) with the user for showing the email of the advertiser, in response to detecting that the user opens the fridge 200B. The voice assistant 100 displays (1010) the information of the email on the display of the fridge 200B based on the delivery plan, in response to detecting that the user accepts to show the email of the advertiser.

FIG. 11A illustrates operations performed by the hardware components of the voice assistant 100 to deliver the information of the SMS message and the email received at the smartphone 200D based on the current context of the user and the priority of each notification, according to an embodiment. The voice assistant 100 includes the speaker (not shown) to provide the response to the user. Further, the voice assistant 100 includes the mic (not shown) to receive the voice query of the user. The voice assistant 100 is connected to the smartphone 200D and the fridge 200B for determining the operation condition. The fridge 200B includes the touch display to display the content (e.g. text, image etc.) and receive the user touch input. The voice assistant 100 tracks the current location of the user and the current activity of the user based on the motion sensor data generated due to the user activity. The voice assistant 100 is configured to control the smartphone 200D and the fridge 200B. Further, the voice assistant 100 is configured to access the smartphone 200D to determine the notification information received at the smartphone 200D.

Consider, the user is sleeping in the bedroom at night. The smartphone 200D and the voice assistant 100 are kept in the bedroom. The fridge 200B is located in the kitchen. The context engine 112 determines that the user is sleeping in the bedroom and the time is night time. The context knowledge database 121 stores the current context of the user. The context engine 112 detects that the smartphone 200D is present in the bedroom based on the strength of the wireless signal from the smartphone 200D. The context knowledge database 121 stores the current location details of the user, the smartphone 200D, the fridge 200B. The historical knowledge database 122 stores the historical data includes the daily routine of the user, the time of each activity in the daily routine, the location at which the user performs each activity and a device near to the user while performing the activity.

The context engine 112 detects (1101) that the user is sleeping in the bedroom based on the motion sensor data. Consider, the delivery plan engine 116 does not have any existing plan for special delivery of the email received from advertiser and the SMS message from the mother, when the user missed to view the notifications.

FIG. 11B illustrates operations performed by the hardware components of the voice assistant 100 to deliver the information of the SMS message and the email received at the smartphone 200D based on the current context of the user and the priority of each notification, according to an embodiment, following FIG. 11A. Consider, the smartphone 200D receives (1102) the email from the advertiser and the SMS from the mother while the user is sleeping. The notification and event engine 111 parses (1103) the notifications to retrieve the information in each notification includes the sender of the notification and the intent of the notification. The notification and event engine 111 determines “mother” as the sender of the SMS message and “mother will come to home by today” as the intent of the SMS message. The notification and event engine 111 determines “advertiser” as the sender of the email and “MOVIE200 is the promocode to book movie ticket” as the intent of the email. The priority determiner 117 assigns (1104) high priority to the SMS message and low priority to the email based on the sender of the notifications. Further, the historical knowledge database 122 stores (1105) the information in the email.

The information delivery engine 115 performs (1106) the regular delivery of the email by configuring the smartphone 200D to display the notifications and provide the notification tone. However, the user is unavailable to view the notifications received at smartphone 200D. Further, the notification and event engine 111 detects (1107) that the user missed to view the email and the SMS message.

Further, the information delivery engine 115 detects (1108) that the existing delivery plan for the special delivery of the notifications are unavailable. The information delivery engine 115 retrieves (1109) the contextual notification information from the context knowledge database 121, where the contextual information includes the current activity of the user and the current location details of the user, the fridge 200B and the smartphone 200D. The information delivery engine 115 retrieves the historical data from the historical knowledge database 122.

FIG. 11C illustrates operations performed by the hardware components of the voice assistant 100 to deliver the information of the SMS message and the email received at the smartphone 200D based on the current context of the user and the priority of each notification, according to an embodiment, following FIG. 11B. Further, the delivery plan engine 116 creates (1110) the delivery plan for the special delivery of the notification information to the user, where the special delivery is created by referring to the delivery ontology database 123 and using the contextual information and the historical data. The special delivery includes the first plan, the second plan and the third plan. The information delivery engine 115 performs the first plan when the user wakes up. While performing the first plan, the information delivery engine 115 notifies the user about the received email and the SMS message. Further, the information delivery engine 115 is configured to start delivering the notification informationnotification information having high priority at first and continue to deliver the notification informationnotification information having low priority as per the first plan.

The information delivery engine 115 performs the second plan when the user left the bedroom and entered to the bathroom. While performing the second plan, the information delivery engine 115 suspends the delivery of the notification informationnotification information, update the remaining notification information to be delivered to the user and checks whether the user reached the kitchen. The information delivery engine 115 performs the third plan when the user reached the kitchen and opens the fridge 200B. While performing the third plan, the information delivery engine 115 configures the fridge 200B to display the remaining notification information.

FIG. 11D illustrates operations performed by the hardware components of the voice assistant 100 to deliver the information of the SMS message and the email received at the smartphone 200D based on the current context of the user and the priority of each notification, according to an embodiment, following FIG. 11C. Consider, the user wakes up at morning. The notification and event engine 111 detects (1111) that the user wakes up based on the motion sensor data. The information delivery engine 115 performs (1112) the first plan by notifying (1113) the user about the email and the SMS message and starts delivering the information of the SMS message at first, in response to detecting that the user wakes up.

FIG. 11E illustrates operations performed by the hardware components of the voice assistant 100 to deliver the information of the SMS message and the email received at the smartphone 200D based on the current context of the user and the priority of each notification, according to an embodiment, following FIG. 11D. Consider, the user left the bedroom and enters to the bathroom after completing the delivery of the information of the SMS message by the voice assistant 100. The notification and event engine 111 detects (1114) that the user left the bedroom and went to the bathroom for bathing based on the motion sensor data. The information delivery engine 115 performs (1115) the second plan by suspending (1116) the delivery of the notification information, in response to detecting that the user left the bedroom. Further, the notification and event engine 111 checks whether the user reaches the kitchen as per the second plan.

FIG. 11F illustrates operations performed by the hardware components of the voice assistant 100 to deliver the information of the SMS message and the email received at the smartphone 200D based on the current context of the user and the priority of each notification, according to an embodiment, following FIG. 11E. Consider, the user reaches the kitchen and opens the fridge 200B after the bathing. The notification and event engine 111 detects (1117) that the user reaches the kitchen and opens the fridge 200B based on the motion sensor data and the change in operation condition of the fridge 200B while opening the fridge 200D. The information delivery engine 115 performs (1118) the third plan by checking (1119) with the user for showing the email of the advertiser, in response to detecting that the user opens the fridge 200B.

FIG. 11G illustrates operations performed by the hardware components of the voice assistant 100 to deliver the information of the SMS message and the email received at the smartphone 200D based on the current context of the user and the priority of each notification, according to an embodiment, following FIG. 11F. The voice assistant 100 displays (1020) the information of the email on the display of the fridge 200B based on the delivery plan, in response to detecting that the user accepts to show the email of the advertiser.

Referring to FIG. 12, the electronic device 100 may receive notification (operation 1210). The electronic device 100 may receive notification from external apparatus or terminal.

The electronic device 100 may determine notification information based on the received notification (operation 1220). The notification information may be information to be delivered to a user.

The electronic device 100 may deliver notification information to at least one of IoT device with a delivery plan, so that the IoT device delivers the notification information to the user according to the delivery plan (operation 1230).

FIG. 13A is a flow diagram 2000 illustrating a method for delivering the notification information by the electronic device 100 in the IoT network 1000, according to an embodiment. At 201, the method includes receiving the at least one notification. In an embodiment, the method allows the notification and event engine 111 to receive the at least one notification.

At 201, the method includes receiving the at least one notification. In an embodiment, the method allows the notification and event engine 111 to receive the at least one notification.

At 202, the method includes determining the current context of the user and the historical data associated with the at least one notification. In an embodiment, the method allows the context engine 112 to determine the current context of the user. In an embodiment, the method allows the historical data determiner 113 to determine the historical data associated with the at least one notification.

At 203, the method includes determining the at least one portion of the notification information to be delivered to the user based on at least one of the notification, the current context of the user, or the historical data associated with the at least one notification. In an embodiment, the method allows the information delivery engine 115 to determine the at least one portion of the notification information to be delivered to the user based on the at least one of the notification, the current context of the user and the historical data associated with the at least one notification.

At 204, the method includes creating the delivery plan for delivering the at least one portion of the notification information. In an embodiment, the method allows the delivery plan engine 116 to create the delivery plan for delivering the at least one portion of the notification information.

At 205, the method includes delivering the at least one portion of the notification information based on the delivery plan. In an embodiment, the method allows the information delivery engine 115 to deliver the at least one portion of the notification information based on the delivery plan.

At 206, the method includes determining whether the delivery of the at least one portion of the information to the user is completed by tracking the status of delivery while the delivery progresses. In an embodiment, the method allows the information delivery engine 115 to determine whether the delivery of the at least one portion of the information to the user is completed by tracking the status of delivery while the delivery progresses. At 207, the method includes updating the delivery plan based on the current context of the user, and the current context of the electronic device 100 and the at least one IoT device 200 for performing the step 205, in response to determining that the delivery of the at least one portion of the information to the user is completed. In an embodiment, the method allows the delivery plan engine 116 to update the delivery plan based on the current context of the user, and the current context of the electronic device 100 and the at least one IoT device 200 for re-attempting the delivery, in response to determining that the delivery of the at least one portion of the information to the user is not completed.

At 208, the method includes determining the at least one action to be performed by the user based on the at least one delivered portion of the notification information, in response to determining that the delivery of the at least one portion of the information to the user is completed. In an embodiment, the method allows the user activity determiner 114 to determine the at least one action to be performed by the user based on the at least one portion of the notification information, in response to determining that the delivery of the at least one portion of the information to the user is completed.

At 209, the method includes tracking whether the user has performed the at least one action based on the at least one tracking follow-up procedure specified in the delivery plan. In an embodiment, the method allows the notification and event engine 111 to track the user’s action. The notification and event engine 111 determines whether the user has performed the at least one action based on the at least one tracking follow-up procedure specified in the delivery plan. Or, the context engine 112 may determine whether the user has performed the at least one action.

At 210, the method includes delivering the reminder to the user, in response to determining that the user has not performed the at least one action. In an embodiment, the method allows the information delivery engine 115 to deliver the reminder to the user, in response to determining that the user has not performed the at least one action.

At 211, the method includes terminating the delivery of the reminder to the user, in response to determining that the user performs the at least one action. In an embodiment, the method allows the information delivery engine 115 to terminate the delivery of the reminder to the user, in response to determining that the user performs the at least one action.

Referring to FIG. 14, the electronic device 140014 may include a tuner 1410, a detection unit 1430, an inputter/outputter 1440, a video processor 1450, a video outputter 1455, an audio processor 1460, an audio output 1470, and a user interface 1480 in addition to the processor 110, the memory 120 and the communicator 130.

The electronic device 1400 of FIG. 14 may include elements of the electronic device 100 of FIG. 2A and 2B. Accordingly, redundant descriptions for the processor 110, the memory 120 and the communicator 130 with reference to FIG. 2A and 2B will be omitted.

The tuner 1410 may conduct amplification, mixing, or resonance on broadcast content received by wire or wirelessly to tune and select a frequency of a channel to be received by the electronic device 1400 from among many radio wave components. The content received through the tuner 1410 is decoded into an audio, a video, and/or additional information. The audio, the video, and/or the additional information may be stored in the memory 120 under the control of the processor 110.

The communicator 130 may include at least one communication module such as a short-range communication module, a wired communication module, a mobile communication module, or a broadcast receiving module. The at least one communication module refers to a communication module capable of performing data transmission/reception through a network according to a communication standard such as a tuner for performing broadcast reception, Bluetooth, wireless local area network (WLAN), Wi-Fi, wireless broadband (Wibro), world interoperability for microwave access (Wimax), code-division multiple access (CDMA), or wideband code division multiple access (WCDMA).

The communicator 130 may connect the electronic device 1400 to an external device or a server or an IoT device 200 under the control of the processor 110. The electronic device 1400 may download or browse a web for a program or an application required by the electronic device 1400 from the external device or the server through the communicator 130.

The communicator 130 may include one of wireless LAN 1421, Bluetooth 1422, and wired Ethernet 1423 corresponding to the performance and structure of the electronic device 1400. Also, the communicator 130 may include a combination of the wireless LAN 1421, the Bluetooth 1422, and the wired Ethernet 1423. The communicator 130 may receive a control signal through a control device such as a remote controller under the control of the processor 110. The control signal may be implemented as a Bluetooth type, an RF signal type, or a Wi-Fi type. The communicator 130 may further include another short-range communication (e.g., near-field communication (NFC) or Bluetooth low energy (BLE)) in addition to the Bluetooth 1422. According to an embodiment of the disclosure, the communicator 130 may transmit/receive a connection signal to/from the external device or the like through short-range communication such as the Bluetooth 1422 or BLE.

The detection unit 1430 may detect a user’s speech, image, or interaction, and may include a microphone 1431, a camera 1432, and a light receiver 1433. The microphone 1431 may receive an uttered speech of the user, and may convert the received speech into an electrical signal and may output the electrical signal to the processor 110. The camera 1432 may include a sensor and a lens, and may capture an image formed on a screen. The light receiver 1433 may receive an optical signal (including the control signal). The light receiver 1433 may receive an optical signal corresponding to a user input (e.g., touch, press, touch gesture, speech, or motion) from a control device such as a remote controller or a mobile phone. The control signal may be extracted from the received optical signal under the control of the processor 110.

The inputter/outputter 1440 (input/output interface) may receive a video (e.g., a moving picture signal or a still image signal), an audio (e.g., a speech signal or a music signal), and additional information (e.g., a description, a title of content, or a location in which the content is stored) from a device outside the electronic device 1400 under the control of the processor 110. The input/output interface 1440 may include one of a high-definition multimedia interface (HDMI) port 1441, a component jack 1442, a PC port 1443, and a USB port 1444. The inputter/outputter 1440 may include a combination of the HDMI port 1441, the component jack 1442, the PC port 1443, and the USB port 1444.

The video processor 1450 may process image data to be displayed by video output 1455, and may perform any of various image processing operations such as decoding, rendering, scaling, noise filtering, frame rate conversion, or resolution conversion on the image data.

The video outputter (video output) 1455 may display content received from a broadcasting station, an external server, or an external storage medium, or a video signal received through the HDMI port 1441 on a screen. The content that is a media signal may include a video signal or a text signal.

When the video output 1455 is implemented as a touchscreen, the video output 1455 may be used as an input device as well as an output device. The video outputter 1455 may include at least one of a liquid crystal display, a thin-film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional (3D) display, or an electrophoretic display. According to a configuration of the electronic device 1400, the electronic device 1400 may include two or more video outputs 1455.

The audio processor 1460 processes audio data. The audio processor 1460 may perform any of various processing operations such as decoding, amplification, or noise filtering on the audio data.

The audio output 1470 may output an audio included in content received through the tuner 1410, an audio input through the communicator 130 or the input/output interface 1440, and an audio stored in the memory 120 under the control of the processor 110. The audio output 1470 may include at least one of a speaker 1471, a headphone output terminal 1472, or a Sony/Philips digital interface (S/PDIF) output terminal 1473.

The user interface 1480 may receive a user input for controlling the electronic device 1400. The user interface 1480 may include any of various user input devices such as, but not limited to, a touch panel for detecting a touch of a user, a button for receiving a push operation of the user, a wheel for receiving a rotation operation of the user, a keyboard, a dome switch, a microphone for speech recognition, and a motion detection sensor for sensing a motion. Also, when the electronic device 1400 is operated by a remote controller, the user interface 1480 may receive a control signal from the remote controller.

The various actions, acts, blocks, steps, or the like in the flow diagram 2000 may be performed in the order presented, in a different order or simultaneously. Further, in some embodiments, some of the actions, acts, blocks, steps, or the like may be omitted, added, modified, skipped, or the like without departing from the scope of the application.

The embodiments disclosed herein can be implemented using at least one software program running on at least one hardware device and performing network management functions to control the elements.

The foregoing description of the specific embodiments will so fully reveal the general nature of the embodiments herein that others can, by applying current knowledge, readily modify and/or adapt for various applications such specific embodiments without departing from the generic concept, and, therefore, such adaptations and modifications should and are intended to be comprehended within the meaning and range of equivalents of the disclosed embodiments. It is to be understood that the phraseology or terminology employed herein is for the purpose of description and not of limitation. Therefore, while the embodiments herein have been described in terms of preferred embodiments, those skilled in the art will recognize that the embodiments herein can be practiced with modification within the scope of the embodiments as described herein.

Claims

An electronic device (100) comprising:

a communicator (130);

a memory (120) storing one or more instructions; and

a processor (110) configured to execute the one or more instructions stored in the memory to

identify notification,

provide notification information to be delivered to a user based on the notification, and

transmit the notification information to at least one of IoT device (200) with a delivery plan using the communicator (130), so that the IoT device (200) delivers the notification information to the user according to the delivery plan.
The electronic device (100) of claim 1, wherein the processor (110) is further configured to execute the one or more instructions to

determine a current context of the user,

determine a historical data related to the notification, and

provide the notification information based on at least one of the notification, the current context of the user, or the historical data related to the notification.
The electronic device (100) of claim 2, wherein the notification information includes at least one of the notification's sender, the notification's recipient, a time of receipt of the notification, or contents of the notification.
The electronic device (100) of claim 2, wherein the current context of the user is determined based on at least one of the user's current location, a current time, the at least one IoT device (200) close to the user, at least one person close to the user, the user's current mood, the user's current activity or a situation requiring privacy.
The electronic device (100) of claim 2, wherein the historical data related to the notification includes at least one of other previous notifications, activities performed by the user, routines of the user's daily activities, a location where each activity is performed, IoT device near to the user while the activity is being performed, user preferences, or user profiles.
The electronic device (100) of claim 2, wherein the processor (110) is further configured to execute the one or more instructions to

track whether the IoT device (200) has delivered the notification information to the user,

determine at least one task related to the notification information when it is determined that the IoT device (200) has delivered the notification information to the user,

track whether the at least one task has been performed, and

transmit a reminder to the at least one of IoT device (200) so that the IoT device (200) delivers the reminder to the user, in response to determining that the at least one task has not been performed.
The electronic device (100) of claim 6, wherein the at least one task includes an action to be performed by the user, and the at least one task is determined based on at least one of the notification, the current context of the user, or the historical data related to the notification.
The electronic device (100) of claim 2, wherein the processor (110) is further configured to execute the one or more instructions to

provide the delivery plan based on at least one of the notification, the current context of the user, the historical data related to the notification, or a priority of the notification.
The electronic device (100) of claim 8, wherein the priority of the notification is determined based on at least one of the notification's sender, the notification's recipient, a type of the notification, an importance of the notification or a relationship of the notification with the historical data related to the notification.
The electronic device (100) of claim 8, wherein the delivery plan includes information on at least one IoT device (200) identified among a plurality of IoT devices, and the identified at least one IoT device (200) is a device close to the user's current location at the time the notification is delivered to the user.
An operating method of an electronic device (100), comprising:

identifying notification;

providing notification information to be delivered to a user based on the notification; and

transmitting the notification information to at least one of IoT device (200) with a delivery plan, so that the IoT device (200) delivers the notification information to the user according to the delivery plan.
The method of claim 11, wherein the current context of the user is determined based on at least one of the user's current location, a current time, the at least one IoT device (200) close to the user, at least one person close to the user, the user's current mood, the user's current activity or a situation requiring privacy and

the historical data related to the notification includes at least one of other previous notifications, activities performed by the user, routines of the user's daily activities, a location where each activity is performed, IoT device near to the user while the activity is being performed, user preferences or user profiles.
The method of claim 11, wherein the providing notification information comprises:

determining a current context of the user;

determining a historical data related to the notification; and

providing the notification information based on at least one of the notification, the current context of the user, or the historical data related to the notification.
The method of claim 13, further comprising

tracking whether the IoT device (200) has delivered the notification information to the user,

determining at least one task related to the notification information when it is determined that the IoT device (200) has delivered the notification information to the user,

tracking whether the at least one task has been performed, and

transmitting a reminder to the at least one of IoT device (200) so that the IoT device (200) delivers the reminder to the user, in response to determining that the at least one task has not been performed.
The method of claim 12, further comprising

providing the delivery plan based on at least one of the notification, the current context of the user, the historical data related to the notification, or a priority of the notification.