WO2022103142A1 - Method and electronic device for displaying enhance message in electronic device - Google Patents

Method and electronic device for displaying enhance message in electronic device Download PDF

Info

Publication number
WO2022103142A1
WO2022103142A1 PCT/KR2021/016310 KR2021016310W WO2022103142A1 WO 2022103142 A1 WO2022103142 A1 WO 2022103142A1 KR 2021016310 W KR2021016310 W KR 2021016310W WO 2022103142 A1 WO2022103142 A1 WO 2022103142A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
event
prime
user
determining
Prior art date
Application number
PCT/KR2021/016310
Other languages
French (fr)
Inventor
Ankur Agrawal
Abhishek Sharma
G Abhishek KUMAR
Amod CHOURASIA
Kalgesh Singh
Nitesh Goyal
Original Assignee
Samsung Electronics Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020210100610A external-priority patent/KR20220063708A/en
Application filed by Samsung Electronics Co., Ltd. filed Critical Samsung Electronics Co., Ltd.
Publication of WO2022103142A1 publication Critical patent/WO2022103142A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/04Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem"
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods

Definitions

  • the present disclosure relates to a user interface, and more specifically related to a method and electronic device for displaying an enhance message in the electronic device.
  • Today's electronic devices can access a large quantity of information and services through Internet. Further, functionality of the electronic devices are increasing rapidly, the electronic devices such as smartphones, tablets, computers, and alike are capable of running applications that perform different tasks (e.g. such as capturing pictures, screenshots, web browsing, watching a movie, booking tickets for an event, and call recording) (as shown in FIG. 1) and provide different types of information to a user. Further, each time the user wants to access for example a specific image/ data, then the user has to scan for specific information/relevant data manually from a large amount of data contained in the electronic device. There is no easy way to smartly retrieve the specific image/ data in existing systems which makes the existing systems cumbersome and may hamper user experience. Since finding the relevant data is an important task, the issues in the existing system need to be addressed.
  • different tasks e.g. such as capturing pictures, screenshots, web browsing, watching a movie, booking tickets for an event, and call recording
  • FIG. 1 Today's electronic devices can access a large quantity of information and services through
  • the principal object of the embodiments herein is to provide a method and electronic device displaying an enhance message in the electronic device by learning a user ⁇ s interaction on received data and linking the received data with existing user data based on the learning to enrich a user ⁇ s view by generating a rich card.
  • Another object of the embodiments is to create a prime event associated with a user of the electronic device based on the data received from the plurality of applications of the electronic device and predict a sub event required to complete the prime event based on a plurality of parameters associated with the user of the electronic device.
  • embodiments herein disclose a method for displaying an enhance message in an electronic device.
  • the method includes receiving, by the electronic device, data from a plurality of applications of the electronic device. Further, the method includes creating, by the electronic device, a prime event associated with a user of the electronic device based on the data received from the plurality of applications of the electronic device. Further, the method includes determining, by the electronic device, a weight for a plurality of parameters associated with the data received from the plurality of applications of the electronic device. Further, the method includes determining, by the electronic device, at least one activity of the user of the electronic device. Further, the method includes generating, by the electronic device, at least one rich card (i.e. enhance message) based on the determined weight.
  • a rich card i.e. enhance message
  • the method includes determining, by the electronic device, whether the prime event is completed based on the at least one activity of the user of the electronic device. Further, the method includes updating at least one rich card based on the determined weight in response to determining that the prime event is completed and displaying the updated rich card on the electronic device. Further, the method includes determining at least one recommendation for the user of the electronic device based on at least one rich card stored in the electronic device in response to determining that the prime event is not completed.
  • the rich card comprising information related to at least one of an actual time taken by the user of the electronic device to complete the prime event, an actual sub event associated with the prime event completed by the user of the electronic device, an actual location visited by the user of the electronic device to complete at least one of the prime event and the sub event, and an actual mode used to complete at least one of the prime event and the actual sub event.
  • the method includes predicting, by the electronic device, a sub event required to complete the prime event based on a plurality of parameters associated with the user of the electronic device. Further, the method includes updating, by the electronic device, a rich card based on the prime event and predicted sub event. Further, the method includes displaying, by the electronic device, the rich card in the electronic device.
  • the rich card comprises at least one of a predicted time required to complete the at least prime event, the predicted sub event that need to be performed to complete the prime event, a predicted time required to complete the at least predicted sub event, and a predicted mode to be used to complete at least one of the prime event and the predicted sub event.
  • the method includes extracting, by the electronic device, information about at least one of a start time, an end time, a location, a state of the electronic device, and keywords related to at least one event from the data. Further, the method includes creating, by the electronic device, the prime event by applying at least one machine learning (ML) model on the information about at least one of the start time, the end time, the location, the state of the electronic device, and the keywords related to the prime event from the data.
  • ML machine learning
  • the method includes determining, by the electronic device, whether the data received from the plurality of applications of the electronic device is valid to create the event associated with the user of the electronic device, wherein the event comprises one of the prime event and the at least one sub event. Further, the method includes creating the at least one event in the electronic device in response to determining that the plurality of parameters is valid. Further, the method includes discarding the at least one event in the electronic device in response to determining that the plurality of parameters is not valid.
  • the method includes determining, by the electronic device, whether the start time, the end time, the location, the state of the electronic device, and the keywords are available in a created event. Further, the method includes creating the event associated with the user of the electronic device as the prime event in response to determining that the start time, the end time, the location, the state of the electronic device, and the keywords are available in the created event. Further, the method includes creating the event associated with the user of the electronic device as the sub event in response to determining that the start time, the end time, the location, the state of the electronic device, and the keywords are not available in the created event.
  • the method includes applying, by the electronic device, the weight to each of the parameters based on an interaction of the user of the electronic device with at least one of the sub event and the prime event. Further, the method includes determining, by the electronic device, whether the prime event is co-relates with the sub event based on the applied weight. Further, the method includes adding the sub event into the prime event in response to determining that the prime-event is co-related with the sub event. Further, the method includes performing one of discarding the sub event and creating a new prime event in response to determining that the prime event is not co-related with the sub event.
  • the plurality of parameters comprises preferences of the user of the electronic device, a list of locations visited by the user of the electronic device, and a list of sub events completed by the user of the electronic device to complete the prime event.
  • the method includes sharing a predicted rich card with at least one-second user of the electronic device, tracking usage of the predicted rich card, and updating the weight of neural network node of at least one machine learning model based on the usage of the predicted rich card.
  • the method includes sharing the updated rich card with at least one-second user of the electronic device, tracking usage of the updated rich card, and updating weight of neural network node of the at least one machine learning model based on the usage of the updated rich card.
  • displaying the rich card information in an optimal mode wherein the optimal mode comprises one of an image output, a text output, an audio output, and a video output.
  • the rich card information includes a summary of the at least one prime event, a logs of the at least one prime event, and a comparison of at least two prime events.
  • the embodiments herein provide the electronic device for displaying the enhance message.
  • the electronic device includes an enhanced messaging controller coupled with a processor and a memory.
  • the enhanced messaging controller is configured to receive data from the plurality of applications of the electronic device. Further, the enhanced messaging controller is configured to create a prime event associated with the user of the electronic device based on the data received from the plurality of applications of the electronic device. Further, the enhanced messaging controller is configured to predict a sub event required to complete the prime event based on the plurality of parameters associated with the user of the electronic device. Further, the enhanced messaging controller is configured to generate the rich card based on the prime event and predicted sub event. Further, the enhanced messaging controller is configured to display the rich card in the electronic device.
  • a method and electronic device displaying an enhance message in the electronic device by learning a user ⁇ s interaction on received data and linking the received data with existing user data based on the learning to enrich a user ⁇ s view by generating a rich card are provided.
  • FIG. 1 illustrates an existing search system for particular data for quick reference or share with at least one second user by an electronic device, according to a prior art disclosed herein;
  • FIG. 2 is a block diagram of the electronic device for displaying the enhance message in the electronic device, according to an embodiment as disclosed herein;
  • FIG. 3A and 3B are flow diagrams illustrating various operations for displaying the enhance message in the electronic device, according to an embodiment as disclosed herein;
  • FIG. 3C is a flow diagram illustrating various operations for creating a prime event in the electronic device, according to an embodiment as disclosed herein;
  • FIGS. 4A-4D illustrate various example scenarios to generate a rich card for enhancing a message communication, according to an embodiment as disclosed herein.
  • FIGS. 5-9 illustrate timelines for various events to generate rich cards.
  • circuits may, for example, be embodied in one or more semiconductor chips, or on substrate supports such as printed circuit boards and the like.
  • circuits constituting a block may be implemented by dedicated hardware, or by a processor (e.g., one or more programmed microprocessors and associated circuitry), or by a combination of dedicated hardware to perform some functions of the block and a processor to perform other functions of the block.
  • a processor e.g., one or more programmed microprocessors and associated circuitry
  • Each block of the embodiments may be physically separated into two or more interacting and discrete blocks without departing from the scope of the invention.
  • the blocks of the embodiments may be physically combined into more complex blocks without departing from the scope of the invention
  • embodiments herein disclose a method for displaying an enhance message in an electronic device.
  • the method includes receiving, by the electronic device, data from a plurality of applications of the electronic device. Further, the method includes creating, by the electronic device, a prime event associated with a user of the electronic device based on the data received from the plurality of applications of the electronic device. Further, the method includes determining, by the electronic device, a weight for a plurality of parameters associated with the data received from the plurality of applications of the electronic device. Further, the method includes generating, by the electronic device, at least one rich card based on the determined weight. Further, the method includes determining, by the electronic device, at least one activity of the user of the electronic device.
  • the method includes determining, by the electronic device, whether the prime event is completed based on the at least one activity of the user of the electronic device. Further, the method includes updating at least one rich card in response to determining that the prime event is completed and displaying the updated rich card on the electronic device. Further, the method includes determining at least one recommendation for the user of the electronic device based on at least one rich card stored in the electronic device in response to determining that the prime event is not completed.
  • FIGS. 2 through 4G there are shown preferred embodiments.
  • FIG. 2 is a block diagram of the electronic device (100) for displaying the enhance message in the electronic device (100), according to an embodiment as disclosed herein.
  • the electronic device (100) can be, for example, but not limited to a smart phone, a laptop, a desktop, a smart watch, a smart TV or a like.
  • the electronic device (100) includes a memory (110), a processor (120), a communicator (130), a display (140), and an enhanced messaging controller (150).
  • the memory (110) also stores instructions to be executed by the processor (120).
  • the memory (110) may include non-volatile storage elements. Examples of such non-volatile storage elements may include magnetic hard discs, optical discs, floppy discs, flash memories, or forms of electrically programmable memories (EPROM) or electrically erasable and programmable (EEPROM) memories.
  • the memory (110) may, in some examples, be considered a non-transitory storage medium.
  • the term “non-transitory” may indicate that the storage medium is not embodied in a carrier wave or a propagated signal. However, the term “non-transitory” should not be interpreted that the memory (110) is non-movable.
  • the memory (110) can be configured to store larger amounts of information than the memory.
  • a non-transitory storage medium may store data that can, over time, change (e.g., in Random Access Memory (RAM) or cache).
  • the memory (110) can be an internal storage unit or it can be an external storage unit of the electronic device (100), a cloud storage, or any other type of external storage.
  • the memory (110) includes an application repository (110a) to store data of a plurality of applications (e.g., calling application, gallery application, camera application, business application, education application, lifestyle application, entertainment application, utility application, travel application, health and fitness application) of the electronic device (100).
  • the processor (120) communicates with the memory (110), the communicator (130), the display (140), and the enhanced messaging controller (150).
  • the processor (120) is configured to execute instructions stored in the memory (110) and to perform various processes.
  • the communicator (130) is configured for communicating internally between internal hardware components and with external devices via one or more networks.
  • the enhanced messaging controller (150) includes a data transformer (151), an event controller (152), a user co-efficient evaluator (153), a rich card controller (154), and an ML engine (155).
  • the enhanced messaging controller (150) is implemented by processing circuitry such as logic gates, integrated circuits, microprocessors, microcontrollers, memory circuits, passive electronic components, active electronic components, optical components, hardwired circuits, or the like, and may optionally be driven by firmware.
  • the circuits may, for example, be embodied in one or more semiconductor chips, or on substrate supports such as printed circuit boards and the like.
  • the data transformer (151) receives data from the plurality of applications of the electronic device (100).
  • the plurality of applications (110) of the electronic device (100) can be, for example, but not limited to an Electronic Mail (email), a Short Message Service (SMS), a Multimedia Messaging Service (MMS), a web browsing.
  • the data transformer (151) extracts useful information from the received data using Natural language processing (NLP).
  • the useful information can be, for example, but not limited to an event location, an event start time, an event start date, an event end time, an event end date and event keywords.
  • the data transformer (151) extracts information related to real-time information present in the received data.
  • the information can be related to a usability time, a current location of the user of the electronic device (100), a current time associated with the user of the electronic device (100), and a current context of the user of the electronic device (100), a usage context of the user of the electronic device (100), a user profile related data, etc. Further, the data transformer (151) transfers the extracted information to the event controller (152).
  • the event controller (152) determines whether the data (i.e. the extracted information received from the data transformer (151)) received from the plurality of applications (110) of the electronic device (100) is valid to create the event associated with the user of the electronic device (100), the event comprises one of the prime event and the sub event. In order to validate the received data, the event controller (152) uses the ML engine (155). Furthermore, the event controller (152) creates the event in the electronic device (100) in response to determining that the plurality of parameters is valid. Furthermore, the event controller (152) discards the event in the electronic device in response to determining that the plurality of parameters is not valid.
  • the event controller (152) categorizes event and assigns a single category to the given extracted information which can potentially create the event.
  • the single category to the given extracted information can be, for example, but not limited to shopping, friends group school, friend's cricket, and social media.
  • the event controller (152) determines whether all useful information (e.g. the event location, the event start time, the event start date, the event end time, , the event keywords, and the state of the electronic device (100)are available in a created event. Furthermore, the event controller (152) creates the event associated with the user of the electronic device (100) as the prime event in response to determining that all useful information is available in the created event. Furthermore, the event controller (152) creates the event associated with the user of the electronic device (100) as the sub event in response to determining that all useful information is not available in the created event.
  • all useful information e.g. the event location, the event start time, the event start date, the event end time, , the event keywords, and the state of the electronic device (100)are available in a created event. Furthermore, the event controller (152) creates the event associated with the user of the electronic device (100) as the prime event in response to determining that all useful information is available in the created event. Furthermore, the event controller (152) creates the event associated with the user
  • the event controller (152) determines whether the prime event co-relates with the sub event based on various factors.
  • the various factors can be, for example, but not limited to a usage pattern of the user of the electronic device (100), a history/ learning of the event (prime event and/or sub event), a frequency of the event, the current location of the user of the electronic device (100), the current time associated with the user of the electronic device (100), and the current context of the user of the electronic device (100).
  • the event controller (152) uses the ML engine (155). Furthermore, the event controller (152) adds the sub event into the prime event in response to determining that the prime-event is co-related with the sub event. Furthermore, the event controller (152) performing one of discarding the sub event and creating a new prime event in response to determining that the prime event is not co-related with the sub event.
  • the user co-efficient evaluator (153) applies a weight to each of the parameters (context information displays on the screen of the electronic device (100), the plurality of parameters associated with the data received from the plurality of applications of the electronic device (100)) based on the interaction of the user of the electronic device (100) with at least one of the sub event and the prime event.
  • a threshold is maintained for a number of relevant items and uses Least Recently Used (LRU) concept for clearing older items.
  • LRU Least Recently Used
  • the user co-efficient evaluator (153) detects interaction with content (at least one event) and assigning weight to different content , which keeps on increasing based on number of regular interactions of the user of the electronic device (100).
  • user co-efficient evaluator (153) monitors certain limit to such list of content, content which has least weight , once the limit is reached , is removed from the list and latest content is added. For example, the user of the electronic device (100) searches for headphone over a period of time. So, the weight is higher over the period of time. Further, for a long time period, if the user of the electronic device (100) has no interaction with such content, the user co-efficient evaluator (153) shifted the content to bottom of the list, and once space in list is over, is removed from the list. Furthermore, the user co-efficient evaluator (153) calculates the weight (user engagement co-efficient (UEC (W))) by below equation 1,
  • the rich card controller (154) determines at least one activity associated with at least one of the sub event and the prime event of the user of the electronic device (100). Furthermore, the rich card controller (154) generates the rich card based on the prime event and the predicted sub event. The predicted sub event is fetched based on co-relation b/w the prime event and the sub event, and the calculated weight. The rich card comprises at least one of the predicted time required to complete the at least prime event, the predicted sub event that need to be performed to complete the prime event, the predicted time required to complete the at least predicted sub event, and the predicted mode to be used to complete at least one of the prime event and the predicted sub event. Furthermore, the rich card controller (154) displays the rich card in the electronic device (100).
  • the rich card controller (154) shares the generated rich card with at least one-second user of the electronic device (200) (e.g. smart TV, smart watch, smartphone, etc.), track the usage of the generated rich card, and updates weight of neural network node of at least one machine learning model (i.e. ML engine (155)) based on the usage of the generated rich card.
  • at least one-second user of the electronic device (200) e.g. smart TV, smart watch, smartphone, etc.
  • the rich card controller shares the generated rich card with at least one-second user of the electronic device (200) (e.g. smart TV, smart watch, smartphone, etc.), track the usage of the generated rich card, and updates weight of neural network node of at least one machine learning model (i.e. ML engine (155)) based on the usage of the generated rich card.
  • ML engine machine learning model
  • the rich card controller (154) determines whether the prime event is completed based on the at least one activity of the user of the electronic device (100). Furthermore, the rich card controller (154) updates the rich card in response to determining that the prime event is completed, and displays the updated rich card on the electronic device (100).
  • the rich card comprising information related to at least one of an actual time taken by the user of the electronic device (100) to complete the prime event, an actual sub event associated with the prime event completed by the user of the electronic device (100), an actual location visited by the user of the electronic device (100) to complete at least one of the prime event and the sub event, and an actual mode used to complete at least one of the prime event and the actual sub event. Furthermore, the rich card controller (154) shares the updated rich card with at least one-second user of the electronic device (200), tracks the usage of the updated rich card, and updates the weight of neural network node of at least one machine learning model based on the usage of the updated rich card.
  • At least one of the plurality of modules/ components may be implemented through an artificial intelligence (AI) model.
  • AI artificial intelligence
  • a function associated with AI may be performed through memory (110) and the processor (120).
  • the processor (120) may include one or a plurality of processors such as a central processing unit (CPU), an application processor (AP), or the like, a graphics-only processing unit such as a graphics processing unit (GPU), a visual processing unit (VPU), and/or an AI-dedicated processor such as a neural processing unit (NPU).
  • processors such as a central processing unit (CPU), an application processor (AP), or the like, a graphics-only processing unit such as a graphics processing unit (GPU), a visual processing unit (VPU), and/or an AI-dedicated processor such as a neural processing unit (NPU).
  • the one or a plurality of processors controls the processing of the input data in accordance with a predefined operating rule or artificial intelligence (AI) model stored in the non-volatile memory and the volatile memory.
  • the predefined operating rule or artificial intelligence model is provided through training or learning.
  • learning means that, by applying a learning process to a plurality of learning data, a predefined operating rule or AI model of a desired characteristic is made.
  • the learning may be performed in a device itself in which the AI according to an embodiment is performed, and/o may be implemented through a separate server/system.
  • the AI model may consist of a plurality of neural network layers. Each layer has a plurality of weight values and performs a layer operation through calculation of a previous layer and an operation of a plurality of weights.
  • Examples of neural networks include, but are not limited to, convolutional neural network (CNN), deep neural network (DNN), recurrent neural network (RNN), restricted Boltzmann Machine (RBM), deep belief network (DBN), bidirectional recurrent deep neural network (BRDNN), generative adversarial networks (GAN), and deep Q-networks.
  • the learning process is a method for training a predetermined target device (for example, a robot) using a plurality of learning data to cause, allow, or control the target device to make a determination or prediction.
  • Examples of learning processes include, but are not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning.
  • FIG. 2 shows various hardware components of the electronic device (100) but it is to be understood that other embodiments are not limited thereon.
  • the electronic device (100) may include less or more number of components.
  • the labels or names of the components are used only for illustrative purpose and does not limit the scope of the invention.
  • One or more components can be combined together to perform same or substantially similar function for displaying the enhance message in the electronic device (100).
  • FIGs. 3A and 3B are flow diagrams (S300) illustrating various operations for displaying the enhance message in the electronic device (100), according to an embodiment as disclosed herein.
  • the operations (S302-S316ab), (S302-S316ba) are performed by the enhanced messaging controller (150).
  • the method includes receiving data from the plurality of applications of the electronic device (100).
  • the method includes creating the prime event associated with a user of the electronic device (100) based on the data received from the plurality of applications of the electronic device (100).
  • the method includes determining the weight for the plurality of parameters associated with the data received from the plurality of applications of the electronic device (100).
  • the method includes generating the rich card based on the determined weight.
  • the method includes determines whether the at least prime event is created first time.
  • the method includes predicting the sub event required to complete the prime event based on the plurality of parameters associated with the user of the electronic device (100) in response to determining that at least prime event is created the first time.
  • the method includes updating the rich card based on the prime event and a predicted sub event.
  • the method includes displaying the rich card in the electronic device (100).
  • the method includes determining at least one activity of the user of the electronic device (100) in response to determining that the least prime event is not created the first time.
  • the method includes determining whether the prime event is completed.
  • the method includes updating the rich card in response to determining that the prime event is completed.
  • the method includes displaying the updated rich card on the electronic device (100).
  • the method includes determining at least one recommendation for the user of the electronic device (100) based on at least one rich card stored in the electronic device (100).
  • FIG. 3C is a flow diagram (S304) illustrating various operations for creating the prime event in the electronic device (100), according to an embodiment as disclosed herein.
  • the operations (S304a-S304f) are performed by the enhanced messaging controller (150).
  • the method includes determining whether the data received from the plurality of applications (110) of the electronic device (100) is valid to create the event associated with the user of the electronic device (100), the event comprises one of the prime event and the sub event.
  • the method includes discarding the event in the electronic device (100) in response to determining that the plurality of parameters is not valid.
  • the method includes creating the event in the electronic device (100) in response to determining that the plurality of parameters is valid.
  • the method includes determining whether the start time, the end time, the location, the state of the electronic device (100), and the keywords are available in the created event.
  • the method includes creating the event associated with the user of the electronic device (100) as the prime event in response to determining that the start time, the end time, the location, the state of the electronic device (100), and the keywords are available in the created event.
  • the method includes creating the event associated with the user of the electronic device (100) as the sub event in response to determining that the start time, the end time, the location, the state of the electronic device (100), and the keywords are not available in the created event.
  • FIGS. 4A-4D illustrate various example scenarios to generate the rich card for displaying the enhance message, according to an embodiment as disclosed herein.
  • the user of the electronic device (100) receives a notification from Netlix application (110a) of the electronic device (100).
  • the data transformer (151) extracts useful information from the received notification.
  • the useful information in Netlix application (110a) may include but not limited to the event location, April-10 as the event start-date time & event end-date time, and a War movie as the event keywords.
  • the event controller (152) validates all useful information using the ML engine (155) and creates the prime event in response to determining that all useful information is available to create the prime event.
  • the data transformer (151) extracts useful information from the current context (i.e. watching the War movie) displays on the electronic device (100).
  • the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event.
  • the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. notification of the War movie).
  • the data transformer (151) extracts useful information from the current context (i.e. reading review of the War movie) displays on the electronic device (100).
  • the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event.
  • the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. notification of the War movie, watching the War movie).
  • the data transformer (151) extracts useful information from the current context (i.e. listing music of the War movie) displays on the electronic device (100).
  • the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event.
  • the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. notification of the War movie, watching the War movie, reading the review of the War movie).
  • the data transformer (151) extracts useful information from the current context (i.e. watching the trailer of the magic movie) displays on the electronic device (100).
  • the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event.
  • the user of the electronic device (100) receives a mail from the Netlix application (110a) of the electronic device (100).
  • the data transformer (151) extracts useful information from the received mail.
  • the event controller (152) validates all useful information using the ML engine (155) and creates the prime event (i.e. Joker Movie) in response to determining that all useful information is available to create the prime event.
  • the data transformer (151) extracts useful information from the current context (i.e. reading review of the Joker movie) displays on the electronic device (100).
  • the event controller (152) validates all useful information using the ML engine (155) and creates the sub event (i.e. review of the Joker movie) in response to determining that all useful information is not available to create the prime event.
  • the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. notification of the Joker movie), and usage pattern (402a-410a) of the user of the electronic device (100).
  • the data transformer (151) extracts useful information from the current context (i.e. listing music of the Joker movie) displays on the electronic device (100).
  • the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event.
  • the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. notification of the Joker movie, reading review of the Joker movie), and usage pattern (402a-410a) of the user of the electronic device (100).
  • the data transformer (151) extracts useful information from the current context (i.e. watching the trailer of the Joker movie) displays on the electronic device (100).
  • the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event.
  • the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. notification of the Joker movie, reading the review of the Joker movie, listing music of the Joker movie), and usage pattern (402a-410a) of the user of the electronic device (100).
  • the rich card controller (154) generates the rich card based on the prime event (412a) and the sub event (414a to 418a).
  • the sub event is fetched based on co-relation b/w the prime event and the sub event by the event controller (152), and the calculated weight by the user co-efficient evaluator (153).
  • the rich card controller (154) displays the rich card in the electronic device (100).
  • FIGs. 5-9 illustrate timelines for various events to generate a rich card.
  • the user of the electronic device (100) receives a mail from a booking application (110e) of the electronic device (100).
  • the data transformer (151) extracts useful information from the received mail.
  • the useful information is Delhi Hatt, Janakpuri as the event location, 21-Jan-2020 at 2-4 PM as the event start-date time & event end-date time, and a Ticket number (18007) and visitors (4) as the event keywords.
  • the event controller (152) validates all useful information using the ML engine (155) and creates the prime event in response to determining that all useful information is available to create the prime event.
  • the data transformer (151) extracts useful information from the current context (i.e. your cab is arriving for Delhi Hatt) displays on the electronic device (100).
  • the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event.
  • the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. Delhi Hatt).
  • the user of the electronic device (100) capturing and uploading photos of traditional cloth on a social media application (110g) of the electronic device (100).
  • the data transformer (151) extracts useful information from the current context displays on the electronic device (100).
  • the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event.
  • the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. Delhi Hatt, your cab is arriving for Delhi Hatt), and the current location of the user of the electronic device (100).
  • the data transformer (151) extracts the useful information from the current context (i.e. Paid Rs.240 to Rohan Kulfi at Delhi Haat) displays on the electronic device (100).
  • the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event.
  • the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e.
  • the data transformer (151) extracts the useful information from the current context (i.e. Paid Rs.2400 to E-board on 21-Jan-2020 at 3:55 pm) displays on the electronic device (100).
  • the event controller (152) discards the event as all useful information is not valid to create the sub event.
  • the user of the electronic device (100) booking a cab on the cab booking application (110f) of the electronic device (100).
  • the data transformer (151) extracts useful information from the current context (i.e. your cab for home) displays on the electronic device (100).
  • the event controller (152) detects the prime event is completed.
  • the rich card controller (154) generates the rich card based on the prime event (402b) and the sub event (404b to 414b), summary creation of the completed prime event.
  • the sub event is fetched based on co-relation b/w the prime event and the sub event by the event controller (152), and the calculated weight by the user co-efficient evaluator (153).
  • the rich card controller (154) displays the rich card in the electronic device (100). Referring to FIG. 5C : At 416, based on the UEC calculation from the created prime event (402b), future incoming events (416ba to 416bd) are processed and rich cards (418b, 420b, 422b) are displayed in the electronic device (100).
  • the enhanced messaging controller (150) creates a summary of the completed prime event (s) (402c,404c,406c) and displays (408c) as rich card logs on the screen of the electronic device (100).
  • the second user of the electronic device (200) receives a notification from a social media application (210g) of the electronic device (200), and give a reaction to the notification.
  • the notification is related to at least one activity of the user of the electronic device (100) (i.e. User-A), for example, the User-A posts event (e.g. Goa diaries), and the User-B receives the notification for the same.
  • the reaction to the notification is related to at least one activity of the User-B, for example, the User-B like's event which is posted by the User-A.
  • an enhanced messaging controller (250) provides a feature to the User-B to know more about the post. For example, the enhanced messaging controller (250) sends a request for a rich card related to the event which is posted by the User-A.
  • the enhanced messaging controller (150) of the user of the electronic device (100) generates the rich card relates to the User-A posts event and shares the rich card with the User-B.
  • the enhanced messaging controller (150) displays rich cards of the completed prime event (s) (402e, 404e) and provides a comparison (406e) of two similar service providers.
  • the comparison is created by the event controller (152), where the event controller (152) categorizes event and assigns the single category to the given extracted information which can potentially create the event. Further, the comparison is on the basis of preset parameters which are present in the prime event on basis of which category is assigned.
  • the user of the electronic device (100) receives a mail from the booking application (110e) of the electronic device (100).
  • the data transformer (151) extracts useful information from the received mail.
  • the useful information is Manali hotel as the event location, 14-Feb-2020 and 2 days as the event start-date time & event end-date time and a Booking number (18008) as the event keyword.
  • the event controller (152) validates all useful information using the ML engine (155) and creates the prime event in response to determining that all useful information is available to create the prime event.
  • the data transformer (151) extracts useful information from the current context (i.e. your cab is for Manali) displays on the electronic device (100).
  • the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event.
  • the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. Manali hotel).
  • the data transformer (151) extracts the useful information from the current context (i.e. Paid Rs.1000 to HP petrol pump at Amar highway Manali) displays on the electronic device (100).
  • the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event.
  • the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. Manali hotel, your cab is for Manali), the current time associated with the user of the electronic device (100), and the current location of the user of the electronic device (100).
  • the user co-efficient evaluator (153) applies the weight to current context information (i.e. online payment++) of the electronic device (100).
  • the user of the electronic device (100) displays a battery notification.
  • the data transformer (151) extracts useful information from the current context (i.e. battery is getting low 15% remaining) displays on the electronic device (100).
  • the event controller (152) detects a Save our souls (SOS) situation based on the current context and sends a notification to the rich card controller (154) to generate the rich card.
  • SOS Save our souls
  • the rich card controller (154) generates the rich card based on the prime event (402f) and the sub event (404f to 406f).
  • the sub event is fetched based on co-relation b/w the prime event and the sub event by the event controller (152), and the calculated weight by the user co-efficient evaluator (153). Furthermore, the rich card controller (154) shares the rich card with any emergency contact (i.e. the at least one-second electronic device (200)) for the SOS situation.
  • the user of the electronic device (100) receives mail from a shopping application (110i) of the electronic device (100).
  • the data transformer (151) extracts useful information from the received mail.
  • the useful information is search history / learning for the camera as the event location, Diwali as the event start-date time & event end-date time, and an EOS 3000D digital single-lens reflex (DSLR) Camera as the event keywords.
  • the event controller (152) validates all useful information using the ML engine (155) and creates the prime event in response to determining that all useful information is available to create the prime event.
  • the user of the electronic device (100) receives a message from the shopping application (110i) of the electronic device (100).
  • the data transformer (151) extracts useful information from the current context (i.e. you have added EOS 3000D DSLR camera) displays on the electronic device (100).
  • the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event.
  • the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. EOS 3000D DSLR Camera).
  • the user co-efficient evaluator (153) applies the weight to the current context information of the electronic device (100).
  • the user of the electronic device (100) receives an offer message from the other shopping application (110i) of the electronic device (100).
  • the data transformer (151) extracts useful information from the current context (i.e. Diwali sale! Buy your favorite EOS 3000D DSLR camera, at a discount of 25%, DLF mall) displays on the electronic device (100).
  • the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event.
  • the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. EOS 3000D DSLR Camera, you have added EOS 3000D DSLR camera).
  • the user co-efficient evaluator (153) applies the weight to the current context information of the electronic device (100).
  • the user of the electronic device (100) visits a DLF mall.
  • the data transformer (151) extracts useful information from the current context (i.e. DLF mall Location).
  • the event controller (152) co-relates the prime event with the current context based on the history/ learning of the event (i.e. Delhi Hatt, your cab is arriving for Delhi Hatt, Diwali sale! Buy your favorite EOS 3000D DSLR camera, at a discount of 25%, DLF mall) and the current location of the user of the electronic device (100).
  • the event controller (152) detects the prime event is not completed. So, the rich card controller (154) automatically recommending at least one suggestion relates to the prime event (402g) and displays the at least one suggestion in the electronic device (100).

Abstract

A method includes receiving data from a plurality of applications of the electronic device (100). Further, the method includes creating a prime event associated with a user of the electronic device (100) based on the received data, determining a weight for a plurality of parameters associated with the data received from the plurality of applications of the electronic device (100). Further, the method includes generating at least one rich card based on the determined weight. Further, the method includes updating at least one rich card in response to determining that the prime event is completed and displaying the generated rich card on the electronic device (100), and determining at least one recommendation for the user of the electronic device (100) based on at least one rich card stored in the electronic device (100) in response to determining that the prime event is not completed.

Description

METHOD AND ELECTRONIC DEVICE FOR DISPLAYING ENHANCE MESSAGE IN ELECTRONIC DEVICE
The present disclosure relates to a user interface, and more specifically related to a method and electronic device for displaying an enhance message in the electronic device.
[0001] Today's electronic devices can access a large quantity of information and services through Internet. Further, functionality of the electronic devices are increasing rapidly, the electronic devices such as smartphones, tablets, computers, and alike are capable of running applications that perform different tasks (e.g. such as capturing pictures, screenshots, web browsing, watching a movie, booking tickets for an event, and call recording) (as shown in FIG. 1) and provide different types of information to a user. Further, each time the user wants to access for example a specific image/ data, then the user has to scan for specific information/relevant data manually from a large amount of data contained in the electronic device. There is no easy way to smartly retrieve the specific image/ data in existing systems which makes the existing systems cumbersome and may hamper user experience. Since finding the relevant data is an important task, the issues in the existing system need to be addressed.
Thus, it is desired to address the above-mentioned disadvantages or other shortcomings or at least provide a useful alternative.
The principal object of the embodiments herein is to provide a method and electronic device displaying an enhance message in the electronic device by learning a user`s interaction on received data and linking the received data with existing user data based on the learning to enrich a user`s view by generating a rich card.
Another object of the embodiments is to create a prime event associated with a user of the electronic device based on the data received from the plurality of applications of the electronic device and predict a sub event required to complete the prime event based on a plurality of parameters associated with the user of the electronic device.
Accordingly, embodiments herein disclose a method for displaying an enhance message in an electronic device. The method includes receiving, by the electronic device, data from a plurality of applications of the electronic device. Further, the method includes creating, by the electronic device, a prime event associated with a user of the electronic device based on the data received from the plurality of applications of the electronic device. Further, the method includes determining, by the electronic device, a weight for a plurality of parameters associated with the data received from the plurality of applications of the electronic device. Further, the method includes determining, by the electronic device, at least one activity of the user of the electronic device. Further, the method includes generating, by the electronic device, at least one rich card (i.e. enhance message) based on the determined weight.
Further, the method includes determining, by the electronic device, whether the prime event is completed based on the at least one activity of the user of the electronic device. Further, the method includes updating at least one rich card based on the determined weight in response to determining that the prime event is completed and displaying the updated rich card on the electronic device. Further, the method includes determining at least one recommendation for the user of the electronic device based on at least one rich card stored in the electronic device in response to determining that the prime event is not completed.
The rich card comprising information related to at least one of an actual time taken by the user of the electronic device to complete the prime event, an actual sub event associated with the prime event completed by the user of the electronic device, an actual location visited by the user of the electronic device to complete at least one of the prime event and the sub event, and an actual mode used to complete at least one of the prime event and the actual sub event.
Further, the method includes predicting, by the electronic device, a sub event required to complete the prime event based on a plurality of parameters associated with the user of the electronic device. Further, the method includes updating, by the electronic device, a rich card based on the prime event and predicted sub event. Further, the method includes displaying, by the electronic device, the rich card in the electronic device.
In an embodiment, the rich card comprises at least one of a predicted time required to complete the at least prime event, the predicted sub event that need to be performed to complete the prime event, a predicted time required to complete the at least predicted sub event, and a predicted mode to be used to complete at least one of the prime event and the predicted sub event.
In an embodiment, the method includes extracting, by the electronic device, information about at least one of a start time, an end time, a location, a state of the electronic device, and keywords related to at least one event from the data. Further, the method includes creating, by the electronic device, the prime event by applying at least one machine learning (ML) model on the information about at least one of the start time, the end time, the location, the state of the electronic device, and the keywords related to the prime event from the data.
In an embodiment, the method includes determining, by the electronic device, whether the data received from the plurality of applications of the electronic device is valid to create the event associated with the user of the electronic device, wherein the event comprises one of the prime event and the at least one sub event. Further, the method includes creating the at least one event in the electronic device in response to determining that the plurality of parameters is valid. Further, the method includes discarding the at least one event in the electronic device in response to determining that the plurality of parameters is not valid.
In an embodiment, the method includes determining, by the electronic device, whether the start time, the end time, the location, the state of the electronic device, and the keywords are available in a created event. Further, the method includes creating the event associated with the user of the electronic device as the prime event in response to determining that the start time, the end time, the location, the state of the electronic device, and the keywords are available in the created event. Further, the method includes creating the event associated with the user of the electronic device as the sub event in response to determining that the start time, the end time, the location, the state of the electronic device, and the keywords are not available in the created event.
In an embodiment, the method includes applying, by the electronic device, the weight to each of the parameters based on an interaction of the user of the electronic device with at least one of the sub event and the prime event. Further, the method includes determining, by the electronic device, whether the prime event is co-relates with the sub event based on the applied weight. Further, the method includes adding the sub event into the prime event in response to determining that the prime-event is co-related with the sub event. Further, the method includes performing one of discarding the sub event and creating a new prime event in response to determining that the prime event is not co-related with the sub event.
In an embodiment, the plurality of parameters comprises preferences of the user of the electronic device, a list of locations visited by the user of the electronic device, and a list of sub events completed by the user of the electronic device to complete the prime event.
In an embodiment, determining, by the electronic device, whether the prime event is completed based on the at least one activity of the user of the electronic device, the end time, the location, the state of the electronic device, and keywords related to the at least one prime event.
In an embodiment, the method includes sharing a predicted rich card with at least one-second user of the electronic device, tracking usage of the predicted rich card, and updating the weight of neural network node of at least one machine learning model based on the usage of the predicted rich card.
In an embodiment, the method includes sharing the updated rich card with at least one-second user of the electronic device, tracking usage of the updated rich card, and updating weight of neural network node of the at least one machine learning model based on the usage of the updated rich card.
In an embodiment, displaying the rich card information in an optimal mode, wherein the optimal mode comprises one of an image output, a text output, an audio output, and a video output. The rich card information includes a summary of the at least one prime event, a logs of the at least one prime event, and a comparison of at least two prime events.
Accordingly, the embodiments herein provide the electronic device for displaying the enhance message. The electronic device includes an enhanced messaging controller coupled with a processor and a memory. The enhanced messaging controller is configured to receive data from the plurality of applications of the electronic device. Further, the enhanced messaging controller is configured to create a prime event associated with the user of the electronic device based on the data received from the plurality of applications of the electronic device. Further, the enhanced messaging controller is configured to predict a sub event required to complete the prime event based on the plurality of parameters associated with the user of the electronic device. Further, the enhanced messaging controller is configured to generate the rich card based on the prime event and predicted sub event. Further, the enhanced messaging controller is configured to display the rich card in the electronic device.
These and other aspects of the embodiments herein will be better appreciated and understood when considered in conjunction with the following description and the accompanying drawings. It should be understood, however, that the following descriptions, while indicating preferred embodiments and numerous specific details thereof, are given by way of illustration and not of limitation. Many changes and modifications may be made within the scope of the embodiments herein without departing from the spirit thereof, and the embodiments herein include all such modifications.
Accroding to an embodiment, a method and electronic device displaying an enhance message in the electronic device by learning a user`s interaction on received data and linking the received data with existing user data based on the learning to enrich a user`s view by generating a rich card are provided.
This method and electronic device are illustrated in the accompanying drawings, throughout which like reference letters indicate corresponding parts in the various figures. The embodiments herein will be better understood from the following description with reference to the drawings, in which:
FIG. 1 illustrates an existing search system for particular data for quick reference or share with at least one second user by an electronic device, according to a prior art disclosed herein;
FIG. 2 is a block diagram of the electronic device for displaying the enhance message in the electronic device, according to an embodiment as disclosed herein;
FIG. 3A and 3B are flow diagrams illustrating various operations for displaying the enhance message in the electronic device, according to an embodiment as disclosed herein;
FIG. 3C is a flow diagram illustrating various operations for creating a prime event in the electronic device, according to an embodiment as disclosed herein; and
FIGS. 4A-4D illustrate various example scenarios to generate a rich card for enhancing a message communication, according to an embodiment as disclosed herein.
FIGS. 5-9 illustrate timelines for various events to generate rich cards.
The embodiments herein and the various features and advantageous details thereof are explained more fully with reference to the non-limiting embodiments that are illustrated in the accompanying drawings and detailed in the following description. Descriptions of well-known components and processing techniques are omitted so as to not unnecessarily obscure the embodiments herein. Also, the various embodiments described herein are not necessarily mutually exclusive, as some embodiments can be combined with one or more other embodiments to form new embodiments. The term "or" as used herein, refers to a non-exclusive or, unless otherwise indicated. The examples used herein are intended merely to facilitate an understanding of ways in which the embodiments herein can be practiced and to further enable those skilled in the art to practice the embodiments herein. Accordingly, the examples should not be construed as limiting the scope of the embodiments herein.
As is traditional in the field, embodiments may be described and illustrated in terms of blocks which carry out a described function or functions. These blocks, which may be referred to herein as units or modules or the like, are physically implemented by analog or digital circuits such as logic gates, integrated circuits, microprocessors, microcontrollers, memory circuits, passive electronic components, active electronic components, optical components, hardwired circuits, or the like, and may optionally be driven by firmware. The circuits may, for example, be embodied in one or more semiconductor chips, or on substrate supports such as printed circuit boards and the like. The circuits constituting a block may be implemented by dedicated hardware, or by a processor (e.g., one or more programmed microprocessors and associated circuitry), or by a combination of dedicated hardware to perform some functions of the block and a processor to perform other functions of the block. Each block of the embodiments may be physically separated into two or more interacting and discrete blocks without departing from the scope of the invention. Likewise, the blocks of the embodiments may be physically combined into more complex blocks without departing from the scope of the invention
The accompanying drawings are used to help easily understand various technical features and it should be understood that the embodiments presented herein are not limited by the accompanying drawings. As such, the present disclosure should be construed to extend to any alterations, equivalents and substitutes in addition to those which are particularly set out in the accompanying drawings. Although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are generally only used to distinguish one element from another.
Accordingly, embodiments herein disclose a method for displaying an enhance message in an electronic device. The method includes receiving, by the electronic device, data from a plurality of applications of the electronic device. Further, the method includes creating, by the electronic device, a prime event associated with a user of the electronic device based on the data received from the plurality of applications of the electronic device. Further, the method includes determining, by the electronic device, a weight for a plurality of parameters associated with the data received from the plurality of applications of the electronic device. Further, the method includes generating, by the electronic device, at least one rich card based on the determined weight. Further, the method includes determining, by the electronic device, at least one activity of the user of the electronic device. Further, the method includes determining, by the electronic device, whether the prime event is completed based on the at least one activity of the user of the electronic device. Further, the method includes updating at least one rich card in response to determining that the prime event is completed and displaying the updated rich card on the electronic device. Further, the method includes determining at least one recommendation for the user of the electronic device based on at least one rich card stored in the electronic device in response to determining that the prime event is not completed.
Referring now to the drawings, and more particularly to FIGS. 2 through 4G, there are shown preferred embodiments.
FIG. 2 is a block diagram of the electronic device (100) for displaying the enhance message in the electronic device (100), according to an embodiment as disclosed herein. The electronic device (100) can be, for example, but not limited to a smart phone, a laptop, a desktop, a smart watch, a smart TV or a like. In an embodiment, the electronic device (100) includes a memory (110), a processor (120), a communicator (130), a display (140), and an enhanced messaging controller (150).
The memory (110) also stores instructions to be executed by the processor (120). The memory (110) may include non-volatile storage elements. Examples of such non-volatile storage elements may include magnetic hard discs, optical discs, floppy discs, flash memories, or forms of electrically programmable memories (EPROM) or electrically erasable and programmable (EEPROM) memories. In addition, the memory (110) may, in some examples, be considered a non-transitory storage medium. The term "non-transitory" may indicate that the storage medium is not embodied in a carrier wave or a propagated signal. However, the term "non-transitory" should not be interpreted that the memory (110) is non-movable. In some examples, the memory (110) can be configured to store larger amounts of information than the memory. In certain examples, a non-transitory storage medium may store data that can, over time, change (e.g., in Random Access Memory (RAM) or cache). In an embodiment, the memory (110) can be an internal storage unit or it can be an external storage unit of the electronic device (100), a cloud storage, or any other type of external storage. The memory (110) includes an application repository (110a) to store data of a plurality of applications (e.g., calling application, gallery application, camera application, business application, education application, lifestyle application, entertainment application, utility application, travel application, health and fitness application) of the electronic device (100).
The processor (120) communicates with the memory (110), the communicator (130), the display (140), and the enhanced messaging controller (150). The processor (120) is configured to execute instructions stored in the memory (110) and to perform various processes. The communicator (130) is configured for communicating internally between internal hardware components and with external devices via one or more networks.
In an embodiment, the enhanced messaging controller (150) includes a data transformer (151), an event controller (152), a user co-efficient evaluator (153), a rich card controller (154), and an ML engine (155). The enhanced messaging controller (150) is implemented by processing circuitry such as logic gates, integrated circuits, microprocessors, microcontrollers, memory circuits, passive electronic components, active electronic components, optical components, hardwired circuits, or the like, and may optionally be driven by firmware. The circuits may, for example, be embodied in one or more semiconductor chips, or on substrate supports such as printed circuit boards and the like.
The data transformer (151) receives data from the plurality of applications of the electronic device (100). The plurality of applications (110) of the electronic device (100) can be, for example, but not limited to an Electronic Mail (email), a Short Message Service (SMS), a Multimedia Messaging Service (MMS), a web browsing. Further, the data transformer (151) extracts useful information from the received data using Natural language processing (NLP). The useful information can be, for example, but not limited to an event location, an event start time, an event start date, an event end time, an event end date and event keywords. Further, the data transformer (151) extracts information related to real-time information present in the received data. The information can be related to a usability time, a current location of the user of the electronic device (100), a current time associated with the user of the electronic device (100), and a current context of the user of the electronic device (100), a usage context of the user of the electronic device (100), a user profile related data, etc. Further, the data transformer (151) transfers the extracted information to the event controller (152).
The event controller (152) determines whether the data (i.e. the extracted information received from the data transformer (151)) received from the plurality of applications (110) of the electronic device (100) is valid to create the event associated with the user of the electronic device (100), the event comprises one of the prime event and the sub event. In order to validate the received data, the event controller (152) uses the ML engine (155). Furthermore, the event controller (152) creates the event in the electronic device (100) in response to determining that the plurality of parameters is valid. Furthermore, the event controller (152) discards the event in the electronic device in response to determining that the plurality of parameters is not valid.
Furthermore, the event controller (152) categorizes event and assigns a single category to the given extracted information which can potentially create the event. The single category to the given extracted information can be, for example, but not limited to shopping, friends group school, friend's cricket, and social media.
Furthermore, the event controller (152) determines whether all useful information (e.g. the event location, the event start time, the event start date, the event end time, , the event keywords, and the state of the electronic device (100)are available in a created event. Furthermore, the event controller (152) creates the event associated with the user of the electronic device (100) as the prime event in response to determining that all useful information is available in the created event. Furthermore, the event controller (152) creates the event associated with the user of the electronic device (100) as the sub event in response to determining that all useful information is not available in the created event.
Furthermore, the event controller (152) determines whether the prime event co-relates with the sub event based on various factors. The various factors can be, for example, but not limited to a usage pattern of the user of the electronic device (100), a history/ learning of the event (prime event and/or sub event), a frequency of the event, the current location of the user of the electronic device (100), the current time associated with the user of the electronic device (100), and the current context of the user of the electronic device (100). In order to co-relate the prime event with the sub event, the event controller (152) uses the ML engine (155). Furthermore, the event controller (152) adds the sub event into the prime event in response to determining that the prime-event is co-related with the sub event. Furthermore, the event controller (152) performing one of discarding the sub event and creating a new prime event in response to determining that the prime event is not co-related with the sub event.
The user co-efficient evaluator (153) applies a weight to each of the parameters (context information displays on the screen of the electronic device (100), the plurality of parameters associated with the data received from the plurality of applications of the electronic device (100)) based on the interaction of the user of the electronic device (100) with at least one of the sub event and the prime event. A threshold is maintained for a number of relevant items and uses Least Recently Used (LRU) concept for clearing older items. Furthermore, the user co-efficient evaluator (153) detects interaction with content (at least one event) and assigning weight to different content , which keeps on increasing based on number of regular interactions of the user of the electronic device (100). Furthermore, user co-efficient evaluator (153) monitors certain limit to such list of content, content which has least weight , once the limit is reached , is removed from the list and latest content is added. For example, the user of the electronic device (100) searches for headphone over a period of time. So, the weight is higher over the period of time. Further, for a long time period, if the user of the electronic device (100) has no interaction with such content, the user co-efficient evaluator (153) shifted the content to bottom of the list, and once space in list is over, is removed from the list. Furthermore, the user co-efficient evaluator (153) calculates the weight (user engagement co-efficient (UEC (W))) by below equation 1,
(1)
Figure PCTKR2021016310-appb-img-000001
Where, k=User usage factor of content (increases with usage)
T= (Current time - Last access time) in days
Lw = Last weight
The rich card controller (154) determines at least one activity associated with at least one of the sub event and the prime event of the user of the electronic device (100). Furthermore, the rich card controller (154) generates the rich card based on the prime event and the predicted sub event. The predicted sub event is fetched based on co-relation b/w the prime event and the sub event, and the calculated weight. The rich card comprises at least one of the predicted time required to complete the at least prime event, the predicted sub event that need to be performed to complete the prime event, the predicted time required to complete the at least predicted sub event, and the predicted mode to be used to complete at least one of the prime event and the predicted sub event. Furthermore, the rich card controller (154) displays the rich card in the electronic device (100). Furthermore, the rich card controller (154) shares the generated rich card with at least one-second user of the electronic device (200) (e.g. smart TV, smart watch, smartphone, etc.), track the usage of the generated rich card, and updates weight of neural network node of at least one machine learning model (i.e. ML engine (155)) based on the usage of the generated rich card.
Furthermore, the rich card controller (154) determines whether the prime event is completed based on the at least one activity of the user of the electronic device (100). Furthermore, the rich card controller (154) updates the rich card in response to determining that the prime event is completed, and displays the updated rich card on the electronic device (100). The rich card comprising information related to at least one of an actual time taken by the user of the electronic device (100) to complete the prime event, an actual sub event associated with the prime event completed by the user of the electronic device (100), an actual location visited by the user of the electronic device (100) to complete at least one of the prime event and the sub event, and an actual mode used to complete at least one of the prime event and the actual sub event. Furthermore, the rich card controller (154) shares the updated rich card with at least one-second user of the electronic device (200), tracks the usage of the updated rich card, and updates the weight of neural network node of at least one machine learning model based on the usage of the updated rich card.
At least one of the plurality of modules/ components may be implemented through an artificial intelligence (AI) model. A function associated with AI may be performed through memory (110) and the processor (120).
The processor (120) may include one or a plurality of processors such as a central processing unit (CPU), an application processor (AP), or the like, a graphics-only processing unit such as a graphics processing unit (GPU), a visual processing unit (VPU), and/or an AI-dedicated processor such as a neural processing unit (NPU).
The one or a plurality of processors controls the processing of the input data in accordance with a predefined operating rule or artificial intelligence (AI) model stored in the non-volatile memory and the volatile memory. The predefined operating rule or artificial intelligence model is provided through training or learning.
Here, being provided through learning means that, by applying a learning process to a plurality of learning data, a predefined operating rule or AI model of a desired characteristic is made. The learning may be performed in a device itself in which the AI according to an embodiment is performed, and/o may be implemented through a separate server/system.
The AI model may consist of a plurality of neural network layers. Each layer has a plurality of weight values and performs a layer operation through calculation of a previous layer and an operation of a plurality of weights. Examples of neural networks include, but are not limited to, convolutional neural network (CNN), deep neural network (DNN), recurrent neural network (RNN), restricted Boltzmann Machine (RBM), deep belief network (DBN), bidirectional recurrent deep neural network (BRDNN), generative adversarial networks (GAN), and deep Q-networks.
The learning process is a method for training a predetermined target device (for example, a robot) using a plurality of learning data to cause, allow, or control the target device to make a determination or prediction. Examples of learning processes include, but are not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning.
Although the FIG. 2 shows various hardware components of the electronic device (100) but it is to be understood that other embodiments are not limited thereon. In other embodiments, the electronic device (100) may include less or more number of components. Further, the labels or names of the components are used only for illustrative purpose and does not limit the scope of the invention. One or more components can be combined together to perform same or substantially similar function for displaying the enhance message in the electronic device (100).
FIGs. 3A and 3B are flow diagrams (S300) illustrating various operations for displaying the enhance message in the electronic device (100), according to an embodiment as disclosed herein. The operations (S302-S316ab), (S302-S316ba) are performed by the enhanced messaging controller (150).
Referring to FIGs. 3 A and 3B, at S302, the method includes receiving data from the plurality of applications of the electronic device (100). At S304, the method includes creating the prime event associated with a user of the electronic device (100) based on the data received from the plurality of applications of the electronic device (100). At S306, the method includes determining the weight for the plurality of parameters associated with the data received from the plurality of applications of the electronic device (100). At S308, the method includes generating the rich card based on the determined weight. At S310, the method includes determines whether the at least prime event is created first time. At S312, the method includes predicting the sub event required to complete the prime event based on the plurality of parameters associated with the user of the electronic device (100) in response to determining that at least prime event is created the first time. At S314, the method includes updating the rich card based on the prime event and a predicted sub event. At S316, the method includes displaying the rich card in the electronic device (100).
At S318, the method includes determining at least one activity of the user of the electronic device (100) in response to determining that the least prime event is not created the first time. At S320, the method includes determining whether the prime event is completed. At S320aa, the method includes updating the rich card in response to determining that the prime event is completed. At S320ab, the method includes displaying the updated rich card on the electronic device (100). At S320ba, the method includes determining at least one recommendation for the user of the electronic device (100) based on at least one rich card stored in the electronic device (100).
The various operations, actions, acts, blocks, steps, or the like in the flow diagram (S300) may be performed in the order presented, in a different order or simultaneously. Further, in some embodiments, some of the operations, actions, acts, blocks, steps, or the like may be omitted, added, modified, skipped, or the like without departing from the scope of the invention.
FIG. 3C is a flow diagram (S304) illustrating various operations for creating the prime event in the electronic device (100), according to an embodiment as disclosed herein. The operations (S304a-S304f) are performed by the enhanced messaging controller (150).
Referring to FIG. 3C, at S304a, the method includes determining whether the data received from the plurality of applications (110) of the electronic device (100) is valid to create the event associated with the user of the electronic device (100), the event comprises one of the prime event and the sub event. At S304b, the method includes discarding the event in the electronic device (100) in response to determining that the plurality of parameters is not valid. At S304c, the method includes creating the event in the electronic device (100) in response to determining that the plurality of parameters is valid.
At S304d, the method includes determining whether the start time, the end time, the location, the state of the electronic device (100), and the keywords are available in the created event. At S304e, the method includes creating the event associated with the user of the electronic device (100) as the prime event in response to determining that the start time, the end time, the location, the state of the electronic device (100), and the keywords are available in the created event. At S304f, the method includes creating the event associated with the user of the electronic device (100) as the sub event in response to determining that the start time, the end time, the location, the state of the electronic device (100), and the keywords are not available in the created event.
FIGS. 4A-4D illustrate various example scenarios to generate the rich card for displaying the enhance message, according to an embodiment as disclosed herein.
Referring to FIG. 4A: At 402a, the user of the electronic device (100) receives a notification from Netlix application (110a) of the electronic device (100). The data transformer (151) extracts useful information from the received notification. The useful information in Netlix application (110a) may include but not limited to the event location, April-10 as the event start-date time & event end-date time, and a War movie as the event keywords. Further, the event controller (152) validates all useful information using the ML engine (155) and creates the prime event in response to determining that all useful information is available to create the prime event. Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. UEC= Movie: W1) of the electronic device (100).
At 404a, the user of the electronic device (100) watching the War movie on the Netlix application (110a) of the electronic device (100). The data transformer (151) extracts useful information from the current context (i.e. watching the War movie) displays on the electronic device (100). Furthermore, the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event. Furthermore, the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. notification of the War movie). Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. UEC= Movie: W2, preferred language-English: W6, and Film Genres-sci-fi: W7) of the electronic device (100).
At 406a, the user of the electronic device (100) reading a review of the War movie on a review application (110b) of the electronic device (100). The data transformer (151) extracts useful information from the current context (i.e. reading review of the War movie) displays on the electronic device (100). Furthermore, the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event. Furthermore, the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. notification of the War movie, watching the War movie). Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. UEC= Reading review: W3) of the electronic device (100).
At 408a, the user of the electronic device (100) listing music of the War movie on a music application (110c) of the electronic device (100). The data transformer (151) extracts useful information from the current context (i.e. listing music of the War movie) displays on the electronic device (100). Furthermore, the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event. Furthermore, the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. notification of the War movie, watching the War movie, reading the review of the War movie). Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. UEC= Music: W4) of the electronic device (100).
At 410a, the user of the electronic device (100) watching a trailer of a magic movie on a trailer application (110d) of the electronic device (100). The data transformer (151) extracts useful information from the current context (i.e. watching the trailer of the magic movie) displays on the electronic device (100). Furthermore, the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event. Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. UEC= Trailer: W5) of the electronic device (100). So, the UEC after 410a is given in the below table.1.
UEC Weight
Movie Interest W1+W2
Preferred language-English W6
Genre-Sci-fi W7
Music Interest W4
Reading reviews W3
Trailer Viewing W5
Referring to FIG. 4B: At 412a, the user of the electronic device (100) receives a mail from the Netlix application (110a) of the electronic device (100). The data transformer (151) extracts useful information from the received mail. Further, the event controller (152) validates all useful information using the ML engine (155) and creates the prime event (i.e. Joker Movie) in response to determining that all useful information is available to create the prime event. Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. UEC= Movie: W3) of the electronic device (100) and updates the previous user co-efficient of table.1.
At 414a, the user of the electronic device (100) reading a review of the Joker movie on the review application (110b) of the electronic device (100). The data transformer (151) extracts useful information from the current context (i.e. reading review of the Joker movie) displays on the electronic device (100). Furthermore, the event controller (152) validates all useful information using the ML engine (155) and creates the sub event (i.e. review of the Joker movie) in response to determining that all useful information is not available to create the prime event. Furthermore, the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. notification of the Joker movie), and usage pattern (402a-410a) of the user of the electronic device (100). Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. UEC= Reading review: W5) of the electronic device (100) and updates the previous user co-efficient of table.1.
Referring to FIG. 4C: At 416a, the user of the electronic device (100) listing music of the Joker movie on the music application (110c) of the electronic device (100). The data transformer (151) extracts useful information from the current context (i.e. listing music of the Joker movie) displays on the electronic device (100). Furthermore, the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event. Furthermore, the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. notification of the Joker movie, reading review of the Joker movie), and usage pattern (402a-410a) of the user of the electronic device (100). Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. UEC= Music: W8) of the electronic device (100) and updates the previous user co-efficient of table.1.
At 418a, the user of the electronic device (100) watching a trailer of the Joker movie on the trailer application (110d) of the electronic device (100). The data transformer (151) extracts useful information from the current context (i.e. watching the trailer of the Joker movie) displays on the electronic device (100). Furthermore, the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event. Furthermore, the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. notification of the Joker movie, reading the review of the Joker movie, listing music of the Joker movie), and usage pattern (402a-410a) of the user of the electronic device (100). Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. UEC= Trailer: W9) of the electronic device (100) and updates the previous user co-efficient of table.1.
Referring to FIG. 4D: At 420a, the rich card controller (154) generates the rich card based on the prime event (412a) and the sub event (414a to 418a). The sub event is fetched based on co-relation b/w the prime event and the sub event by the event controller (152), and the calculated weight by the user co-efficient evaluator (153). Furthermore, the rich card controller (154) displays the rich card in the electronic device (100).
FIGs. 5-9 illustrate timelines for various events to generate a rich card.
Referring to FIG. 5A: At 402b, the user of the electronic device (100) receives a mail from a booking application (110e) of the electronic device (100). The data transformer (151) extracts useful information from the received mail. The useful information is Delhi Hatt, Janakpuri as the event location, 21-Jan-2020 at 2-4 PM as the event start-date time & event end-date time, and a Ticket number (18007) and visitors (4) as the event keywords. Further, the event controller (152) validates all useful information using the ML engine (155) and creates the prime event in response to determining that all useful information is available to create the prime event. Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. UEC= Delhi++) of the electronic device (100).
At 404b, the user of the electronic device (100) booking a cab on a cab booking application (110f) of the electronic device (100). The data transformer (151) extracts useful information from the current context (i.e. your cab is arriving for Delhi Hatt) displays on the electronic device (100). Furthermore, the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event. Furthermore, the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. Delhi Hatt). Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. UEC= online cab++) of the electronic device (100).
At 406b, the user of the electronic device (100) capturing and uploading photos of traditional cloth on a social media application (110g) of the electronic device (100). The data transformer (151) extracts useful information from the current context displays on the electronic device (100). Furthermore, the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event. Furthermore, the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. Delhi Hatt, your cab is arriving for Delhi Hatt), and the current location of the user of the electronic device (100). Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. UEC= cloth++) of the electronic device (100).
At 408b, the user of the electronic device (100) paying online payment through a payment application (110h) of the electronic device (100). The data transformer (151) extracts the useful information from the current context (i.e. Paid Rs.240 to Rohan Kulfi at Delhi Haat) displays on the electronic device (100). Furthermore, the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event. Furthermore, the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. Delhi Hatt, your cab is arriving for Delhi Hatt,), the current time associated with the user of the electronic device (100) and the current location of the user of the electronic device (100). Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. UEC= Kulfi++, online payment++) of the electronic device (100).
Referring to FIG. 5B: At 410b, the user of the electronic device (100) paying online payment to E-board through the payment application (110h) of the electronic device (100). The data transformer (151) extracts the useful information from the current context (i.e. Paid Rs.2400 to E-board on 21-Jan-2020 at 3:55 pm) displays on the electronic device (100). Furthermore, the event controller (152) discards the event as all useful information is not valid to create the sub event. At 412b, the user of the electronic device (100) booking a cab on the cab booking application (110f) of the electronic device (100). The data transformer (151) extracts useful information from the current context (i.e. your cab for home) displays on the electronic device (100). Furthermore, the event controller (152) detects the prime event is completed.
At 414b, the rich card controller (154) generates the rich card based on the prime event (402b) and the sub event (404b to 414b), summary creation of the completed prime event. The sub event is fetched based on co-relation b/w the prime event and the sub event by the event controller (152), and the calculated weight by the user co-efficient evaluator (153). Furthermore, the rich card controller (154) displays the rich card in the electronic device (100). Referring to FIG. 5C: At 416, based on the UEC calculation from the created prime event (402b), future incoming events (416ba to 416bd) are processed and rich cards (418b, 420b, 422b) are displayed in the electronic device (100).
Referring to FIG. 5D: the enhanced messaging controller (150) creates a summary of the completed prime event (s) (402c,404c,406c) and displays (408c) as rich card logs on the screen of the electronic device (100).
Referring to FIGs. 6A and 6B: At 402d-404d, the second user of the electronic device (200) (i.e. User-B) receives a notification from a social media application (210g) of the electronic device (200), and give a reaction to the notification. The notification is related to at least one activity of the user of the electronic device (100) (i.e. User-A), for example, the User-A posts event (e.g. Goa diaries), and the User-B receives the notification for the same. The reaction to the notification is related to at least one activity of the User-B, for example, the User-B like's event which is posted by the User-A. At 406d, the User-A is being notified that the User-B like the event which is posted by the User-A. At 408d, an enhanced messaging controller (250) provides a feature to the User-B to know more about the post. For example, the enhanced messaging controller (250) sends a request for a rich card related to the event which is posted by the User-A. At 410d-412d, the enhanced messaging controller (150) of the user of the electronic device (100) generates the rich card relates to the User-A posts event and shares the rich card with the User-B.
Referring to FIG. 7: the enhanced messaging controller (150) displays rich cards of the completed prime event (s) (402e, 404e) and provides a comparison (406e) of two similar service providers. Example of similar service providers, SWI food delivery, and Zom food delivery. The comparison is created by the event controller (152), where the event controller (152) categorizes event and assigns the single category to the given extracted information which can potentially create the event. Further, the comparison is on the basis of preset parameters which are present in the prime event on basis of which category is assigned.
Referring to FIG. 8A: At 402f, the user of the electronic device (100) receives a mail from the booking application (110e) of the electronic device (100). The data transformer (151) extracts useful information from the received mail. The useful information is Manali hotel as the event location, 14-Feb-2020 and 2 days as the event start-date time & event end-date time and a Booking number (18008) as the event keyword. Further, the event controller (152) validates all useful information using the ML engine (155) and creates the prime event in response to determining that all useful information is available to create the prime event. Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. UEC= Manali hotel ++) of the electronic device (100).
At 404f, the user of the electronic device (100) booking a cab on the cab booking application (110f) of the electronic device (100). The data transformer (151) extracts useful information from the current context (i.e. your cab is for Manali) displays on the electronic device (100). Furthermore, the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event. Furthermore, the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. Manali hotel). Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. UEC= online cab++) of the electronic device (100).
At 406f, the user of the electronic device (100) paying online payment through the payment application (110h) of the electronic device (100). The data transformer (151) extracts the useful information from the current context (i.e. Paid Rs.1000 to HP petrol pump at Amar highway Manali) displays on the electronic device (100). Furthermore, the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event. Furthermore, the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. Manali hotel, your cab is for Manali), the current time associated with the user of the electronic device (100), and the current location of the user of the electronic device (100). Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. online payment++) of the electronic device (100).
At 408f, the user of the electronic device (100) displays a battery notification. The data transformer (151) extracts useful information from the current context (i.e. battery is getting low 15% remaining) displays on the electronic device (100). Furthermore, the event controller (152) detects a Save our souls (SOS) situation based on the current context and sends a notification to the rich card controller (154) to generate the rich card. Referring to FIG. 8B: At 410f, the rich card controller (154) generates the rich card based on the prime event (402f) and the sub event (404f to 406f). The sub event is fetched based on co-relation b/w the prime event and the sub event by the event controller (152), and the calculated weight by the user co-efficient evaluator (153). Furthermore, the rich card controller (154) shares the rich card with any emergency contact (i.e. the at least one-second electronic device (200)) for the SOS situation.
Referring to FIG. 9: At 402g, the user of the electronic device (100) receives mail from a shopping application (110i) of the electronic device (100). The data transformer (151) extracts useful information from the received mail. The useful information is search history / learning for the camera as the event location, Diwali as the event start-date time & event end-date time, and an EOS 3000D digital single-lens reflex (DSLR) Camera as the event keywords. Further, the event controller (152) validates all useful information using the ML engine (155) and creates the prime event in response to determining that all useful information is available to create the prime event. Furthermore, the user co-efficient evaluator (153) applies the weight to current context information (i.e. UEC= EOS 3000D DSLR Camera ++, Diwali ++) of the electronic device (100).
At 404g, the user of the electronic device (100) receives a message from the shopping application (110i) of the electronic device (100). The data transformer (151) extracts useful information from the current context (i.e. you have added EOS 3000D DSLR camera) displays on the electronic device (100). Furthermore, the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event. Furthermore, the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. EOS 3000D DSLR Camera). Furthermore, the user co-efficient evaluator (153) applies the weight to the current context information of the electronic device (100).
At 406g, the user of the electronic device (100) receives an offer message from the other shopping application (110i) of the electronic device (100). The data transformer (151) extracts useful information from the current context (i.e. Diwali sale!! Buy your favorite EOS 3000D DSLR camera, at a discount of 25%, DLF mall) displays on the electronic device (100). Furthermore, the event controller (152) validates all useful information using the ML engine (155) and creates the sub event in response to determining that all useful information is not available to create the prime event. Furthermore, the event controller (152) co-relates the prime event with the sub event based on the history/ learning of the event (i.e. EOS 3000D DSLR Camera, you have added EOS 3000D DSLR camera). Furthermore, the user co-efficient evaluator (153) applies the weight to the current context information of the electronic device (100).
At 408g-410g, the user of the electronic device (100) visits a DLF mall. The data transformer (151) extracts useful information from the current context (i.e. DLF mall Location). Furthermore, the event controller (152) co-relates the prime event with the current context based on the history/ learning of the event (i.e. Delhi Hatt, your cab is arriving for Delhi Hatt, Diwali sale!! Buy your favorite EOS 3000D DSLR camera, at a discount of 25%, DLF mall) and the current location of the user of the electronic device (100). Furthermore, the event controller (152) detects the prime event is not completed. So, the rich card controller (154) automatically recommending at least one suggestion relates to the prime event (402g) and displays the at least one suggestion in the electronic device (100).
The foregoing description of the specific embodiments will so fully reveal the general nature of the embodiments herein that others can, by applying current knowledge, readily modify and/or adapt for various applications such specific embodiments without departing from the generic concept, and, therefore, such adaptations and modifications should and are intended to be comprehended within the meaning and range of equivalents of the disclosed embodiments. It is to be understood that the phraseology or terminology employed herein is for the purpose of description and not of limitation. Therefore, while the embodiments herein have been described in terms of preferred embodiments, those skilled in the art will recognize that the embodiments herein can be practiced with modification within the spirit and scope of the embodiments as described herein.

Claims (15)

  1. A method for displaying an enhance message in an electronic device (100), the method comprises:
    receiving, by the electronic device (100), data from a plurality of applications of the electronic device (100);
    creating, by the electronic device (100), at least one prime event associated with a user of the electronic device (100) based on the data received from the plurality of applications of the electronic device (100);
    determining, by the electronic device (100), a weight for a plurality of parameters associated with the data received from the plurality of applications of the electronic device (100);
    generating, by the electronic device (100), at least one rich card based on the determined weight; and
    displaying, by the electronic device (100), the at least one rich card on the electronic device (100).
  2. The method as claimed in claim 1, the method comprises:
    determining, by the electronic device (100), at least one activity of the user of the electronic device (100);
    determining, by the electronic device (100), whether the at least one prime event is completed based on the at least one activity of the user of the electronic device (100); and
    performing, by the electronic device (100), one of:
    updating the at least one rich card based on the determined weight in response to determining that the at least one prime event is completed, and displaying the at least one updated rich card on the electronic device (100), and
    determining at least one recommendation for the user of the electronic device (100) based on at least one rich card stored in the electronic device (100) in response to determining that the at least one prime event is not completed.
  3. The method as claimed in claim 2, wherein the at least one rich card comprising information related to at least one of an actual time taken by the user of the electronic device (100) to complete the at least one prime event, at least one actual sub event associated with the at least one prime event completed by the user of the electronic device (100), at least one actual location visited by the user of the electronic device (100) to complete at least one of the at least one prime event and the at least one sub event, and an actual mode used to complete at least one of the at least one prime event and the at least one actual sub event.
  4. The method as claimed in claim 1, the method comprises:
    predicting, by the electronic device (100), at least one sub event required to complete the at least one prime event based on the plurality of parameters associated with the user of the electronic device (100);
    updating, by the electronic device (100), the at least one rich card based on the at least one prime event and at least one predicted sub event; and
    displaying, by the electronic device (100), the at least one rich card in the electronic device (100).
  5. The method as claimed in claim 4, wherein the rich card comprises at least one of a predicted time required to complete the at least prime event, the at least one predicted sub event that need to be performed to complete the at least one prime event, a predicted time required to complete the at least predicted sub event, and a predicted mode to be used to complete at least one of the at least one prime event and the at least one predicted sub event.
  6. The method as claimed in claim 1, wherein creating, by the electronic device (100), the at least one prime event associated with the user of the electronic device (100) based on the data received from the plurality of applications of the electronic device (100) comprises:
    extracting, by the electronic device (100), information about at least one of a start time, an end time, a location, a state of the electronic device (100), and a keywords related to at least one event from the data;
    creating, by the electronic device (100), the at least one prime event by applying at least one machine learning (ML) model (155) on the information about at least one of the start time, the end time, the location, the state of the electronic device (100), and the keywords related to the at least one prime event from the data.
  7. The method as claimed in claim 6, wherein creating the at least one prime event comprises:
    determining, by the electronic device (100), whether the data received from the plurality of applications of the electronic device (100) is valid to create the at least one event associated with the user of the electronic device (100), wherein the at least one event comprises one of the at least one prime event and the at least one sub event; and
    performing, by the electronic device (100), one of:
    creating the at least one event in the electronic device (100) in response to determining that the plurality of parameters is valid, and
    discarding the at least one event in the electronic device (100) in response to determining that the plurality of parameters is not valid.
  8. The method as claimed in claim 7, wherein creating the at least one event in the electronic device (100) in response to determining that the plurality of parameters is valid, further comprises:
    determining, by the electronic device (100), whether the start time, the end time, the location, the state of the electronic device (100), and the keywords are available in the created at least one event; and
    performing, by the electronic device (100), one of:
    creating the at least one event associated with the user of the electronic device (100) as the at least one prime event in response to determining that the start time, the end time, the location, the state of the electronic device (100), and the keywords are available in the created at least one event, and
    creating the at least one event associated with the user of the electronic device (100) as the at least one sub event in response to determining that the start time, the end time, the location, the state of the electronic device (100), and the keywords are not available in the created at least one event.
  9. The method as claimed in claim 4, wherein predicting the at least one sub event required to complete the at least one prime event based on the plurality of parameters associated with the user of the electronic device (100) comprises:
    applying, by the electronic device (100), the weight to each of the parameters based on an interaction of the user of the electronic device (100) with at least one of the at least one sub event and the at least one prime event;
    determining, by the electronic device (100), whether the at least one prime event is co-relates with the at least one sub event based on the applied weight; and
    performing, by the electronic device (100), one of:
    adding the at least one sub event into the at least one prime event in response to determining that the at least one prime-event is co-related with the at least one sub event, and
    performing one of discarding the at least one sub event and creating at least one new prime event in response to determining that the at least one prime event is not co-related with the at least one sub event.
  10. The method as claimed in claim 4, wherein the plurality of parameters comprises preferences of the user of the electronic device (100), a list of locations visited by the user of the electronic device (100), and a list of sub events completed by the user of the electronic device (100) to complete the at least one prime event.
  11. The method as claimed in claim 2, wherein determining, by the electronic device (100), whether the at least one prime event is completed based on the at least one activity of the user of the electronic device (100), and the end time, the location, the state of the electronic device, and keywords related to the at least one event.
  12. The method as claimed in claim 4, wherein the method comprises:
    sharing the predicted rich card with at least one-second user of the electronic device (200);
    tracking a usage of the predicted rich card; and
    updating weight of neural network node of at least one machine learning model based on the usage of the predicted rich card.
  13. The method as claimed in claim 2, wherein the method comprises:
    sharing the updated rich card with at least one-second user of the electronic device (200);
    tracking a usage of the updated rich card; and
    updating weight of neural network node of at least one machine learning model based on the usage of the updated rich card.
  14. The method as claimed in claim 2, wherein displaying the at least one rich card information in an optimal mode, wherein the optimal mode comprises one of an image output, a text output, an audio output, and a video output, wherein the rich card information includes a summary of the at least one prime event, a logs of the at least one prime event, and a comparison of at least two prime events.
  15. An electronic device (100) for displaying an enhance message, the electronic device (100) comprising:
    a memory (110);
    a processor (120); and
    an enhanced messaging controller (150), operably connected to the memory (110) and the processor (120), configured to:
    receive data from a plurality of applications of the electronic device (100);
    create at least one prime event associated with a user of the electronic device (100) based on the data received from the plurality of applications of the electronic device (100);
    determine a weight for a plurality of parameters associated with the data received from the plurality of applications of the electronic device (100);
    generate at least one rich card based on the determined weight; and
    display the at least one rich card on the electronic device (100).
PCT/KR2021/016310 2020-11-10 2021-11-10 Method and electronic device for displaying enhance message in electronic device WO2022103142A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
IN202041049086 2020-11-10
IN202041049086 2020-11-10
KR1020210100610A KR20220063708A (en) 2020-11-10 2021-07-30 Method and electronic device for displaying enhance message in electronic device
KR10-2021-0100610 2021-07-30

Publications (1)

Publication Number Publication Date
WO2022103142A1 true WO2022103142A1 (en) 2022-05-19

Family

ID=81602563

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2021/016310 WO2022103142A1 (en) 2020-11-10 2021-11-10 Method and electronic device for displaying enhance message in electronic device

Country Status (1)

Country Link
WO (1) WO2022103142A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130252591A1 (en) * 2012-03-20 2013-09-26 Samsung Electronics Co., Ltd. Smart alarm
US20140351744A1 (en) * 2013-05-22 2014-11-27 Samsung Electronics Co., Ltd. Method of operating notification screen and electronic device supporting the same
US20150135088A1 (en) * 2013-11-12 2015-05-14 Microsoft Corporation Aggregating and presenting event information
US20160203415A1 (en) * 2015-01-14 2016-07-14 Microsoft Technology Licensing, Llc User interaction pattern extraction for device personalization
US20190258371A1 (en) * 2016-10-19 2019-08-22 Huawei Technologies Co., Ltd. Picture Processing Method and Apparatus, Electronic Device, and Graphical User Interface

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130252591A1 (en) * 2012-03-20 2013-09-26 Samsung Electronics Co., Ltd. Smart alarm
US20140351744A1 (en) * 2013-05-22 2014-11-27 Samsung Electronics Co., Ltd. Method of operating notification screen and electronic device supporting the same
US20150135088A1 (en) * 2013-11-12 2015-05-14 Microsoft Corporation Aggregating and presenting event information
US20160203415A1 (en) * 2015-01-14 2016-07-14 Microsoft Technology Licensing, Llc User interaction pattern extraction for device personalization
US20190258371A1 (en) * 2016-10-19 2019-08-22 Huawei Technologies Co., Ltd. Picture Processing Method and Apparatus, Electronic Device, and Graphical User Interface

Similar Documents

Publication Publication Date Title
CN107368508B (en) Keyword search method and system using communication tool service
CN110458360B (en) Method, device, equipment and storage medium for predicting hot resources
JP6487427B2 (en) Flexible image layout
WO2020096087A1 (en) Method, system, and non-transitory computer-readable recording medium for managing message group
KR20160055800A (en) Selecting content items for presentation to a social networking system user in a newsfeed
KR20150038315A (en) Negative signals for advertisement targeting
CN111435377B (en) Application recommendation method, device, electronic equipment and storage medium
CN110688527A (en) Video recommendation method and device, storage medium and electronic equipment
CN110061908A (en) Application program recommendation, device, electronic equipment and medium
WO2019088734A1 (en) Method and system for automatically creating an instant ad-hoc calendar event
CN111400625B (en) Page processing method and device, electronic equipment and computer readable storage medium
WO2019059435A1 (en) Method and system for making recommendations using content including location data
CN114398554B (en) Content searching method, device, equipment and medium
CN105210049A (en) Contact aggregation in a social network
CN113630303A (en) Content sharing method, content sharing system, readable storage medium and electronic device
CN107547646B (en) Application program pushing method and device, terminal and computer readable storage medium
JP2022169565A (en) Method and system for recommending profile photo, and non-transitory computer-readable recording medium
WO2022103142A1 (en) Method and electronic device for displaying enhance message in electronic device
WO2018038442A1 (en) Method for sharing photo image using time and location information, server, and computer-readable recording medium
JP7098579B2 (en) Information processing equipment and methods and programs
CN114528433A (en) Template selection method and device, electronic equipment and storage medium
KR20220063708A (en) Method and electronic device for displaying enhance message in electronic device
CN110752958A (en) User behavior analysis method, device, equipment and storage medium
KR20200122602A (en) Method, system, and non-transitory computer readable record medium for image retrieval and delivery
WO2021118133A1 (en) Method and apparatus for providing machine learning-based recommendations in blockchain network

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21892309

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21892309

Country of ref document: EP

Kind code of ref document: A1