WO2021041132A1 - Operational mode-based settings for presenting notifications on a user display - Google Patents

Operational mode-based settings for presenting notifications on a user display Download PDF

Info

Publication number
WO2021041132A1
WO2021041132A1 PCT/US2020/047070 US2020047070W WO2021041132A1 WO 2021041132 A1 WO2021041132 A1 WO 2021041132A1 US 2020047070 W US2020047070 W US 2020047070W WO 2021041132 A1 WO2021041132 A1 WO 2021041132A1
Authority
WO
WIPO (PCT)
Prior art keywords
notification
application
user
data
presented
Prior art date
Application number
PCT/US2020/047070
Other languages
English (en)
French (fr)
Inventor
Elizabeth Ruth JUENGER
Ryan David SUTTON
Makoto Oshita
Zentaro KAJI
Original Assignee
Sony Interactive Entertainment Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/557,578 external-priority patent/US10946294B1/en
Priority claimed from US16/557,559 external-priority patent/US10946279B1/en
Priority claimed from US16/557,600 external-priority patent/US20210064317A1/en
Application filed by Sony Interactive Entertainment Inc. filed Critical Sony Interactive Entertainment Inc.
Publication of WO2021041132A1 publication Critical patent/WO2021041132A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/53—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/70—Game security or game management aspects
    • A63F13/77—Game security or game management aspects involving data related to game devices or game servers, e.g. configuration data, software version or amount of memory
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/85—Providing additional services to players
    • A63F13/87—Communicating with other players during game play, e.g. by e-mail or chat
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • G06F9/542—Event management; Broadcasting; Multicasting; Notifications
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/80—Special adaptations for executing a specific game genre or game mode
    • A63F13/847—Cooperative playing, e.g. requiring coordinated actions from several players to achieve a common goal
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/10—Office automation; Time management

Definitions

  • GUIs are the predominant type of interfaces available to users for interacting with computer systems.
  • a GUI is operable to present notifications to a user. For example, upon receiving message data, a messaging application presents a text message on the GUI. Similarly, upon receiving a news alert, a news application presents a news notification on the GUI.
  • a first application is presenting content on the GUI (e.g., a video game application presenting video game content) and notification data is destined to a second application (e.g., the messaging application)
  • the full notification data may not be presented on the GUI (e.g., the entire text message) unless the presentation of the content is paused and a switch is performed from the first application to the second application. Accordingly, user input may be needed to switch to the second application prior to the notification data being presented. Additional user input may be needed to dismiss the notification data and resume the presentation of the content.
  • GUI can be an effective user interface
  • switching between applications may not be seamless and the presentation of information may be limited.
  • a computer system presents, in an application window on a display communicatively coupled with a device, content based on an execution of an application.
  • the computer system also receives notification data and determines an operational mode of the device from a plurality of operational modes based on the application. Each of the operational modes is associated with a different set of notification settings.
  • the computer system determines, based on the set of notification settings associated with the operational mode, that a notification is to be presented on the display.
  • the notification corresponds to the notification data.
  • the computer system presents the notification on the display while a presentation of the content in the application window continues.
  • FIG. 1 illustrates an example of a computing environment for presenting notifications, according to an embodiment of the present disclosure.
  • FIG. 2 illustrates a computer system that presents notifications, according to an embodiment of the present disclosure.
  • FIG. 3 illustrates an example of modules for presenting notifications, according to an embodiment of the present disclosure.
  • FIG. 4 illustrates an example of an in-line notification, according to embodiments of the present disclosure.
  • FIG. 5 illustrates an example of an in-application notification, according to embodiments of the present disclosure.
  • FIG. 6 illustrates an example of an in-flow notification, according to embodiments of the present disclosure.
  • FIG. 7 illustrates an example of a pop-up notification, according to embodiments of the present disclosure.
  • FIG. 8 illustrates examples of a state of a notification, according to embodiments of the present disclosure.
  • FIG. 9 illustrates an example of a flow for presenting an in-context notification, according to embodiments of the present disclosure.
  • FIG. 10 illustrates an example of operational modes of a device, according to embodiments of the present disclosure.
  • FIG. 11 illustrates an example of notification settings associated with an operational mode, according to embodiments of the present disclosure.
  • FIG. 12 illustrates an example of replacing a notification, according to embodiments of the present disclosure.
  • FIG. 13 illustrates an example of replacing and accumulating a notification, according to embodiments of the present disclosure.
  • FIG. 14 illustrates an example of modifying a notification, according to embodiments of the present disclosure.
  • FIG. 15 illustrates an example of grouping notifications, according to embodiments of the present disclosure.
  • FIG. 16 illustrates an example of a flow for presenting notifications, according to an operational mode, according to embodiments of the present disclosure.
  • FIG. 17 illustrates an example of a notification summary, according to an operational mode, according to embodiments of the present disclosure.
  • FIG. 18 illustrates examples of states of a notification summary, according to embodiments of the present disclosure.
  • FIG. 19 illustrates examples of summarizing notifications, according to embodiments of the present disclosure.
  • FIG. 20 illustrates an example of a flow for summarizing and presenting notifications, according to embodiments of the present disclosure.
  • FIG. 21 illustrates an example of a flow for presenting in-context and pop-up notifications on a video game console, according to embodiments of the present disclosure.
  • FIG. 22 illustrates an example of a hardware system suitable for implementing a computer system, according to embodiments of the present disclosure.
  • a computer system presents a GUI on a display. Upon an execution of an application, content of the application is presented in the GUI. The computer system also determines a context associated with a user of the application and/or with execution of one or more applications. The context indicates user interactions and interest with the application(s). In addition, the computer system stores notification rules specifying when, how, where, and/or what notifications should be presented based on the context. Upon receiving notification data, the computer system manages the presentation of a corresponding notification based on the context and the notification rules. Managing the notifications includes multiple aspects.
  • the computer system determines whether the notification should be presented in the GUI and the type of presentation (e.g., in-context or pop-up) or whether such a presentation should be restricted.
  • the computer system can add the notification to a notification summary and can update the notification summary over time based on priorities of the notifications.
  • the notification summary is presented on the display.
  • notifications not presented to the user can be added to a notification list. The notification list is updated over time, whereby some or all of the notifications are replaced, modified, and/or grouped.
  • the presentation of the underlying content continues, whereby no user input may be needed to switch back and resume the presentation of this content.
  • the presented notification can be also updated given a change to the context such that any information and/or selectable action presented in the notification continues to be relevant to the most current context.
  • a video game system that hosts a video game application, a chat application, a video streaming application, a social media application, and multiple other applications.
  • the video game system Upon a login of a video game player, the video game system presents a home user interface on a display. From this interface, the video game player can launch the video game application and video game content can be presented within an application window in a foreground on the display.
  • the video game system determines that the notification data is associated with the chat application. Given that the application window in the foreground corresponds to the video game application rather than the chat application, the video game system presents the corresponding notification in a pop-up window laid over the application window.
  • the notification is presented in a collapsed state indicating that a message was sent from the second user, while the presentation of the video game content continues and the application window remains in the foreground.
  • the video game system presents the notification in an expanded state, where the actual content of the notification and a selectable option to respond are presented. In this state, the presentation of the video game content also continues and the application window remains in the foreground.
  • the video game player completes a level of the video game and the video game system receives user input to initiate a flow for downloading and launching the next level.
  • a new application window is presented on the display.
  • a different application than the video game application such as a menu application, is executed and can present the new application window.
  • the new application window presents a confirmation of the user input (e.g., the next level is being downloaded).
  • the video game system receives system notifications about these tasks and presents an in-flow notification within the new application window.
  • the in-flow notification provides updates about the tasks.
  • the video game player launches the chat application. Chats with other users are presented within an application window of the chat application in the foreground.
  • the video game system receives second notification data from the second device and presents a corresponding text in the application window. Given that the text is available within a viewing area of the application window, the video game system can alert the video game player about the text by presenting a visual indicator around the text (e.g., a blue rectangle, a flashing rectangle, or any other visual alert). This visual indicator corresponds to an in-line notification indicating that new notification data is available within the viewable area.
  • third notification data is received from the second device.
  • the corresponding text should be presented, but its presentation would not be in the current viewing area. Accordingly, the video game system presents an in application notification within the viewing area indicating that new text is available and would be presented upon a scroll down.
  • the video game player switches from the chat application to the video streaming application.
  • the video game system executes the video game application and presents an application window for this application in the foreground.
  • the application window presents video content streamed from a network source.
  • a video operational mode indicates that, while video is being streamed, social media notifications should be restricted. Accordingly, during the streaming, the video game system receives first notification data corresponding to an invitation of the second user to a first social media event starting in five minutes. The corresponding first social media notification is suppressed rather than being presented while the video stream is occurring, and is sent to a notification list. Ten minutes later, and while the video stream continues, the video game system received second notification data corresponding to an invitation of the second user to a second social media event starting in one hour.
  • the video game system replaces the first social media notification with the second social media notification in the notification list.
  • the notification list can be presented on the display, such that the second social media notification can be viewed and the invitation to the second media event can be accepted.
  • the video game system receives social media notification data. Given the game title and the user interactions with the video game, the video game system determines that the corresponding social media notification should be queued rather than presented given that the context indicates an immersive game session. Accordingly, the video game system adds the social media notification to a queue and, optionally, sends the social media notification to a mobile device associated with the video game player. Notifications in the queue are organized according to priorities, where each priority can be updated based on the relevance of the corresponding notification to the current context and on the recency of the notification.
  • the video game system can present a notification summary identifying the total number of notifications that have been queued.
  • the video game system presents the notification summary in an expanded state.
  • the video game system presents the top three (or some other number) highest priority notifications and provides an option to view the remaining notifications.
  • Each of the three notifications is presented in a collapsed state and can be further selected to be presented in an expanded state.
  • the content (e.g., information and selectable action(s)) in each of the summarized notifications is updated based on the current context.
  • Embodiments of the present disclosure provide several advantages over existing computer systems and their underlying GUIs. For example, effectivity of a GUI and efficiency of underlying processing and memory are improved.
  • the GUI can provide an improved user experience, whereas timely and relevant notifications are presented to a user on the GUI, while the ongoing content presentation continues, and other notifications are summarized and/or added to a notification list for later presentation. In this way, a user may view the relevant notifications in a timely manner and, as needed, expanded any of such notifications without interrupting the ongoing content presentation. Because relevant notifications are presented, the processing and memory usage can be reduced relative to existing systems that would present all notifications and would necessitate a switch back and forth between foreground and background applications.
  • a computer system can include one or more user devices, each communicatively coupled with one or more displays.
  • the computer system can also include a backend system, such as a server, that tracks contexts across the one or more devices, and the receipt, queuing, prioritizing, and/or interactions with notifications, among other functionalities.
  • FIG. 1 illustrates an example of a computing environment for presenting notifications, according to an embodiment of the present disclosure.
  • the computing environment includes a video game system 110 communicatively coupled with a display 120, a mobile device 130 that integrates a display, a backend server 150, and a user device 140.
  • the video game system 110 and the mobile device 130 are available to a video game player 112 (e.g., operated by the video game player 112 or associated with the video game player 112 under a user account).
  • the user device 140 is available to a user 142 (e.g., another video game player).
  • the backend server 150 provides management functionality to control when, how, where, and/or what notifications should be presented.
  • the user 142 operates the user device 140 to send notification data 144 targeted to the video game player 112.
  • the backend server 150 receives the notification data 144 and determines that the video game player 112 is associated with the video game console 110 and the mobile device 130.
  • the backend server 150 also determines a context associated with the video game player 112 and/or the video game console 110. Based on the context, the backend server 150 determines whether corresponding notification data 152 should be sent to the video game console 110 for presentation on the display 120 as a notification 114 or whether such a presentation should be restricted. If the notification 114 is to be presented, the backend server 150 determines the type of the notification 114, such as whether it should be an in-context notification or a pop up notification.
  • the video game player 112 can operate a user input device, such as a video game controller, to interact with the video game system 110.
  • the user input device can include a button operable to interact with the notification 114.
  • Interacting with the notification 114 can include viewing the notification in one or more states, dismissing the notification 114, requesting a notification summary that includes the notification 114, requesting a notification list that includes the notification 114, or any other types of interactions.
  • the backend server 150 determines whether corresponding notification data 154 should be sent to the mobile device 130 for a presentation as a notification 132 on the display of the mobile device 130.
  • the backend server 150 sends the notification data 154 to the mobile device 130.
  • the notification data 152 can be sent to a queue for a notification summary and its priority in the queue can be updated based on whether a user interaction with the notification 132 presented by the mobile device occurred.
  • a notification represents an output presentable on a user interface, such as a GUI, and notifying a user by including presentable information and/or a selectable action.
  • a text message, a social media post and/or like, a multimedia (e.g., audio, video, video game content) download status, a multimedia purchase are examples of a notification.
  • Notification data represents data usable to populate the notification, upon presentation and metadata that defines presentation parameters of the notification.
  • a notification is typically presented in a dedicated notification area, such as the bottom right or a top bar of GUI on a display. Notification data is.
  • embodiments of the present disclosure allow the presentation of a notification in other areas of the GUI.
  • a notification can be a pop-up notification that can be presented in a pop-up window laid over an application window in the foreground.
  • a notification can be an in context notification that can be presented within the application window.
  • Different types of in-context notifications are possible, such as in-line notifications, in-application notifications, and in-flow notifications. Each of the types corresponds to a presentation style.
  • An in-line notification corresponds to a style of in-line presentation and represents a notification having presentable information located in a user viewing area within the application window.
  • An in application notification corresponds to a style of in-application presentation and represents a having presentable information located outside of the user viewing area but within the application window.
  • An in-flow notification corresponds to a style of in-flow presentation and represents a notification having presentable information about tasks of a flow being performed.
  • Pop-up, in-line, in-application, and in-flow notifications can be dynamically updated based on the most current context.
  • each of the Pop-up, in-line, in application, and in-flow notifications can be associated with multiple attributes including a source application (e.g., the application that generated the notification), a destination application (e.g., the application that should present the notification), a notification type (e.g., a message), notification subject (e.g., a message thread), an accumulation parameter (e.g., a counter, such as the number of messages), a time sensitivity (e.g., should be presented immediately; otherwise, the notification is outdated), a priority, a timestamp (e.g., the time a notification was received), and/or an expiration time (e.g., the notification is no longer relevant past the expiration time).
  • attributes are usable to manage the presentation of a notification.
  • the backend server 150 backend server 150 can also determine the current context.
  • the backend server 150 also stores rules specifying when, how, where, and/or what notifications should be presented based on the context.
  • the rules can be defined according to notification settings that can have default values and configured via user input of the video game player 112 at the video game console 110. Some or all of the notification settings can be configured and updated dynamically based on an artificial intelligence model, such as one using a machine learning algorithm, trained based on historical data of multiple video game players.
  • the backend server 150 is shown as a separate computer system from the video game console 110, some or all of the functionalities of the backend server 150 can be implemented by the video game system 110 (e.g., the video game system 110 can include a video game console specific to the video game player 112 and a cloud server available to multiple players).
  • the rules can be stores locally on the video game system 110, whereas the notification settings can be stored locally in association with a user profile or remotely on the backend server 150 also in association with a user profile.
  • the context determination can be performed locally on the video game console 110.
  • the video game player 112 can be associated with a different number and other types of devices. For instance, in addition to or instead of being associated with a mobile device 130, the video game player 112 can be associated with a tablet, a desktop computer, or any other user device.
  • FIG. 2 illustrates a computer system that presents notifications, according to an embodiment of the present disclosure.
  • the computer system includes a video game console 210 and a display 220.
  • the computer system may also include a backend system, such as a set of cloud servers, that is communicatively coupled with the video game console 210.
  • the video game console 210 is communicatively coupled with a video game controller (not shown) and with the display 220 (e.g., over a communications bus).
  • a video game player operates the video game controller to interact with the video game console 210. These interactions may include playing a video game presented on the display 220 and interacting with other applications of the video game console 210.
  • the video game console 210 includes a processor and a memory (e.g., a non- transitory computer-readable storage medium) storing computer-readable instructions that can be executed by the processor and that, upon execution by the processor, cause the video game console 210 to perform operations relates to various applications.
  • the computer-readable instructions can correspond to the various applications of the video game console 210 including a video game application 240, a music application 242, a video application 244, a social media application 246, a chat application 248, and a notification application 250, among other applications of the video game console 210 (e.g., a home user interface (UI) application that facilitates a home page on the display 220).
  • UI home user interface
  • the video game controller is an example of an input device.
  • Other types of the input device are possible including, a keyboard, a touchscreen, a touchpad, a mouse, an optical system, or other user devices suitable for receiving input of a user.
  • a rendering process of the video game console 210 presents video game content (e.g., illustrated as a car race video game content) in an application window on a GUI of the display 220.
  • the application window is presented in the foreground of the GUI, indicating that the video game application is active and user input at the video game controller is usable to interact with the video game application.
  • other applications can also be executing either in the background or their application windows can be presented in the background of the GUI indicating that the user input is not usable to interact with such applications.
  • the notification application 250 determines attributes for a corresponding notification 212 including, for instance, whether the notification data is targeted to the video game application 240, the music application 242, the video application 244, the social media application 246, or the chat application 246.
  • the notification application 250 can also determine a context, such as the level of user interactions and the active application (e.g., the video game application 240 having a foreground application window), and can apply rules to determine whether the corresponding notification 212 should be presented in a pop-up window over the foreground application window or as an in-context notification within the foreground application window, or whether the corresponding notification 212 should be restricted (e.g., queued in a notification summary or added to a notification list).
  • the notification application 250 passes through, for instance, an application programming interface (API), the notification data and instructions for presenting the notification 212 (e.g., as a pop-up or in-context) to the active application (e.g., the video game application 240).
  • the active application presents the notification 212 as pop-up over the foreground application window or in-context within the foreground application window.
  • API application programming interface
  • FIG. 2 illustrates that the different applications are executed on the video game console 210
  • the embodiments of the present disclosure are not limited as such. Instead, the applications can be executed on the backend system (e.g., the cloud servers) and/or their execution can be distributed between the video game console 210 and the backend system.
  • the backend system e.g., the cloud servers
  • FIG. 3 illustrates an example of modules for presenting notifications, according to an embodiment of the present disclosure.
  • the modules upon receiving notification data 302, the modules are used to determine whether an in-context notification 312 having an in context presentation style (e.g., a style of any of an in-line presentation, in-application presentation, or in-flow presentation), a notification summary 322, or a pop-up notification 324 should be used.
  • a first module implements an in-context logic 310 to determine whether the in-context notification 312 should be presented. If not, a second module implements an operational mode logic 320 to determine whether the notification summary 322 should be presented. If not, a determination is made to present the pop-up notification 324.
  • each of the in-context logic 310 and the operational mode logic 320 is implemented as computer-readable instructions, such as software code, that can be executed by a processor.
  • Such instructions can be stored in a non-transitory computer- readable medium, such as a computer memory and can be part of a notification application, such as the notification application 250 of FIG. 2.
  • the computer-readable instructions, as stored in the non-transitory computer-readable medium, and the processor represent a module.
  • the module can be a computing component of a video game system, such as the video game system 110 of FIG. 1, a backend server, such as the backend server 150 of FIG.
  • the in-context logic 310 includes or has access to a set of rules specifying whether the in-context notification 312 should be presented based on a context associated with the notification data 302, one or more users, and/or one or more applications.
  • the set of rules can be predefined as conditional statements and can be customized based on user preferences.
  • the user preferences can be indicated in user settings and/or the customization can be performed based on a machine learning algorithm.
  • the operational mode logic 320 includes or has access to a set of rules specifying whether the notification summary 322 should be presented based on an operational mode of a device.
  • the set of rules can be predefined as conditional statements and can be customized based on user preferences.
  • the user preferences can be indicated in user settings and/or the customization can be performed based on a machine learning algorithm.
  • FIG. 3 illustrates two modules, a different number and/or a different arrangement of modules are possible.
  • a third module may be implemented to determine whether a notification should be added to a notification list. Operations of these modules are further illustrated in connection with the next figures.
  • FIGS. 4-7 the figures illustrate examples of in-line, in-application, in flow, and pop-up notifications.
  • the type of the notification to present depends on a context associated with notification data, a user, and/or an application available to the user. Understanding where the users’ attention is and what repercussions there would be if the user missed the notification are factors that are considered. If a user is not distracted and/or if the notification is relevant to the current context, an in-context notification (in-line, in application, or in-flow notification). If the notification would cause user frustration, confusion, or negative and/or is less relevant, a pop-up notification is possible.
  • a set of rules implementing this approach can be defined.
  • a notification generally relates to an activity, an update, an event, or feedback about a task from a flow being performed. If the activity, update, or event occurred in a viewing area within an application window that is in the foreground, an in-line notification can be used. If the activity, update, or event occurred outside of the viewing area but within the application window, an in-application notification can be used. If the application window presents information about the flow, an in-flow notification can be presented to provide the feedback. On the other hand, if the activity, update, or event occurred in the background or in an application window presented in the background, a pop- up notification can be used. Similarly, if feedback is about a completion of a sensitive task, a task failure, or a task that was initiated remotely and is still processing when a user login in to a device, a pop-up notification can also be used.
  • FIG. 4 illustrates an example of an in-line notification, according to embodiments of the present disclosure.
  • an in-line notification is used when the location of the presentable information (e.g., notified content) of the notification is in the area where a user is currently viewing (e.g., a user viewing area).
  • the presentable information is updated and/or animated to be in view of the user.
  • a GUI 410 is presented on the display.
  • An application is being executed (e.g., a chat application) and presents content (e.g., chat content) in an application window 420 on the GUI 410.
  • the presented content relates to a subject 422 (e.g., a chat thread).
  • a second window 430 is presented on the GUI 410 and provides information about other applications (e.g., a video game that was recently executed).
  • Notification data is received (e.g., text for a chat from Friend A).
  • a determination is made that the notification data is associated with the application (e.g., the chat application is the destination of the chat), rather than the second window 430, and with the subject 422 (e.g., the text belongs to the chat thread). Accordingly, a determination is made to present an in-context notification.
  • the notification data e.g. the text from Friend A
  • the notification data can be presented in a location within a user viewing area of the application window 420 (e.g., the notification data would be in view to a user when presented). Because the location is within the viewing area, an in-line notification 450 is possible.
  • the in-line notification 450 provides a visual indicator of the notification data, such as an indicator that updates and/or animates the notification data (e.g., a blue rectangle around the text of the chat, or any other type of visual indicator).
  • FIG. 5 illustrates an example of an in-application notification, according to embodiments of the present disclosure.
  • an in-application notification is used when the location of the presentable information (e.g., notified content) of the notification is within an application window that is in the foreground (e.g., an area of focus), but is outside of the viewing area.
  • the in-application notification is presented within the viewing area and can alert the user that the presentable information is outside of the viewing area.
  • the in application notification can be interactive such that, upon a user interaction with the in- application notification, the viewing area is changed to show the location of the presentable information.
  • a GUI 510 is presented on the display.
  • An application is being executed (e.g., a chat application) and presents content (e.g., chat content) in an application window 520 on the GUI 510.
  • the presented content relates to a subject 522 (e.g., a chat thread).
  • a second window 530 is presented on the GUI 510 and provides information about other applications (e.g., a video game that was recently executed).
  • Notification data is received (e.g., text for a chat from Friend A).
  • a determination is made that the notification data is associated with the application (e.g., the chat application is the destination of the chat), rather than the second window 530, and with the subject 522 (e.g., the text belongs to the chat thread). Accordingly, a determination is made to present an in-context notification.
  • the notification data e.g. the text from Friend A
  • the notification data can be presented in a location outside of the user viewing area of the application window 520 (e.g., the notification data would be shown at the end of the chat thread, but the user has scrolled up and the current viewing area excludes the end of the chat thread).
  • an in-application notification 550 is possible.
  • the in application notification 550 provides a visual indicator that the presentable information is available to the user at a location outside of the viewing area, but within the application window 520 (e.g., the notification includes a description that new text was received and is available upon a scroll down to the end of the chat thread).
  • FIG. 6 illustrates an example of an in-flow notification, according to embodiments of the present disclosure.
  • an in-flow notification is used when the flow of an activity in the foreground communicates and provides feedback to a user about one or more tasks of the flow being performed.
  • GUI 610 is presented on the display.
  • An application is being executed (e.g., a video game application) and presents content about a flow (e.g., download, install, or purchase a video game application, video game level, another application, or any other content) in an application window 620 on the GUI 610.
  • a flow e.g., download, install, or purchase a video game application, video game level, another application, or any other content
  • Notification data is received (e.g., progress of the download is received from a network source).
  • a determination is made that the notification data is associated with the application (e.g., the video game application), and with the flow (e.g., the download). Accordingly, a determination is made to present an in-flow notification 650.
  • the in-flow notification 650 provides a visual indicator about the progress of the flow and/or the tasks that are being performed.
  • the in-flow notification 650 is presented within the application window 620 and is updated to reflect the progress.
  • the in-flow notification 650 is updated to present a selectable action related to the flow (e.g., a launch button to launch the downloaded application).
  • FIG. 7 illustrates an example of a pop-up notification, according to embodiments of the present disclosure.
  • a pop-up notification is used when the notification data is unassociated with an application presenting content in an application window that is in the foreground (e.g., an active application) and when the notification data is time sensitive and/or relevant to a context of the user and/or the application.
  • the pop-up notification is presented in a pop-up window laid over the application window.
  • the presentation of the content continues in the application window and the user focus remains on the application (e.g., user input at a controller is used to interact with the presented content).
  • a GUI 710 is presented on the display.
  • An application is being executed (e.g., a chat application) and presents content (e.g., chat content) in an application window 720 on the GUI 710.
  • the presented content related to a subject 722 (e.g., a chat thread).
  • a second window 730 is presented on the GUI 410 and provides information about other applications (e.g., a video game that was recently executed).
  • notification data is received (e.g., a system notification, data associated with the recently executed video game application, etc.).
  • a determination is made that the notification data is unassociated with the application (e.g., the chat application is not the destination of the notification data). Accordingly, a determination is made not to present an in-context notification.
  • the notification data is associated with the application. However, in this example, a determination is made that the notification data is unassociated with the subject 722 (e.g., the notification data relates to a different chat thread). Hence, a determination is also made not to present an in-context notification in this example.
  • the pop-up notification 750 can be laid over the application window 720 or located over any other area of the GUI 720. For instance, the notification 750 can slide from right to left on the top side of the GUI 720 or can slide from top to bottom on the top side of the GUI 720. If another pop-up notification is already presented on the GUI 720, the new pop-up notification 750 can be shown below the existing pop-up notification or can slide and push down the existing pop-up notification.
  • an in-context or a pop-up notification when an in-context or a pop-up notification is presented, the execution of an active application continues and the presentation of content by the active application in an application window in the foreground also continues.
  • Different types of information can be used for the notification depending on the type of the notification. For instance, an in-line notification can visually indicate that notification data is available at a location within a user viewing area. An in-application notification can visually indicate that notification data is available at a location outside of the user viewing area and may not include the notification data. In comparison, an in-flow notification or a pop-up notification can include some or all of the notification data.
  • different states of the notification can be used depending on the type of the notification. For instance, the in-line notification can be presented according to one state, whereas the other types of notification can be presented according to one of multiple possible states. If multiple states are used, the type and/or amount of presentable information changes between the states.
  • FIG. 8 illustrates examples of a state of a notification, according to embodiments of the present disclosure.
  • a first state corresponds to a collapsed state, in which minimum information is presented to alert a user about the receipt of notification data.
  • a second state corresponds to an expanded state, in which some or all of the notification data can be presented.
  • a notification is presented in a collapsed state 810.
  • the notification includes a header 812 that generally identifies the type and/or title of the notification (e.g., “text message from a friend” for a chat notification).
  • the size of the notification is increased and its content is updated to provide supplemental information.
  • the notification includes a header 852 (which could be the same as the header 812; in other words, the size and presentable information in the header do not change between the states).
  • the notification also includes a body 854 and an action 856.
  • the body 854 provides supplementary information derived from the notification data (e.g., the actual text from the text message).
  • the action 856 represents a selectable icon that can trigger the related application to perform a task or trigger a flow (e.g., a respond icon for responding to the text message). If action 856 is selected, an application window for the related application can be presented and used or the notification can be shown in a third state that provides the functionalities of such an application window.
  • the notification is presented, whether in the collapsed state 810 or the expanded state 850, its content (e.g. information in the header, body, and/or action) can be updated over time. For instance, when an inflow notification is presented, the body of such a notification can show a progress of the flow and is updated depending on the status of the progress.
  • its content e.g. information in the header, body, and/or action
  • FIG. 9 illustrates an example of a flow for presenting an in-context notification, according to embodiments of the present disclosure.
  • the operations of the flow can be implemented as hardware circuitry and/or stored as computer-readable instructions on a non- transitory computer-readable medium of a computer system, such as a video game system or backend server.
  • the instructions represent modules that include circuitry or code executable by a processor(s) of the computer system. The execution of such instructions configures the computer system to perform the specific operations described herein.
  • Each circuitry or code in combination with the processor represents a means for performing a respective operation(s). While the operations are illustrated in a particular order, it should be understood that no particular order is required.
  • the flow starts at operation 902, where the computer system presents content in an application window.
  • an application is executing and presents the content in the application window on a GUI of a display.
  • the computer system receives notification data.
  • the notification data is received from another device and is associated with a context.
  • the context indicates a source application, a destination application, a notification type, and/or a notification subject, among other attributes. Other information can also be indicated by the context.
  • the computer system determines whether the notification data is associated with the application. In particular, if the destination application of the notification data is the same as the application, a determination is made that the notification data is associated with the application. In this case, operation 908 follows operation 906. Otherwise, operation 912 follows operation 906.
  • the computer system determines whether the application window is in the foreground. If so, the notification data is associated with an active application and, accordingly, a determination is made to present an in-context notification. In this case, operation 910 follows operation 908. Otherwise, operation 912 follows operation 908.
  • the computer system presents the in-context notification within the application window.
  • in-context notifications are possible.
  • an in-line notification is used.
  • an in-application notification is used.
  • the notification data relates to a flow that has been triggered and the application window presents information about the flow, an in-flow notification is used.
  • the computer system has determined that the notification data is unassociated with the active application and/or the application window is not in the foreground. Accordingly, the computer system determines that the presentation of an in-context notification should be restricted. Instead, the computer system can determine whether a pop-up notification should be presented, whether the notification data should be sent to a queue for addition to a notification summary, and/or whether the notification should be sent to a notification list. Different techniques are possible to perform this determination. In one example technique, a set of rules is used to determine whether the pop-up notification should be used. Otherwise, the notification data can be added to the notification summary and/or notification list.
  • the set of rules generally specify that if the notification is time sensitive and/or has a certain level of relevance to a user, the pop-up notification should be used. For instance, if an activity, update, or event related to the notification data occurred in the background or in an application window presented in the background, the pop-up notification can be used. Similarly, if feedback is about a completion of a sensitive task, a task failure, or a task that was initiated remotely and is still processing when a user logs in to a device, the pop-up notification can also be used. Otherwise, the notification data can be added to the notification summary and/or the notification list.
  • an operational mode can be used. Here, the operational mode can be associated with notification settings indicating whether the pop-up notification is permitted or restricted. If permitted, the pop-up notification is presented. Otherwise, the notification data can be added to the notification summary and/or the notification list. The use of an operational mode is further described in connection with the next figures.
  • association of notification data with an application and the application presenting content in a foreground application window are examples of matching contexts.
  • Other ways to use contexts and/or other types of contexts are also possible.
  • the computer system can determine whether a match between a context associated with the notification data and a context associated with the application exists. If a match exists, the computer system can determine a presentation style for an in context notification as illustrated under operation 910 (e.g., an in-line presentation style, an in-application presentation style, and/or an in-flow presentation style). Otherwise, the computer system can determine that a pop-up notification should be presented, or some other form of restricting the presentation of an in-context application is to be used.
  • a presentation style for an in context notification as illustrated under operation 910 (e.g., an in-line presentation style, an in-application presentation style, and/or an in-flow presentation style). Otherwise, the computer system can determine that a pop-up notification should be presented, or some other form of restricting the presentation of an in-context application is to be used.
  • the context associated with the notification data includes at least one of a first user identifier associated with a first user of the application, a second user identifier associated with a second user of a source application that generated the notification data, a subject of the notification data, a type of the notification data, a first application identifier associated with the application, a second application identifier associated with the second application, a first platform identifier associated with a first platform hosting the application (e.g., a video gaming platform), or a second platform identifier associated with a second platform hosting the source application (e.g., a social media platform).
  • the context associated with the application includes at least one: the first user identifier, the first application identifier, the first platform identifier, an operational mode, or an indication that the application window is in a foreground of the display.
  • the match exists when, for instance, the first user identifiers are the same in the two contexts (or can be mapped to a same user account), the first application identifiers are the same in the two context, and/or the first platform identifiers are the same in the two contexts.
  • a match also exists when the operational mode and/or the foreground state indicate that the subject of the notification data, the type of the notification data, the second user identifier, the second application identifier, and/or the second platform identifier are associated with a permission to present the notification data (e.g., are on an exception list).
  • the notification source, the notification type and/or the notification subject can be further used for determining whether the in-context notification should be presented. If the notification source is on an exception list of permitted application, the in-context notification can be presented.
  • the in-context notification can be presented.
  • the active application is a chat application running on a first device of a first user.
  • a second user operates a second device to execute another instance of the chat application and sends text as notification data.
  • the notification source e.g., the other instance of the chat application
  • the notification type e.g., a chat
  • the in-context notification can be presented if the text corresponds to an ongoing chat thread. Otherwise, a pop-up notification is used.
  • a user context indicates a level a level of attention (or focus) of the user to the content. Different techniques are available to determine this level.
  • the operational mode of the device indicates the level of user attention. For instance, a user watching a movie can correspond to a lower level of attention than a user playing a video game.
  • the type of content indicates the level of user attention. For instance, a user playing a chess video game can correspond to a lower level of attention than a user playing a first-person shooter video game.
  • gaze information detected by an eye tracking system or motion data detected by a motion tracking system can indicate the level of user attention.
  • gaze information indicating that the user is not looking at the GUI or motion information indicating a relatively low level of motion can correspond to a lower level of attention than when the gaze is on the GUI or a higher level of motion is detected.
  • the application context indicates a level of user interaction with the application. Different techniques are also available to determine this level.
  • the operational mode of the device indicates the level of user interaction. For instance, in the movie mode, a relatively lower level of user interaction is expected in comparison to a gaming mode.
  • the type of content indicates the level of user attention. For instance, for a chess video game, a relatively lower level of user interaction is expected in comparison to a first-person shooter video game.
  • the amount and/or frequency of user input received at an input device indicates the level of user interaction. The larger the amount is and/or the higher the frequency is, the higher the level of user interaction is.
  • rules can be defined to trigger in context notification of a specific type or a pop-up notification or to use a notification summary or notification list. For instance, if the user attention level and/or user interaction level is high (e.g., exceeding a predefined threshold level), an in-context notification is shown only if the notification data relates to the activity that the user is engaged in (e.g., is associated with the active application). Otherwise, a pop-up notification is used if the notification data is time sensitive or is relevant to the user context and/or application context. And otherwise, the notification data is sent to a notification summary and/or a notification list.
  • conditional statements can be stored as a set of rules.
  • the conditional statements can be predefined and manually updated based on user input to reflect user preferences and/or user settings.
  • rules and/or other types of rules can be automatically learned by the computer system. For example, data about the user context and/or the application context can be tracked for the user and across different users. A machine learning (ML) algorithm is trained based on such data to output parameters that define the rules. Such rules can then be pushed to the computer system or the trained ML algorithm itself can be hosted on the computer system, whereby the user context and/or application context are used as an input and output is received indicating whether a notification should be presented and the notification type.
  • ML machine learning
  • FIG. 10 illustrates an example of operational modes of a device, according to embodiments of the present disclosure.
  • the device presents a GUI 1010 on a display.
  • the GUI 1010 includes different fields related to notification settings.
  • a first field 1020 corresponds to general settings
  • a second field 1030 corresponds to operation modes
  • a third field corresponds to notification types (illustrated as different channels, such as a social media channel providing social media notification, a gaming channel providing gaming notifications, a media and events channel providing media and event notifications, a downloads and uploads channel providing download and upload notifications, promotions and offers channel providing promotion and offer notifications, etc.).
  • Each of the three fields can be selected to further present notification settings that can be defined under the selected field.
  • FIG. 10 illustrates a selection of the operational mode field 1030.
  • FIG. 10 shows four of such modes.
  • Such modes can be identified in different fields 1032, and each of such fields can be selected to further present the notification settings applicable to the corresponding operational mode, as further illustrated in FIG. 11.
  • Each mode indicates a mode of operation of the device.
  • a different user context and/or a different application context can be expected.
  • the level of user attention and/or the level of user interaction can change between the operational modes.
  • the notification settings can be varied between the operational modes to reflect this change.
  • the device is a video game console.
  • the operational models include a gaming mode, a content on demand mode (e.g., a movie and video mode), a content broadcast mode, or a virtual reality mode.
  • a gaming mode a higher level of user attention and/or user interaction can be expected relative to the content on demand mode or the content broadcast mode, but lower than that of the virtual reality mode.
  • FIG. 11 illustrates an example of notification settings associated with an operational mode, according to embodiments of the present disclosure. For example, upon a user selection of the “operational mode A” as presented in the fields 1032 of FIG. 10, the notification settings applicable to the selected operational mode are presented.
  • a GUI 1110 identifies the operational mode 1120 and presents an exception list showing different notification types 1130 (e.g., download complete, upload complete, friends online, invitation to a game, invitation to a broadcast, music track change, group activity, etc.).
  • Each of such notification types 1130 can be selected.
  • a checkbox 1140 can be displayed next to each notification type and, when checked, indicates that the notification type was selected.
  • a selection of a notification type from the exception list indicates that, when notification data is received and is associated with the selected notification type, a corresponding notification can be presented (whether in-context or pop up) when the device is in the operational mode 1120.
  • the operational mode 1120 is associated with an exception list and, only when a notification type on the exception list is selected can the corresponding notification be presented. If a notification type is unselected, the presentation of the corresponding notification is restricted.
  • FIG. 11 illustrates an exception list
  • a permission list is possible.
  • the presentation of the corresponding notification is permitted. If selected, the presentation of the notification is restricted.
  • notification types are illustrated, other parameters can be used to define the permissions and restrictions per operational model.
  • the exception list can identify source applications, destination applications, and/or types of the source applications and/or destination applications (e.g., social media applications, gaming applications, etc.). If any of these parameters is selected, notification data associated with the selected parameter (e.g., notification data associated with a selected source application, a destination application, or an application type) can result in a presentation of a corresponding notification.
  • Each of the operational modes can be associated with its own set of notification settings. Such settings can be set to a certain default configuration (e.g., default selections and of notification types). User input can also be received to change the default configuration (e.g., to unselect selected notification settings and select unselected notification settings).
  • changes to the default or customized configurations can be pushed from a computer system (e.g., one including a backend server).
  • the computer system automatically learns the changes. For instance, data about a user context and/or application context can be tracked for a user and across different users under each of the operational modes. A ML algorithm is trained based on such data to output parameters that define the configuration.
  • the device is in an operational mode associated with notification settings.
  • Notification data is received.
  • the notification type (and, additionally or alternatively, the source application, destination application, type of the source application, type of the destination application) associated with the notification data is checked against the notification settings. If the notification settings permit the presentation of the corresponding notification, the notification data is further used to present an in-context notification or a pop up notification. Otherwise, the corresponding notification can be sent to a queue for addition to a notification summary or can be added to a notification list such that the notification can be retrieved and presented at a different point in time.
  • a notification summary supports the organizing of notifications that have not be shown according to priorities and the presenting of a subset of the highest priority notifications to a user along with an option to view the remaining notifications.
  • FIGS. 17-20 describe examples of the notification summary.
  • a notification list represents a different way of organizing notifications as further illustrated in FIGS. 12-16.
  • the notification list includes notifications having different attributes (e.g., of different notification types, associated with different source applications and/or destination applications, etc.).
  • a notification can be replaced, replaced and accumulated, modified, and/or grouped with other notifications such that, when the notification list is presented to the user, up-to-date notifications are presented.
  • a notification is added to a notifications list given a certain context (e.g., given that the device is in a particular operational mode that restricts the presentation), can be subsequently presented as an in-context notifications or as a pop-up notification when the context changes (e.g., the device changes to a different operational mode that permits the presentation).
  • a certain context e.g., given that the device is in a particular operational mode that restricts the presentation
  • the context changes e.g., the device changes to a different operational mode that permits the presentation.
  • FIG. 12 illustrates an example of replacing a notification, according to embodiments of the present disclosure.
  • Notification replacement represents a method in which a first notification is removed and a second notification replaces the first notification.
  • the second notification has a more recent time stamp than the first notification.
  • the notification replacement can result in a new notification (e.g., in-context or pop-up) and can place such a notification at the top of a notification list.
  • the notification replacement does not include any information or indication of the previous notification that was replaced. Accordingly, this replacement method is typically used if it is no longer valuable to inform the user of the prior content which has been replaced.
  • a set of rules can be defined to reflect this approach. For instance, the notification replacement is used when the previous content is outdated (e.g., its time stamp is in the past) or is no longer relevant (e.g., the notification data is associated with an application that is no longer active).
  • the notification replacement is also used when the content being replaced is about a status of a task within a flow (e.g., the download was ongoing and is now complete).
  • the notification replacement is also used when the notification data includes information that was updated, but the update does not impact the relevance of the notification data (e.g., when the notification data indicates a name of a video game team changed for a third time, where the quantity of “two” does not impact the relevance).
  • a first notification 1210 relates to a task (e.g., a download).
  • the first notification 1210 has a first time stamp (e.g., two hours) and indicates a task status (e.g., a start of the download).
  • a task status e.g., a start of the download.
  • additional notification data is received indicating a progress of the task.
  • the notification data is used to replace the first notification 1210.
  • a second notification 1250 replaces the first notification 1210 and has a second time stamp (e.g., three minutes) indicating the status at that time stamp (e.g., the download was complete three minutes ago).
  • the notification list is updated to include the second notification 1250 instead.
  • the second notification 1250 is arranged in the notification list according to the second time stamp.
  • the presentation is updated to show the second notification 1250 instead.
  • FIG. 13 illustrates an example of replacing and accumulating a notification, according to embodiments of the present disclosure.
  • Notification replacement and accumulation is another method for notification replacement.
  • the method uses a counter (e.g., an accumulate parameter) to count up the number of times the replacement has been performed. Accordingly, a user can be notified not only that the notification has been replaced, but also that there has been additional activity regarding the replaced notification.
  • the presentation of the counter can be within the notification, separate from the notification or shown alone without a presentation of the notification.
  • the notification replacement and accumulation is used when the previous content is not outdated and/or still has a relevance.
  • the notification replacement and accumulation is used when the quantity of the value of the counter can affect the perceived importance of the replaced content.
  • a first notification 1310 relates to an event (e.g., a photo posted by the user on a social media platform).
  • the first notification 1310 has a first time stamp (e.g., two hours) and includes notification data about the event (e.g., a photo like by Friend A). Over time, other notification data is received and relates to the same event. For instance, second, third, and fourth notification data are received at different times indicating photo likes from three other friends.
  • the latest notification data (the fourth one — a photo like from Friend B) has a fourth time stamp (e.g., three minutes) and is used as the last replacement.
  • a new notification 1350 replaces the first notification 1310 and has the fourth time stamp.
  • the new notification 1350 includes the latest notification data (e.g., the a photo like from Friend D) and shows the latest value of the counter (e.g., three others).
  • the notification list is updated to include the new notification 1350 instead.
  • the new notification 1350 is arranged in the notification list according to the fourth time stamp.
  • the presentation is updated to show the new notification 1350 instead.
  • FIG. 14 illustrates an example of modifying a notification, according to embodiments of the present disclosure.
  • the notification modification represents a method in which a notification has additional notification data added to the notification without notifying the user in the foreground. This method does not re-notify the user of the changes and will maintain the notification in its chronological order within a notification list.
  • the notification modification is used when the existing notification has not been presented yet and the additional notification data does not impact the relevance or time sensitivity of the original notification data or when the additional notification data is to the same destination application and includes the same actions as the original notification data.
  • the notification modification is also used to avoid generating a new notification and changing its order in the notification list.
  • a first notification 1410 relates to an event (e.g., an invitation to a game play).
  • the first notification 1410 has a first time stamp (e.g., two hours) and includes notification data about the event (e.g., a game invitation from Friend A).
  • additional notification data is received, relates to the event, and does not change the relevance of the first notification.
  • the additional notification data indicates that Friend A is still waiting for an accept or decline of the game invitation.
  • a modified notification 1450 is presented, where this modified notification 1450 is the same as the first notification 1450 except that its content has changed (e.g., indicating that Friend A is still waiting).
  • the time stamp of the first notification 1410 can be shown in the modified notification 1450.
  • FIG. 15 illustrates an example of grouping notifications, according to embodiments of the present disclosure.
  • Notification grouping represents a method in which one notification is grouped together with at least another notification. Notifications are grouped together, but are treated as individual notifications. This method allows a user to view a high-level summary of notification activity. When viewing in a notification list, the notifications are still being displayed separately and in a chronological order.
  • the notification grouping is used when notifications share at least one common attribute. For instance, when multiple notifications have the same notification type (e.g., chat messages), the notifications are grouped together under a group corresponding to the notification type. Similarly, when multiple notifications are associated with the same source application, destination application, and/or type of source and/or destination application, these notifications can be grouped together.
  • notification type e.g., chat messages
  • the notifications are grouped together under a group corresponding to the notification type.
  • these notifications can be grouped together.
  • a first set 1510 of notifications is added to a notification list.
  • the first set 1510 includes a first chat notification having a first time stamp (two hours ago), a social media notification having a second time stamp (one hour ago), and a second chat notification having a third time stamp (thirty minutes ago).
  • the two chat notifications are grouped together, but the social media notification is not. The grouping does not alter any of the notifications or their time stamps.
  • a second set 1550 of notifications is defined.
  • the second set 1550 represents a re-organization of the first set 1510.
  • the first chat notification and the second chat notification are grouped together according to their chronological order (e.g., the first chat notification is listed first).
  • FIG. 16 illustrates an example of a flow for presenting notifications, according to an operational mode, according to embodiments of the present disclosure.
  • the operations of the flow can be implemented as hardware circuitry and/or stored as computer-readable instructions on a non-transitory computer-readable medium of a computer system, such as a video game system or backend server.
  • the instructions represent modules that include circuitry or code executable by a processor(s) of the computer system. The execution of such instructions configures the computer system to perform the specific operations described herein.
  • Each circuitry or code in combination with the processor represents a means for performing a respective operation(s). While the operations are illustrated in a particular order, it should be understood that no particular order is required.
  • the flow starts at operation 1602, where the computer system presents content in an application window.
  • an application is executing and presents the content in the application window on a GUI of a display communicatively coupled with a device.
  • the device can be a computing component of the computer system.
  • the computer system receives notification data.
  • the notification data is received from another device and is associated with a source application, a destination application, a notification type, and/or a notification subject, among other attributes.
  • the computer system determines an operational mode of the device.
  • the operational mode corresponds to the mode of operation of the device at a point in time of receiving the notification data or in a time window that includes this point in time.
  • Different techniques are available to determine the operational mode.
  • user input is received to launch the operational mode. This user input represents a user selection of the operational mode.
  • the determination need not rely on a user selection. Instead, based on the type of the content that is being presented, a title of the content, a source of the content, a type of the application, a level of user attention, and/or a level of user interaction, the operational mode is determined. For instance, when the content represents video game content and the level of user interaction indicates that the user is actively playing a video game, a video game mode is determined.
  • the computer system determines whether a notification corresponding to the notification data should be presented.
  • the notification mode is associated with notification settings.
  • the notification settings can specify whether the presentation of the notification is permitted based on an attribute of the notification data, such as the source application, destination application, notification type, and/or notification subject. If permitted, operation 1610 follows operation 1608. Otherwise, operation 1612 follows operation 1608.
  • the computer system presents the notification as in-context notification or as a pop-up notification.
  • a set of rules can be used to determine the type of the notification as described herein above in connection with FIGS. 4-9.
  • the computer system has determined that the presentation of the notification should be restricted. Accordingly, the computer system sends the notification to a notification list (or to a notification summary as described in connection with the next figures).
  • the computer system updates the notification in the notification list. Different types of updates are possible, including a notification replacement, a notification replacement and accumulation, a notification modification, and/or a notification grouping. The updates can depend on the attributes of the notifications and on a set of the update rules as described herein above in connection with FIGS. 12-15.
  • the computer system presents the notification list.
  • Different triggers are possible to trigger this presentation.
  • user input is received and indicates a request for the notification.
  • a selectable icon can be presented on the GUI and a user selection of this icon indicates the request.
  • the various notifications are shown in the notification list in a collapsed state and are arranged according to their chronological order. A user selection of one of these notifications changes its presentation to an expanded state.
  • the notification settings associated with the operational mode indicates that the presentation of the notification is restricted, this notification may not be presented and is added to the notification list instead.
  • the computer system determines that the operational mode changes to a second operational mode associated with a second set of notification settings. In this case, the computer system determines whether the second set permits the presentation. If so, the notification is presented and is removed from the notification list. For example, while in the operational mode, notifications may have been received and not presented.
  • the computer system may determine a set of such notifications and present at least a subset of notifications that were received and not presented.
  • the presentation e.g., which notifications to present, the total number of such notifications, the presentation style, and other presentation factors
  • notification settings and rules can be predefined and manually updated based on user input to reflect user preferences and/or user settings.
  • notification settings and rules can be automatically learned by the computer system. For example, data about the user context and/or the application context can be tracked for the user and across different users under different operational modes. A ML algorithm is trained based on such data to output parameters that define the notification settings and rules. Such notification settings and rules can then be pushed to the computer system or the trained ML algorithm itself can be hosted on the computer system, whereby the user context and/or application context are used as an input and output is received indicating whether a notification should be presented and the notification type.
  • FIG. 17 illustrates an example of a notification summary, according to an operational mode, according to embodiments of the present disclosure.
  • an application may be executing and presenting content in an application window on a GUI.
  • the notification data can be added to a queue.
  • a notification summary can be generated from the queue, where the notification summary includes notifications that have not been presented.
  • These notifications can have different attributes (e.g., of different notification types, associated with different source applications and/or destination applications, etc.).
  • the notifications in the summary are organized based on their priorities.
  • a priority of a notification can be defined based on the notification’s relevance and recency.
  • the notification summary can be presented on the GUI in a first state, such as a collapsed state, indicating the total number of notifications in the notification summary.
  • a second state such as an expanded state, showing some or all of the notifications. In this way, a user can quickly determine the total number of notifications that were not shown and can have quick and efficient access to the highest priority notifications.
  • an application e.g., a video game application
  • content e.g., video game content
  • Notification data corresponding to multiple notifications is received.
  • a determination is made not to present the notifications.
  • a notification summary 1730 is presented in a first state on the GUI 1710 indicating that the notifications were received and can be viewed.
  • the notification summary 1730 is presented in a pop-up window outside of the application window 1720.
  • the notification summary 1730 is presented in a pop-up window over, at least partially, the application window 1720.
  • the notification summary 1730 is presented as a dynamic icon in a predefined area of the GUI 1710 (e.g., top right comer) showing the total number of notifications.
  • the notification summary 1730 is not presented until the particular context changes. For instance, once the application stops executing or the application window 1720 moves to the background, the notification summary 1730 is presented.
  • FIG. 17 illustrates the notification summary 1730 in the second state as a notification summary 1750.
  • additional information related to the notifications can be presented. For instance, one or more of the notifications are identified.
  • FIG. 18 illustrates examples of states of a notification summary, according to embodiments of the present disclosure.
  • multiple states are possible and a different level of information can be shown in each state.
  • a first state 1810 corresponds to a collapsed state and shows a header of a notification summary.
  • the header indicates that notifications have not been presented (e.g., by including text such as: “while you were [away/gaming/watching, etc.].. ”) and the total number of such notifications (e.g., “eight new notifications”).
  • the header can indicate a reason why the notification summary is presented. Different reasons may exist, generally depend on a user context and/or an application context, and correspond to the conditions that resulted in queuing the notifications rather than presenting them immediately. For instance, the notification summary is presented on a display coupled to a computing device.
  • One reason corresponds to an operational mode of the computing device that prevented the immediate presentation (e.g., “while you were gaming, eight notifications were received”). Another reason corresponds to one or more notifications being received while the computing device is powered off (e.g., “while you were away, eight notifications were received”). Yet another reason corresponds to the relevant user not being logged in onto the computing device (e.g., “while you were logged off, eight notifications were received”). In this way, the notification summary and the reason for the notification summary are presented simultaneously under the first state 1810.
  • a second state 1840 corresponds to an expanded state and shows the header, a preview of a selected subset of the notifications, and a total number of remaining notifications that are not in the preview.
  • the header can remain the same or can be modified (e.g., does not include the text, need not but may show the reason for the notification summary, etc.). Nonetheless, the header typically shows the total number of notifications that are in the notification summary.
  • the selected subset corresponds to a predefined number of the highest priority notifications (e.g., the top three notifications).
  • the preview shows each such notification in a collapsed state (as described in connection with FIG. 8). At the bottom of the notification summary, the total number of remaining notifications is shown and this number corresponds to the total number of notifications in the notification summary minus the total number of notifications in the preview (e.g., “five remaining notifications”).
  • a notification is presented in a collapsed state in the preview from the notification summary.
  • User input can be received and can indicate a user selection of the notification.
  • the notification can be presented in an expanded state.
  • Different techniques are possible for the presentation of the notification in the expanded state.
  • the notification summary is further expanded (e.g., the size of its window is increased) and the expanded notification is still presented within the notification summary (e.g., within the window by pushing down other notifications from the preview).
  • the expanded notification is shown in a separate window from the notification summary. In this case, the notification summary can be updated by removing the notification from it.
  • a third state 1870 also corresponds to an expanded state. Here, however all the notifications are previewed rather than a subset. If previewing the notifications necessitates a larger area than the window of the notification summary, a scrolling mechanism can be used to scroll through the notifications. These notifications are organized according to their priorities, where the highest priority notification is previewed at the top of the notification summary and the lowest priority notification is previewed at the bottom of the notification summary.
  • FIG. 19 illustrates examples of summarizing notifications, according to embodiments of the present disclosure.
  • notifications are organized according to their priorities.
  • a notification summary previews a subset of the notifications, where the subset is selected based on the priorities.
  • a priority of a notification can be defined as either or both of its relevance and its recency.
  • the relevance indicates how relevant the notification is to a current context, such as a user context and/or an application context.
  • the recency indicates the difference between the current time and the time the corresponding notification data was received.
  • a set 1910 of notifications has been queued (FIG. 19 shows eight notifications).
  • Each of such notification is associated with a time stamp, representing the point in time when the corresponding notification data was received.
  • the recency of a notification can be determined as a difference between the current time and the time stamp (e.g., as illustrated, “Notification A” has a one minute recency indicating that the corresponding notification data was received a minute ago).
  • the relevance depends on the type of the notification.
  • a relevance can be predefined per notification type (or any other attribute of notification type such as source application, destination application, counter, type of the source and/or destination application, etc.). For instance, if the notification is a video game notification, its relevance is higher than that of a social media notification, which in turn is higher than a promotion notification.
  • the relevance can change depending on the operational mode.
  • each operational mode can be associated with a predefined relevance per notification type (or any other attribute). For instance, if the operational mode is a social media mode, social media notifications are associated with the highest relevance.
  • the relevance depends on whether the notification is associated with an application having an application window in the foreground or the background. If in the foreground, the relevance is higher than that of a notification associated with a background application window.
  • the relevance depends on the user context and/or application context. If such contexts indicate an activity, event, update, or feedback and if the notification is associated with the activity, event, update, or feedback, its relevance is increased. For instance, if the user context indicates that user attention is on video game content and if the application context indicates user interaction with a particular video game application, a notification related to the video game application has a higher relevance than a notification related to another video game application, which in turn has a higher relevance than a notification related to a non-video game application.
  • the notification data when notification data is sent to a queue and a corresponding first notification is added to the notification summary, the notification data can also be sent to a second device of the user, such as to the user’s mobile device. User interaction with the corresponding second notification on the second device is monitored. If the second notification is presented, the relevance of the first notification in the notification summary is decreased to a minimum or even the first notification can be removed from the notification summary. If the second notification is dismissed without being presented, the relevance of the first notification can be decreased to a predefined level (but not to a minimum). If no user interaction with the second notification is detected, the relevance of the first notification is not changed.
  • a ML algorithm can be used to generate the relevance of a notification. In particular, data about the user context and/or the application context and how notifications are presented and dismissed, or restricted and subsequently viewed can be tracked for the user and across different users. The ML algorithm is trained based on such data to output relevance of notifications.
  • the priority of a notification in the notification summary changes based on one or both of its relevance and recency.
  • the notifications in the notification summary can be re arranged.
  • the latest priorities of the notifications are determined and these notifications are re-arranged accordingly.
  • the notification summary is organized first based on the relevance assigned to each notification (e.g., messages having higher relevance than promotions). The notifications are then sorted based on recency (e.g., the latest message is shown above an older message). A predefined number (e.g., three) of the highest priority notifications (e.g., the first three notifications in the notification summary) can be presented in a preview of the notification summary.
  • a notification summary 1950 of the set 1910 of notifications can be presented in an expanded state that also indicates the reason why the notification summary 1950 is presented.
  • “Notification D” has the highest relevance, followed by “Notification A” and “Notification G,” although “Notification A” was received prior to “Notification D.”
  • FIG. 20 illustrates an example of a flow for summarizing and presenting notifications, according to embodiments of the present disclosure.
  • the operations of the flow can be implemented as hardware circuitry and/or stored as computer-readable instructions on a non-transitory computer-readable medium of a computer system, such as a video game system or backend server.
  • the instructions represent modules that include circuitry or code executable by a processor(s) of the computer system. The execution of such instructions configures the computer system to perform the specific operations described herein.
  • Each circuitry or code in combination with the processor represents a means for performing a respective operation(s). While the operations are illustrated in a particular order, it should be understood that no particular order is required.
  • the flow starts at operation 2002, where the computer system presents content in an application window.
  • an application is executing and presents the content in the application window on a GUI of a display communicatively coupled with a device.
  • the device can be a computing component of the computer system.
  • the computer system receives notification data.
  • the notification data is received from another device and is associated with a source application, a destination application, a notification type, and/or a notification subject, among other attributes.
  • the notification data can be used to present a notification on the GUI.
  • the computer system determines whether the notification is to be queued.
  • the computer system determines that a presentation of the notification is restricted (e.g., the notification is not to be presented as an in-context notification or as a pop-up notification).
  • a presentation of the notification is restricted (e.g., the notification is not to be presented as an in-context notification or as a pop-up notification).
  • Different techniques are possible to determine whether the notification is to be restricted or presented, as described herein above. If it should be restricted, the computer system can determine whether the notification is to be queued.
  • the computer system determines that the notification is to be queued based on a determination that the notification data is unassociated with the application and that the application window is presented in a foreground of the display.
  • the computer system determines that the notification is to be queued based on a determination that the notification data is associated with the application and that the application window is presented in a background of the display. If the notification is to be presented, operation 2008 follows operation 2006. Otherwise, operation 2010 follows operation 2006.
  • the computer system presents the notification as in-context notification or as a pop-up notification.
  • a set of rules can be used to determine the type of the notification as described herein above in connection with FIGS. 4-9.
  • the computer system sends, at a first point in time, the notification to a queue of notifications.
  • Each of the notifications in the queue is associated with a notification priority.
  • the notification priority can be defined as a relevance and a recency.
  • the computer system updates, at a second point in time, the notifications in the queue. For instance, the relevance of each notification is updated as described herein above in connection with FIG. 19. The recency of each notification is also updated based on the time stamp of the notification. The notifications are re-organized (e.g., ranked) according to their relevance and sorted according to their recency.
  • the computer system selects a subset of the notifications. For instance, a predefined number (e.g., three) notifications should be selected. The three highest priority (or the predefined number) notifications are selected and form the subset.
  • a predefined number e.g., three
  • the three highest priority (or the predefined number) notifications are selected and form the subset.
  • the computer system generates a notification summary.
  • the notification summary includes the various notifications organized according to the priorities.
  • the notification summary can also include a header indicating the total number of notifications, a preview of the subset of notifications, and a footer indicating the total number of remaining notifications.
  • the computer system presents the notifications summary. For instance, the notification summary is presented in a first state that shows the header. Based on a user interaction with the header, the notification summary is presented in a second state that further shows the preview and the footer. Upon a user interaction with the footer, the various notifications are previewed in the notification summary.
  • FIG. 20 illustrates that notification data is received while content is being presented in an application window
  • the flow similarly apply to presenting a notification summary when the notification data is received while power to the device is turned off or when a user is not logged in to the device.
  • the computer system can generate a notification list that includes different sets of notifications.
  • a first set can correspond to first notifications that have been received but presented.
  • a second set can correspond to notifications that have been received and presented.
  • the notification summary can be generated from the notification list, where the notification summary includes a subset corresponding to one or more of the first notifications.
  • FIG. 21 illustrates an example of a flow for presenting in-context and pop-up notifications on a video game console, according to embodiments of the present disclosure.
  • the operations of the flow can be implemented as hardware circuitry and/or stored as computer-readable instructions on a non-transitory computer-readable medium of the video game console.
  • the instructions represent modules that include circuitry or code executable by a processor(s) of the video game console. The execution of such instructions configures the video game console to perform the specific operations described herein.
  • Each circuitry or code in combination with the processor represents a means for performing a respective operation(s). While the operations are illustrated in a particular order, it should be understood that no particular order is required.
  • the video game console receives notification data.
  • the video game consoler determines whether a user login to the video game console exists. If so, operation 2104 follows operation 2102. Otherwise, operation 2126 follows operation 2102.
  • the video game console determines whether an immersive user experience is being provided.
  • an immersive user experience corresponds to one of predefined operational modes of the video game console. For instance, if the operational mode is a gaming mode, the video game console determines that an immersive user experience is being provided.
  • the immersive user experience can depend on the user context (e.g., the level of user attention) and application context (e.g., the level of user interaction). When the level of user attention and/or the level of user interaction exceed a predefined level, a determination is made that the immersive user experience is provided. If so, operation 2106 follows operation 2104. Otherwise, operation 2120 follows operation 2104.
  • the video game console determines whether a video game is being played. For instance, a video game application can be executing and video game content is presented in an application window. If the application window is in the foreground, a determination is made that a video game is being played. If so, operation 2108 follows operation 2106. Otherwise, operation 2110 follows operation 2106.
  • the video game console determines that a pop-up notification should be presented.
  • a user of the video game console is engaged in an immersive user experience and is playing a video game. Accordingly, the pop-up notification can be presented to alert the user.
  • the video game console sends a push notification to the mobile device or the other device.
  • the video game console determines whether the notification is time sensitive or not (e.g., based on an attribute of the notification; for instance, system notifications are time sensitive). If time sensitive, operation 2116 follows operation 2114. Otherwise, operation 2118 follows operation 2114.
  • the video game console determines that a pop-up notification should be presented.
  • the pop-up notification is needed because of the time sensitivity. Accordingly, the pop-up notification can be presented to alert the user.
  • the video game console sends the notification to a notification and/or a queue to be added to a notification summary.
  • the video game console determines a user focus on the content that is presented (or any service provided) by the video game console.
  • the user focus can depend on the user context and/or the application context.
  • operation 2122 follows operation 2120.
  • operation 2124 follows operation 2120.
  • the video game console determines that an in context notification should be presented. Accordingly, the in-context notification can be presented as in-line, in-application, or in-flow.
  • the game console determines that a pop-up notification should be presented. Accordingly, the pop-up notification can be presented to alert the user.
  • operation 2126 a determination is made whether the user is associated with the mobile device or the device having access to the web, similarly to operation 2110. If so (the user associated with the mobile device or the device having access to the web and, optionally, activities are detected), operation 2128 follows operation 2126. Otherwise, operation 2134 follows operation 2126.
  • the video game console determines whether the mobile device or the other device is connected to a local area network. For instance, this determination is made based on a service set identifier (SSID) of the access point to which the mobile device or other device is connected. If so, operation 2130 follows operation 2128. Otherwise, operation 2132 follows operation 2128.
  • SSID service set identifier
  • the video game console sends the notification to the notification and/or the queue to be added to the notification summary.
  • the video game console also sends a push notification to the mobile device or the other device.
  • the push can be performed over the local area network.
  • the video game console sends the notification to the notification and/or the queue to be added to the notification summary.
  • the video game console also sends a push notification to the mobile device or the other device.
  • the push can be performed over a remote network.
  • the video game console sends the notification to the notification and/or the queue to be added to the notification summary.
  • FIG. 22 illustrates an example of a hardware system suitable for implementing a computer system 2200, according to embodiments of the present disclosure.
  • the computer system 2200 represents, for example, a video game system, a backend set of servers, or other types of a computer system.
  • the computer system 2200 includes a central processing unit (CPU) 2205 for running software applications and optionally an operating system.
  • the CPU 2205 may be made up of one or more homogeneous or heterogeneous processing cores.
  • Memory 2210 stores applications and data for use by the CPU 2205.
  • Storage 2215 provides non-volatile storage and other computer readable media for applications and data and may include fixed disk drives, removable disk drives, flash memory devices, and CD-ROM, DVD-ROM, Blu-ray, HD-DVD, or other optical storage devices, as well as signal transmission and storage media.
  • User input devices 2220 communicate user inputs from one or more users to the computer system 2200, examples of which may include keyboards, mice, joysticks, touch pads, touch screens, still or video cameras, and/or microphones.
  • Network interface 2225 allows the computer system 2200 to communicate with other computer systems via an electronic communications network, and may include wired or wireless communication over local area networks and wide area networks such as the Internet.
  • An audio processor 2255 is adapted to generate analog or digital audio output from instructions and/or data provided by the CPU 2205, memory 2210, and/or storage 2215.
  • the components of computer system 2200, including the CPU 2205, memory 2210, data storage 2215, user input devices 2220, network interface 2225, and audio processor 2255 are connected via one or more data buses 2260.
  • a graphics subsystem 2230 is further connected with the data bus 2260 and the components of the computer system 2200.
  • the graphics subsystem 2230 includes a graphics processing unit (GPU) 2235 and graphics memory 2240.
  • the graphics memory 2240 includes a display memory (e.g., a frame buffer) used for storing pixel data for each pixel of an output image.
  • the graphics memory 2240 can be integrated in the same device as the GPU 2235, connected as a separate device with the GPU 2235, and/or implemented within the memory 2210. Pixel data can be provided to the graphics memory 2240 directly from the CPU 2205.
  • the CPU 2205 provides the GPU 2235 with data and/or instructions defining the desired output images, from which the GPU 2235 generates the pixel data of one or more output images.
  • the data and/or instructions defining the desired output images can be stored in the memory 2210 and/or graphics memory 2240.
  • the GPU 2235 includes 3D rendering capabilities for generating pixel data for output images from instructions and data defining the geometry, lighting, shading, texturing, motion, and/or camera parameters for a scene.
  • the GPU 2235 can further include one or more programmable execution units capable of executing shader programs.
  • the graphics subsystem 2230 periodically outputs pixel data for an image from the graphics memory 2240 to be displayed on the display device 2250.
  • the display device 2250 can be any device capable of displaying visual information in response to a signal from the computer system 2200, including CRT, LCD, plasma, and OLED displays.
  • the computer system 2200 can provide the display device 2250 with an analog or digital signal.
  • the CPU 2205 is one or more general- purpose microprocessors having one or more processing cores. Further embodiments can be implemented using one or more CPUs 2205 with microprocessor architectures specifically adapted for highly parallel and computationally intensive applications, such as media and interactive entertainment applications.
  • the components of a system may be connected via a network, which may be any combination of the following: the Internet, an IP network, an intranet, a wide-area network (“WAN”), a local-area network (“LAN”), a virtual private network (“VPN”), the Public Switched Telephone Network (“PSTN”), or any other type of network supporting data communication between devices described herein, in different embodiments.
  • a network may include both wired and wireless connections, including optical links. Many other examples are possible and apparent to those skilled in the art in light of this disclosure. In the discussion herein, a network may or may not be noted specifically.
  • a method for presenting notifications and implemented by a computer system comprising: presenting, in an application window on a display communicatively coupled with a device, content based on an execution of an application; receiving notification data; determining an operational mode of the device from a plurality of operational modes based on the application, wherein each of the operational modes is associated with a different set of notification settings; determining, based on the set of notification settings associated with the operational mode, that a notification is to be presented on the display, the notification corresponding to the notification data; and presenting the notification on the display while a presentation of the content in the application window continues.
  • Clause 2 The method of clause 1, further comprising: determining that the notification is not to be presented in the application window based on a determination that the notification data is unassociated with the application or based on a determination that the notification data is associated with the application and the application window is in a background of the display.
  • Clause 4 The method of any preceding clauses, further comprising: receiving second notification data associated with a second application; determining that the set of notification settings restricts, based on at least one of the second application or a notification type, a presentation of a second notification that is of the notification type and that includes the second notification data; sending the second notification data to a queue based on the presentation of the second notification being restricted; and sending the second notification data to a second device based on the second notification data being queued.
  • Clause 6 The method of any preceding clauses, further comprising: receiving second notification data; determining that the operational mode changed to a second operational mode of the plurality of operational modes; determining a second set of notification settings associated with the second operational mode; determining that the second set restricts, a presentation of a second notification that includes the second notification data; and sending the second notification data to a queue based on the presentation of the second notification being restricted.
  • Clause 7 The method of any preceding clauses, wherein the notification is presented in a pop-up window over the application window while the presentation of the content continues, and wherein the notification is presented in a first state that indicates at least one of a notification type or a title of the notification.
  • Clause 8 The method of clause 7, further comprising: receiving a user interaction with the notification; and presenting, based on the user interaction, the notification in a second state in the pop-up window while the presentation of the content continues, wherein the second state indicates a description of the notification from the notification data and a selectable action.
  • Clause 9. The method of clause 8, further comprising: receiving an update to at least one of the description or the selectable action; and presenting, while the presentation of the content and the presentation of the notification in the second state continue, the update in the notification.
  • Clause 10 The method of clause 9, wherein the content is presented to a user, and further comprising: in response to receiving the notification data: determining a user context of the user, the user context indicating a level of attention of the user to the content, and determining an application context of the application, the application context indicating a level of user interaction with the application; and determining a change to at least one of the user context or the application context, wherein the update to the notification is based on change.
  • a computer system comprising: one or more processors; and one or more memories storing computer-readable instructions that, upon execution by the one or more processors, configure the computer system to: present, in an application window on a display communicatively coupled with a device, content based on an execution of an application; receive notification data; determine an operational mode of the device from a plurality of operational modes based on the application, wherein each of the operational modes is associated with a different set of notification settings; determine, based on the set of notification settings associated with the operational mode, that a notification is to be presented on the display, the notification corresponding to the notification data; and present the notification on the display while a presentation of the content in the application window continues
  • Clause 12 The computer system of clause 11, wherein the execution of the computer-readable instructions further configures the computer system to: receive second notification data; determine that the set of notification settings restricts a presentation of a second notification that includes the second notification data; send the second notification to a notification list based on the presentation of the second notification being restricted.
  • Clause 13 The computer system of clause 12, wherein the second notification is associated with a set of parameters that include at least one of a source application, a destination application, a notification type, or a notification subject, and wherein the execution of the computer-readable instructions further configures the computer system to update the second notification in the notification list to a third notification by at least: replacing the second notification with the third notification based on a match between the set of parameters associated with the second notification and a set of parameters associated with the third notification; placing the third notification at a top of the notification list; and associating the third notification with a timestamp based on the placing of the third notification.
  • updating the second notification further comprises: incrementing a counter associated with the second notification and the third notification, the counter being presentable in the third notification.
  • Clause 15 The computer system of clause 14, wherein the execution of the computer-readable instructions further configures the computer system to: present the notification list including notifications that are arranged based on time stamps corresponding to the notifications, wherein the third notification is presented and shows the counter.
  • Clause 16 The computer system of clause 12, wherein the execution of the computer-readable instructions further configures the computer system to: group the second notification with a third notification in the notification list based on the second notification and the third notification being associated with a same notification type; and present the notification list including, wherein the second notification and the third notification are shown in the notification list as being grouped together.
  • Clause 17 The computer system of clause 12, wherein the second notification is associated with a time stamp, wherein the execution of the computer-readable instructions further configures the computer system to: modify notification content of the second notification in the notification list to a third notification without modifying the time stamp; and present the notification list including notifications that are arranged based on time stamps corresponding to the notifications.
  • One or more non-transitory computer-readable storage media storing computer-readable instructions that, upon execution on a computer system, cause the computer system to perform operations comprising: presenting, in an application window on a display communicatively coupled with a device, content based on an execution of an application; receiving notification data; determining an operational mode of the device from a plurality of operational modes based on the application, wherein each of the operational modes is associated with a different set of notification settings; determining, based on the set of notification settings associated with the operational mode, that a notification is to be presented on the display, the notification corresponding to the notification data; and presenting the notification on the display while a presentation of the content in the application window continues.
  • Clause 19 The one or more non-transitory computer-readable storage media of clause 18, wherein the operational mode indicates a level of user focus on the content, and wherein the operational mode is determined based on at least one of: a user selection of the operational mode, a type of the content, a title of the content, a source of the content, or a type of the application.
  • Clause 20 The one or more non-transitory computer-readable storage media of clause 18 or 19, wherein the device comprises a video game console, and wherein the operational mode comprises at least one of a gaming mode, a content on demand mode, a content broadcast mode, or a virtual reality mode.
  • the embodiments may be described as a process which is depicted as a flow diagram or block diagram. Although each may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be rearranged. A process may have additional steps not included in the figure.
  • the term “memory” or “memory unit” may represent one or more devices for storing data, including read-only memory (ROM), random access memory (RAM), magnetic RAM, core memory, magnetic disk storage mediums, optical storage mediums, flash memory devices, or other computer-readable mediums for storing information.
  • ROM read-only memory
  • RAM random access memory
  • magnetic RAM magnetic RAM
  • core memory magnetic disk storage mediums
  • optical storage mediums flash memory devices
  • computer-readable mediums includes, but is not limited to, portable or fixed storage devices, optical storage devices, wireless channels, a sim card, other smart cards, and various other mediums capable of storing, containing, or carrying instructions or data.
  • embodiments may be implemented by hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof.
  • the program code or code segments to perform the necessary tasks may be stored in a computer-readable medium such as a storage medium. Processors may perform the necessary tasks.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Business, Economics & Management (AREA)
  • Optics & Photonics (AREA)
  • Business, Economics & Management (AREA)
  • Computer Security & Cryptography (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
PCT/US2020/047070 2019-08-30 2020-08-19 Operational mode-based settings for presenting notifications on a user display WO2021041132A1 (en)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US16/557,578 US10946294B1 (en) 2019-08-30 2019-08-30 Summarizing notifications on a user display
US16/557,600 2019-08-30
US16/557,559 2019-08-30
US16/557,578 2019-08-30
US16/557,559 US10946279B1 (en) 2019-08-30 2019-08-30 Context-based notifications on a user display
US16/557,600 US20210064317A1 (en) 2019-08-30 2019-08-30 Operational mode-based settings for presenting notifications on a user display

Publications (1)

Publication Number Publication Date
WO2021041132A1 true WO2021041132A1 (en) 2021-03-04

Family

ID=74684012

Family Applications (3)

Application Number Title Priority Date Filing Date
PCT/US2020/047070 WO2021041132A1 (en) 2019-08-30 2020-08-19 Operational mode-based settings for presenting notifications on a user display
PCT/US2020/047060 WO2021041129A1 (en) 2019-08-30 2020-08-19 Context-based notifications on a user display
PCT/US2020/047064 WO2021041130A1 (en) 2019-08-30 2020-08-19 Summarizing notifications on a user display

Family Applications After (2)

Application Number Title Priority Date Filing Date
PCT/US2020/047060 WO2021041129A1 (en) 2019-08-30 2020-08-19 Context-based notifications on a user display
PCT/US2020/047064 WO2021041130A1 (en) 2019-08-30 2020-08-19 Summarizing notifications on a user display

Country Status (4)

Country Link
EP (1) EP4021598A4 (ja)
JP (1) JP2022546474A (ja)
CN (1) CN114556295B (ja)
WO (3) WO2021041132A1 (ja)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110004845A1 (en) * 2009-05-19 2011-01-06 Intelliborn Corporation Method and System For Notifying A User of An Event Or Information Using Motion And Transparency On A Small Screen Display
US20110167383A1 (en) * 2010-01-05 2011-07-07 Hewlett-Packard Development Company, L.P. Notification In Immersive Applications
US20120198002A1 (en) * 2011-01-27 2012-08-02 T-Mobile Usa, Inc. Unified Notification Platform
US20130159417A1 (en) * 2011-12-19 2013-06-20 France Telecom Method for notification of events on a device running multiple user identities
US20140351744A1 (en) * 2013-05-22 2014-11-27 Samsung Electronics Co., Ltd. Method of operating notification screen and electronic device supporting the same

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7941491B2 (en) * 2004-06-04 2011-05-10 Messagemind, Inc. System and method for dynamic adaptive user-based prioritization and display of electronic messages
US20070174768A1 (en) * 2006-01-20 2007-07-26 International Business Machines Corporation Adaptive alert management
US20070214429A1 (en) * 2006-03-13 2007-09-13 Olga Lyudovyk System and method for managing application alerts
US8117304B2 (en) * 2007-10-25 2012-02-14 International Business Machines Corporation Processing event notifications with an event sink
US8825842B2 (en) * 2011-04-28 2014-09-02 Facebook, Inc. Managing notifications pushed to user devices
US9185680B2 (en) * 2013-12-19 2015-11-10 International Business Machines Corporation Contextual push notification service
US20170099592A1 (en) * 2014-05-30 2017-04-06 Interdigital Technology Corporation Personalized notifications for mobile applications users
US9032321B1 (en) * 2014-06-16 2015-05-12 Google Inc. Context-based presentation of a user interface
KR102341823B1 (ko) * 2015-02-17 2021-12-21 삼성전자주식회사 상황 인식 기반 서비스 제공 방법 및 그 전자 장치
US10114519B2 (en) * 2016-05-03 2018-10-30 Microsoft Technology Licensing, Llc Contextual content presentation based on microenvironment interactions
US10620920B2 (en) * 2016-05-17 2020-04-14 Google Llc Automatic graphical user interface generation from notification data
US10754502B2 (en) * 2018-01-25 2020-08-25 Microsoft Technology Licensing, Llc Framework for contextual notifications

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110004845A1 (en) * 2009-05-19 2011-01-06 Intelliborn Corporation Method and System For Notifying A User of An Event Or Information Using Motion And Transparency On A Small Screen Display
US20110167383A1 (en) * 2010-01-05 2011-07-07 Hewlett-Packard Development Company, L.P. Notification In Immersive Applications
US20120198002A1 (en) * 2011-01-27 2012-08-02 T-Mobile Usa, Inc. Unified Notification Platform
US20130159417A1 (en) * 2011-12-19 2013-06-20 France Telecom Method for notification of events on a device running multiple user identities
US20140351744A1 (en) * 2013-05-22 2014-11-27 Samsung Electronics Co., Ltd. Method of operating notification screen and electronic device supporting the same

Also Published As

Publication number Publication date
CN114556295A (zh) 2022-05-27
WO2021041130A1 (en) 2021-03-04
JP2022546474A (ja) 2022-11-04
CN114556295B (zh) 2024-06-25
EP4021598A4 (en) 2023-08-23
EP4021598A1 (en) 2022-07-06
WO2021041129A1 (en) 2021-03-04

Similar Documents

Publication Publication Date Title
US20210064317A1 (en) Operational mode-based settings for presenting notifications on a user display
US11712624B2 (en) User immersion context-based notifications on a user display
US11890549B2 (en) Summarizing notifications on a user display
US11565176B2 (en) Methods and systems for cloud executing mini-games and sharing
US10058787B2 (en) Systems and methods for generating and sharing video clips of cloud-provisioned games
JP6563627B2 (ja) 共有されたクラウドで実行されるミニゲームのコンテンツのタグ付け、およびタグ共有制御のシステムおよび方法
US10531145B2 (en) Information processing apparatus and information processing method
EP2992679A1 (en) Integrated interactive television entertainment system
US20230132371A9 (en) System, method, and computer-readable medium including program for providing live video distribution service
US11093114B2 (en) Context-based user interface menu with selectable actions
US20220155918A1 (en) Context-Based User Interface Menu With Selectable Actions
US20220321939A1 (en) Systems and methods for streaming media menu templates
WO2021041132A1 (en) Operational mode-based settings for presenting notifications on a user display
US11797169B2 (en) Context-based user interface menu with selectable actions
CN117793396A (zh) 直播间防打断操作的方法、装置、电子设备及存储介质
CN115098012A (zh) 显示方法、电子设备和计算机程序产品
CN117376592A (zh) 显示控制方法及装置、显示方法及装置、设备和介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20857741

Country of ref document: EP

Kind code of ref document: A1

DPE2 Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20857741

Country of ref document: EP

Kind code of ref document: A1