DE202017104272U1 - Context information for a notification - Google Patents

Abstract

A non-transitory computer-readable storage medium encoded with instructions that, when executed by one or more processors included in a data processing device, cause the data processing device to perform operations, the operations comprising: receiving a query-independent request for context information relevant to the Notification is relevant by a user device in response to the user device receiving a notification in response to an occurrence of a triggering event; Identifying multiple search terms from the content in the notification; Determining a relevance score for each of the plurality of search terms; Selecting one or more of the multiple search terms based on the relevance ratings; and providing a respective user interface element for the display with the notification for the user device for each of the selected one or more search terms, each user interface element containing context information regarding the respective search term.

Description

This utility model refers to providing context information to a user.

A device may provide context information to a user. For example, an entity may display a webpage about a particular item, receive a search query from the user containing search terms for the particular item, retrieve search results in response to the search query, and provide the search results to the user.

Typical interaction models require that users provide some form of user query for a user device. For example, a user may have set a notification to be reminded when a movie is about to start in the movie theaters. On the day before the theatrical release on the user's smartphone a notification "The film X has its theatrical release tomorrow" appear. The user may then decide to review movie reviews to determine if he wants to watch the movie. Accordingly, the user can express: "Phone, show me reviews for the movie X". A search process then performs a resource search using the "Reviews for Movie X" query to identify resources that may satisfy the user's information needs.

Be provided under protection and subject of the utility model are, according to the provisions of the utility model law, only devices as defined in the appended claims, but no method. Wherever in the description, if appropriate, reference is made to methods, these references are merely illustrative of the device or devices set forth in the appended claims.

SUMMARY

In general, an innovative aspect of the subject matter described in this utility model patent may be embodied in methods that include the actions of receiving a query-independent request for context information relevant to the notification from a user device in response to the user device responding to an occurrence of a user Triggers a notification, identifying a plurality of search terms from the content in the notification, determining a relevance score for each of the multiple search terms, selecting one or more of the plurality of search terms based on the relevance scores, and providing each user interface element for display with the triggering event Notification to the user device for each of the selected one or more search terms, each user interface element providing context information regarding each Contains search terms.

Other embodiments of this aspect include corresponding computer systems, devices and computer programs recorded in one or more computer storage devices each configured to perform the actions of the methods. A system of one or more computers may be configured to perform certain operations or actions based on having software, firmware, hardware, or a combination of them installed in the system that cause or cause the system to operate performs the actions. One or more computer programs may be configured to perform certain operations or actions based on having instructions that, when executed by data processing devices, cause the device to perform the actions.

Each of the above and other embodiments may optionally include one or more of the following features, alone or in combination. In certain aspects, receiving a query-independent request for context information relevant to the notification from a user device in response to the user device responding to the occurrence receives a notification request that does not contain one or more terms entered by the user and that contains the content in the notification. In some aspects, receiving a query-independent request for context information relevant to the notification from a user device in response to the user device receiving a notification in response to an occurrence of a trigger event includes receiving a query-independent request for context information relevant to the notification the notification is relevant, from the user device in response to the user device generating the notification in response to the occurrence of the triggering event. In some implementations, receiving a query-independent request for context information relevant to the notification from a user device in response to the user device receiving a notification in response to the occurrence of a triggering event includes receiving in response to the determination that a Background application provides the notification for the display, from the user device in response to the user device receiving the notification.

In certain aspects, the notification includes a user interface element superimposed on a graphical user interface. In some aspects, the trigger event includes reminder fulfillment criteria for calendar setting and / or receipt of a text message from another user while a text message conversation with the other user is not viewed, and / or an application in the user device includes a push notification from a server receives. In some implementations, identifying multiple search terms from the content in the notification includes extracting text in the notification from the query-independent request and identifying the plurality of search terms from the text. In certain aspects, identifying multiple search terms from the content in the notification includes extracting an indication of an application corresponding to the notification from the query-independent request and identifying the plurality of search terms based at least on the application corresponding to the notification.

In general, an innovative aspect of the subject matter described herein may be embodied in methods that include actions to receive a notification for display on the user device in response to the occurrence of a triggering event and by a user device, the notification relating to a search term Responsive to receiving the notification to display on the user device, a query-independent request for context information relevant to the notification provided by the user device for a context information server, receiving a user interface element containing context information regarding the search term, and the notification and the user interface element simultaneously display on the user device.

Other embodiments of this aspect include corresponding computer systems, devices and computer programs recorded in one or more computer storage devices each configured to perform the actions of the methods. A system of one or more computers may be configured to perform certain operations or actions based on having software, firmware, hardware, or a combination of them installed in the system that cause or cause the system to operate performs the actions. One or more computer programs may be configured to perform certain operations or actions based on having instructions that, when executed by data processing devices, cause the device to perform the actions.

The above and other embodiments may optionally include one or more of the following features, alone or in combination. In certain aspects, providing a query-independent request for context information relevant to the notification by the user device for a context information server includes providing a query-independent request that does not include one or more user-entered terms and containing the content in the notification , In some aspects, the notification includes a user interface element superimposed on a graphical user interface. In some implementations, the trigger event includes reminder fulfillment criteria for calendar setting and / or receipt of a text message from another user while the text message conversation with the other user is not viewed, and / or an application in the user device includes push notification from a server receives.

Certain embodiments of the subject matter described herein may be implemented to realize one or more of the following advantages. When a notification is received, a device may provide context information to a user that is likely to satisfy a user's information needs without a user providing a query to the device or even requesting context information when viewing the notification. This results in a convenient way for the user to obtain context information for notifications. The user no longer needs to enter query expressions or speak query expressions to obtain contextual information. In fact, when the user receives the notification, he may receive context information without providing any indication that the user desires context information for the notification. Accordingly, users receive context information in a manner that is convenient not only for the user, but also in a relatively discrete manner so that bystanders are not disturbed by the user speaking to the device. Since the user does not need to enter a query or needs to provide any indication that Contextual information is desired, the user may also receive contextual information in some implementations if the user were not actually able to effectively enter or provide the indication, e.g. For example, if the user has only one hand free.

In addition, because the context information can be provided without input from the user, the system need not perform text-to-speech processing or handle keyboard input. This leads to fewer input errors and erroneous input queries. Accordingly, as a whole, thousands of erroneous and inaccurate queries are avoided, which in turn leads to a more efficient use of search system resources. In other words, multiple erroneous query processing cycles are avoided, which reduces the required processing resources and reduces the overall system bandwidth requirements (or, alternatively, allows a larger number of users to be serviced without a corresponding increase in processing resources). This improvement in the art of search processing is thus another distinct advantage realized by the systems and methods described herein.

The details of one or more embodiments of the subject matter described herein are set forth in the accompanying drawings and the description below. Other features, aspects, and advantages of the subject matter will be apparent from the description, from the drawings, and from the claims.

BRIEF DESCRIPTION OF THE DRAWINGS

1 Figure 10 is a block diagram of an example environment in which context information is provided for a notification.

2 FIG. 10 is a more detailed block diagram of an example environment in which context information is provided for notification.

3 and 4 are flowcharts of example processes for providing context information for a notification.

5 is a schematic representation of a computer system. Like reference numerals and designations in the various drawings indicate like elements.

DETAILED DESCRIPTION

A user may wish to receive additional information regarding an item of notification shown on a device. For example, a user may search a web site if a notification "Movie X has its theatrical release tomorrow" can be generated for a reminder that the user has set in a calendar application when they see the notification. The user may wish to receive certain additional information about the "Movie X". Accordingly, the user can open a web page for a search engine, enter "Movie X" and then select a search result to view it. However, this process can be time consuming and require multiple interactions by the user.

The following describes systems and methods for providing context information for a notification. Rather than providing context information based on a user-entered query, the system may provide context information relevant to a notification without receiving from the user a query input or an indication requesting context information for the notification. To provide the context information, the system may determine that a user device has received a notification, and in response, identify search terms from the content of the notification and then provide contextual information about the identified search terms to the user. For example, the system may identify that the text "Movie X" in the notification matches a movie named "Movie X" and, in response, together with the notification, display a brief description, age approval, and local movie X movie show times ,

1 is a block diagram of an example environment 100 in which context information is provided for a notification. The environment 100 contains a user device 110 and a context information server 150 ,

A user device 110 is used by a user to obtain context information for a notification. The user device 110 is an electronic device that can display notifications. Exemplary user devices 110 include personal computers (eg, desktops or laptops), mobile communication devices (eg, smartphones or tablets), and other devices that can send and receive data over the network (eg, televisions or goggles or watches with network communication functionality). Usually contains one User device a user application, for. For example, use a web browser to allow sending and receiving data over the network. The web browser may allow a user to display and interact with text, images, videos, music, and other information typically found on a web page at a web site on the World Wide Web or on a local area network. The user device 110 can use any suitable application to send and receive data over the network and present data to a user.

In addition, the user device 110 Contain applications that can generate notifications. The user device 110 can z. For example, a calendar application that can generate notifications for reminders and / or a messaging application that can generate notifications when messages are sent by the user device 110 and / or a restaurant reservation application that can generate notifications when reservations are pending, and / or a messaging application that can generate notifications as if by the user equipment 110 a push notification is received for a message update, and / or contain another application. The applications may be in a background of the user device 110 be executed when notifications are generated. For example, a user may own the user device 110 to play a game when a messaging application receives a message, and in response, the user device may 110 display, via a graphical user interface for the game, a notification containing a beginning portion of the received message. Notifications, such as a push notification to a user equipment that can be received regardless of the active status of any particular application, may also be received in the absence of an application.

A notification is information provided to a user in response to an occurrence of a triggering event. A notification can z. B. be a graphical user element on a screen of the user device 110 is displayed and contains text or pictures informing a user of the occurrence of a triggering event. In another example, a notification may be audio output via a user equipment microphone 110 and that contains synthesized speech informing a user of an occurrence of a triggering event. A trigger event may be an event that triggers a notification to be provided to a user. A triggering event contains z. B. reminder fulfillment criteria for calendar setting and / or receipt of a text message from another user while a user is not viewing a text messaging conversation with the other user, and / or an application in the user device is receiving a push notification from a server, and / or another event.

The user device 110 may include a notification and, in response thereto, a context information request for the context information server notification 150 provide. For example, the user device 110 receive a notification "calendar application flight to San Francisco reservation" by a in a background of the user device 110 and, in response, provide a request containing the text "book flight to San Francisco" before the notification is displayed or provide a request containing a screenshot of the notification as it appears on the user device 110 is shown. As in 1 is shown, the notification is provided while the user is viewing a new application.

As the user device 110 the request for the context information server 150 without requiring the user to enter terms for a query whether verbal, physical or other interaction, the request may be considered as a query-independent request. For example, the user device 110 the request without input from the user for the context information server 150 provide after the notification has been received when the user device 110 receives a notification of provisioning to a user.

The user device then receives 110 in response to providing the request for the context information server 150 one or more user interface elements from the context information server 150 , For example, the user device 110 from the context information server 150 receive a user interface element for "San Francisco". For illustration, the user interface elements are described as cards. However, other user interface elements, e.g. Chat bubbles, selectable annotated annotations or footnotes, synthesized voice responses, or other forms. A context map may be data containing context information about a search term. For example, a "San Francisco" context map may contain contextual information describing "San Francisco" as "a California city". The context map can specify next actions. For example, the context map for "San Francisco "includes selectable options to search for web pages, messages, pictures, or videos relevant to a query that includes the terms" San Francisco. "

The user device 110 Provides the received context maps to the user. For example, the user device 110 provide the context maps by being a graphics box 160 which is adjacent to a notification and all that is provided by the user device 110 displayed was superimposed before the notification was displayed. The graphics field 160 identifies that the graphics box is for the term "San Francisco" and that San Francisco is "a California city" and contains selectable options 162 to search for web pages, messages, pictures, or videos that are relevant to a query that contains the words "San Francisco".

In the example off 1 are the selectable options 162 General options obtained for the search term "San Francisco". However, options may also be provided that are more specific to the content of the notification. For example, the context of "San Francisco" in the notification, as indicated by the phrase "book flight", is a travel context. The context information server 150 may consider the context and may instead include travel-related options such as "rental cars,""hotels,""restaurants," and so on.

The user device 110 can the graphics box 160 while the notification is displayed. For example, notifications on the user device 110 for a limited period of time, e.g. One second, two seconds, or a different amount of time, and can display the notification and the graphics panel 160 both disappear after the limited amount of time. In another example, the notifications and the graphics box 160 on the user device 110 be shown until the user in the user device 110 provides an input that causes the notification or graphics box 160 is no longer displayed. In some implementations, the user device may 110 in a mode in which a user sets up the user device 110 not actively used, eg. B. in a locked mode, work. In the mode in which a user is the user device 110 not actively used, the notifications and graphics boxes can be shown when the user device 110 detects that the user is actively using the device, e.g. B. when the user with the user device 110 interacts while the user device 110 is in a locked mode.

2 Figure 4 is a more detailed block diagram of the example environment 100 in which context information is provided for a notification. The environment 100 contains a client context engine 210 in a user device and the context information server 150 , The context information server 150 contains a term identification engine 220 , a conceptual knowledge graph 222 , a relevance rating engine 230 , a term selection engine 240 , a context map provider 250 and a map information database 260 , In some implementations, the client context module may 210 in the in 1 shown user device 110 be provided. In other implementations, the client context module may 210 in another user device, which is different from the one in 1 shown user device 110 is different, be provided.

The client context engine 210 determines that the user device has received a notification to be displayed on the user device. The notification may be obtained by the user device in response to an occurrence of a triggering event. For example, the client context module 210 in response to the message application receiving a push notification from a message server, determining that a message application has generated a notification "Promoting the celebrity X receives the award Y". The client context engine 210 may determine that notifications are received, that indications are received that notifications have been generated by one or more applications executing in the user device or by the user device's operating system. For example, the user device's operating system may be for the client context module, whether the notifications were generated by the operating system or generated by applications running in the user device 210 provide all notifications before the operating system displays the notifications.

In response to the determination that the user device has received a notification in response to the occurrence of a triggering event, the client context module generates 210 for the context information server 150 a request for context information for the notification. For example, the client context module 210 a context information request for the notification of "the celebrity X receives the award Y" for the context information server 150 produce.

The client context engine 210 may contain information about the notification in the request. The client context engine 210 can z. B. a Receive tree-based document object model representing the notification and include the model in the request. The document object model may include text that appears in the notification and the appearance of the text, e.g. For example, define the size, color, position, font, or other formatting of the text. In another example, the client context module may 210 generate a screenshot of the notification as it is displayed on the user device and include the screenshot in the notification.

In some implementations, the client context module may 210 containing the notification information in the request by additionally or alternatively determining additional information about the notification and including the additional information in the request. The additional information about the request may include an indication of an application for which the notification was generated and / or a location of the user device 110 and / or contain an identity of the user. For example, the client context module 210 determine that the user device 110 located in Atlanta and include a location "Atlanta" in the request.

The client context engine then issues 210 the requirement for the term identification engine 220 ready. The client context engine 210 makes the request z. For the term identification engine 220 without the user providing any indication that contextual information is desired after the notification has been received by the user device.

The client context engine 210 receives in response to providing the request for the term identification engine 220 a context map and render the context map. For example, the client context engine receives 210 a contextual card for the celebrity "Celebrity X" containing a full name, a short description and a selectable option to view celebrity images, and then render the context map adjacent to the notification on the previously displayed one. In some implementations, the client context module may 210 show the context map simultaneously with the notification. For example, the client context module 210 cause the user device to delay displaying the notification until the context map has been received, and then display the notification concurrently with the context map. In another example, the client context module may 210 cause the user device to delay displaying the notification until from the context information server 150 an indication is received that no context map is available for the notification, and then display the notification without any context map.

The term identification engine 220 receives the request for context information for a notification and identifies one or more search terms from the content in the notification. For example, the term identification engine 220 receive a request containing a notification "The celebrity X is awarded the prize Y" generated in a user device in response to a message application running in the background of the user device receiving a push notification from a message server. As used in this utility model, a "search term" is a concept or thing that can be used by a search system to perform a search for information. On a search term can by a text fragment, z. By an expression or phrase, and are search terms, e.g. Based on the context, distinguishable from each other. A search term can be z. A keyword and an instance of a particular entity, a proper name, an entity, or a relation modeled by a node or edge in a knowledge graph, and the like.

The term identification engine 220 can extract text from the request. The term identification engine 220 can z. For example, extract the text "The celebrity X receives the award Y" from the request. The term identification engine 220 may extract the text by parsing a document object model representing the notification, performing optical character recognition on a screenshot of the notification as displayed on the user device, or the content of the notification indicated in the request analyzed in another way.

The term identification engine 220 identified from the extracted text using the concept knowledge graph 222 the one or more search terms. For example, the term identification engine 220 identify the text "Prominent X" in the notification of the name of a celebrity "Celebrity X" in the concept knowledge graph 222 fits, and that the text "Price Y" in the notification to the name of a prize "Price Y" in the concept knowledge graph 222 fits. The conceptual knowledge graph 222 may be a knowledge graph containing nodes for search terms, edges indicating relationships between the nodes, and context information describing the search terms represented by the nodes.

In some implementations, the term identification engine 220 identify the one or more search terms based on additional information in the request from the extracted text. For example, the term identification engine 220 z. Based on geographic location data associated with the request or user device, determine that the request indicates that the user device 110 is in Atlanta, focusing on search terms that are in Atlanta. In another example, the term identification engine 220 determine that the request indicates that the request is from "User A" and focus on search terms for which "User A" is during the last hour, the last day, the last week, the last month, or another Time duration has received information.

The relevance rating engine 230 can by the term identification engine 220 receive identified search terms and determine a relevance score for each of the search terms. The relevance score may reflect confidence that the search term is relevant to the user, ie, a level of trust that the user would like to see contextual information about the search term. For example, the relevance rating engine 230 receive an indication that in the notification the keywords of the celebrity "X" and the price "Price Y" have been identified, determine for the celebrity "Celebrity X" a relevance score of 90%, which indicates a high level of confidence that the user likes Contextual information about the celebrity "Prominent X" and for the price "Price Y" determine a relevance rating of 80%, which indicates a slightly lower level of confidence that the user would like to see contextual information about the price "Price Y".

The relevance rating engine 230 can determine a relevance score for a search term based on a user's commitment to the search terms. Examples of binding include providing search queries for resources relevant to the search term, requesting a resource indexed as relevant to the search term, or another significant signal for interest in the search term. The relevance rating engine 230 can determine relevance scores that indicate a higher confidence level, that the user would like to see contextual information about a higher-binding search term, and can determine relevance scores that indicate a lower level of confidence that the user would like to see contextual information about a lower-binding search term. The relevance rating engine 230 can the binding for a search term z. From analyzing search query history logs or resource request logs.

Additionally or alternatively, the relevance rating engine 230 determine a relevance score for a search term based on the natural language processing on the content from which the search term was identified. For example, the relevance rating engine 230 Determine relevance ratings that indicate a higher level of confidence that the user would like to see contextual information about search terms identified from a text that is a subject of a sentence, and may determine relevance ratings that indicate a lower confidence level that the user likes See contextual information about search terms that were identified from the text that is an object of a sentence.

Additionally or alternatively, the relevance rating engine 230 determine a relevance score for each search term based on an appearance of the text that identified the search term. For example, the relevance rating engine 230 For search terms identified by text that appears earlier in the notification, determine a relevance score that reflects a higher level of confidence. In another example, the relevance rating engine 230 For search terms that are identified from text that is bold, determine relevance ratings that reflect a higher level of confidence because the text can be bold because the text is important. In another example, the relevance rating engine 230 Relevant ratings that reflect a higher confidence level determine for search terms that were identified from text that is larger in size, that has a different color, or that is aligned differently from most of the text in the notification because of a different look of the text can indicate that the text is important.

The term selection engine 240 may receive the relevance ratings and select one or more search terms for which contextual information is to be provided to the user. For example, the term selection engine 240 an indication of the celebrity "Celebrity X" marked with a relevance score of 90%, and an identification of the prize "Price Y" marked with the relevance rating of 70%, and in response receive the celebrity "Prominent X" and not choose the price "Price Y" to provide contextual information.

The term selection engine 240 may select the search terms based on the determination of whether the search terms have respective relevance ratings that satisfy a relevance threshold. For example, the term selection engine 240 Select the celebrity "Celebrity X" because the relevance score of 90% is greater than a 60%, 65%, 85%, or any other percentage threshold of less than 90%. In another example, the term selection engine 240 Do not select the price "Price Y" because the relevance score of 70% is lower than a relevance threshold of 85%, 95%, 95% or another percentage above 70%.

In some implementations, the term selection engine may 240 select the search terms additionally or alternatively based on a maximum. For example, the term selection engine 240 select a maximum of one, two, four, or a different number of cards and select the maximum number of relevancy rating keywords that reflect the highest level of confidence in the relevance. In some implementations, the term selection engine may 240 additionally or alternatively select the search terms based on a minimum. For example, the term selection engine 240 Select one, two, four, or any other number of relevance rating cards that reflect the highest level of trust in relevance.

The context map provider 250 can obtain context maps that contain context information for the selected search terms and context maps for the client context module 210 provide. For example, the context map provider 250 an identification of the celebrity "Prominent X" from the term selection engine 240 and a context map for the celebrity "Prominent X" for the client context engine 210 provide. In the example, the context map contains a full name and a brief description of the celebrity "Celebrity X" and has appeared a selectable option to view images of the celebrity "Prominent X".

The context map provider 250 can get context maps by creating context maps for search terms. For example, the context map provider 250 from the terminology knowledge graph 222 receive a full name, a brief description, and an indication that "Prominent X" celebrity images are available, and then create a shortcut card that has a full name and a short description for the celebrity "X" and a selectable option to watch movies, in which the celebrity "Prominent X" has appeared contains. In another example, the context map provider may 250 Run searches on the celebrity "Celebrity X" to determine a full name, a brief description, and whether or not pictures of the celebrity "Celebrity X" are available.

In some implementations, the context map provider may 250 determine whether in a map information database 260 already has a context map for the search term before creating a context map for a search term. For example, the context map provider 250 the map information database 260 for a contextual card for the celebrity "Prominent X" query. Where the card information database 260 contains an existing context map for the search term, the map information database 260 the context map for the context map provider 250 deploy, so that the context map provider 250 the existing context map for the client context engine 210 instead of creating a new context map.

3 is a flowchart of a process 300 to provide context information for a notification. The process 300 can z. By the context information server 150 from the environment 100 be used.

The process 300 includes receiving a query independent request for context information relevant to a notification in response to the user device responding in response to the occurrence of a triggering event ( 310 ) receives the notification. For example, the term identification engine 220 Receive a request containing a document object model of a notification "Buy a ticket for the film X in the movie theater Y", which is generated from a reminder that a user has set in a calendar application.

The process 300 contains identifying multiple search terms from content in the notification ( 320 ). For example, the term identification engine 220 extract the text "Film X" and "Film Theater Y" from the text in the notification and, in response, identify a film "Film X" and an establishment "Film Theater Y" from the respective text.

The process 300 includes determining a relevance score for each of the identified multiple search terms ( 330 ). For example can be the relevance rating engine 230 receive an identification of the movie "Movie X" and determine that searches for the movie "Movie X" are very widespread, and in response determine a relevance score indicating a high degree of confidence that the user would like contextual information for the movie "Film X " would see. In another example, the relevance rating engine 230 receive an indication of the "Filmtheater Y" permanent establishment and determine that searches for the "Filmtheater Y" venue are not widespread, and in response determine a relevance score indicating a low level of confidence that the user will be pleased to provide context information for the "Filmtheater Y" venue " would see. In the example, the relevance ranking engine determines 230 additionally or alternatively, a relevance score indicating a low level of confidence that the user would like to see context information for the movie theater "Y" in response to determining that a user is usually going to a movie theater "Y" venue such that it is unlikely that he would like to receive context information about the plant.

The process 300 includes selecting search terms based on relevance ratings ( 340 ). For example, the term selection engine 240 Based on a high relevance rating of 95% for the film, which meets a relevance threshold of 80%, the film "Film X" will be used to provide contextual information and the "Filmtheater Y" venue based on a low relevance rating of 33% for the film Permanent establishment that does not meet the 80% relevance threshold.

The process 300 includes providing a respective context map for each of the selected search terms ( 350 ). For example, the context map provider 250 in response to that the term selection engine 240 selects the movie "Movie X" and does not select the "Movie Theater Y" venue, creates a context map for the movie "Movie X", and the contextual map for the client context module 210 and do not create or provide a contextual map for the Filmtheater Y facility.

In the example described, one particular intent for a search term may be higher than another search term, and the other keywords may be ignored. However, the process can 300 In some implementations, provide context maps based on multiple selected search terms. For example, the term identification engine 220 for a request containing a document object model of a notification defining the text "book flight to San Francisco", extract from the request the text "book flight to San Francisco" and extract from the text "San Francisco" a city "San Francisco" identify and extract the text "flight" from the request and identify a "flight" object from the text "flight". The relevance rating engine 230 may use natural language processing to determine that the notification is for travel to a destination, the destination being the city "San Francisco," and in response determine a relevance score indicating a high level of confidence that the user would like to see contextual information for the city "San Francisco". The relevance rating engine 230 may determine that the notification is regarding a trip to a destination and that the object "flight" refers to the type of transport and, in response, determine a relevance score that indicates a high degree of confidence that the user likes contextual information for the object Would see "flight". As a result, the relevance rating engine 230 select both the city of "San Francisco" and the object "Flight" and in response provide a context map with flight related information for the city of "San Francisco".

In some implementations, the process may be 300 Contain additional steps, contain fewer steps, or divide some of the steps into multiple steps. For example, the context information server 150 the steps 330 and 340 and instead provide context maps for each identified search term.

4 is a flowchart of a process 400 to provide context information for a notification. The process 400 can z. By the client context module 210 from the environment 100 be used.

The process 300 includes receiving a notice regarding a search term for display on a user device ( 410 ). For example, the client context module 210 determine that a calendar application in the user device has generated a notification "Buy a ticket for the movie X in the movie theater Y".

The process 400 includes providing a query-independent request for context information relevant to the notification ( 420 ). For example, the client context module 210 in response to the user device receiving the notification, for the context information server 150 Provide a request that includes a document object model of a notification that defines the text "Buy a ticket for movie X at the movie theater Y" and how the text should appear in the notification.

The process 400 includes receiving a user interface element containing context information regarding the search term ( 430 ). For example, the client context module 210 in response to providing the request for the context information server 150 a card for the Movie "Movie X" from the context information server 150 receive.

The process 400 Contains the simultaneous display of the notification and the user interface element ( 440 ). For example, the client context module 210 provide the ticket for the movie "Movie X" for an operating system of a user device to cause the user device to display the notification "Buy a ticket for the movie X in the movie theater Y" while at the same time displaying the map immediately below the notification.

In some implementations, the process may be 400 Contain additional steps, contain fewer steps, or divide some of the steps into multiple steps. For example, the client context module 210 additional functions of the context information server 150 To run.

In situations where the systems discussed herein may collect personal information about users or use personal information, the user may be given an opportunity to control whether programs or features provide user information (eg, information about a social network of the user, about social activities or activities, the profession, user preferences, or the user's current location), or to control whether and / or how to receive content from the content server that may be more relevant to the user. In addition, certain data may be treated in one or more ways to remove person-identifiable information before it is stored or used. For example, a user's identity may be treated so that no personally identifiable information can be determined for the user, or the geographic location of a user where location information is obtained (such as at a city, postal code, or state level) may be generalized so that no specific location of the user can be determined. Thus, the user may have control over how information about the user is collected and used by the content server.

Embodiments of the subject matter and the operations described in this utility model may be embodied in digital electronic circuitry or in computer software, computer firmware, or computer hardware including the structures disclosed in this utility model and their structural equivalents, or in combinations of any one or more thereof be implemented. Embodiments of the subject matter described in this utility model may be embodied as one or more computer programs, i. H. as one or more modules of computer program instructions stored in a computer data storage medium for execution e.g. B. encoded by a data processing device or to control the operation thereof, are implemented. Alternatively or additionally, the program instructions may be included in an artificially generated outstretched signal, e.g. In an electrical, optical or electromagnetic signal generated by a machine which is generated to encode information for transmission to a suitable receiver device for execution by a data processing device. A computer storage medium may, for. A computer readable storage device, a computer readable storage substrate, a read / write data storage device or a serial access data storage device, or a read / write data storage device or a serial access data storage device or a combination of one or more of them. Moreover, although a computer storage medium is not a propagated signal, a computer storage medium may be a source or destination of computer program instructions encoded in an artificially generated propagated signal. The computer storage medium may also be or may be included in one or more separate physical components or media (eg, multiple CDs, disks, or other storage devices).

The operations described in this utility model may be implemented as operations performed by a data processing device on data stored on or on a plurality of computer readable data storage devices or received from other sources.

The term "data processing device" includes all types of devices, devices, and machines for processing data, including, for example, a programmable processor, a computer, a one-chip system, or more of the foregoing, or combinations thereof. The apparatus may include special logic circuitry, e.g. As an FPGA (programmable logic device) or an ASIC (application-specific integrated circuit) included. In addition, in addition to hardware code that creates an execution environment for the computer program in question, e.g. Code that includes processor firmware, a protocol stack, a database management system, an operating system, a cross-platform runtime environment, a virtual machine, or a combination of one or more of them. The device and the execution environment may be different Implement computer model infrastructures such as web services, distributed computing infrastructures, and GRID computer infrastructures.

A computer program (also known as a program, software, software application, script, or code) may be in any form of programming language, including compiled or interpreted languages, declarative or procedural languages, and may be in any form, including as a stand-alone program or software as a module, as a component, as a subroutine, as an object, or as another entity suitable for use in a computing environment. A computer program may or may not be equivalent to a file in a file system. A program may be stored in a section of a file holding other programs or data (eg, one or more scripts stored in a markup language document) in a single file intended for the program in question. or in multiple coordinated files (for example, files that store one or more modules, subprograms, or sections of code). A computer program may be used to run in a computer or in multiple computers located at one site or distributed over multiple sites and interconnected by a communications network.

The processes and logic operations described in this utility model may be performed by one or more programmable processors executing one or more computer programs to perform actions by manipulating input data and generating output. The processes and logic operations may also be implemented by special logic circuitry, e.g. By an FPGA (a freely programmable logic device) or by an ASIC (an application specific integrated circuit), and the devices may also be implemented as such.

Processors suitable for executing a computer program include, for example, both general purpose and specialty microprocessors and any one or more processors of any type of digital computer. Generally, a processor receives instructions and data from a read only memory or from a read / write memory or both. The essential elements of a computer are a processor for performing actions in accordance with instructions and one or more data storage means for storing instructions and data. Generally, a computer also includes data from one or more mass storage devices for storing data, e.g. Magnetic, magneto-optical disks or optical disks, or is operably coupled to receive data from, or transmit data to, or both. However, a computer does not need to have such facilities. In addition, a computer can be moved to another device, eg. A mobile telephone, personal digital assistant (PDA), mobile audio or video player, game console, global positioning system (GPS) receiver, or portable storage device (e.g. -Bus flash drive (USB flash drive)), just to name a few, be embedded. Devices suitable for storing computer program instructions and data include all forms of nonvolatile data storage, media and data storage devices including, by way of example, semiconductor data storage devices, e.g. EPROM, EEPROM and flash data storage devices; Magnetic disks, z. Internal hard disks or removable disks; magneto-optical disks; and CD-ROM and DVD-ROM discs. The processor and data memory may be supplemented or integrated with special logic circuitry.

In order to provide interaction with a user, embodiments of the subject matter described in this utility model may be stored in a computer having a display device, e.g. B. with a CRT monitor (cathode ray tube monitor) or with an LCD monitor (liquid crystal display monitor) for displaying information to the user, and with a keyboard and a pointing device, eg. A mouse or a trackball through which the user can provide input to the computer. To provide interaction with a user, other types of devices may also be used; z. For example, feedback provided to the user may include some form of sensory feedback, e.g. A visual feedback, audible feedback, or tactile feedback; and an input may be received by the user in any form including an acoustic input, a voice input, or a touch input. In addition, a computer may interact with a user by sending and receiving documents from a device used by the user; z. By sending web pages to a web browser on a user device of the user in response to requests received from the web browser.

Embodiments of the subject matter described in this utility model may be implemented in a computer system having a backend component, e.g. As one Data server, or that contains a middleware component, eg. As an application server contains or that a front-end component, for. A user computer having a graphical user interface or a web browser through which a user may interact with an implementation of the subject matter described in this utility model, or which contains any combination of one or more of such backend, middleware or frontend components. The components of the system may be replaced by some form or medium of digital data communication, e.g. B. by a communication network, be connected to each other. Examples of communication networks include a local area network ("LAN") and a wide area network ("WAN"), an inter-network (eg, the Internet), and peer-to-peer networks (eg, ad hoc). peer-to-peer networks).

The computer system may include users and servers. Generally, a user and a server are remote from each other and usually interact through a communication network. The relationship between user and server is due to computer programs running on the respective computers and having a user-server relationship with each other. In some embodiments, a server sends data (eg, an HTML page) to a user device (eg, to display data for a user interacting with the user device and receiving a user input from it). Data generated at the user equipment (eg, a result of user interaction) may be received by the user equipment at the server.

An example of such a type of computer is in 5 shown a schematic representation of a general computer system 500 shows. In accordance with an implementation, the system can 500 for the operations described in connection with any of the computer-implemented methods described above. The system 500 contains a processor 510 , a data store 520 , a storage device 530 and an input / output device 540 , All components 510 . 520 . 530 and 540 are using a system bus 550 connected with each other. The processor 510 is able to execute instructions within the system 500 to process. In one implementation, the processor is 510 a single-threaded processor. In another implementation, the processor is 510 a multi-threaded processor. The processor 510 is able to process statements in the data store 520 or on the storage device 530 stored to graphical information for a user interface in the input / output device 540 display.

The data store 520 stores information within the system 500 , In one implementation, the data store is 520 a computer readable medium. In one implementation, the data store is 520 a volatile data storage unit. In another implementation, the data store is 520 a non-volatile data storage unit.

The storage device 530 is capable of mass storage for the system 500 provide. In one implementation, the storage device is 530 a computer readable medium. In various other implementations, the memory device may 530 a floppy disk device, a hard disk device, an optical disk device or a tape device.

The input / output device 540 provides input / output operations to the system 500 ready. In one implementation, the input / output device contains 540 a keyboard and / or pointing device. In another implementation, the input / output device contains 540 a display unit for displaying graphical user interfaces.

While this utility model contains many specific implementation details, these are not to be understood as limitations on the scope of what may be claimed, but rather as descriptions of features specific to particular embodiments. Certain features described in this utility model in the context of separate embodiments may also be implemented together in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented separately in several embodiments or implemented in any suitable sub-combination. Although features may be described above as acting in certain combinations and even initially claimed, one or more features of a claimed combination may, in some instances, be excluded from the combination and may include the claimed combination a sub-combination or be directed to variants of a sub-combination.

Similarly, while operations in the drawings are shown in a particular order, it is similarly not to be understood that it requires that these operations be performed in a particular order shown or in a sequential order, or that all illustrated operations be performed to produce desirable results to achieve. In certain circumstances, multitasking and parallel processing may be beneficial. Moreover, the separation of various system components in the above-described embodiments is not to be understood as requiring such separation in all embodiments, and of course the described program components and systems may generally be integrated into a single software product or packaged into multiple software products.

Thus, certain embodiments of the subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions depicted in the claims may be performed in a different order and continue to produce desirable results. In addition, the processes shown in the accompanying figures do not necessarily require the particular order or sequential order shown to achieve desirable results. In certain implementations, multitasking and parallel processing may be beneficial.

Claims (20)

A non-transitory computer-readable storage medium encoded with instructions that, when executed by one or more processors included in a data processing device, cause the data processing device to perform operations, the operations comprising: Receiving a query-independent request for context information relevant to the notification from a user device in response to the user device receiving a notification in response to an occurrence of a trigger event; Identifying multiple search terms from the content in the notification; Determining a relevance score for each of the plurality of search terms; Selecting one or more of the multiple search terms based on the relevance ratings; and Providing a respective user interface element for the display with the notification for the user device for each of the selected one or more search terms, each user interface element containing context information regarding the respective search term. The non-transitory computer-readable storage medium of claim 1, wherein receiving a query-independent request for context information relevant to the notification from a user device in response to the user device receiving a notification in response to the occurrence of a trigger event comprises: Receiving a query-independent request that does not include one or more terms entered by the user and that contains the content in the notification. The non-transitory computer-readable storage medium of claim 1 or 2, wherein receiving a query-independent request for context information relevant to the notification from a user device in response to the user device receiving a notification in response to an occurrence of a trigger event comprises: Receiving, by the user device, a request-independent request for context information relevant to the notification in response to the user device generating the notification in response to the occurrence of the trigger event. The non-transitory computer-readable storage medium of claim 1, wherein receiving a query-independent request for context information relevant to the notification from a user device in response to the user device receiving a notification in response to an occurrence of a trigger event : In response to the determination that a background application provides the notification for the indication, receiving from the user device in response to the user device receiving the notification. The non-transitory computer readable storage medium of any one of claims 1 to 4, wherein the notification comprises a user interface element superimposed on a graphical user interface. The non-transitory computer-readable storage medium of any one of claims 1 to 5, wherein the triggering event is reminder fulfillment criteria for calendar setting and / or receipt of a text message from another user while not viewing a text message conversation with the other user and / or an application in the user device receives a push notification from a server. The non-transitory computer-readable storage medium of any one of claims 1 to 6, wherein identifying multiple search terms from the content in the notification comprises: extracting text in the notification from the query-independent request; and identifying the multiple search terms from the text. Non-transitory computer-readable storage medium according to claim 7, wherein identifying multiple search terms from the content in the notification comprises: Extracting an indication of an application that corresponds to the notification from the query independent request; and Identifying the multiple search terms based at least on the application corresponding to the notification. System comprising: a data processing device; and a non-transitory computer-readable storage medium in data communication with the data processing device and storing instructions executable by the data processing device, and in this embodiment, causing the data processing device to perform operations including: Receiving a query-independent request for context information relevant to the notification from a user device in response to the user device receiving a notification in response to an occurrence of a trigger event; Identifying multiple search terms from the content in the notification; Determining a relevance score for each of the plurality of search terms; Selecting one or more of the multiple search terms based on the relevance ratings; and Providing a respective user interface element for the display with the notification for the user device for each of the selected one or more search terms, each user interface element containing context information regarding the respective search term. The system of claim 9, wherein receiving a query-independent request for context information relevant to the notification from a user device in response to the user device receiving a notification in response to an occurrence of a triggering event comprises: Receiving a query-independent request that does not include one or more terms entered by the user and that contains the content in the notification. The system of claim 9 or 10, wherein receiving a query-independent request for context information relevant to the notification from a user device in response to the user device receiving a notification in response to an occurrence of a trigger event comprises: Receiving, by the user device, a request-independent request for context information relevant to the notification in response to the user device generating the notification in response to the occurrence of the trigger event. The system of claim 9, wherein receiving a query-independent request for context information relevant to the notification from a user device in response to the user device receiving a notification in response to an occurrence of a trigger event comprises: In response to the determination that a background application provides the notification for the indication, receiving from the user device in response to the user device receiving the notification. The system of any one of claims 9 to 12, wherein the notification comprises a user interface element superimposed on a graphical user interface. The system of any one of claims 9 to 13, wherein the triggering event is a push to meet memory criteria and / or to receive a text message from another user while a text message conversation with the other user is not viewed Notification from a server includes. The system of any one of claims 9 to 14, wherein identifying multiple search terms from the content in the notification comprises: Extracting text in the notification from the query independent request; and Identify the multiple search terms from the text. The system of claim 15, wherein identifying multiple search terms from the content in the notification comprises: Extracting an indication of an application that corresponds to the notification from the query independent request; and Identifying the multiple search terms based at least on the application corresponding to the notification. A non-transitory computer-readable storage medium encoded with instructions that, when executed by one or more processors included in a data processing device, cause the data processing device to perform operations, the operations comprising: Receiving a notification for display on the user device in response to the occurrence of a triggering event and by a user device, the notification relating to a search term; Providing, by the user device for a context information server, a request-independent request for context information relevant to the notification in response to receiving the notification for display on the user device; Receiving a user interface element containing context information regarding the search term; and simultaneously displaying the notification and the user interface element on the user device. The non-transitory computer-readable storage medium of claim 17, wherein providing a query-independent request for context information relevant to the notification by the user device for a context information server comprises: Providing a query-independent request that does not include one or more terms entered by a user and that contains the content in the notification. The non-transitory computer-readable storage medium of any of claims 17 or 18, wherein the notification comprises a user interface element superimposed on a graphical user interface. 17. The non-transitory computer readable storage medium of claim 17, wherein the triggering event is reminder fulfillment criteria for calendar setting and / or receipt of a text message from another user while a text messaging conversation with the other user is not viewed, and / or an application in the User device receives a push notification from a server includes.

Images