WO2012027750A1 - Interface utilisateur de boîte d'entrée triée pour application de messagerie - Google Patents
Interface utilisateur de boîte d'entrée triée pour application de messagerie Download PDFInfo
- Publication number
- WO2012027750A1 WO2012027750A1 PCT/US2011/049580 US2011049580W WO2012027750A1 WO 2012027750 A1 WO2012027750 A1 WO 2012027750A1 US 2011049580 W US2011049580 W US 2011049580W WO 2012027750 A1 WO2012027750 A1 WO 2012027750A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- message
- messages
- user
- area
- importance
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/21—Monitoring or handling of messages
- H04L51/214—Monitoring or handling of messages using selective forwarding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/42—Mailbox-related aspects, e.g. synchronisation of mailboxes
Definitions
- the disclosed embodiments relate generally to displaying messages, such as email, instant, and voicemail messages.
- a user account typically includes all the messages sent to and from a respective email address or user name, excluding messages deleted from the account.
- some user accounts may be associated with a plurality of email addresses or user names, sometimes called aliases, which together may be considered to be a single logical email address or user name.
- the amount of received email can quickly overwhelm users - making it difficult to sift important messages from unimportant ones.
- the client device concurrently displays message information associated with a respective user by displaying first message information representing a first set of messages in a first area of the display, and displaying second message information representing a second set of messages in a second area of the display that is separate from the first area, where the first set of messages meet predefined message importance criteria, and each message in the first set of messages is excluded from the second set of messages.
- the displayed message information includes messages from a message account of the respective user.
- the first message information is a first list of conversations, each conversation in the first list having at least one message meeting the predefined message importance criteria.
- each conversation in the first list has at least one message that is unread by the user.
- each of the second set of messages has been labeled with a predefined label by the user.
- the first message information is displayed in chronological order in the first area and the second message information is displayed in chronological order in the second area.
- the client device further concurrently displays a third set of messages in a third area that is separate from the first area and second area, wherein the first set of messages and second set of messages are excluded from the third set of messages.
- the client device further displays a respective expansion affordance in each of the first and second areas, and in response to user selection of the respective expansion affordance, expands the corresponding area and displays only the set of messages corresponding to the expanded area.
- each item represented by the first message information includes a predefined label to denote importance of the corresponding item, wherein each item represented by the first message information is a message or a conversation having one or more messages.
- the client device further displays a selectable importance marking affordance.
- the client device marks the user selected items as important using the predefined label and moves the user selected items from one respective area of the display to another respective area of the display.
- Figure 1 A is a block diagram illustrating an overview of a distributed client- server system according to some embodiments.
- Figure IB is a block diagram illustrating a process of generating importance scores for messages according to some embodiments.
- Figure 2 is a block diagram illustrating a server system according to some embodiments.
- Figures 3A-3C are block diagrams of data structures for a message database a user account database, and an importance prediction models database, according to some embodiments.
- Figure 4 is a block diagram illustrating a client system according to some embodiments.
- Figures 5A-5C are flowcharts representing a method for identifying important messages at a server, according to some embodiments.
- Figure 6A is a schematic screenshot of a "Sorted Inbox" user interface of a messaging application in which lists of conversations are displayed in two non-overlapping areas of the display, the two areas of the display including an "Important" link and a
- Figure 6B is a schematic screenshot of a "Sorted Inbox" user interface of a messaging application in which lists of conversations are displayed in three non-overlapping areas of the display, the three areas of the display including an "Important” link, a “Starred” link and an "Everything Else” link respectively, according to some embodiments.
- Figure 6C is a schematic screenshot of a "Sorted Inbox" user interface of a messaging application, depicting how a user expands the area (of the messaging application user interface) labeled "Important” by selecting a "View All” link, according to some embodiments.
- Figure 6D is a schematic screenshot of the area (of a messaging application user interface) labeled "Important" in its expanded state, according to some embodiments.
- Figure 6E is a schematic screen shot of a messaging application user interface, depicting how a user can mark an item as important by selecting the item and clicking on an "Important" button, according to some embodiments.
- Figure 6F is a schematic screen shot of a messaging application user interface, depicting an item being moved from the area “Starred” to the area “Important” after being marked as important by the user, according to some embodiments.
- Figure 7A is a flow chart representing a method for displaying messages associated with a respective user, according to some embodiments.
- Figure 7B is a flow chart illustrating the operation of an expansion affordance, according to some embodiments.
- Figure 7C is a flow chart illustrating the operation of an importance marking affordance, according to some embodiments.
- first contact could be termed a second contact
- second contact could be termed a first contact
- first contact and second contact are both contacts, but they are not the same contact.
- the phrase “if it is determined” or “if (a stated condition or event) is detected” may be construed to mean “upon determining” or “in response to determining” or “upon detecting (the stated condition or event)” or “in response to detecting (the stated condition or event),” depending on the context.
- Figure 1 A is a block diagram of a distributed computer system 100 including client systems 102 and a server system 106 according to some embodiments.
- the server system 106 is connected to client computers 102 through one or more communication networks 108.
- Client computer 102 (sometimes called a “client system,” or “client device” or
- client may be any computer or device through which a user of the client computer 102 can submit service requests to and receive messaging services or other services from the server system 106.
- client computers 102 include, without limitation, desktop computers, laptop computers, tablet computers, mobile devices such as mobile phones, personal digital assistants, set-top boxes, or any combination of the above.
- a respective client computer 102 may contain one or more client applications 104 for submitting requests to the server system 106.
- client application 104 can be a web browser or other application that permits a user to search for, browse, and/or use information (e.g., web pages and web services) accessible through the communication network 108.
- the communication network(s) 108 can be any wired or wireless local area network (LAN) and/or wide area network (WAN), such as an intranet, an extranet, the Internet, or a combination of such networks.
- the communication network 108 uses the HyperText Transport Protocol (HTTP) and the Transmission Control Protocol/Internet Protocol (TCP/IP) to transport information between different networks.
- HTTP HyperText Transport Protocol
- TCP/IP Transmission Control Protocol/Internet Protocol
- the HTTP permits client devices to access various information items available on the Internet via the communication network 108.
- the various embodiments, however, are not limited to the use of any particular protocol.
- the server system 106 includes a front end server 112, a message signal extractor 114, an importance weight generator 116, an important message identifier 118, importance prediction models 122, a user account database 124, a message database 126, and a search engine 120 for searching message database 126.
- the front end server 112 is configured to receive data from a client computer
- the data is a message, HTTP request, Ajax request, or other communication.
- the HTTP request or Ajax request may include a search query (e.g., "labekinbox") for processing by the search engine 120.
- a message associated with a particular user is received by the server system 106, where user data regarding the particular user is stored in the user account database 124.
- the received message is stored in message database 126.
- the message is stored in message database 126 either as a new
- the message is sent from the front end server 112 to the message signal extractor 114, which extracts one or more message signals from the message. For each message signal of at least a subset of the extracted message signals, an importance weight is generated by importance weight generator 116 using importance prediction models 122. Based on the message signals and their generated importance weights, important message identifier 118 determines an importance score for the message. In some embodiments, the importance score of the message is used by important message identifier 118 for comparison with a threshold to determine importance of the message.
- FIG. IB is a block diagram illustrating a process of generating importance scores for messages according to some embodiments.
- Importance prediction models 122 include a first importance prediction model 132 and a second importance prediction model 134. Both the first importance prediction model 132 and the second importance prediction model 134 include a plurality of weights, each corresponding to respective message signals.
- the first importance prediction model 132 is based on information associated with multiple users.
- the first importance prediction model 132 is also called the global importance prediction model.
- the second importance prediction model 134 is based on information associated with a respective user (i.e., a single user).
- the second importance prediction model 134 is also called the user importance prediction model.
- the extracted message signals include a first plurality of message signals 128.
- the importance weight generator 116 For each message signal of the first plurality of message signals 128, the importance weight generator 116 generates an importance weight for the respective message signal by determining a first weight for the respective message signal using the first importance prediction model 132, determining a second weight for the respective message signal using the second importance prediction model 134, and combining the first weight and the second weight to determine the importance weight of the respective message signal.
- the combining includes adding the first and second weight.
- the importance weight generator 116 performs table lookup or database lookup operations to obtain the first weight and second weight. As discussed below in more detail with reference to Figure 5 A, the importance weights in the various importance prediction models may be generated and updated using machine learning techniques.
- the server system in addition to a global importance prediction model and a user importance prediction model, the server system also uses a group importance prediction model, for a respective plurality of users (also called a group of users) that include the user for whom message services are being performed.
- a group importance prediction model for a respective plurality of users (also called a group of users) that include the user for whom message services are being performed.
- weights from all three importance prediction models are determined and applied to corresponding extracted message signals so as to generate a combined importance score for a respective message.
- weights in the importance prediction models can have both positive and negative values. Weights with positive values are typically associated with message signals that are predictive of message importance. Weights with negative values are typically associated with message signals (e.g., a signal identifying that the message was automatically generated, or a signal that indicates the message includes one or more words on a predefined black list) that are associated with unimportant messages.
- the extracted message signals include a second plurality of message signals 130.
- importance weight generator 116 For each message signal of the second plurality of message signals 130, importance weight generator 116 generates an importance weight for the respective message signal using second importance prediction model 134 but not first importance prediction model 132.
- the second plurality of message signals 130 are message signals for which user-specific weights are generated, but for which global model weights are not generated.
- important message identifier 118 determines importance score 136 for the message based on the generated importance weights of the first plurality of message signals 128. Alternatively, important message identifier 118 determines the importance score 136 for the message based on the generated importance weights of both the first plurality of message signals 128 and the second plurality of message signals 130.
- the message and information regarding importance of the message are stored in the message database 126.
- information regarding importance of the message is the importance score of the message.
- information regarding importance of the message are labels denoting importance. For example, in one implementation messages with these labels (which denote message importance) have an importance score above a threshold.
- conversations having at least one message with an importance score above the threshold are assigned a label denoting importance.
- Search engine 120 communicates with message database 126 to retrieve the message along with information regarding importance of the message, and sends the message and information regarding importance of the message to front end server 112.
- Front end server 112 sends the message along with information regarding importance of the message to the user for display at a client device 102.
- message information corresponding to the message e.g., the subject line of the message, information identifying the sender of the message, etc. is sent by front end server 112, along with information regarding importance of the message to client device 102.
- message information corresponding to the conversation that includes the message is sent by front end server 112, along with information regarding importance of the conversation to client device 102.
- message information corresponding to the conversation that includes the message e.g., a subject line of a message in the conversation and/or a snippet of text from the conversation, information identifying the sender of the message, etc.
- front end server 112 along with information regarding importance of the conversation to client device 102.
- modules and data structures used to identify important messages have been illustrated above in server system 106, it should be understood that, in accordance with other embodiments, analogous modules and data structures which are also used to identify important messages are located at client computer 102 instead of, or in addition to, the modules and data structures shown in server system 106 above.
- FIG. 2 is a block diagram illustrating a server system 106 in accordance with some embodiments.
- the server system 106 typically includes one or more processing units (CPU's) 202 for executing modules, programs and/or instructions stored in memory 206 and thereby performing processing operations; one or more network or other communications interfaces 204; memory 206; and one or more communication buses 208 for interconnecting these components.
- Communication buses 208 may include circuitry (sometimes called a chipset) that interconnects and controls communications between system components.
- Memory 206 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM or other random access solid state memory devices; and may include non- volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices. Memory 206 may optionally include one or more storage devices remotely located from the CPU(s) 202.
- Memory 206 or alternately the non-volatile memory device(s) within memory 206, comprises a non-transitory computer readable storage medium.
- memory 206 or the computer readable storage medium of memory 206 stores the following programs, modules and data structures, or a subset thereof:
- an operating system 210 that includes procedures for handling various basic system services and for performing hardware dependent tasks
- a network communication module 212 that is used for connecting the server computer 106 to other computers via the one or more communication network interfaces 204 (wired or wireless) and one or more communication networks, such as the Internet, other wide area networks, local area networks, metropolitan area networks, and so on;
- a message signal extractor 114 for extracting one or more message signals from the received message
- importance prediction models 122 including first importance prediction model 132 and one or more second importance prediction models 134 (e.g., one for each distinct user for whom message importance services are to be provided), for storing a plurality of weights, each corresponding to a respective message signal;
- a message database 126 for storing messages and related information, as discussed below with reference to Figure 3 A;
- an important message identifier 118 for generating importance scores for messages using an importance score generator 218; in some embodiments, the important message identifier 118 also includes an importance threshold 220 (or in some implementations, more than one importance threshold), which is used for determining importance of messages.
- Each of the above identified modules, applications or programs corresponds to a set of instructions, executable by the one or more processors of server system 106, for performing a function described above.
- the above identified modules, applications or programs i.e., sets of instructions
- memory 206 may store a subset of the modules and data structures identified above.
- memory 206 may store additional modules and data structures not described above.
- Figure 2 shows a "server system," Figure 2 is intended more as functional description of the various features which may be present in a set of servers than as a structural schematic of the embodiments described herein.
- items shown separately could be combined and some items could be separated.
- some items shown separately in Figure 2 could be implemented on single servers and single items could be implemented by one or more servers.
- the actual number of servers used to implement a server system and how features are allocated among them will vary from one implementation to another, and may depend in part on the amount of data traffic that the system must handle during peak usage periods as well as during average usage periods.
- Figure 3 A depicts an exemplary data structure of a message record 304 in message database 126 ( Figure 1A) according to some embodiments.
- the message database includes stores messages (in message records 304) for a plurality of user accounts such as Account 1, Account 2, ..., and Account M.
- the database stores a set 302 of message records 304 corresponding to a plurality of messages such as Message 1, Message 2, ..., and Message N.
- message data 304-2 includes header information 306 and message content 320.
- message data 304-2 includes the importance score of the message 321.
- message data 304-2 further includes a message identifier 305 that uniquely identifies the message, and/or a conversation identifier and message identifier that together uniquely identify the message.
- message data 304-2 for a respective message includes feedback data 328 (e.g., one or more of: time elapsed between message receipt and reading, whether the user has replied or forwarded the message, whether the user has read or replied or forwarded the message more than once, whether the user has explicitly marked the message as being important, and whether the user has explicitly marked the message as not important).
- header information 306 includes information 308 identifying the senders and recipients of the message, the message subject 310, one or more labels (if any) applied to the message 312, one or more time stamps 316, and other metadata 318.
- the labels applied to a respective message 312 include an importance label 314 (e.g., when the message importance score exceeds a threshold), which denotes importance of the message.
- the one or more time stamps 316 include information indicating the time when the message is received by the user account, and optionally include time information (which may be stored in the header 306 or elsewhere in the database 302) that indicates the time(s) when the user read the message and the time(s) when the user replied to the message.
- the one or more time stamps 316 may be useful in calculating how quickly the user reads, responds to or otherwise interacts with the message.
- other metadata 318 includes one of more values such as the number of times the message has been read, forwarded, and other metrics of interaction.
- the message content 320 contains the content of the message, e.g., text, images, and attachments. Those of ordinary skill in the art would recognize other ways to store the message information. For example, an attachment might be stored in another storage structure with a reference to it stored in the message record 304.
- Figure 3B depicts an exemplary data structure of a user account record 322 in the user account database 124 ( Figure 1A) according to some embodiments.
- the user account record 322 includes a plurality of user accounts such as User Account 1, User Account 2, ..., and User Account M.
- user account record 322-2 includes a contact list 324 (or includes a pointer to contact list 324) that includes a list of contacts associated with the user, and optionally includes one or more of: social graph data 326, and important terms 330.
- the user data 322-2 also includes a user-specific importance prediction model 332, which is described in greater detail below with respect to Figure 3C.
- user-specific importance prediction model 332 for a respective user or user account is stored in a separate database from user account database 124. It is noted that a user may have multiple accounts, or multiple usernames for messaging, and that in some implementations a single user-specific importance prediction model 332 is used in conjunction with two or more of the usernames and/or accounts of the user.
- the user has an associated social graph that includes one or more social graph members. Each of the one or more social graph members has a calculated social graph weight based on the interactions between the user and the respective social graph member.
- Social graph data 326 includes information regarding the one or more social graph members. In some embodiments, information regarding the one or more social graph members includes the calculated social graph weights of the one or more social graph members.
- social graph data 326 also includes weights for that group of members of the social graph.
- social graph data 326 for a respective user optionally includes weights for a plurality of groups of social graph members with whom the user has communicated as a group.
- server 106 collects feedback data from the user regarding importance of a respective message.
- the user may explicitly mark a message as important, or not important.
- the speed with which a user opens a new message, or deletes a message without opening it may be treated as feedback data.
- the feedback data from the user is stored in the user account database 124.
- the feedback data is stored in the message database 126.
- Important terms 330 include terms determined to be indicative of message importance.
- important terms 330 are specific to the user, and thus a respective user account 322 includes a set of user-specific important terms 330. Important terms are described in more detail below with reference to Figure 5A.
- FIG. 3C depicts an exemplary data structure of importance prediction models 122 (Figure 1A), according to some embodiments.
- Importance prediction models 122 includes a global importance prediction model 132 and a set of user importance prediction models 134 ( Figure IB).
- User importance prediction models 134 include a plurality of user- specific importance prediction models, for a plurality of respective users.
- user-specific importance prediction models 134 include User Model 1, User Model 2, ..., and User Model P.
- Both global model 132 and user-specific model such as User Model 1 include a plurality of weights, each corresponding to a respective message signal or a respective combination message signal.
- the message signals used include both individual message signals (each based on a single message signal) and one or more combination message signals (each based on two or more message signals). Combination message signals are described in more detail below with reference to Figure 5A.
- the plurality of weights and signal identifiers for their respective message signals are stored in records 334, 336, 338, 340, 342 in a look-up table in importance prediction model database 122.
- FIG. 4 is a block diagram illustrating a client computer 102 in accordance with some embodiments.
- the client computer 102 typically includes one or more processing units (CPU's) 402 for executing modules, programs and/or instructions stored in memory 406 and thereby performing processing operations; one or more network or other communications interfaces 404; memory 406; and one or more communication buses 408 for interconnecting these components.
- Communication buses 408 may include circuitry (sometimes called a chipset) that interconnects and controls communications between system components.
- Client computer 102 optionally may include a user interface 410 comprising a display device and a keyboard, mouse, touch-sensitive surface or other input device.
- Memory 406 includes highspeed random access memory, such as DRAM, SRAM, DDR RAM or other random access solid state memory devices; and may include non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices. Memory 406 may optionally include one or more storage devices remotely located from the CPU(s) 402. Memory 406, or alternately the non- volatile memory device(s) within memory 406, comprises a computer readable storage medium. In some embodiments, memory 406 or the computer readable storage medium of memory 406 stores the following programs, modules and data structures, or a subset thereof:
- an operating system 412 that includes procedures for handling various basic system services and for performing hardware dependent tasks
- a network communication module 414 that is used for connecting the client computer 102 to other computers via the one or more communication network interfaces 404 (wired or wireless) and one or more communication networks, such as the Internet, other wide area networks, local area networks, metropolitan area networks, and so on;
- a client application 416 for rendering messages to the user of the client and receiving input from the user (e.g., labeling a message as important or unimportant);
- a user account database 418 for storing user data
- a message database 420 for storing messages and other communication received from a server system 106.
- Each of the above identified modules, applications or programs corresponds to a set of instructions, executable by the one or more processors of client computer 102, for performing a function described above.
- the above identified modules, applications or programs i.e., sets of instructions
- memory 406 may store a subset of the modules and data structures identified above.
- memory 406 may store additional modules and data structures not described above.
- FIG. 5A-5C are flowcharts representing a server method 500 for identifying important messages, in accordance with some embodiments.
- Server method 500 may be governed by instructions that are stored in a computer readable storage medium and that are executed by one or more processors of one or more servers (see server system 106, Figure 2).
- Each of the operations shown in Figure 5 may correspond to instructions stored in a computer memory or computer readable storage medium (e.g., memory 206, Figure 2).
- the computer readable storage medium may include a magnetic or optical disk storage device, solid state storage devices such as flash memory devices, or other non-volatile memory device or devices.
- the computer readable instructions stored on the computer readable storage medium are in source code, assembly language code, object code, or other instruction format that is interpreted by one or more processors.
- server 106 ( Figures 1, 2) automatically generates (502) the plurality of weights included in first and second importance prediction models (132, 134, Figure IB) using data from message database 126 and user account database 124, without requiring the user to provide explicit feedback regarding importance of any messages.
- Each of the plurality of weights in the first and second importance prediction models corresponds to a respective message signal.
- a message signal in the first (global) importance prediction model is given a greater weight if the server determines the probability is high that a common user will act within a predetermined amount of time upon messages exhibiting the message signal.
- the term "exhibited" is defined as follows. A message signal extracted from a respective message is said to be exhibited by that message.
- the server may find that a common user will more likely respond within 48 hours to a message where the user is the only recipient than to other messages where the user is not the only recipient.
- the message signal "User is the only recipient” is given a greater weight than the message signal "User is not the only recipient” in the global importance prediction model.
- a message signal in the second (user) importance prediction model is given a greater weight if the server determines the probability is high that a specific user will act within a predetermined amount of time upon messages exhibiting the message signal.
- the server may find that a specific user is likely respond within 48 hours to messages from a person named "John Doe," and a corresponding message signal is given an commensurate weight.
- a weight is assigned to each message signal that is included in an importance prediction model that is commensurate with its predictive power, e.g., for predicting the likelihood that messages exhibiting the message signal will be opened by the user within a predefined period of time after the signal has been received in the user account.
- server 106 automatically generates and/or periodically updates (504) one or more of the importance weights in the first and second importance prediction models using machine learning.
- Machine learning includes a set of techniques, implemented using software tools and computer systems, that generate functions and predictive models (e.g., by determining weights to be applied to components of the functions or predictive models). Machine learning is well known to those skilled in the art and is therefore not described in detail in this document.
- the server in order for the machine learning technique to adapt to changes in the activity in a user's messaging account (e.g., changes in the messages being received by a user, for example, a sudden influx of messages concerning events such as holidays, and/or changes in a user's behavior), the server creates a user profile that is independent of the importance prediction model for a respective user.
- the user profile tracks user behavior-related statistical data, such as the number of messages the user receives, reads or replies to per day, the percentage of messages read or replied to by the user per day and the number of messages marked as important by the user per day.
- the machine learning technique will ignore any new user data in the learning process until either the deviation of received messages and/or user behavior ends, or the deviation of received messages and/or user behavior persists long enough so that it becomes the new normal with respect to received messages and/or user behavior.
- the server updates (506) one or more of the importance weights in the first and second importance prediction models using a time-dependent decay function to discount over time the importance of user actions with respect to messages having a respective message signal.
- the influence of user actions e.g., opening, replying, deleting
- the influence of user actions are discounted by an amount that corresponds to how long ago the user actions occurred. For example, in these embodiments, a user action that occurred two weeks ago (or perhaps two months ago) is more heavily discounted than a similar user action that occurred one day ago.
- server 106 receives (508) a message associated with a user.
- the received message includes (510) information identifying message participants.
- Message participants include people listed in one or more of the To, From, and Cc fields of the message, and possibly in other fields as well (e.g., a Reply-To field, if provided).
- message participants also include people listed in the To, From, Cc, ... fields of other messages that are in the same conversation as the received message.
- the user has (510) an associated social graph (326, Figure 3B).
- the user's social graph data 326 ( Figure 3B) includes information regarding one or more of the message participants.
- server 106 extracts (512) one or more message signals from the message.
- some of the message signals are extracted from the message header.
- message signals extracted from the message header include: a signal identifying whether the user is the only recipient of the message, a signal identifying whether the message is sent by the user, a signal identifying whether the subject of the message contains one or more words conveying importance (e.g., "important,” “please read,” “urgent,” “action needed,” “confidential” and “reminder"), a signal identifying whether the subject of the message contains the user's display name, one or more signals identifying the labels (if any) applied to the message, a signal identifying whether the message is addressed to the user using the Bcc field; a signal indicating if the message was sent to a list to which the user has subscribed; one or more signals indicating whether the message was sent from one or more particular domains (e.g., domains identified in a user profile as domains from which the user appears
- some of the message signals are extracted from the message body, i.e., content of the message.
- message signals extracted from the message content include: a signal identifying whether the content contains one or more words conveying importance, a signal identifying whether the content contains the user's display name.
- message signals are extracted from the context of the received message (also herein called the current message) within a thread that includes at least one earlier message.
- Examples of message signals extracted from the context of the message within a thread include: a signal indicating whether the thread is initiated by the user, a signal identifying whether the message is the first message in the thread, a signal identifying whether the user has replied to a message in the thread, and one or more time related signals, such as signals identifying how long an earlier message in the thread (i.e., a message received prior to the current message) has remained unread by the user, and/or how quickly the user first read or responded to an earlier message in the thread.
- the extracted message signals include (516) a plurality of term-related message signals.
- a term-related message signal corresponds to presence or quantity of important terms in the message, where important terms include terms determined to be indicative of message importance.
- important terms include “important,” “please read,” “urgent,” “action needed,” “confidential,” “reminder,” and the name of the respective user. Some important terms apply to multiple users, and some important terms only apply to a specific user.
- the number of important terms (e.g., terms found in one or more lists of important terms) in a message are counted.
- the count of important terms in a message includes important terms in the subject of the first message in a conversation but not in the subjects of other messages in the conversation, to avoid repetitively counting the same term.
- the extracted message signals include multiple signals, each of which corresponds to a particular count or range of counts of important terms in the received message.
- the extracted message signals may include: one important term; 2 important terms; 3 to 4 important terms; 5 or more important terms; and, one or more important terms in message subject.
- the important term list for a respective user is updated periodically, or from time to time, based on recently received messages or based on messages received since the last time the important term list was generated or updated.
- the extracted message signals include (518) a plurality of social graph-related message signals.
- Examples of social graph-related message signals include: a signal identifying the percentage of messages the user reads from the sender of the message, a signal identifying the percentage of messages the user reads that have at least one of the same recipients as the received message, a signal identifying the percentage of messages that are read out of the total messages sent to exactly the same group of recipients, a signal identifying whether the sender of the message has a corresponding social graph weight associated with the user, a signal identifying the social graph weight of the sender.
- Social graph weight is described above with reference to Figure 3B.
- the extracted message signals include (514) a first plurality of message signals.
- each of the first plurality of message signals has corresponding importance weights in both the global importance prediction model and the user importance prediction model.
- its first (global) weight in the global importance prediction model is a baseline value of the importance weight of the message signal
- its second (user) weight in the user importance prediction model represents how much the user model deviates from the global model, in other words, the difference between the user model and the global model.
- a respective message signal in the first plurality of message signals has a first weight equal to 0.5 in the global importance prediction model and a second weight equal to -0.2 in the user importance prediction model, where the difference between the global model and the user model for this respective message signal is quantitatively expressed as -0.2.
- the first plurality of message signals include (519) one or more combination message signals, where a combination message signal includes combination of two or more other message signals.
- a combination message signal includes combination of two or more other message signals.
- two or more message signals are combined using a logic function (e.g. AND, OR, XOR%) to generate a combination message signal. Weights are generated for the generated combination message signal and used to help determine message importance.
- a logic function e.g. AND, OR, XOR
- the server extracts a first message signal "This message was from a very important person (VIP): True or False," and a second message signal "The message was sent by an automated system: True or False.”
- the two message signals can be combined into one combination message signal using a logic AND function; for example, the combination message signal is determined to be True only when "the message is sent by a VIP" AND “the message is NOT sent by an automated system.” It is advantageous to use combination message signals in cases where the combination message signal has been determined (e.g., through the use of machine learning) to have greater message importance predictive power than the combination's constituent message signals in isolation.
- server 106 generates (520) an importance weight for each message signal of the first plurality of message signals. For a respective message signal (522), server 106 determines (524) a first weight for the respective message signal using the first (global) importance prediction model. The server also determines (526) a second weight for the respective message signal using the second (user) importance prediction model.
- both the first and second importance prediction models include (528) a plurality of term-related weights, each corresponding to a term-related message signal. Term-related message signals are described in more detail above with reference to Figure 5A. [0074] In some embodiments, both the first and second importance prediction models include (530) a plurality of social graph-related weights, each corresponding to a social graph-related message signal. Social graph-related message signals are described in more detail above with reference to Figure 5A.
- server 106 determines (532) the importance weight of a respective message signal by combining the first and the second weights. In some embodiments, the importance weight of the respective message signal is determined (534) by adding the first weight and the second weight.
- Operations 522 to 534, for determining the importance weight for a respective message signal are repeated (536) for each message signal in the first plurality of message signals.
- server 106 determines (552) an importance score for the message based on the generated importance weights of the first plurality of message signals.
- the importance score of the message is determined by adding up the importance weights of each message signal in the first plurality of message signals.
- the extracted message signals further include (540) a second plurality of message signals.
- each of the second plurality of message signals has corresponding importance weights in only the user importance prediction model but not the global importance prediction model.
- the server generates (542) an importance weight for each message signal of the second plurality of message signals.
- server 106 determines (546) the importance weight for the respective message signal using the second (user) importance prediction model but not the first (global) importance prediction model. These operations are repeated so as to determine the importance weight for each respective message signal in the second plurality of message signals (548).
- server 106 determines (554) an importance score for the message based on the generated importance weights of the first and second pluralities of message signals.
- the importance score of the message is determined by adding up the importance weights of each message signal in the first and second pluralities of message signals.
- the server determines importance scores for the message and a plurality of other messages using the method described above and then orders the message and the plurality of other messages based on their importance scores.
- server 106 compares (556) the importance score of the message with a threshold to determine importance of the message. In some embodiments, messages with importance scores greater than the threshold are determined to be important. In some embodiments, messages with importance scores less than the threshold are determined to be unimportant. In some embodiments, the threshold is predetermined by the server. In some embodiments, the server periodically updates (558) the threshold using machine learning.
- the server compares the importance score of the message with multiple thresholds to determine a level of importance for the message. For example, the server compares the importance score of the message with two thresholds Tl and T2, where Tl is less than T2. If the importance score of the message is greater than T2, the message is determined to be "Very Important;” if the importance score of the message is less than T2 but greater than Tl, the message is determined to be "Important;” if the importance score of the message is less than Tl, the message is determined to be
- each of the received messages is assigned an importance level and the messages are divided into tiers or levels of importance.
- the server sends (560) the message (or message information concerning the message) along with information regarding importance of the message to the user for display at a client device.
- information regarding importance of the message includes instructions for displaying the message in a sub-region of a display window where the sub-region is used to display important messages, as described in greater detail below with reference to Figure 6A, which depicts a "Sorted Inbox" user interface of a messaging application.
- information regarding importance of the message includes instructions for displaying a predefined label to denote importance of the message, as described in greater detail below with reference to Figure 6A.
- the server may send information corresponding to the message (e.g., the subject line of the message, information identifying the sender of the message, information identifying a subject of the conversation to which the message belong, etc.) along with the message importance information.
- information corresponding to the message e.g., the subject line of the message, information identifying the sender of the message, information identifying a subject of the conversation to which the message belong, etc.
- server 106 collects (562) the optional feedback data from the user regarding importance of the message or any other messages, and incorporates the optional user feedback data in generating and/or updating (562) importance weights for the second (user) importance prediction model.
- server 106 collects (562) the optional feedback data from the user regarding importance of the message or any other messages, and incorporates the optional user feedback data in generating and/or updating importance weights for both the first (global) and second (user) importance prediction models, but the user feedback data is given lower weight for updating the global model than for updating the user model.
- FIG. 6A is a schematic screenshot of a "Sorted Inbox" user interface 600 of a messaging application in which lists of conversations are displayed in two non-overlapping areas of the user interface 600, according to some embodiments.
- a "Compose Mail” link 602. The user clicks on link 602 to start writing a new message.
- the system After the user submits one or more query terms through textbox 604 and clicks on the "Search Mail” button 606, the system generates a new display listing messages or conversations matching the query terms.
- Nearby textbox 604 are two importance marking affordances (sometimes called buttons, or user interface buttons), "Important” 608 and "Unimportant” 610. The user selects one of the two affordances to mark a message or conversation as important or unimportant, which will be described in more detail below with reference to Figures 6E-6F.
- Next to the "Important” and “Unimportant” affordances are two pull-down lists: "add label” list 612 and "more actions” list 614.
- each box corresponding to a system-defined category represented by a respective system-defined label such as "Sorted Inbox,” “Inbox,” “Starred,” “Sent Mail,” “Drafts,” “All Mail,” “Spam,” “Trash,” “Important,” etc.
- the set of system-defined categories may be different, including a subset of these categories and/or additional categories.
- Group boxes 616 there are another series of group boxes, each box corresponding to a user-defined category represented by a respective user-defined label such as Label 1, Label 2..., etc. Note that since the current screenshot displays only conversations belonging to the "Sorted Inbox” category, the corresponding link in group boxes 616 has been highlighted.
- the "Sorted Inbox” category includes messages and conversations organized and displayed according to importance of the respective message or conversation, as described in more detail below with reference to Figures 6A-6F.
- the "Starred” category includes messages and conversations in which the user plans to be actively involved, e.g., by sending messages to other participants, which is similar to a "To Do" list.
- a message may be flagged with a predefined label such as a star 640, so that a user can search for starred messages.
- the "Important" category 616-1 includes messages and conversations that have been determined to meet predefined message importance criteria. The predefined message importance criteria are described in more detail above with reference to Figure 5C.
- message area of the user interface which is used to display message information (e.g., a list of conversations matching a query, or the messages in a conversation), representing a set of messages.
- message information e.g., a list of conversations matching a query, or the messages in a conversation
- the message information is for messages to and from the message account of a respective user.
- the displayed message information includes or concerns messages in which the respective user is a participant (e.g., specified in the To, Cc, or Bcc field of each message).
- the displayed messages are (or include) email messages.
- the displayed message information includes or concerns two or more types of messages, such as two or more of: email messages, chat messages, SMS messages, voice messages, and video messages.
- the message area concurrently displays message information for a first set of messages 632 in a first area of the user interface, and message information for a second set of messages in a second area of the user interface that is separate from the first area.
- the first area in the message area includes a heading 618 (e.g., "Important") to identify the messages displayed in the first area. Heading 618 is displayed at the top left corner of the first area.
- heading 618 is also a link 618 that, when selected by a user, provides the user with options for determining which messages are to be displayed in the first area of the user interface, and more generally for configuring that area of the user interface.
- heading for each additional message area is also a link that, when selected by a user, provides the user with options for determining which messages are to be displayed in that area of the user interface, and more generally for configuring that area of the user interface.
- Each conversation/message displayed in the first area meets predefined message importance criteria, and each conversation displayed in the first area has at least one message meeting the predefined message importance criteria.
- the predefined message importance criteria are described in more detail above with reference to Figure 5C. It should be noted that it is advantageous to display only messages that have been determined to meet the predefined importance criteria in the first area because it enables the user to quickly and conveniently locate messages that have been determined to be important, without having to browse multiple pages of messages to locate important messages on each page.
- each row in the first area includes a checkbox 622, and information for one conversation, including: a sender list 624, a recipient status indicator 626, a message/conversation topic and snippet of the message/conversation 628 and a date/time value 630 (e.g., the date/time of receipt of the last message in the listed conversation).
- checkbox 622 is checked by the user if the user decides to move the corresponding message or conversation from one system-defined category, e.g., "Inbox", to another one, e.g., "Trash", or if the user decides to attach a user-defined label to the corresponding conversation, or if the user decides to move the corresponding message or conversation from one area of the display to another one.
- system-defined category e.g., "Inbox”
- Trash e.g., "Trash”
- the "Sorted Inbox" user interface 600 of the messaging application also includes a collapse affordance 621 for collapsing the first area and thereby removing items previously listed in the first area from being displayed the user interface.
- each of the distinct message areas of the "Sorted Inbox" user interface 600 includes a respective collapse affordance (e.g., collapse affordances 621 and 639 in Figure 6A, and 621, 639 and 647 in Figure 6B) for collapsing the corresponding area of the user interface and thereby removing items previously listed in the respective area from being displayed the user interface.
- a respective collapse affordance e.g., collapse affordances 621 and 639 in Figure 6A, and 621, 639 and 647 in Figure 6B
- the list of messages and conversations 632 is displayed in chronological order in the first area.
- messages that have been received most recently are displayed above messages that have been received earlier. It is advantageous to display the list of important messages 632 in chronological order because chronological order makes the most intuitive sense to many users; some users may be confused if conversations or messages are not displayed in chronological order.
- messages and conversations that have not been read by the user are highlighted.
- all messages in the list of important messages 632 are unread by the user, and all conversations in list 632 have at least one message that is unread by the user. It is advantageous to display only unread messages that have been determined to meet the predefined importance criteria in the first area because it enables the user to quickly and conveniently locate unread messages that have been determined to be important, which in many cases are among the most important messages to the user.
- the user is given the option of displaying important conversations/messages in the list 632, without regard to whether the user has read all the messages in the list 632.
- the message area of the display window in Figure 6 A further includes a second area with a heading 636 (e.g., "Starred") displayed at the top left corner of the second area.
- a heading 636 e.g., "Starred”
- Below heading 636 is a list of conversations 642 each occupying one row in the second area.
- Each conversation in list 642 has at least one message flagged by the user with the predefined label.
- each message in list 642 would be a message flagged by the user with the predefined label.
- a star symbol 640 is displayed next to the conversation/message checkbox for each conversation/message in list 642.
- the list of messages and conversations 642 is displayed in chronological order in the second area.
- each of the conversations/messages in list 632 of the first area is excluded from list 642 of the second area.
- no conversation/message in list 642 meets the predefined message importance criteria. As applied to lists of conversations, this means that no conversation in list 642 contains a message that meets the predefined message importance criteria.
- the message area of the message application's user interface further includes a third area for displaying a third set of messages.
- the third area includes a heading 644 (e.g., "Everything else") displayed at the top left corner of the third area.
- heading 644 e.g., "Everything else" displayed at the top left corner of the third area.
- Below heading 644 is a list 650 of conversations or messages, each occupying one row in the third area.
- a "View Inbox" link 646 also called an expansion affordance
- the list 650 of conversations/messages is displayed in chronological order in the third area.
- each of the conversations/messages in list 632 of the first area and list 642 of the second area is excluded from list 650 of the third area.
- the user interface includes four distinct message areas (not shown), each for displaying a distinct set of conversations/messages.
- the user can configure the user interface to determine the content of each message area.
- the user can configure one of these areas to including only messages having a particular user-defined label (e.g., messages having the user-defined label "vacation").
- the client device selects, for display in the respective area of the user interface, only messages (or conversations having at least one message) labeled with the particular user-defined label.
- each of the first, second and third areas in Figure 6B includes a clickable drop-down header that allows a user to customize the way messages are displayed in a respective area and/or apply actions to all visible messages displayed in a respective area.
- a clickable drop-down header is attached to link "Important" 618, link “Starred” 636 and link "Everything Else” 644 respectively.
- the clickable drop-down header includes options that enable a user to customize the size of a respective area, the category of a respective area, etc.
- the clickable drop-down header includes options that enable the user to select or deselect all visible messages in a respective area, or apply other actions to all visible messages in a respective area.
- Figure 6C is a schematic screenshot of a "Sorted Inbox" user interface of a messaging application, depicting how a user expands the first area of the messaging application user interface by selecting the "View All” link (also called an expansion affordance), according to some embodiments. If a user wants to view only the messages and conversations in list 632 of the first area, the user can click (652) on the "View All” link located at the top right corner of the first area to expand the first area. The user interface schematically depicted in Figure 6C will then change to the user interface schematically depicted in Figure 6D, which depicts the first area in its expanded state. As shown in Figure 6D, after the user clicks on the "View All" link to expand the first area, only
- list 632 includes more conversations/messages than the maximum number of messages that can be displayed in the first area in Figure 6C, but after the user expands the first area by clicking on the "View All” link, additional conversations/messages from list 632 that are not displayed in the first area in Figure 6C can be displayed in the message area in Figure 6D.
- the user can click on the "View Starred” link 638 ( Figure 6A) to expand the second area, or click on the "View Inbox” link 646 ( Figure 6B) to expand the third area.
- each of the first, second and third areas in Figure 6B includes a collapse affordance 621, 639, 647 (also called an display area collapse link) that allows a user to collapse a respective display area of the user interface.
- a respective collapse affordance is displayed above and near the left margin of the corresponding display area.
- the respective area is collapsed.
- the respective area in its collapsed state only shows a header with the title of the respective area and a count of messages included in the respective area.
- Figure 6E is a schematic screenshot of a messaging application user interface, depicting how a user can mark an item displayed in the second area as important by selecting the item and clicking on the "Important" button (also called an importance marking affordance), according to some embodiments.
- the user wants to mark a message or conversation in the second area (e.g., conversation 660 in Figure 6E) as important, the user can select (670) the checkbox of conversation 660 and click (672) the button "Important.”
- the screenshot in Figure 6E will then change to the screenshot in Figure 6F, where conversation 660 is moved from the second area to the first area and is included in the list 632 of the first area. Accordingly, in this example, conversation 662 is moved from the second message in list 642 (as shown in Figure 6E) to the first message in list 642 (as shown in Figure 6F).
- Figure 7A is a flow chart representing a method 700 for displaying (702) messages associated with a respective user, according to some embodiments.
- a client system e.g., client system 102, Figure 1A and 4) displays (704) first message information
- client system 102 displays (706) second message information representing a second set of messages in a second area of the display that is separate from the first area (see, for example, the areas occupied by lists 632 and 642, Figure 6A).
- client system 102 further displays (708) a third set of messages in a third area that is separate from the first and second areas (see, for example, the areas occupied by lists 632, 642 and 650, Figure 6B).
- both the first message information and the second message information are displayed (710) by client system 102 in chronological order in their respective display areas. Details of method 700 are described above with reference to Figures 6A-6F.
- Figure 7B is a flow chart illustrating the operation of an expansion affordance, according to some embodiments.
- Client system 102 system displays (712) a respective expansion affordance (e.g., 620, 638, Figure 6A) in each of the first and second areas.
- client system 102 receives (714) a user selection of the expansion affordance for the first area, and expands (716) the first area and displays only the first message information.
- client system 102 receives (714) a user selection of the expansion affordance for the second area, and expands (718) the second area and displays only the second message information. Details of the method are described above with reference to Figures 6C-6D.
- Figure 7C is a flow chart illustrating the operation of an importance marking affordance, according to some embodiments.
- the system displays (720) a selectable importance marking affordance.
- Figure 6 A shows two selectable importance marking affordances, the Important 608 and Not Important 610 marking affordances.
- the system receives (722) a user selection of one or more items represented by the second message information and receives (724) a user selection of the selectable importance marking affordance.
- the system marks (726) the user selected items as important using a predefined label. Details of the method are described above with reference to Figures 6E-6F.
- the user action of marking selected items as important, or as not important provides user-generated feedback data regarding importance of one or more user-selected messages.
- the server collects feedback data from the user regarding importance of one or more messages, and modifies the second importance prediction model using the feedback data.
- the server periodically (or from time to time) updates one or more of the importance weights in the first and second importance prediction models using machine-learning that is based, at least in part, on the feedback data.
- the server updates one or more of the importance weights in the first and second importance prediction models using a time-dependent decay function that is applied to the feedback data and optionally to information concerning other user actions on messages.
- the server also updates one or more importance thresholds based, at least in part, on the feedback data, so as to adjust the volume of conversations/messages classified as important and displayed in the message display area (e.g., see Figure 6A) for important conversations/messages.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Sur un dispositif client muni d'un afficheur et dans un procédé d'affichage de messages sur le dispositif client, le dispositif client affiche simultanément des informations de messages associées à un utilisateur respectif en affichant des premières informations de messages représentant un premier ensemble de messages dans une première zone de l'afficheur, et en affichant des secondes informations de messages représentant un second ensemble de messages dans une seconde zone de l'afficheur qui est distincte de la première zone, le premier ensemble de messages répondant à des critères d'importance prédéfinie des messages, et chaque message du premier ensemble de messages étant exclu du second ensemble de messages.
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US37779310P | 2010-08-27 | 2010-08-27 | |
US61/377,793 | 2010-08-27 | ||
US13/219,653 | 2011-08-27 | ||
US13/219,653 US20120054642A1 (en) | 2010-08-27 | 2011-08-27 | Sorted Inbox User Interface for Messaging Application |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2012027750A1 true WO2012027750A1 (fr) | 2012-03-01 |
Family
ID=44583491
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2011/049580 WO2012027750A1 (fr) | 2010-08-27 | 2011-08-29 | Interface utilisateur de boîte d'entrée triée pour application de messagerie |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2012027750A1 (fr) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070254723A1 (en) * | 2006-04-19 | 2007-11-01 | Samsung Electronics Co., Ltd. | Method and device for managing data in mobile terminal |
US20090144655A1 (en) * | 2007-12-03 | 2009-06-04 | Research In Motion Limited | Multiple display regions in a unified message inbox |
US20100197355A1 (en) * | 2007-09-28 | 2010-08-05 | Kyocera Corporation | Mobile Terminal, Display Switching Method and Display Switching Program |
-
2011
- 2011-08-29 WO PCT/US2011/049580 patent/WO2012027750A1/fr active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070254723A1 (en) * | 2006-04-19 | 2007-11-01 | Samsung Electronics Co., Ltd. | Method and device for managing data in mobile terminal |
US20100197355A1 (en) * | 2007-09-28 | 2010-08-05 | Kyocera Corporation | Mobile Terminal, Display Switching Method and Display Switching Program |
US20090144655A1 (en) * | 2007-12-03 | 2009-06-04 | Research In Motion Limited | Multiple display regions in a unified message inbox |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8700545B2 (en) | Sorted inbox with important message identification based on global and user models | |
AU2011338267B2 (en) | Priority inbox notifications and synchronization for mobile messaging application | |
US10250549B2 (en) | Electronic message organization via social groups | |
US10757057B2 (en) | Managing conversations | |
JP6178928B2 (ja) | メッセージ管理システムのための動的なフィルタ生成 | |
RU2600102C2 (ru) | Сортировка обмена электронной информацией | |
EP2973380B1 (fr) | Assistant de messagerie électronique pour une gestion efficace des courriers électroniques | |
US20150134389A1 (en) | Systems and methods for automatic suggestions in a relationship management system | |
JP6109743B2 (ja) | 複数のメッセージング・チャネルを有するメッセージング・システム | |
CN108352005B (zh) | 针对可穿戴设备的通信界面 | |
JP2005514705A (ja) | 強化された電子メール管理システム | |
WO2012027749A1 (fr) | Boîte de réception triée avec une identification des messages importants en fonction de modèles globaux et de modèles d'utilisateur | |
JP2005182154A (ja) | メッセージ処理システムおよびメッセージ処理方法 | |
WO2012027750A1 (fr) | Interface utilisateur de boîte d'entrée triée pour application de messagerie | |
US8495071B1 (en) | User productivity by showing most viewed messages | |
Dugan et al. | RemindMe: Plugging a Reminder Manager into Email for Enhancing Workplace Responsiveness | |
Raghunandan | Scalable client features to handle high volume e-mail |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11754585 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 11754585 Country of ref document: EP Kind code of ref document: A1 |