AU2012240311B2 - Recommending digital content based on implicit user identification - Google Patents

Recommending digital content based on implicit user identification Download PDF

Info

Publication number
AU2012240311B2
AU2012240311B2 AU2012240311A AU2012240311A AU2012240311B2 AU 2012240311 B2 AU2012240311 B2 AU 2012240311B2 AU 2012240311 A AU2012240311 A AU 2012240311A AU 2012240311 A AU2012240311 A AU 2012240311A AU 2012240311 B2 AU2012240311 B2 AU 2012240311B2
Authority
AU
Australia
Prior art keywords
user
behavior
pattern
content
context information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
AU2012240311A
Other versions
AU2012240311A1 (en
Inventor
John Funge
Neil D. Hunt
Satish Kumar KRISHNAMURTHY
Jonathan Michael Sanders
Todd Scot Yellin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netflix Inc
Original Assignee
Netflix Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=46967106&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=AU2012240311(B2) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Netflix Inc filed Critical Netflix Inc
Publication of AU2012240311A1 publication Critical patent/AU2012240311A1/en
Application granted granted Critical
Publication of AU2012240311B2 publication Critical patent/AU2012240311B2/en
Priority to AU2016202876A priority Critical patent/AU2016202876B2/en
Priority to AU2018241081A priority patent/AU2018241081A1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0251Targeted advertisements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/441Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44222Analytics of user selections, e.g. selection of programs or purchase activity
    • H04N21/44224Monitoring of user activity on external systems, e.g. Internet browsing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for program selection
    • H04N21/4826End-user interface for program selection using recommendation lists, e.g. of programs or channels sorted out according to their score

Abstract

One embodiment of the present invention sets forth a technique for recommending digital content to a user of a digital content application based on continually learned patterns of behavior. Based on metrics collected from a current session of the digital content application, properties associated with one or more users interacting with the application are inferred. The inferred properties are matched against previously defined patterns of behavior to identify digital content that could be presented to the one or more users for optional selection.

Description

WO 2012/138667 PCT/US2012/032023 RECOMMENDING DIGITAL CONTENT BASED ON IMPLICIT USER IDENTIFICATION CROSS-REFERENCE TO RELATED APPLICATIONS [0001] This application claims benefit of United States patent application serial 5 number 13/080,420, filed April 5, 2012, which is herein incorporated by reference. BACKGROUND OF THE INVENTION Field of the Invention [0002] Embodiments of the present invention relate generally to digital media and, more specifically, to recommending digital content based on implicit user 10 identification. Description of the Related Art [0003] Digital content distribution systems conventionally include a content server, a content player, and a communications network connecting the content server to the content player. The content server is configured to store digital content files, which 15 can be downloaded from the content server to the content player. Each digital content file corresponds to a specific identifying title, such as "Gone with the Wind," which is familiar to a user. The digital content file typically includes sequential content data, organized according to playback chronology, and may comprise audio data, video data, or a combination thereof. 20 [0004] The content player is configured to download and play a digital content file, in response to a user request selecting the title for playback. The user is typically presented with a set of recommended titles for selection. Such recommendations are based primarily on previous operations and/or selections performed by the user. However, in a scenario where multiple users interact with the same content player, 25 the recommendations can be inaccurate. For example, if user A performs certain actions within the content player, the next time any user other than user A, such as user B or C, interacts with the same content player, the recommendations may be based on the actions performed by user A. Further, user A may have one set of interests when interacting with the content player alone and a different set of interests 30 when interacting with the content player in a group. In such a scenario, recommendations based primarily on previous operations and/or selections performed by user A can be inapplicable if the determination is not made regarding 1 who is interacting with the content player. Lastly, in a scenario where the same user may be in different moods/interests at different times, the recommendations can be in applicable if the current mood/interest of the user is not determined. [0005] One solution to the above-mentioned inaccuracy is having the users of the 5 content player explicitly identify themselves (or their mood/interest) every time they begin interacting with the content player. However, this explicit identification puts an additional burden on the user when interacting with the content player and, therefore, is not a desirable user experience. [0006] As the foregoing illustrates, what is needed in the art is an approach for 10 recommending digital content to a user based on his/her identity without requiring explicit identification from the user, or any additional inputs about their interests. [0006A] It is not admitted that any background information in this specification, including any prior art or discussion thereof, forms part of the common general knowledge, or that this prior art could reasonably be expected to have been 15 understood, regarded as relevant, and/or combined with other pieces of prior art by a skilled person in the art. SUMMARY OF THE INVENTION [0006B] A first aspect of the present invention provides a method for recommending digital content to at least one user of a client device, the method 20 comprising: collecting context information during a current session of a content streaming application wherein the context information comprises a plurality of metrics describing the current session for streaming content for display on the client device, and wherein the context information is collected at least in part from a second endpoint device that is distinct from the client device; analyzing, by operation of one 25 or more computer processors, the context information to determine a set of properties describing the at least one user; analyzing a plurality of previously defined patterns of behavior to identify a first pattern of behavior most closely associated with the determined set of properties without considering an identity of the at least one user, wherein each of the plurality of previously defined patterns of behavior describes a 30 pattern of user actions and content selections within a graphical user interface during previous session on the client device and by a respective one or more users of the content streaming application; and identifying digital content to present to the at least one user within the graphical user interface of the content streaming application for selection, based on the pattern of user actions and content selections described by 35 the identified first pattern of behavior. 2 [0006C] A second aspect of the present invention provides a computer readable medium storing instructions that, when executed by a processor, cause the processor to recommend digital content to at least one user of a client device by performing the 5 steps of:collecting context information during a current session of a content streaming application, wherein the context information comprises a plurality of metrics describing the current session for streaming content for display on the client device, and wherein the context information is collected at least in part from a second endpoint device that is distinct from the client device;analyzing the context information 10 to determine a set of properties describing the at least one user; analyzing a plurality of previously defined patterns of behavior to identify a first pattern of behavior most closely associated with the determined set of properties without considering an identity of the at least one user, wherein each of the plurality of previously defined patterns of behavior describes a pattern of user actions and content selections within 15 a graphical user interface during previous sessions on the client device and by a respective one or more users of the content streaming application; and identifying digital content to present to the at least one user within the graphical user interface of the content streaming application for selection, based on the pattern of user actions and content selections described by the identified first pattern behavior. 20 [0006D] A third aspect of the present invention provides a computer system, comprising: a memory; and a processor configured to: collect context information during a current session of a content streaming application, wherein the context information comprises a plurality of metrics describing the current session for streaming content for display on the client device, and wherein the context information 25 is collected at least in part from a second endpoint device that is distinct from the client device; analyze the context information to determine a set of properties describing the at least one user; analyze a plurality of previously defined patterns of behavior to identify a first pattern of behavior most closely associated with the determined set of properties without considering an identity of the at least one user, 30 wherein each of the plurality of previously defined patterns of behavior describes a pattern of user actions and content selections within a graphical user interface during previous sessions on the client device and by a respective one or more users of the content streaming application, and identify digital content to present to the at least one user within the graphical user interface of the content streaming application for 2A selection, based on the first pattern of user actions and content selections described by the identified first pattern of behavior. [0007] The disclosure hereinafter also describes in a general sense, a method for 5 recommending digital content to at least one user. The method includes the steps of analyzing context information related to a current session of a content application to infer a set of properties associated with the at least one user and their current interest, analyzing a plurality of previously defined patterns of behavior to identify a first pattern of behavior most closely associated with the inferred set of properties, 10 and, based on the first pattern of behavior, identifying digital content that should be presented to the at least one user as an option for selection. [0007A] As used herein, except where the context requires otherwise the term 'comprise' and variations of the term, such as 'comprising', 'comprises' and 'comprised', are not intended to exclude other additives, components, integers or 15 steps. [0008] One advantage of the disclosed technique is that digital content is recommended to users based on properties related to the identity of the users without having the users explicitly specify their identity. BRIEF DESCRIPTION OF THE DRAWINGS 20 [0009] So that the manner in which the above recited features of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings. It is to be noted, however, that the appended drawings illustrate only typical embodiments of this invention and are 25 therefore not to be considered limiting of its scope, for the invention may admit to other equally effective embodiments. 2B WO 2012/138667 PCT/US2012/032023 [0010] Figure 1 illustrates a content distribution system configured to implement one or more aspects of the present invention; [0011] Figure 2 is a more detailed view of the endpoint device of Figure 1, according to one embodiment of the invention; 5 [0012] Figure 3 is a more detailed view of the personalization server of Figure 1, according to one embodiment of the invention; [0013] Figure 4 is a conceptual diagram of a timeline illustrating interactions of multiple users with the content application, according to one embodiment of the invention; and 10 [0014] Figure 5 is a flow diagram of method steps for personalizing recommendations based on the context associated with a current session of the content application, according to one embodiment of the invention. DETAILED DESCRIPTION [0015] In the following description, numerous specific details are set forth to 15 provide a more thorough understanding of the present invention. However, it will be apparent to one of skill in the art that the present invention may be practiced without one or more of these specific details. In other instances, well-known features have not been described in order to avoid obscuring the present invention. [0016] Figure 1 illustrates a content distribution system 100 configured to 20 implement one or more aspects of the invention. As shown, the content distribution system 100 includes a content distribution network (CDN) 102, a communications network 104, a personalization server 106 and an endpoint device 108. [0017] The communications network 104 includes a plurality of network communications systems, such as routers and switches, configured to facilitate data 25 communication between the personalization server 106, the CDN 102 and the endpoint device 108. Persons skilled in the art will recognize that many technically feasible techniques exist for building the communications network 104, including technologies practiced in deploying the well-known internet communications network. [0018] The endpoint device 108 may comprise a computer system, a set top box, 30 a mobile device such as a mobile phone, or any other technically feasible computing 3 WO 2012/138667 PCT/US2012/032023 platform that has network connectivity and is coupled to or includes a display device and speaker device for presenting video frames, and generating acoustic output, respectively. [0019] The CDN 102 comprises one or more computer systems configured to 5 serve download requests for digital content files received from the endpoint device 108. The digital content files may reside on a mass storage system accessible to the computer system. The mass storage system may include, without limitation, direct attached storage, network attached file storage, or network attached block-level storage. The digital content files may be formatted and stored on the mass storage 10 system using any technically feasible technique. A data transfer protocol, such as the well-known hyper-text transfer protocol (HTTP), may be used to download digital content files from the CDN 102 to the endpoint device 108. [0020] The personalization server 106 interacts with the endpoint device 108 to identify digital content that can be recommended to at least one user of the endpoint 15 device 108. Based on metrics collected at the endpoint device 108 and from any other endpoint devices within the content distribution system 100, the personalization server 106 infers properties related to the identity of the users of the endpoint device 108. The type of digital content that is recommended is then based on the inferred identity. The operations of the personalization server 106 are described in greater 20 detail in conjunction with Figure 3. [0021] Although, in the above description, the content distribution system 100 is shown with one endpoint device 108 and one CDN 102, persons skilled in the art will recognize that the architecture of Figure 1 contemplates only an exemplary embodiment of the invention. Other embodiments may include any number of 25 endpoint devices 108 and/or CDNs 102. Thus, Figure 1 is in no way intended to limit the scope of the present invention in any way. [0022] Figure 2 is a more detailed view of the endpoint device 108 of Figure 1, according to one embodiment of the invention. As shown, the endpoint device 108 includes, without limitation, a central processing unit (CPU) 210, a graphics 30 subsystem 212, an input/output (1/O) device interface 214, a network interface 218, a secure memory space 220, an interconnect 222 and a memory subsystem 230. The endpoint device 108 may also include a mass storage unit 216. 4 WO 2012/138667 PCT/US2012/032023 [0023] The CPU 210 is configured to retrieve and execute programming instructions stored in the memory subsystem 230. Similarly, the CPU 210 is configured to store and retrieve application data residing in the memory subsystem 230. The interconnect 222 is configured to facilitate transmission of data, such as 5 programming instructions and application data, between the CPU 210, graphics subsystem 212, 1/0 devices interface 214, mass storage 216, network interface 218, secure memory space 220 and memory subsystem 230. [0024] The graphics subsystem 212 is configured to generate frames of video data and transmit the frames of video data to display device 250. In one embodiment, the 10 graphics subsystem 212 may be integrated into an integrated circuit, along with the CPU 210. The display device 250 may comprise any technically feasible means for generating an image for display. For example, the display device 250 may be fabricated using liquid crystal display (LCD) technology, cathode-ray technology, and light-emitting diode (LED) display technology (either organic or inorganic). An 15 input/output (1/O) device interface 214 is configured to receive input data from user 1/O devices 252 and transmit the input data to the CPU 210 via the interconnect 222. For example, user 1/O devices 252 may comprise one of more buttons, a keyboard, and a mouse or other pointing device. The I/O device interface 214 also includes an audio output unit configured to generate an electrical audio output signal. User 1/O 20 devices 252 includes a speaker configured to generate an acoustic output in response to the electrical audio output signal. In alternative embodiments, the display device 250 may include the speaker. A television is an example of a device known in the art that can display video frames and generate an acoustic output. A mass storage unit 216, such as a hard disk drive or flash memory storage drive, is 25 configured to store non-volatile data. A network interface 218 is configured to transmit and receive packets of data via the communications network 120. In one embodiment, the network interface 218 is configured to communicate using the well known Ethernet standard. The network interface 218 is coupled to the CPU 210 via the interconnect 222. 30 [0025] The memory subsystem 230 includes programming instructions and data that comprise an operating system 232 and a content application 234. The operating system 232 performs system management functions such as managing hardware devices including the network interface 218, mass storage unit 216, 1/0 device 5 WO 2012/138667 PCT/US2012/032023 interface 214, and graphics subsystem 212. The operating system 232 also provides process and memory management models for the content application 234. [0026] The content application 234 includes a user interface 236, a metrics collection engine 238 and a playback engine 240. The content application 234 allows 5 users to browse through and watch digital content that is served by the CDN 102. The content application 234 interacts with the personalization server 106 to recommend digital content to the user of the endpoint device 108 for optional selection. The user interface 234 provides a specific structure, such as a window and object metaphor, for user interaction with the content application 234. Persons skilled 10 in the art will recognize the various operating systems and user interfaces that are well-known in the art and suitable for incorporation into the endpoint device 108. [0027] Within a particular session of the content application 234, the metrics collection engine 238 collects metrics related to the interactions of the user with the content application 234 or metrics related to the execution environment of the content 15 application 234. In one embodiment, a session is a fixed length of time, in another embodiment, a session is a period of uninterrupted user interaction with the content application 234, and, in yet another embodiment, a session may be a new instantiation of the content application 234. The metrics collected by the metrics collection engine 238 may include, but are not limited to, the following: 20 e Content selections: Particular content selected by the user while interacting with the content application 236. * Content browsing patterns * Device information related to the endpoint device 108, such as the device type. * Location information: Location can be determined using the internet protocol 25 (IP) address of the endpoint device 108 or various location-determining devices, such as a global positioning system (GPS) unit attached to or included in the endpoint device 108. * Time of day when the current session was initiated. * Particular button pressed on the user I/O devices for performing certain actions 30 within the content application 236, such as selection, browsing, etc. * Button press timings and pressure. * Button press patterns 6 WO 2012/138667 PCT/US2012/032023 * Sensor information, such as accelerometers, gyroscopes, magnetometers, and other inertial sensors. * Audio information collected via microphones coupled to the endpoint device 108. 5 e Video information collected via cameras coupled to the endpoint device 108. [0028] The metrics collected by the metrics collection engine 238 are referred to herein as the "context information" associated with the current session. For each session, the metrics collection engine 238 transmits the context information to the personalization server 106 for further processing. As described in greater detail 10 below in conjunction with Figure 3, the personalization server 106 processes the context information to generate recommendations of digital content for presentation to the user of the endpoint device 108. The user of the endpoint device 108, in response, may select the recommended digital content or browse through the content library of the content application 234 to select digital content for viewing. The 15 selected digital content is downloaded from the CDN 102 and rendered by the playback engine 240. [0029] The metrics described above may be collected across various endpoint devices 108. For example, the sensor information collected from a mobile endpoint device 108, such as a personal digital assistant (PDA), can be used to provide 20 context information for content being displayed on a different endpoint device 108. [0030] Figure 3 is a more detailed view of the personalization server 106 of Figure 1, according to one embodiment of the invention. The personalization server 106 includes a context processing engine 302, a learned pattern store 304 and a recommendation engine 306. 25 [0031] As previously described herein, the personalization server 106 interacts with the endpoint device 108 to identify digital content that can be recommended to the user(s) of the endpoint device 108. In operation, upon receiving the context information collected by the metrics collection engine 238, the context processing engine 302 analyzes the context information to infer a set of properties associated 30 with the user(s) of the endpoint device 108. The set of properties may include: 7 WO 2012/138667 PCT/US2012/032023 * the actual identity of the user(s). For example, the device information or the audio/video information specified by the context information may be used to recognize a specific named person is probably currently using the device. * the class of the user(s). The class may specify the age range of the 5 user(s), the emotional state of the user(s), the gender of the user(s), etc. For example, time of day specified by the context information may indicate that a child is using the endpoint device 108. As another example, the button press information, such as the pressure with which the buttons are pressed, can be used to determine the gender or age of the user(s). 10 [0032] Once the set of properties associated with the user(s) of the endpoint device 108 are determined, the context processing engine 302 matches the set of properties against previously-defined patterns of behavior stored in the learned pattern store 304. The pattern of behavior that best-fits the set of properties and, thus, the inferred characteristics of the user(s) of the endpoint device 108, is selected. 15 The patterns of behavior stored in the learned pattern store 304 are identified based on analyzing context information associated with previous sessions of the content application 234 executing on the endpoint device 108 or context information associated with other sessions of the content application 234 executing on other endpoint devices within the content distribution system 100. A pattern of behavior 20 specifies different actions or digital content type selections are probable given a set of properties. Patterns of behavior defined for a particular account or an endpoint device 108 are stored in the individual patterns 308, and patterns of behavior defined across multiple accounts of endpoint devices are stored in the group patterns 310. [0033] In one embodiment, to select a pattern of behavior that best-fits the set of 25 properties determined for the context information, each of the patterns of behavior stored in the learned pattern store 304 is analyzed. When performing such an analysis, a weight is attached to each pattern of behavior based on the set of properties, where the weight indicates a degree of correlation between the set of properties and the pattern of behavior. The pattern of behavior with the highest 30 correlation is then selected. Persons skilled in the art should recognize that any technically feasible machine learning or data-mining techniques, including for example, decision trees, hidden Markov models, Bayesian learning techniques, and other alternatives can be implemented to select a pattern of behavior that best-fits the 8 WO 2012/138667 PCT/US2012/032023 set of properties. Several machine learning techniques are known in the arts of artificial intelligence and machine learning. The various alternatives include techniques related to evolution strategies, genetic algorithms, genetic programming, multidimensional clustering, neural networks, and weighted majority techniques. In 5 addition, the algorithm may include a weighted average of a set of relatively simpler elements, updated in real time using an exponential gradient technique, or some other machine learning technique. [0034] Once selected, the pattern of behavior that best-fits the set of properties determined for the context information is analyzed by the recommendation engine 10 306 to identify digital content that should be recommended to the user(s) of the endpoint device 108. The recommendation is based on the different actions or digital content type selections that are specified by the selected pattern of behavior. Information regarding the digital content that should be recommended is then transmitted to the content application 236 for display. 15 [0035] In various embodiments, the functionality implemented by the personalization server 106 may be implemented by the endpoint device 108 or by a combination of the endpoint device 108 and the personalization server 106. [0036] Figure 4 is a conceptual diagram of a timeline illustrating interactions of multiple users with the content application, according to one embodiment of the 20 invention. User A 402, user B 404 and user C 406 are users of the endpoint device 108. At time 408, user A 402 is using the endpoint device 108 alone, and metrics collected at time 408 are based only on the interactions of user A 402 with the content application 234. Such context information is processed in the personalization server 106, and patterns in the learned pattern store are updated or added accordingly. 25 Similarly, at time 410, user A 402 and user B 404 are using the endpoint device 108 together, and metrics collected at time 408 are based on the interactions of user A 402 and user B 402 with the content application 234. Such context information is processed in the personalization server 106, and patterns in the learned pattern store are updated or added accordingly. Further, at time 412, user A 402, user B 404 and 30 user C 406 are using the endpoint device 108 together, and metrics collected at time 408 are based on the interactions of user A 402, user B 404 and user C 406 with the content application 234. Such context information is processed in the personalization server 106, and patterns in the learned pattern store are updated or added 9 WO 2012/138667 PCT/US2012/032023 accordingly. The context information can be used to infer, among other properties, the state of mind, i.e., the mood, of the user(s) of the endpoint device 108. [0037] It is important to note that the content application 234 and the personalization server 106 are unaware of the particular identities of user A 402, user 5 B, 404 and user C 406, or that two or more of the users are interacting together. The context information collected is treated merely as a pattern of interaction. [0038] When the personalization server 106 receives the context information associated with time 414, the set of properties determined based on the context information and other context information related to other endpoint devices 108 are 10 matched against the patterns detected at times 408, 410 and 412. The best-fit pattern is identified, and digital content is recommended based on the best-fit pattern. [0039] Figure 5 is a flow diagram of method steps for personalizing recommendations based on the context associated with a current session of the content application, according to one embodiment of the invention. Although the 15 method steps are described in conjunction with the systems for Figures 1-3, persons skilled in the art will understand that any system configured to perform the method steps, in any order, is within the scope of the invention. [0040] The method 500 begins at step 502, where the context processing engine 302 within the personalization server 106 receives context information associated with 20 a current session of the content application 234 from the metrics collection engine 238. At step 504, the context processing engine 302 analyzes the context information to infer a set of properties associated with the user(s) of the endpoint device 108. For example, time of day specified by the context information may indicate that a child is using the endpoint device 108. Another property that can be inferred from the context 25 information is the current state of mind, i.e., the mood, of the user(s) of the endpoint device 108. [0041] At step 506, the context processing engine 302 matches the set of properties against previously-defined patterns of behavior stored in the learned pattern store 304. The pattern of behavior that best-fits the set of properties and, 30 thus, the inferred characteristics of the user(s) of the endpoint device 108, is selected. 10 WO 2012/138667 PCT/US2012/032023 [0042] At step 508, the recommendation engine 306 within the personalization server 106 analyzes the pattern of behavior selected in step 504 to identify digital content that should be recommended to the user(s) of the endpoint device 108. The recommendation is based on the different actions or digital content type selections 5 that are specified by the selected pattern of behavior. Information regarding the digital content that should be recommended is then transmitted to the content application 236 for display. [0043] One advantage of the disclosed technique is that digital content is recommended to users based on properties related to the identity of the users without 10 having the users explicitly specify their identity. [0044] One embodiment of the invention may be implemented as a program product stored on computer-readable storage media within the endpoint device 108. In this embodiment, the endpoint device 108 comprising an embedded computer platform such as a set top box. An alternative embodiment of the invention may be 15 implemented as a program product that is downloaded to a memory within a computer system, for example as executable instructions embedded within an internet web site. In this embodiment, the endpoint device 108 comprises the computer system. [0045] While the forgoing is directed to embodiments of the present invention, 20 other and further embodiments of the invention may be devised without departing from the basic scope thereof. For example, aspects of the present invention may be implemented in hardware or software or in a combination of hardware and software. One embodiment of the invention may be implemented as a program product for use with a computer system. The program(s) of the program product define functions of 25 the embodiments (including the methods described herein) and can be contained on a variety of computer-readable storage media. Illustrative computer-readable storage media include, but are not limited to: (i) non-writable storage media (e.g., read-only memory devices within a computer such as CD-ROM disks readable by a CD-ROM drive, flash memory, ROM chips or any type of solid-state non-volatile semiconductor 30 memory) on which information is permanently stored; and (ii) writable storage media (e.g., floppy disks within a diskette drive or hard-disk drive or any type of solid-state random-access semiconductor memory) on which alterable information is stored. Such computer-readable storage media, when carrying computer-readable 11 WO 2012/138667 PCT/US2012/032023 instructions that direct the functions of the present invention, are embodiments of the present invention. [0046] In view of the foregoing, the scope of the present invention is determined by the claims that follow. 5 12

Claims (23)

1. A method for recommending digital content to at least one user of a client device, the method comprising: 5 collecting context information during a current session of a content streaming application, wherein the context information comprises a plurality of metrics describing the current session for streaming content for display on the client device, and wherein the context information is collected at least in part from a second endpoint device that is distinct from the client 10 device; analyzing, by operation of one or more computer processors, the context information to determine a set of properties describing the at least one user; analyzing a plurality of previously defined patterns of behavior to identify a first 15 pattern of behavior most closely associated with the determined set of properties without considering an identity of the at least one user, wherein each of the plurality of previously defined patterns of behavior describes a pattern of user actions and content selections within a graphical user interface during previous session on the client device and 20 by a respective one or more users of the content streaming application; and identifying digital content to present to the at least one user within the graphical user interface of the content streaming application for selection, based on the pattern of user actions and content selections described by the identified first pattern of behavior. 25
2. The method of claim 1, further comprising analyzing context information associated with a previous session of the content application to define the first pattern of behavior. 30
3. The method of claim 1, further comprising analyzing context information associated with a previous session of a different content application to define the first pattern of behavior. 13
4. The method of claim 1, wherein the step of analyzing the plurality of previously defined patterns of behavior comprises attaching a weight to each pattern of behavior based on the set of properties, wherein the weight attached to a pattern of behavior indicates a degree of correlation between the at least one user and the pattern of 5 behavior.
5. The method of claim 4, further comprising determining, based on the weight attached to the first pattern of behavior, that the first pattern of behavior has the highest degree of correlation with the at least one user. 10
6. The method of claim 1, wherein the plurality of metrics includes a last operation performed by the at least one user within the current session.
7. The method of claim 1, wherein the plurality of metrics includes a device on 15 which the content application is executing.
8. The method of claim 1, wherein the plurality of metrics includes the time of day at which the at least one user begins the current session. 20
9. The method of claim 1, wherein the plurality of metrics includes a geographic location of the at least one user.
10. The method of claim 1, wherein the set of properties further includes at least one property that indicates a range of age for the at least one user. 25
11. The method of claim 1, wherein the plurality of metrics includes an identity of the at least one user based on data collected from one or more sensors.
12. The method of claim 1, wherein the set of properties further includes at least 30 one property that indicates a number of the at least one user.
13. The method of claim 1, wherein the set of properties includes at least one property that indicates at least one characteristic of a current state of mind associated with the at least one user. 14
14. A computer readable medium storing instructions that, when executed by a processor, cause the processor to recommend digital content to at least one user of a client device by performing the steps of: 5 collecting context information during a current session of a content streaming application, wherein the context information comprises a plurality of metrics describing the current session for streaming content for display on the client device, and wherein the context information is collected at least in part from a second endpoint device that is distinct from the client 10 device; analyzing the context information to determine a set of properties describing the at least one user ; analyzing a plurality of previously defined patterns of behavior to identify a first pattern of behavior most closely associated with the determined set of 15 properties without considering an identity of the at least one user, wherein each of the plurality of previously defined patterns of behavior describes a pattern of user actions and content selections within a graphical user interface during previous sessions on the client device and by a respective one or more users of the content streaming 20 application; and identifying digital content to present to the at least one user within the graphical user interface of the content streaming application for selection, based on the pattern of user actions and content selections described by the identified first pattern behavior. 25
15. The computer readable medium of claim 14, further comprising analyzing context information associated with a previous session of the content application to define the first pattern of behavior. 30
16. The computer readable medium of claim 14, further comprising analyzing context information associated with a previous session of a different content application to define the first pattern of behavior. 15
17. The computer readable medium of claim 14, wherein the step of analyzing the plurality of previously defined patterns of behavior comprises attaching a weight to each pattern of behavior based on the set of properties, wherein the weight attached to a pattern of behavior indicates a degree of correlation between the at least one 5 user and the pattern of behavior.
18. The computer readable medium of claim 17, further comprising determining, based on the weight attached to the first pattern of behavior, that the first pattern of behavior has the highest degree of correlation with the at least one user. 10
19. The computer readable medium of claim 14, wherein the plurality of metrics includes a last operation performed by the at least one user within the current session. 15
20. The computer readable medium of claim 14, wherein the plurality of metrics includes a device on which the content application is executing.
21. The computer readable medium of claim 14, wherein the plurality of metrics includes the time of day at which the at least one user begins the current session. 20
22. The computer readable medium of claim 14, wherein the set of properties includes at least one property that indicates a range of age for the at least one user.
23. A computer system, comprising: 25 a memory; and a processor configured to: collect context information during a current session of a content streaming application, wherein the context information comprises a plurality of metrics describing the current session for streaming 30 content for display on the client device, and wherein the context information is collected at least in part from a second endpoint device that is distinct from the client device; analyze the context information to determine a set of properties describing the at least one user; 16 analyze a plurality of previously defined patterns of behavior to identify a first pattern of behavior most closely associated with the determined set of properties without considering an identity of the at least one user, wherein each of the plurality of previously 5 defined patterns of behavior describes a pattern of user actions and content selections within a graphical user interface during previous sessions on the client device and by a respective one or more users of the content streaming application, and identify digital content to present to the at least one user within the 10 graphical user interface of the content streaming application for selection, based on the first pattern of user actions and content selections described by the identified first pattern of behavior. 17
AU2012240311A 2011-04-05 2012-04-03 Recommending digital content based on implicit user identification Active AU2012240311B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU2016202876A AU2016202876B2 (en) 2011-04-05 2016-05-04 Recommending digital content based on implicit user identification
AU2018241081A AU2018241081A1 (en) 2011-04-05 2018-10-03 Recommending digital content based on implicit user identification

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/080,420 2011-04-05
US13/080,420 US8887095B2 (en) 2011-04-05 2011-04-05 Recommending digital content based on implicit user identification
PCT/US2012/032023 WO2012138667A1 (en) 2011-04-05 2012-04-03 Recommending digital content based on implicit user identification

Related Child Applications (1)

Application Number Title Priority Date Filing Date
AU2016202876A Division AU2016202876B2 (en) 2011-04-05 2016-05-04 Recommending digital content based on implicit user identification

Publications (2)

Publication Number Publication Date
AU2012240311A1 AU2012240311A1 (en) 2013-10-24
AU2012240311B2 true AU2012240311B2 (en) 2016-02-04

Family

ID=46967106

Family Applications (3)

Application Number Title Priority Date Filing Date
AU2012240311A Active AU2012240311B2 (en) 2011-04-05 2012-04-03 Recommending digital content based on implicit user identification
AU2016202876A Withdrawn - After Issue AU2016202876B2 (en) 2011-04-05 2016-05-04 Recommending digital content based on implicit user identification
AU2018241081A Withdrawn AU2018241081A1 (en) 2011-04-05 2018-10-03 Recommending digital content based on implicit user identification

Family Applications After (2)

Application Number Title Priority Date Filing Date
AU2016202876A Withdrawn - After Issue AU2016202876B2 (en) 2011-04-05 2016-05-04 Recommending digital content based on implicit user identification
AU2018241081A Withdrawn AU2018241081A1 (en) 2011-04-05 2018-10-03 Recommending digital content based on implicit user identification

Country Status (5)

Country Link
US (1) US8887095B2 (en)
EP (1) EP2695038A4 (en)
AU (3) AU2012240311B2 (en)
CA (1) CA2832557C (en)
WO (1) WO2012138667A1 (en)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10509841B2 (en) * 2011-06-06 2019-12-17 International Business Machines Corporation Inferred user identity in content distribution
US20130080907A1 (en) * 2011-09-23 2013-03-28 Richard Skelton Method and system for a personalized content play list
US8930354B2 (en) * 2012-01-09 2015-01-06 James Lewin System and method for organizing content
US10108788B2 (en) * 2013-09-10 2018-10-23 Netflix, Inc. Fast-expiring licenses used to speculatively authorize access to streaming media content
US10373192B2 (en) * 2014-08-18 2019-08-06 Google Llc Matching conversions from applications to selected content items
US9744940B1 (en) 2016-04-13 2017-08-29 Autoliv Asp, Inc. Seatbelt pretensioning retractor assembly
CN107306355B (en) * 2016-04-20 2019-10-25 华为技术有限公司 A kind of content recommendation method and server
US20180011615A1 (en) * 2016-07-08 2018-01-11 Netflix, Inc. Regenerating an interactive page based on current user interaction
WO2018148750A1 (en) * 2017-02-13 2018-08-16 Sony Interactive Entertainment LLC Method and system for re-aggregation and optimization of media
US10820027B2 (en) 2017-02-13 2020-10-27 Sony Interactive Entertainment LLC Method and system for re-aggregation and optimization of media
US10369963B2 (en) 2017-03-17 2019-08-06 Autoliv Asp, Inc. Seatbelt pretensioning retractor assembly including a gas release opening
US11059452B2 (en) 2017-03-17 2021-07-13 Autoliv Asp, Inc. Seatbelt pretensioning retractor assembly including a gas release opening
US10328895B2 (en) 2017-03-17 2019-06-25 Autoliv Asp, Inc. Seatbelt pretensioning retractor assembly including a pretensioner rod
US10259426B2 (en) 2017-03-17 2019-04-16 Autoliv Asp, Inc. Seatbelt pretensioning retractor assembly including a piston-safety valve member
US10452350B2 (en) * 2017-04-04 2019-10-22 Roku, Inc. Interaction-based user identification
US20180293509A1 (en) * 2017-04-06 2018-10-11 Coursera, Inc. User-based onboarding
US11120067B2 (en) 2018-07-17 2021-09-14 International Business Machines Corporation Present controlled heterogeneous digital content to users
KR20200063777A (en) 2018-11-28 2020-06-05 삼성전자주식회사 Display apparatus and controlling method thereof
US10864886B2 (en) 2019-02-22 2020-12-15 Autoliv Asp, Inc. Retractor pretensioner assembly
US10946831B2 (en) 2019-02-25 2021-03-16 Autoliv Asp, Inc. Retractor pretensioner assembly
KR102277006B1 (en) * 2019-05-27 2021-07-13 에스케이텔레콤 주식회사 Method for providing content recommendation model, method for recommending content, and apparatuses thereof
CN112052656A (en) * 2019-06-06 2020-12-08 微软技术许可有限责任公司 Recommending topic patterns for documents

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070265073A1 (en) * 2005-12-27 2007-11-15 Massive Incorporated Streaming media casts, such as in a video game or mobile device environment
US20070269787A1 (en) * 2006-04-24 2007-11-22 Cronstrom David S Method and system for recommending media content to a user of a mobile radio terminal
US20080209229A1 (en) * 2006-11-13 2008-08-28 Veveo, Inc. Method of and system for selecting and presenting content based on user identification

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100876300B1 (en) 2000-11-22 2008-12-31 코닌클리케 필립스 일렉트로닉스 엔.브이. Method and apparatus for generating recommendations based on a user's current mood
US7730063B2 (en) * 2002-12-10 2010-06-01 Asset Trust, Inc. Personalized medicine service
US20080242279A1 (en) 2005-09-14 2008-10-02 Jorey Ramer Behavior-based mobile content placement on a mobile communication facility
US7788188B2 (en) 2006-01-30 2010-08-31 Hoozware, Inc. System for providing a service to venues where people aggregate
US8386509B1 (en) * 2006-06-30 2013-02-26 Amazon Technologies, Inc. Method and system for associating search keywords with interest spaces
US8566164B2 (en) * 2007-12-31 2013-10-22 Intent IQ, LLC Targeted online advertisements based on viewing or interacting with television advertisements
US10650062B2 (en) * 2007-12-31 2020-05-12 International Business Machines Corporation Activity centric resource recommendations in a computing environment
WO2011094734A2 (en) * 2010-02-01 2011-08-04 Jumptap, Inc. Integrated advertising system
US20120221411A1 (en) * 2011-02-25 2012-08-30 Cbs Interactive Inc. Apparatus and methods for determining user intent and providing targeted content according to intent
US8744912B2 (en) * 2011-04-14 2014-06-03 Koozoo Inc. Method and system for an advanced player in a network of multiple live video sources
US20120330869A1 (en) * 2011-06-25 2012-12-27 Jayson Theordore Durham Mental Model Elicitation Device (MMED) Methods and Apparatus

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070265073A1 (en) * 2005-12-27 2007-11-15 Massive Incorporated Streaming media casts, such as in a video game or mobile device environment
US20070269787A1 (en) * 2006-04-24 2007-11-22 Cronstrom David S Method and system for recommending media content to a user of a mobile radio terminal
US20080209229A1 (en) * 2006-11-13 2008-08-28 Veveo, Inc. Method of and system for selecting and presenting content based on user identification

Also Published As

Publication number Publication date
US20120260214A1 (en) 2012-10-11
WO2012138667A1 (en) 2012-10-11
EP2695038A1 (en) 2014-02-12
US8887095B2 (en) 2014-11-11
AU2016202876A1 (en) 2016-05-26
AU2016202876B2 (en) 2018-07-05
CA2832557A1 (en) 2012-10-11
AU2018241081A1 (en) 2018-10-25
CA2832557C (en) 2018-07-31
AU2012240311A1 (en) 2013-10-24
EP2695038A4 (en) 2014-09-24

Similar Documents

Publication Publication Date Title
AU2016202876B2 (en) Recommending digital content based on implicit user identification
US10867221B2 (en) Computerized method and system for automated determination of high quality digital content
EP3256914B1 (en) Methods, systems, and media for ambient background noise modification based on mood and/or behavior information
EP3256930B1 (en) Methods, systems, and media for recommending computerized services based on the movements of a pet in the user's environment
KR102626662B1 (en) Global recommendation system for overlapping media catalogs
US10387115B2 (en) Method and apparatus for generating a recommended set of items
TWI636416B (en) Method and system for multi-phase ranking for content personalization
Beach et al. Fusing mobile, sensor, and social data to fully enable context-aware computing
KR101475980B1 (en) Real-time annotator
US10284537B2 (en) Methods, systems, and media for presenting information related to an event based on metadata
RU2611260C2 (en) Method and device to provide recommendations of multimedia resources
JP6542503B2 (en) System and method for ranking mini games executed in the cloud based on tag content and social network content
US11048855B2 (en) Methods, systems, and media for modifying the presentation of contextually relevant documents in browser windows of a browsing application
JP6329967B2 (en) Computer storage medium and prefetch method
US20160232244A1 (en) Methods, systems, and media for personalizing computerized services based on mood and/or behavior information from multiple data sources
JP2014131276A (en) System and method for generating and sharing video clip of cloud supplied game
CN110929086A (en) Audio and video recommendation method and device and storage medium
JP5485968B2 (en) Execution screen disclosure device, execution screen disclosure method, client device, and cloud computing system
KR20110057264A (en) Method, system, and apparatus for ranking media sharing channels
RU2714594C1 (en) Method and system for determining parameter relevance for content items
EP4260566A1 (en) A system and a method for generating and distributing multimedia content
TW201345589A (en) Enhancement to autonomously executed applications
EP2667321A1 (en) Method for requesting digital content, for providing digital content, and for producing a personal profile of a user

Legal Events

Date Code Title Description
FGA Letters patent sealed or granted (standard patent)