US8790168B1 - Method to detect and score churn in online social games - Google Patents

Method to detect and score churn in online social games Download PDF

Info

Publication number
US8790168B1
US8790168B1 US13/436,315 US201213436315A US8790168B1 US 8790168 B1 US8790168 B1 US 8790168B1 US 201213436315 A US201213436315 A US 201213436315A US 8790168 B1 US8790168 B1 US 8790168B1
Authority
US
United States
Prior art keywords
player
online
game
group
churn
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US13/436,315
Inventor
Hans Wolters
Jim Baer
Girish Keswani
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zynga Inc
Original Assignee
Zynga Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zynga Inc filed Critical Zynga Inc
Priority to US13/436,315 priority Critical patent/US8790168B1/en
Assigned to ZYNGA INC. reassignment ZYNGA INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BAER, Jim, KESWANI, GIRISH, WOLTERS, HANS
Priority to US14/341,903 priority patent/US10518167B2/en
Application granted granted Critical
Publication of US8790168B1 publication Critical patent/US8790168B1/en
Assigned to BANK OF AMERICA, N.A., AS LENDER reassignment BANK OF AMERICA, N.A., AS LENDER NOTICE OF GRANT OF SECURITY INTEREST IN PATENTS Assignors: ZYNGA INC.
Priority to US16/700,642 priority patent/US11278805B2/en
Assigned to ZYNGA INC. reassignment ZYNGA INC. TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Assignors: BANK OF AMERICA, N.A., AS LENDER
Assigned to BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT reassignment BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT NOTICE OF GRANT OF SECURITY INTEREST IN PATENTS Assignors: ZYNGA INC.
Assigned to ZYNGA INC. reassignment ZYNGA INC. TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Assignors: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50Controlling the output signals based on the game progress
    • A63F13/12
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/70Game security or game management aspects
    • A63F13/79Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories
    • A63F13/795Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories for finding other players; for building a team; for providing a buddy list
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/50Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers
    • A63F2300/53Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers details of basic data processing
    • A63F2300/535Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers details of basic data processing for monitoring, e.g. of user parameters, terminal parameters, application parameters, network parameters
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/50Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers
    • A63F2300/55Details of game data or player data management
    • A63F2300/5546Details of game data or player data management using player registration data, e.g. identification, account, preferences, game history
    • A63F2300/5566Details of game data or player data management using player registration data, e.g. identification, account, preferences, game history by matching opponents or finding partners to build a team, e.g. by skill level, geographical area, background, play style

Definitions

  • the present disclosure generally relates to games and applications in general and, in particular embodiments, to computer-implemented, online social games.
  • Online social games are becoming widespread. The success of an online social game depends on the number of players and how often these players visit the online social game. As such, the retention of online players to visiting the online social games is an important factor towards the success of the online social games.
  • FIG. 1 illustrates an example embodiment of a system for implementing particular disclosed embodiments.
  • FIG. 2 illustrates an example embodiment of a social network.
  • FIG. 3 illustrates a flow diagram of an example embodiment of a method for detecting and scoring churn in online social games.
  • FIG. 4 illustrates a flow diagram of another example embodiment of a method for increasing retention using churn prediction in online social games.
  • FIG. 5A illustrates an example embodiment of a data flow in a system.
  • FIG. 5B is an example embodiment of a churn prediction server.
  • FIG. 6 illustrates an example embodiment of a network environment.
  • FIG. 7 illustrates an example embodiment of a computer system architecture.
  • FIG. 8 is a block diagram illustrating an example of a timeline for churn prediction.
  • FIG. 9 illustrates an example of a table illustrating the weighting scheme with their corresponding online engagement scores.
  • a method and a system for predicting churn of a player of an online game is described. Online engagements of a group of players of an online game are monitored during a churn prediction model training period.
  • the churn prediction model training period includes the last first number of days (e.g., last 90 days). Online engagement scores for the group of players are computed based on a number of days the group of players has played on the online game within a periodic number of days (e.g., a week) within the churn model training period (e.g. last 90 days). Exponential weights are assigned to the online engagement scores so that a weight of an online engagement score is higher when occurred more recently.
  • the exponential weights are used to compute a weighted exponential moving average of the online engagement scores of the group of players of the online game during the churn model training period (e.g., last 90 days).
  • the weighted exponential moving average of the online engagement scores of the group of players of the online game is used to determine an online engagement threshold value of a churn prediction model for the online game.
  • the online engagement threshold value is applied to a weighted exponential moving average of an online engagement score of a player during an observation period comprising the last second number of days (e.g., last 30 days) to determine a churn probability of the player within a prediction period comprising the next third number of days (e.g., the next 30 days).
  • FIG. 1 illustrates an example of a system for implementing various disclosed embodiments.
  • system 100 comprises player 101 , social networking system 120 a , game networking system 120 b , client system 130 , and network 160 .
  • the components of system 100 can be connected to each other in any suitable configuration, using any suitable type of connection.
  • the components may be connected directly or over a network 160 , which may be any suitable network.
  • one or more portions of network 160 may be an ad hoc network, an intranet, an extranet, a virtual private network (VPN), a local area network (LAN), a wireless LAN (WLAN), a wide area network (WAN), a wireless WAN (WWAN), a metropolitan area network (MAN), a portion of the Internet, a portion of the Public Switched Telephone Network (PSTN), a cellular telephone network, another type of network, or a combination of two or more such networks.
  • VPN virtual private network
  • LAN local area network
  • WLAN wireless LAN
  • WAN wide area network
  • WWAN wireless WAN
  • MAN metropolitan area network
  • PSTN Public Switched Telephone Network
  • PSTN Public Switched Telephone Network
  • Social network system 120 a is a network-addressable computing system that can host one or more social graphs. Social networking system 120 a can generate, store, receive, and transmit social networking data. Social networking system 120 a can be accessed by the other components of system 100 either directly or via network 160 .
  • Game networking system 120 b is a network-addressable computing system that can host one or more online games. Game networking system 120 b can generate, store, receive, and transmit game-related data, such as, for example, game account data, game input, game state data, and game displays. Game networking system 120 b can be accessed by the other components of system 100 either directly or via network 160 .
  • Player 101 may use client system 130 to access, send data to, and receive data from social network system 120 a and game networking system 120 b .
  • Client system 130 can access social networking system 120 a or game networking system 120 b directly, via network 160 , or via a third-party system.
  • client system 130 may access game networking system 120 b via social networking system 120 a .
  • Client system 130 can be any suitable computing device, such as a personal computer, laptop, cellular phone, smart phone, computing tablet, etc.
  • FIG. 1 illustrates a particular number of players 101 , social networking system 120 a , game networking system 120 b , client system 130 , and network 160
  • this disclosure contemplates any suitable number of players 101 , social networking systems 120 a , game networking systems 120 b , client systems 130 , and networks 160 .
  • system 100 may include one or more game networking systems 120 b and no social networking systems 120 a .
  • system 100 may include a system that comprises both social networking system 120 a and game networking system 120 b .
  • FIG. 1 illustrates a particular number of players 101 , social networking system 120 a , game networking system 120 b , client system 130 , and network 160
  • system 100 may include one or more game networking systems 120 b and no social networking systems 120 a .
  • system 100 may include a system that comprises both social networking system 120 a and game networking system 120 b .
  • FIG. 1 illustrates a particular number of players 101 , social networking system 120 a , game networking system 120 b
  • FIG. 1 illustrates a particular arrangement of player 101 , social networking system 120 a , game networking system 120 b , client system 130 , and network 160 , this disclosure contemplates any suitable arrangement of player 101 , social network system 120 a , game networking system 120 b , client system 130 , and network 160 .
  • suitable connections 110 include wireline (such as, for example, Digital Subscriber Line (DSL) or Data Over Cable Service Interface Specification (DOCSIS)), wireless (such as, for example, Wi-Fi or Worldwide Interoperability for Microwave Access (WiMAX)) or optical (such as, for example, Synchronous Optical Network (SONET) or Synchronous Digital Hierarchy (SDH)) connections.
  • wireline such as, for example, Digital Subscriber Line (DSL) or Data Over Cable Service Interface Specification (DOCSIS)
  • wireless such as, for example, Wi-Fi or Worldwide Interoperability for Microwave Access (WiMAX)
  • optical such as, for example, Synchronous Optical Network (SONET) or Synchronous Digital Hierarchy (SDH) connections.
  • SONET Synchronous Optical Network
  • SDH Synchronous Digital Hierarchy
  • one or more connections 110 each include an ad hoc network, an intranet, an extranet, a VPN, a LAN, a WLAN, a WAN, a WWAN, a MAN, a portion of the Internet, a portion of the PSTN, a cellular telephone network, or another type of connection, or a combination of two or more such connections.
  • Connections 110 need not necessarily be the same throughout system 100 .
  • One or more first connections 110 may differ in one or more respects from one or more second connections 110 .
  • client system 130 may have a direct connection to social networking system 120 a or game networking system 120 b , bypassing network 160 .
  • a game engine manages the game state of the game.
  • Game state comprises all game play parameters, including player character state, non-player character (NPC) state, in-game object state, game world state (e.g., internal game clocks, game environment), and other game play parameters.
  • Each player 101 controls one or more player characters (PCs).
  • the game engine controls all other aspects of the game, including non-player characters (NPCs), and in-game objects.
  • the game engine also manages game state, including player character state for currently active (online) and inactive (offline) players.
  • An online game can be hosted by game networking system 120 b , which can be accessed using any suitable connection with a suitable client system 130 .
  • a player may have a game account on game networking system 120 b , wherein the game account can contain a variety of information associated with the player (e.g., the player's personal information, financial information, purchase history, player character state, game state).
  • a player may play multiple games on game networking system 120 b , which may maintain a single game account for the player with respect to all the games, or multiple individual game accounts for each game with respect to the player.
  • game networking system 120 b can assign a unique identifier to each player 101 of an online game hosted on game networking system 120 b .
  • Game networking system 120 b can determine that a player 101 is accessing the online game by reading the user's cookies, which may be appended to HTTP requests transmitted by client system 130 , and/or by the player 101 logging onto the online game.
  • player 101 may access an online game and control the game's progress via client system 130 (e.g., by inputting commands to the game at the client device).
  • Client system 130 can display the game interface, receive inputs from player 101 , transmitting user inputs or other events to the game engine, and receive instructions from the game engine.
  • the game engine can be executed on any suitable system (such as, for example, client system 130 , social networking system 120 a , or game networking system 120 b ).
  • client system 130 can download client components of an online game, which are executed locally, while a remote game server, such as game networking system 120 b , provides backend support for the client components and may be responsible for maintaining application data of the game, processing the inputs from the player, updating and/or synchronizing the game state based on the game logic and each input from the player, and transmitting instructions to client system 130 .
  • a remote game server such as game networking system 120 b
  • game networking system 120 b provides backend support for the client components and may be responsible for maintaining application data of the game, processing the inputs from the player, updating and/or synchronizing the game state based on the game logic and each input from the player, and transmitting instructions to client system 130 .
  • game networking system 120 b provides backend support for the client components and may be responsible for maintaining application data of the game, processing the inputs from the player, updating and/or synchronizing the game state based on the game logic and each input from the player, and transmitting instructions to client system 130 .
  • players may control player characters (PCs), a game engine controls non-player characters (NPCs) and game features, and the game engine also manages player character state and game state and tracks the state for currently active (i.e., online) players and currently inactive (i.e., offline) players.
  • a player character can have a set of attributes and a set of friends associated with the player character.
  • player character state can refer to any in-game characteristic of a player character, such as location, assets, levels, condition, health, status, inventory, skill set, name, orientation, affiliation, specialty, and so on.
  • Player characters may be displayed as graphical avatars within a user interface of the game.
  • Game state encompasses the notion of player character state and refers to any parameter value that characterizes the state of an in-game element, such as a non-player character, a virtual object (such as a wall or castle), etc.
  • the game engine may use player character state to determine the outcome of game events, sometimes also considering set or random variables. Generally, a player character's probability of having a more favorable outcome is greater when the player character has a better state. For example, a healthier player character is less likely to die in a particular encounter relative to a weaker player character or non-player character.
  • the game engine can assign a unique client identifier to each player.
  • player 101 may access particular game instances of an online game.
  • a game instance is copy of a specific game play area that is created during runtime.
  • a game instance is a discrete game play area where one or more players 101 can interact in synchronous or asynchronous play.
  • a game instance may be, for example, a level, zone, area, region, location, virtual space, or other suitable play area.
  • a game instance may be populated by one or more in-game objects. Each object may be defined within the game instance by one or more variables, such as, for example, position, height, width, depth, direction, time, duration, speed, color, and other suitable variables.
  • a game instance may be exclusive (i.e., accessible by specific players) or non-exclusive (i.e., accessible by any player).
  • a game instance is populated by one or more player characters controlled by one or more players 101 and one or more in-game objects controlled by the game engine.
  • the game engine may allow player 101 to select a particular game instance to play from a plurality of game instances. Alternatively, the game engine may automatically select the game instance that player 101 will access.
  • an online game comprises only one game instance that all players 101 of the online game can access.
  • a specific game instance may be associated with one or more specific players.
  • a game instance is associated with a specific player when one or more game parameters of the game instance are associated with the specific player.
  • a game instance associated with a first player may be named “First Player's Play Area.” This game instance may be populated with the first player's PC and one or more in-game objects associated with the first player.
  • a game instance associated with a specific player may only be accessible by that specific player.
  • a first player may access a first game instance when playing an online game, and this first game instance may be inaccessible to all other players.
  • a game instance associated with a specific player may be accessible by one or more other players, either synchronously or asynchronously with the specific player's game play.
  • a first player may be associated with a first game instance, but the first game instance may be accessed by all first-degree friends in the first player's social network.
  • the game engine may create a specific game instance for a specific player when that player accesses the game.
  • the game engine may create a first game instance when a first player initially accesses an online game, and that same game instance may be loaded each time the first player accesses the game.
  • the game engine may create a new game instance each time a first player accesses an online game, wherein each game instance may be created randomly or selected from a set of predetermined game instances.
  • the set of in-game actions available to a specific player may be different in a game instance that is associated with that player compared to a game instance that is not associated with that player.
  • the set of in-game actions available to a specific player in a game instance associated with that player may be a subset, superset, or independent of the set of in-game actions available to that player in a game instance that is not associated with him.
  • a first player may be associated with Blackacre Farm in an online farming game.
  • the first player may be able to plant crops on Blackacre Farm. If the first player accesses game instance associated with another player, such as Whiteacre Farm, the game engine may not allow the first player to plant crops in that game instance. However, other in-game actions may be available to the first player, such as watering or fertilizing crops on Whiteacre Farm.
  • a game engine can interface with a social graph.
  • Social graphs are models of connections between entities (e.g., individuals, users, contacts, friends, players, player characters, non-player characters, businesses, groups, associations, concepts, etc.). These entities are considered “users” of the social graph; as such, the terms “entity” and “user” may be used interchangeably when referring to social graphs herein.
  • a social graph can have a node for each entity and edges to represent relationships between entities.
  • a node in a social graph can represent any entity.
  • a unique client identifier can be assigned to each user in the social graph. This disclosure assumes that at least one entity of a social graph is a player or player character in an online multiplayer game, though this disclosure any suitable social graph users.
  • the minimum number of edges required to connect a player (or player character) to another user is considered the degree of separation between them. For example, where the player and the user are directly connected (one edge), they are deemed to be separated by one degree of separation. The user would be a so-called “first-degree friend” of the player. Where the player and the user are connected through one other user (two edges), they are deemed to be separated by two degrees of separation. This user would be a so-called “second-degree friend” of the player. Where the player and the user are connected through N edges (or N-1 other users), they are deemed to be separated by N degrees of separation. This user would be a so-called “Nth-degree friend.” As used herein, the term “friend” means only first-degree friends, unless context suggests otherwise.
  • each player (or player character) has a social network.
  • a player's social network includes all users in the social graph within Nmax degrees of the player, where Nmax is the maximum degree of separation allowed by the system managing the social graph (such as, for example, social networking system 120 a or game networking system 120 b ).
  • Nmax is the maximum degree of separation allowed by the system managing the social graph (such as, for example, social networking system 120 a or game networking system 120 b ).
  • Nmax equals 1, such that the player's social network includes only first-degree friends.
  • Nmax is unlimited and the player's social network is coextensive with the social graph.
  • the social graph is managed by game networking system 120 b , which is managed by the game operator.
  • the social graph is part of a social networking system 120 a managed by a third-party (e.g., Facebook, Friendster, Myspace).
  • player 101 has a social network on both game networking system 120 b and social networking system 120 a , wherein player 101 can have a social network on the game networking system 120 b that is a subset, superset, or independent of the player's social network on social networking system 120 a .
  • game network system 120 b can maintain social graph information with edge type attributes that indicate whether a given friend is an “in-game friend,” an “out-of-game friend,” or both.
  • the various embodiments disclosed herein are operable when the social graph is managed by social networking system 120 a , game networking system 120 b , or both.
  • FIG. 2 shows an example of a social network within a social graph.
  • Player 201 can be associated, connected or linked to various other users, or “friends,” within the social network 250 .
  • friends can track relationships between users within the social network 250 and are commonly referred to as online “friends” or “friendships” between users.
  • Each friend or friendship in a particular user's social network within a social graph is commonly referred to as a “node.”
  • the details of social network 250 will be described in relation to Player 201 .
  • the terms “player” and “user” can be used interchangeably and can refer to any user or character in an online multiuser game system or social networking system.
  • the term “friend” can mean any node within a player's social network.
  • Player 201 has direct connections with several friends.
  • a direct connection with another individual that connection is referred to as a first-degree friend.
  • Player 201 has two first-degree friends. That is, Player 201 is directly connected to Friend 1 1 211 and Friend 2 1 221 .
  • first-degree friends friends of friends
  • FIG. 2 shows that Player 201 has three second-degree friends to which he is connected via his connection to his first-degree friends.
  • Second-degree Friend 1 2 212 and Friend 2 2 222 are connected to Player 201 via his first-degree Friend 1 1 211 .
  • the limit on the depth of friend connections, or the number of degrees of separation for associations, that Player 201 is allowed is typically dictated by the restrictions and policies implemented by social networking system 120 a.
  • Player 201 can have Nth-degree friends connected to him through a chain of intermediary degree friends as indicated in FIG. 2 .
  • Nth-degree Friend 1 N 219 is connected to Player 201 via second-degree Friend 3 2 232 and one or more other higher-degree friends.
  • Various embodiments may take advantage of and utilize the distinction between the various degrees of friendship relative to Player 201 .
  • a player (or player character) can have a social graph within an online multiplayer game that is maintained by the game engine and another social graph maintained by a separate social networking system.
  • FIG. 2 depicts an example of in-game social network 260 and out-of-game social network 250 .
  • Player 201 has out-of-game connections 255 to a plurality of friends, forming out-of-game social network 250 .
  • Friend 1 1 211 and Friend 2 1 221 are first-degree friends with Player 201 in his out-of-game social network 250 .
  • Player 201 also has in-game connections 265 to a plurality of players, forming in-game social network 260 .
  • Friend 2 1 221 , Friend 3 1 231 , and Friend 4 1 241 are first-degree friends with Player 201 in his in-game social network 260 .
  • Friend 2 1 221 has both an out-of-game connection 255 and an in-game connection 265 with Player 201 , such that Friend 2 1 221 is in both Player 201 's in-game social network 260 and Player 201 's out-of-game social network 250 .
  • Player 201 can have second-degree and higher-degree friends in both his in-game and out of game social networks.
  • a game engine can access in-game social network 260 , out-of-game social network 250 , or both.
  • the connections in a player's in-game social network can be formed both explicitly (e.g., users must “friend” each other) and implicitly (e.g., system observes user behaviors and “friends” users to each other).
  • reference to a friend connection between two or more players can be interpreted to cover both explicit and implicit connections, using one or more social graphs and other factors to infer friend connections.
  • the friend connections can be unidirectional or bidirectional. It is also not a limitation of this description that two players who are deemed “friends” for the purposes of this disclosure are not friends in real life (i.e., in disintermediated interactions or the like), but that could be the case.
  • a game event may be an outcome of an engagement, a provision of access, rights and/or benefits, or the obtaining of some assets (e.g., health, money, strength, inventory, land, etc.).
  • a game engine determines the outcome of a game event according to a variety of factors, such as the game rules, a player character's in-game actions, player character state, game state, interactions of other player characters, and random calculations.
  • Engagements can include simple tasks (e.g., plant a crop, clean a stove), complex tasks (e.g., build a farm or business, run a café), or other events.
  • An online game can be hosted by a game networking system, which can be accessed over any suitable network with an appropriate client system.
  • a player may have a game system account on game system, wherein the game system account can contain a variety of information about the player (e.g., the player's personal information, player character state, game state, etc.).
  • an online game can be embedded into a third-party website.
  • the game can be hosted by the networking system of the third-party website, or it can be hosted on game system and merely accessed via the third-party website.
  • the embedded online game can be hosted solely on a server of game system or using a third-party vendor server.
  • any combination of the functions of the present disclosure can be hosted on or provided from any number of distributed network resources. For example, one or more executable code objects that implement all or a portion of the game can be downloaded to a client system for execution.
  • FIG. 3 illustrates a flow diagram of an example of a method for detecting and scoring churn in an online social game.
  • online engagements of a group of players of an online game are monitored during a churn prediction model training period.
  • the churn prediction model training period includes the last first number of days (e.g., last 90 days).
  • a player's engagement may include the number of days the player has played or accessed the online game for each week for a period of 90 days.
  • players from the group of players have already installed the online game during the churn model training period.
  • the maximum online engagement of a player may be seven days a week for the last 90 days.
  • the minimum online engagement of a player may be zero days a week for the last 90 days.
  • the online engagement may vary week by week.
  • online engagement scores for the group of players are computed based on a number of days the group of players has played on the online game within a periodic number of days (e.g., a week) within the churn model training period (e.g. last 90 days).
  • a score is assigned based on the online engagement. For example, a score of 1 may be assigned when the player has played the online game one day out of a week or a score of 4 may be assigned when the player has played the online game one day a week for four weeks.
  • exponential weights are assigned to the online engagement scores so that a weight of an online engagement score is higher when occurred more recently.
  • the exponential weights are used to compute a weighted exponential moving average of the online engagement scores of the group of players of the online game during the churn model training period (e.g., last 90 days). The weight is chosen so that a player's engagement score is ranked higher when it occurs more recently as opposed to a player who has strong early engagement but recently tapered off.
  • FIG. 9 illustrates an example of a table 900 illustrating the weighting scheme with their corresponding online engagement scores.
  • Column 902 represents scores of players in the group from 4 weeks prior.
  • Column 904 represents scores of players in the group from 3 weeks prior.
  • Column 906 represents scores of players in the group from 2 weeks prior.
  • Column 908 represents scores of the players the directly preceding week.
  • Column 910 represents the weighted scores of players in the group.
  • the weighted exponential moving average of the online engagement scores of the group of players of the online game is used to determine an online engagement threshold value of a churn prediction model for the online game.
  • the churn prediction model is generated by training a simple na ⁇ ve Bayesian classifier that computes the posterior probabilities of a player to be a likely churner based on the learned distributions as well as the priors. For example, the prior probabilities turn out to be 60% for a user to stay in the game and 40% for a user to churn.
  • the churn model derives a threshold value of 2.4 for the engagement score, meaning that the churn model predicts a player to be a churner if the engagement score is below that threshold value of 2.4.
  • the online engagement threshold value is applied to a weighted exponential moving average of an online engagement score of a player during an observation period comprising the last second number of days (e.g., last 30 days) to determine a churn probability of the player within a prediction period comprising the next third number of days (e.g., the next 30 days). For example, a player having a weighted exponential moving average online engagement score of 2.1 is likely to churn because the score is less than the threshold value of 2.4.
  • a probability of whether the player is likely to churn within the next 30 days may be derived by comparing the score of the player and the threshold value.
  • FIG. 8 is a block diagram illustrating an example of a timeline for churn prediction.
  • the model training period 812 is before the present date, today 810 .
  • the model training period 812 may include for example 90 days.
  • the time period 802 represents a one month period 60 to 90 days before today 810 .
  • the time period 804 represents a one month period 30 to 60 days before today 810 .
  • the observation period 806 represents a one month period 0 to 30 days before today 810 .
  • the observation period 806 is associated with the player.
  • the model training period 812 is associated with the group of players.
  • the prediction period 808 represents the next 30 days after today 810 .
  • FIG. 4 illustrates a flow diagram of an example of a method for increasing retention using churn prediction.
  • a churn probability of a player with the churn rate model applied to an online engagement history of the player is determined using the process as previously described with respect to FIG. 3 .
  • a message is generated to the player to keep the player engaged in the online game when the churn probability of the player exceeds a predetermined churn probability threshold.
  • a message is generated to the player to request the player to complete a task in the online game when the churn probability of the player exceeds a predetermined churn probability threshold. For example, the player is invited to complete a new easier task or is given clues to complete an existing task.
  • another player connected to the player via a social network is identified to help the player complete a task in the online game when the churn probability of the player exceeds a predetermined churn probability threshold.
  • a message is generated to the player to request help from the other player to complete the task in the online game of the player.
  • FIG. 5A illustrates an example data flow between the components of system 500 .
  • system 500 can include client system 530 , social networking system 520 a , and game networking system 520 b .
  • the components of system 500 can be connected to each other in any suitable configuration, using any suitable type of connection.
  • the components may be connected directly or over any suitable network.
  • Client system 530 , social networking system 520 a , and game networking system 520 b can each have one or more corresponding data stores such as local data store 535 , social data store 545 , and game data store 565 , respectively.
  • Social networking system 520 a and game networking system 520 b can also have one or more servers that can communicate with client system 530 over an appropriate network.
  • Social networking system 520 a and game networking system 520 b can have, for example, one or more internet servers for communicating with client system 530 via the Internet.
  • social networking system 520 a and game networking system 520 b can have one or more mobile servers for communicating with client system 530 via a mobile network (e.g., GSM, PCS, Wi-Fi, WPAN, etc.).
  • a mobile network e.g., GSM, PCS, Wi-Fi, WPAN, etc.
  • one server may be able to communicate with client system 530 over both the Internet and a mobile network.
  • separate servers can be used.
  • Client system 530 can receive and transmit data 523 to and from game networking system 520 b .
  • This data can include, for example, webpages, messages, game inputs, game displays, HTTP packets, data requests, transaction information, updates, and other suitable data.
  • game networking system 520 b can communicate data 543 , 547 (e.g., game state information, game system account information, page info, messages, data requests, updates, etc.) with other networking systems, such as social networking system 520 a (e.g., Facebook, Myspace, etc.).
  • Client system 530 can also receive and transmit data 527 to and from social networking system 520 a .
  • This data can include, for example, webpages, messages, social graph information, social network displays, HTTP packets, data requests, transaction information, updates, and other suitable data.
  • Communication between client system 530 , social networking system 520 a , and game networking system 520 b can occur over any appropriate electronic communication medium or network using any suitable communications protocols.
  • client system 530 may include Transport Control Protocol/Internet Protocol (TCP/IP) networking stacks to provide for datagram and transport functions.
  • TCP/IP Transport Control Protocol/Internet Protocol
  • any other suitable network and transport layer protocols can be utilized.
  • hosts or end-systems described herein may use a variety of higher layer communications protocols, including client-server (or request-response) protocols, such as the HyperText Transfer Protocol (HTTP) and other communications protocols, such as HTTP-S, FTP, SNMP, TELNET, and a number of other protocols, may be used.
  • HTTP HyperText Transfer Protocol
  • other communications protocols such as HTTP-S, FTP, SNMP, TELNET, and a number of other protocols
  • HTTP-S HyperText Transfer Protocol
  • FTP FTP
  • SNMP SNMP
  • TELNET Transmission Layer Security
  • a server in one interaction context may be a client in another interaction context.
  • the information transmitted between hosts may be formatted as HyperText Markup Language (HTML) documents.
  • HTML HyperText Markup Language
  • Other structured document languages or formats can be used, such as XML, and the like.
  • Executable code objects such as JavaScript and ActionScript, can also be embedded in the structured documents.
  • a server In some client-server protocols, such as the use of HTML over HTTP, a server generally transmits a response to a request from a client.
  • the response may comprise one or more data objects.
  • the response may comprise a first data object, followed by subsequently transmitted data objects.
  • a client request may cause a server to respond with a first data object, such as an HTML page, which itself refers to other data objects.
  • a client application such as a browser, will request these additional data objects as it parses or otherwise processes the first data object.
  • an instance of an online game can be stored as a set of game state parameters that characterize the state of various in-game objects, such as, for example, player character state parameters, non-player character parameters, and virtual item parameters.
  • game state is maintained in a database as a serialized, unstructured string of text data as a so-called Binary Large Object (BLOB).
  • BLOB Binary Large Object
  • the client-side executable may be a FLASH-based game, which can de-serialize the game state data in the BLOB.
  • the game logic implemented at client system 530 maintains and modifies the various game state parameters locally.
  • the client-side game logic may also batch game events, such as mouse clicks, and transmit these events to game networking system 520 b .
  • Game networking system 520 b may itself operate by retrieving a copy of the BLOB from a database or an intermediate memory cache (memcache) layer.
  • Game networking system 520 b can also de-serialize the BLOB to resolve the game state parameters and execute its own game logic based on the events in the batch file of events transmitted by the client to synchronize the game state on the server side. Game networking system 520 b may then re-serialize the game state, now modified, into a BLOB and pass this to a memory cache layer for lazy updates to a persistent database.
  • one server system such as game networking system 520 b
  • client systems 530 there may be multiple players at multiple client systems 530 all playing the same online game.
  • the number of players playing the same game at the same time may be very large.
  • multiple client systems 530 may transmit multiple player inputs and/or game events to game networking system 520 b for further processing.
  • multiple client systems 530 may transmit other types of application data to game networking system 520 b.
  • a computed-implemented game may be a text-based or turn-based game implemented as a series of web pages that are generated after a player selects one or more actions to perform.
  • the web pages may be displayed in a browser client executed on client system 530 .
  • a client application downloaded to client system 530 may operate to serve a set of webpages to a player.
  • a computer-implemented game may be an animated or rendered game executable as a stand-alone application or within the context of a webpage or other structured document.
  • the computer-implemented game may be implemented using Adobe Flash-based technologies.
  • a game may be fully or partially implemented as a SWF object that is embedded in a web page and executable by a Flash media player plug-in.
  • one or more described webpages may be associated with or accessed by social networking system 520 a .
  • This disclosure contemplates using any suitable application for the retrieval and rendering of structured documents hosted by any suitable network-addressable resource or website.
  • Application event data of a game is any data relevant to the game (e.g., player inputs).
  • each application datum may have a name and a value, and the value of the application datum may change (i.e., be updated) at any time.
  • client system 530 may need to inform game networking system 520 b of the update. For example, if the game is a farming game with a harvest mechanic (such as Zynga FarmVille), an event can correspond to a player clicking on a parcel of land to harvest a crop.
  • the application event data may identify an event or action (e.g., harvest) and an object in the game to which the event or action applies.
  • system 500 is discussed in reference to updating a multi-player online game hosted on a network-addressable system (such as, for example, social networking system 520 a or game networking system 520 b ), where an instance of the online game is executed remotely on a client system 530 , which then transmits application event data to the hosting system such that the remote game server synchronizes game state associated with the instance executed by the client system 530 .
  • a network-addressable system such as, for example, social networking system 520 a or game networking system 520 b
  • one or more objects of a game may be represented as an Adobe Flash object.
  • Flash may manipulate vector and raster graphics, and supports bidirectional streaming of audio and video.
  • “Flash” may mean the authoring environment, the player, or the application files.
  • client system 530 may include a Flash client.
  • the Flash client may be configured to receive and run Flash application or game object code from any suitable networking system (such as, for example, social networking system 520 a or game networking system 520 b ).
  • the Flash client may be run in a browser client executed on client system 530 .
  • a player can interact with Flash objects using client system 530 and the Flash client.
  • the Flash objects can represent a variety of in-game objects.
  • the player may perform various in-game actions on various in-game objects by make various changes and updates to the associated Flash objects.
  • in-game actions can be initiated by clicking or similarly interacting with a Flash object that represents a particular in-game object.
  • a player can interact with a Flash object to use, move, rotate, delete, attack, shoot, or harvest an in-game object.
  • This disclosure contemplates performing any suitable in-game action by interacting with any suitable Flash object.
  • the client-executed game logic may update one or more game state parameters associated with the in-game object.
  • the Flash client may send the events that caused the game state changes to the in-game object to game networking system 520 b .
  • the Flash client may collect a batch of some number of events or updates into a batch file. The number of events or updates may be determined by the Flash client dynamically or determined by game networking system 520 b based on server loads or other factors. For example, client system 530 may send a batch file to game networking system 520 b whenever 50 updates have been collected or after a threshold period of time, such as every minute.
  • each application datum may have a name and a value.
  • the value of an application datum may change at any time in response to the game play of a player or in response to the game engine (e.g., based on the game logic).
  • an application data update occurs when the value of a specific application datum is changed.
  • each application event datum may include an action or event name and a value (such as an object identifier).
  • each application datum may be represented as a name-value pair in the batch file.
  • the batch file may include a collection of name-value pairs representing the application data that have been updated at client system 530 .
  • the batch file may be a text file and the name-value pairs may be in string format.
  • game networking system 520 b may serialize all the game-related data, including, for example and without limitation, game states, game events, user inputs, for this particular user and this particular game into a BLOB and stores the BLOB in a database.
  • the BLOB may be associated with an identifier that indicates that the BLOB contains the serialized game-related data for a particular player and a particular online game.
  • the corresponding BLOB may be stored in the database. This enables a player to stop playing the game at any time without losing the current state of the game the player is in.
  • game networking system 520 b may retrieve the corresponding BLOB from the database to determine the most-recent values of the game-related data.
  • game networking system 520 b may also load the corresponding BLOB into a memory cache so that the game system may have faster access to the BLOB and the game-related data contained therein.
  • the Churn Prediction Server 501 may be configured to analyze data including for example, a frequency of users online engagements in the Social Networking System 520 a and/or the Game Networking System 520 b . Based on the analysis of the data, the Churn Prediction Server 501 is able to predict whether a user is likely to churn in the Game Networking System 520 b and/or the Social Networking System 520 a . Furthermore, the Churn Prediction Server 501 can also be configured to provide recommendations to the Game Networking System 520 b on how to improve retaining the user/player to continue playing on the Game Networking System 520 b.
  • FIG. 5B is an example of the Churn Prediction server 501 .
  • the Churn Prediction Server 501 may include an analysis module 502 , a recommendation module 504 , and a storage device 516 .
  • the analysis module 502 is configured to analyze data related to player engagements/interactions on the Game Networking System 520 b and/or the Social Networking System 520 a .
  • the analysis module 502 includes an online engagement monitoring module 506 , an online engagement score module 508 , a moving average computation module 510 , a churn prediction module 512 , and a churn probability module 514 .
  • the recommendation module 504 is configured to provide a recommendation to the Game Networking System 520 b on strategies for improving retaining a player on the Game Networking System 520 b and increasing the player's online engagements and interactions on the Game Networking System 520 b.
  • the storage device 516 may store data related to the modules 506 , 508 , 510 , 512 , 514 , and the recommendation module 504 for further analysis.
  • the storage device 516 may store historical trends and baseline values of users based on the data related to user communications and interactions on the Game Networking System 520 b and/or the Social Networking System 520 a.
  • the online engagement monitoring module 506 monitors online engagements of a group of players of an online game during a churn prediction model training period, the training period comprising the last first number of days.
  • the online engagement score module 508 computes online engagement scores for the group of players based on a number of days the group of players has played on the online game within a periodic number of days within the churn model training period.
  • the moving average computation module 510 assigns exponential weights to the online engagement scores so that a weight of an online engagement score is higher when occurred more recently.
  • the moving average computation module 510 uses the exponential weights to compute a weighted exponential moving average of the online engagement scores of the group of players of the online game during the churn model training period.
  • the churn prediction module 512 uses the weighted exponential moving average of the online engagement scores of the group of players of the online game to determine an online engagement threshold value of a churn prediction model for the online game.
  • the churn probability module 514 applies the online engagement threshold value to a weighted exponential moving average of an online engagement score of a player during an observation period comprising the last second number of days to determine a churn probability of the player within a prediction period comprising the next third number of days.
  • the storage device 516 stores the weighted exponential moving average of the online engagement scores of the group of players of the online game during the churn model training period, the online engagement threshold value of a churn prediction model for the online game for the churn model training period, and the churn probability of the player within the prediction period.
  • one or more described webpages may be associated with a networking system or networking service.
  • alternate embodiments may have application to the retrieval and rendering of structured documents hosted by any type of network addressable resource or web site.
  • a user may be an individual, a group, or an entity (such as a business or third party application).
  • FIG. 6 illustrates an example network environment, in which various example embodiments may operate.
  • Network cloud 660 generally represents one or more interconnected networks, over which the systems and hosts described herein can communicate.
  • Network cloud 660 may include packet-based wide area networks (such as the Internet), private networks, wireless networks, satellite networks, cellular networks, paging networks, and the like.
  • FIG. 6 illustrates, particular embodiments may operate in a network environment comprising one or more networking systems, such as social networking system 620 a , game networking system 620 b , and one or more client systems 630 .
  • Client systems 630 are operably connected to the network environment via a network service provider, a wireless carrier, or any other suitable means.
  • Networking system 620 is a network addressable system that, in various example embodiments, comprises one or more physical servers 622 and data stores 624 .
  • the one or more physical servers 622 are operably connected to computer network 660 via, by way of example, a set of routers and/or networking switches 626 .
  • the functionality hosted by the one or more physical servers 122 may include web or HTTP servers, FTP servers, as well as, without limitation, webpages and applications implemented using Common Gateway Interface (CGI) script, PHP Hyper-text Preprocessor (PHP), Active Server Pages (ASP), Hyper Text Markup Language (HTML), Extensible Markup Language (XML), Java, JavaScript, Asynchronous JavaScript and XML (AJAX), Flash, ActionScript, and the like.
  • CGI Common Gateway Interface
  • PHP PHP Hyper-text Preprocessor
  • ASP Active Server Pages
  • HTML Hyper Text Markup Language
  • XML Extensible Markup Language
  • Java Java
  • JavaScript JavaScript
  • AJAX Asynchronous JavaScript and XML
  • Physical servers 622 may host functionality directed to the operations of networking system 620 .
  • servers 622 may be referred to as server 622 , although server 622 may include numerous servers hosting, for example, networking system 620 , as well as other content distribution servers, data stores, and databases.
  • Data store 624 may store content and data relating to, and enabling, operation of networking system 620 as digital data objects.
  • a data object in particular embodiments, is an item of digital information typically stored or embodied in a data file, database, or record.
  • Content objects may take many forms, including: text (e.g., ASCII, SGML, HTML), images (e.g., jpeg, tif and gif), graphics (vector-based or bitmap), audio, video (e.g., mpeg), or other multimedia, and combinations thereof.
  • Content object data may also include executable code objects (e.g., games executable within a browser window or frame), podcasts, etc.
  • Logically, data store 624 corresponds to one or more of a variety of separate and integrated databases, such as relational databases and object-oriented databases, that maintain information as an integrated collection of logically related records or files stored on one or more physical systems.
  • data store 624 may generally include one or more of a large class of data storage and management systems.
  • data store 624 may be implemented by any suitable physical system(s) including components, such as one or more database servers, mass storage media, media library systems, storage area networks, data storage clouds, and the like.
  • data store 624 includes one or more servers, databases (e.g., MySQL), and/or data warehouses.
  • Data store 624 may include data associated with different networking system 620 users and/or client systems 630 .
  • Client system 630 is generally a computer or computing device including functionality for communicating (e.g., remotely) over a computer network.
  • Client system 630 may be a desktop computer, laptop computer, personal digital assistant (PDA), in- or out-of-car navigation system, smart phone or other cellular or mobile phone, or mobile gaming device, among other suitable computing devices.
  • Client system 630 may execute one or more client applications, such as a web browser (e.g., Microsoft Internet Explorer, Mozilla Firefox, Apple Safari, Google Chrome, and Opera), to access and view content over a computer network.
  • client applications allow a user of client system 630 to enter addresses of specific network resources to be retrieved, such as resources hosted by networking system 620 . These addresses can be Uniform Resource Locators (URLs) and the like.
  • URLs Uniform Resource Locators
  • the client applications may provide access to other pages or records when the user “clicks” on hyperlinks to other resources.
  • hyperlinks may be located within the webpages and provide an automated way for the user to enter the URL of another page and to retrieve that page.
  • a webpage or resource embedded within a webpage may include data records, such as plain textual information, or more complex digitally encoded multimedia content, such as software programs or other code objects, graphics, images, audio signals, videos, and so forth.
  • One prevalent markup language for creating webpages is the Hypertext Markup Language (HTML).
  • HTML Hypertext Markup Language
  • Other common web browser-supported languages and technologies include the Extensible Markup Language (XML), the Extensible Hypertext Markup Language (XHTML), JavaScript, Flash, ActionScript, Cascading Style Sheet (CSS), and, frequently, Java.
  • HTML enables a page developer to create a structured document by denoting structural semantics for text and links, as well as images, web applications, and other objects that can be embedded within the page.
  • a webpage may be delivered to a client as a static document; however, through the use of web elements embedded in the page, an interactive experience may be achieved with the page or a sequence of pages.
  • the web browser interprets and displays the pages and associated resources received or retrieved from the website hosting the page, as well as, potentially, resources from other websites.
  • the user's web browser When a user at a client system 630 desires to view a particular webpage (hereinafter also referred to as target structured document) hosted by networking system 620 , the user's web browser, or other document rendering engine or suitable client application, formulates and transmits a request to networking system 620 .
  • the request generally includes a URL or other document identifier as well as metadata or other information.
  • the request may include information identifying the user, such as a user ID, as well as information identifying or characterizing the web browser or operating system running on the user's client computing device 630 .
  • the request may also include location information identifying a geographic location of the user's client system or a logical network location of the user's client system.
  • the request may also include a timestamp identifying when the request was transmitted.
  • the network environment described above and illustrated in FIG. 6 described with respect to social networking system 620 a and game networking system 620 b , this disclosure encompasses any suitable network environment using any suitable systems.
  • the network environment may include online media systems, online reviewing systems, online search engines, online advertising systems, or any combination of two or more such systems.
  • FIG. 7 illustrates an example computing system architecture, which may be used to implement a server 622 or a client system 630 .
  • hardware system 700 comprises a processor 702 , a cache memory 704 , and one or more executable modules and drivers, stored on a tangible computer readable medium, directed to the functions described herein.
  • hardware system 700 may include a high performance input/output (I/O) bus 706 and a standard I/O bus 708 .
  • a host bridge 710 may couple processor 702 to high performance I/O bus 706
  • I/O bus bridge 712 couples the two buses 706 and 708 to each other.
  • a system memory 714 and one or more network/communication interfaces 716 may couple to bus 706 .
  • Hardware system 700 may further include video memory (not shown) and a display device coupled to the video memory. Mass storage 718 and I/O ports 720 may couple to bus 708 . Hardware system 700 may optionally include a keyboard, a pointing device, and a display device (not shown) coupled to bus 708 . Collectively, these elements are intended to represent a broad category of computer hardware systems, including but not limited to general purpose computer systems based on the x86-compatible processors manufactured by Intel Corporation of Santa Clara, Calif., and the x86-compatible processors manufactured by Advanced Micro Devices (AMD), Inc., of Sunnyvale, Calif., as well as any other suitable processor.
  • AMD Advanced Micro Devices
  • network interface 716 provides communication between hardware system 700 and any of a wide range of networks, such as an Ethernet (e.g., IEEE 802.3) network, a backplane, etc.
  • Mass storage 718 provides permanent storage for the data and programming instructions to perform the above-described functions implemented in servers 422
  • system memory 714 e.g., DRAM
  • I/O ports 720 are one or more serial and/or parallel communication ports that provide communication between additional peripheral devices, which may be coupled to hardware system 700 .
  • Hardware system 700 may include a variety of system architectures and various components of hardware system 700 may be rearranged.
  • cache 704 may be on-chip with processor 702 .
  • cache 704 and processor 702 may be packed together as a “processor module,” with processor 702 being referred to as the “processor core.”
  • certain embodiments of the present disclosure may not require nor include all of the above components.
  • the peripheral devices shown coupled to standard I/O bus 708 may couple to high performance I/O bus 706 .
  • only a single bus may exist, with the components of hardware system 700 being coupled to the single bus.
  • hardware system 700 may include additional components, such as additional processors, storage devices, or memories.
  • An operating system manages and controls the operation of hardware system 700 , including the input and output of data to and from software applications (not shown).
  • the operating system provides an interface between the software applications being executed on the system and the hardware components of the system.
  • Any suitable operating system may be used, such as the LINUX Operating System, the Apple Macintosh Operating System, available from Apple Computer Inc. of Cupertino, Calif., UNIX operating systems, Microsoft (r) Windows(r) operating systems, BSD operating systems, and the like.
  • the functions described herein may be implemented in firmware or on an application-specific integrated circuit.
  • the above-described elements and operations can be comprised of instructions that are stored on non-transitory storage media.
  • the instructions can be retrieved and executed by a processing system.
  • Some examples of instructions are software, program code, and firmware.
  • Some examples of non-transitory storage media are memory devices, tape, disks, integrated circuits, and servers.
  • the instructions are operational when executed by the processing system to direct the processing system to operate in accord with the disclosure.
  • processing system refers to a single processing device or a group of inter-operational processing devices. Some examples of processing devices are integrated circuits and logic circuitry. Those skilled in the art are familiar with instructions, computers, and storage media.
  • web service and “website” may be used interchangeably and additionally may refer to a custom or generalized API on a device, such as a mobile device (e.g., cellular phone, smart phone, personal GPS, personal digital assistance, personal gaming device, etc.), that makes API calls directly to a server.
  • a mobile device e.g., cellular phone, smart phone, personal GPS, personal digital assistance, personal gaming device, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Computer Security & Cryptography (AREA)
  • General Business, Economics & Management (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

A method and a system for predicting churn of a player of an online game is described. Online engagements of a group of players of the online game are monitored during a churn prediction model training period. Online engagement scores for the group of players are computed within a periodic number of days within the churn model training period. A weighted exponential moving average of the online engagement scores of the group of players of the online game is computed during the churn model training period. The weighted exponential moving average is used to determine an online engagement threshold value of a churn prediction model for the online game. The online engagement threshold value is applied to a weighted exponential moving average of a player during an observation period to determine a churn probability of the player within a prediction period.

Description

CROSS-REFERENCE TO RELATED APPLICATION
The present application claims the benefit of U.S. Provisional Patent Application Ser. No. 61/588,589, filed Jan. 19, 2012, entitled “METHOD TO DETECT AND SCORE CHURN IN ONLINE SOCIAL GAMES”, which is incorporated herein by reference in its entirety.
TECHNICAL FIELD
The present disclosure generally relates to games and applications in general and, in particular embodiments, to computer-implemented, online social games.
BACKGROUND
Online social games are becoming widespread. The success of an online social game depends on the number of players and how often these players visit the online social game. As such, the retention of online players to visiting the online social games is an important factor towards the success of the online social games.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings in which:
FIG. 1 illustrates an example embodiment of a system for implementing particular disclosed embodiments.
FIG. 2 illustrates an example embodiment of a social network.
FIG. 3 illustrates a flow diagram of an example embodiment of a method for detecting and scoring churn in online social games.
FIG. 4 illustrates a flow diagram of another example embodiment of a method for increasing retention using churn prediction in online social games.
FIG. 5A illustrates an example embodiment of a data flow in a system.
FIG. 5B is an example embodiment of a churn prediction server.
FIG. 6 illustrates an example embodiment of a network environment.
FIG. 7 illustrates an example embodiment of a computer system architecture.
FIG. 8 is a block diagram illustrating an example of a timeline for churn prediction.
FIG. 9 illustrates an example of a table illustrating the weighting scheme with their corresponding online engagement scores.
DETAILED DESCRIPTION
Although the present invention has been described with reference to specific example embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the invention. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.
A method and a system for predicting churn of a player of an online game is described. Online engagements of a group of players of an online game are monitored during a churn prediction model training period. The churn prediction model training period includes the last first number of days (e.g., last 90 days). Online engagement scores for the group of players are computed based on a number of days the group of players has played on the online game within a periodic number of days (e.g., a week) within the churn model training period (e.g. last 90 days). Exponential weights are assigned to the online engagement scores so that a weight of an online engagement score is higher when occurred more recently. The exponential weights are used to compute a weighted exponential moving average of the online engagement scores of the group of players of the online game during the churn model training period (e.g., last 90 days). The weighted exponential moving average of the online engagement scores of the group of players of the online game is used to determine an online engagement threshold value of a churn prediction model for the online game. The online engagement threshold value is applied to a weighted exponential moving average of an online engagement score of a player during an observation period comprising the last second number of days (e.g., last 30 days) to determine a churn probability of the player within a prediction period comprising the next third number of days (e.g., the next 30 days).
Game Networking System
FIG. 1 illustrates an example of a system for implementing various disclosed embodiments. In particular embodiments, system 100 comprises player 101, social networking system 120 a, game networking system 120 b, client system 130, and network 160. The components of system 100 can be connected to each other in any suitable configuration, using any suitable type of connection. The components may be connected directly or over a network 160, which may be any suitable network. For example, one or more portions of network 160 may be an ad hoc network, an intranet, an extranet, a virtual private network (VPN), a local area network (LAN), a wireless LAN (WLAN), a wide area network (WAN), a wireless WAN (WWAN), a metropolitan area network (MAN), a portion of the Internet, a portion of the Public Switched Telephone Network (PSTN), a cellular telephone network, another type of network, or a combination of two or more such networks.
Social network system 120 a is a network-addressable computing system that can host one or more social graphs. Social networking system 120 a can generate, store, receive, and transmit social networking data. Social networking system 120 a can be accessed by the other components of system 100 either directly or via network 160. Game networking system 120 b is a network-addressable computing system that can host one or more online games. Game networking system 120 b can generate, store, receive, and transmit game-related data, such as, for example, game account data, game input, game state data, and game displays. Game networking system 120 b can be accessed by the other components of system 100 either directly or via network 160. Player 101 may use client system 130 to access, send data to, and receive data from social network system 120 a and game networking system 120 b. Client system 130 can access social networking system 120 a or game networking system 120 b directly, via network 160, or via a third-party system. As an example and not by way of limitation, client system 130 may access game networking system 120 b via social networking system 120 a. Client system 130 can be any suitable computing device, such as a personal computer, laptop, cellular phone, smart phone, computing tablet, etc.
Although FIG. 1 illustrates a particular number of players 101, social networking system 120 a, game networking system 120 b, client system 130, and network 160, this disclosure contemplates any suitable number of players 101, social networking systems 120 a, game networking systems 120 b, client systems 130, and networks 160. As an example and not by way of limitation, system 100 may include one or more game networking systems 120 b and no social networking systems 120 a. As another example and not by way of limitation, system 100 may include a system that comprises both social networking system 120 a and game networking system 120 b. Moreover, although FIG. 1 illustrates a particular arrangement of player 101, social networking system 120 a, game networking system 120 b, client system 130, and network 160, this disclosure contemplates any suitable arrangement of player 101, social network system 120 a, game networking system 120 b, client system 130, and network 160.
The components of system 100 may be connected to each other using any suitable connections 110. For example, suitable connections 110 include wireline (such as, for example, Digital Subscriber Line (DSL) or Data Over Cable Service Interface Specification (DOCSIS)), wireless (such as, for example, Wi-Fi or Worldwide Interoperability for Microwave Access (WiMAX)) or optical (such as, for example, Synchronous Optical Network (SONET) or Synchronous Digital Hierarchy (SDH)) connections. In particular embodiments, one or more connections 110 each include an ad hoc network, an intranet, an extranet, a VPN, a LAN, a WLAN, a WAN, a WWAN, a MAN, a portion of the Internet, a portion of the PSTN, a cellular telephone network, or another type of connection, or a combination of two or more such connections. Connections 110 need not necessarily be the same throughout system 100. One or more first connections 110 may differ in one or more respects from one or more second connections 110. Although FIG. 1 illustrates particular connections between player 101, social networking system 120 a, game networking system 120 b, client system 130, and network 160, this disclosure contemplates any suitable connections between player 101, social networking system 120 a, game networking system 120 b, client system 130, and network 160. As an example and not by way of limitation, in particular embodiments, client system 130 may have a direct connection to social networking system 120 a or game networking system 120 b, bypassing network 160.
In an online computer game, a game engine manages the game state of the game. Game state comprises all game play parameters, including player character state, non-player character (NPC) state, in-game object state, game world state (e.g., internal game clocks, game environment), and other game play parameters. Each player 101 controls one or more player characters (PCs). The game engine controls all other aspects of the game, including non-player characters (NPCs), and in-game objects. The game engine also manages game state, including player character state for currently active (online) and inactive (offline) players.
An online game can be hosted by game networking system 120 b, which can be accessed using any suitable connection with a suitable client system 130. A player may have a game account on game networking system 120 b, wherein the game account can contain a variety of information associated with the player (e.g., the player's personal information, financial information, purchase history, player character state, game state). In some embodiments, a player may play multiple games on game networking system 120 b, which may maintain a single game account for the player with respect to all the games, or multiple individual game accounts for each game with respect to the player. In some embodiments, game networking system 120 b can assign a unique identifier to each player 101 of an online game hosted on game networking system 120 b. Game networking system 120 b can determine that a player 101 is accessing the online game by reading the user's cookies, which may be appended to HTTP requests transmitted by client system 130, and/or by the player 101 logging onto the online game.
In particular embodiments, player 101 may access an online game and control the game's progress via client system 130 (e.g., by inputting commands to the game at the client device). Client system 130 can display the game interface, receive inputs from player 101, transmitting user inputs or other events to the game engine, and receive instructions from the game engine. The game engine can be executed on any suitable system (such as, for example, client system 130, social networking system 120 a, or game networking system 120 b). As an example and not by way of limitation, client system 130 can download client components of an online game, which are executed locally, while a remote game server, such as game networking system 120 b, provides backend support for the client components and may be responsible for maintaining application data of the game, processing the inputs from the player, updating and/or synchronizing the game state based on the game logic and each input from the player, and transmitting instructions to client system 130. As another example and not by way of limitation, each time player 101 provides an input to the game through the client system 130 (such as, for example, by typing on the keyboard or clicking the mouse of client system 130), the client components of the game may transmit the player's input to game networking system 120 b.
Game Systems, Social Networks, and Social Graphs
In an online multiplayer game, players may control player characters (PCs), a game engine controls non-player characters (NPCs) and game features, and the game engine also manages player character state and game state and tracks the state for currently active (i.e., online) players and currently inactive (i.e., offline) players. A player character can have a set of attributes and a set of friends associated with the player character. As used herein, the term “player character state” can refer to any in-game characteristic of a player character, such as location, assets, levels, condition, health, status, inventory, skill set, name, orientation, affiliation, specialty, and so on. Player characters may be displayed as graphical avatars within a user interface of the game. In other implementations, no avatar or other graphical representation of the player character is displayed. Game state encompasses the notion of player character state and refers to any parameter value that characterizes the state of an in-game element, such as a non-player character, a virtual object (such as a wall or castle), etc. The game engine may use player character state to determine the outcome of game events, sometimes also considering set or random variables. Generally, a player character's probability of having a more favorable outcome is greater when the player character has a better state. For example, a healthier player character is less likely to die in a particular encounter relative to a weaker player character or non-player character. In some embodiments, the game engine can assign a unique client identifier to each player.
In particular embodiments, player 101 may access particular game instances of an online game. A game instance is copy of a specific game play area that is created during runtime. In particular embodiments, a game instance is a discrete game play area where one or more players 101 can interact in synchronous or asynchronous play. A game instance may be, for example, a level, zone, area, region, location, virtual space, or other suitable play area. A game instance may be populated by one or more in-game objects. Each object may be defined within the game instance by one or more variables, such as, for example, position, height, width, depth, direction, time, duration, speed, color, and other suitable variables. A game instance may be exclusive (i.e., accessible by specific players) or non-exclusive (i.e., accessible by any player). In particular embodiments, a game instance is populated by one or more player characters controlled by one or more players 101 and one or more in-game objects controlled by the game engine. When accessing an online game, the game engine may allow player 101 to select a particular game instance to play from a plurality of game instances. Alternatively, the game engine may automatically select the game instance that player 101 will access. In particular embodiments, an online game comprises only one game instance that all players 101 of the online game can access.
In particular embodiments, a specific game instance may be associated with one or more specific players. A game instance is associated with a specific player when one or more game parameters of the game instance are associated with the specific player. As an example and not by way of limitation, a game instance associated with a first player may be named “First Player's Play Area.” This game instance may be populated with the first player's PC and one or more in-game objects associated with the first player. In particular embodiments, a game instance associated with a specific player may only be accessible by that specific player. As an example and not by way of limitation, a first player may access a first game instance when playing an online game, and this first game instance may be inaccessible to all other players. In other embodiments, a game instance associated with a specific player may be accessible by one or more other players, either synchronously or asynchronously with the specific player's game play. As an example and not by way of limitation, a first player may be associated with a first game instance, but the first game instance may be accessed by all first-degree friends in the first player's social network. In particular embodiments, the game engine may create a specific game instance for a specific player when that player accesses the game. As an example and not by way of limitation, the game engine may create a first game instance when a first player initially accesses an online game, and that same game instance may be loaded each time the first player accesses the game. As another example and not by way of limitation, the game engine may create a new game instance each time a first player accesses an online game, wherein each game instance may be created randomly or selected from a set of predetermined game instances. In particular embodiments, the set of in-game actions available to a specific player may be different in a game instance that is associated with that player compared to a game instance that is not associated with that player. The set of in-game actions available to a specific player in a game instance associated with that player may be a subset, superset, or independent of the set of in-game actions available to that player in a game instance that is not associated with him. As an example and not by way of limitation, a first player may be associated with Blackacre Farm in an online farming game. The first player may be able to plant crops on Blackacre Farm. If the first player accesses game instance associated with another player, such as Whiteacre Farm, the game engine may not allow the first player to plant crops in that game instance. However, other in-game actions may be available to the first player, such as watering or fertilizing crops on Whiteacre Farm.
In particular embodiments, a game engine can interface with a social graph. Social graphs are models of connections between entities (e.g., individuals, users, contacts, friends, players, player characters, non-player characters, businesses, groups, associations, concepts, etc.). These entities are considered “users” of the social graph; as such, the terms “entity” and “user” may be used interchangeably when referring to social graphs herein. A social graph can have a node for each entity and edges to represent relationships between entities. A node in a social graph can represent any entity. In particular embodiments, a unique client identifier can be assigned to each user in the social graph. This disclosure assumes that at least one entity of a social graph is a player or player character in an online multiplayer game, though this disclosure any suitable social graph users.
The minimum number of edges required to connect a player (or player character) to another user is considered the degree of separation between them. For example, where the player and the user are directly connected (one edge), they are deemed to be separated by one degree of separation. The user would be a so-called “first-degree friend” of the player. Where the player and the user are connected through one other user (two edges), they are deemed to be separated by two degrees of separation. This user would be a so-called “second-degree friend” of the player. Where the player and the user are connected through N edges (or N-1 other users), they are deemed to be separated by N degrees of separation. This user would be a so-called “Nth-degree friend.” As used herein, the term “friend” means only first-degree friends, unless context suggests otherwise.
Within the social graph, each player (or player character) has a social network. A player's social network includes all users in the social graph within Nmax degrees of the player, where Nmax is the maximum degree of separation allowed by the system managing the social graph (such as, for example, social networking system 120 a or game networking system 120 b). In one embodiment, Nmax equals 1, such that the player's social network includes only first-degree friends. In another embodiment, Nmax is unlimited and the player's social network is coextensive with the social graph.
In particular embodiments, the social graph is managed by game networking system 120 b, which is managed by the game operator. In other embodiments, the social graph is part of a social networking system 120 a managed by a third-party (e.g., Facebook, Friendster, Myspace). In yet other embodiments, player 101 has a social network on both game networking system 120 b and social networking system 120 a, wherein player 101 can have a social network on the game networking system 120 b that is a subset, superset, or independent of the player's social network on social networking system 120 a. In such combined systems, game network system 120 b can maintain social graph information with edge type attributes that indicate whether a given friend is an “in-game friend,” an “out-of-game friend,” or both. The various embodiments disclosed herein are operable when the social graph is managed by social networking system 120 a, game networking system 120 b, or both.
FIG. 2 shows an example of a social network within a social graph. As shown, Player 201 can be associated, connected or linked to various other users, or “friends,” within the social network 250. These associations, connections or links can track relationships between users within the social network 250 and are commonly referred to as online “friends” or “friendships” between users. Each friend or friendship in a particular user's social network within a social graph is commonly referred to as a “node.” For purposes of illustration and not by way of limitation, the details of social network 250 will be described in relation to Player 201. As used herein, the terms “player” and “user” can be used interchangeably and can refer to any user or character in an online multiuser game system or social networking system. As used herein, the term “friend” can mean any node within a player's social network.
As shown in FIG. 2, Player 201 has direct connections with several friends. When Player 201 has a direct connection with another individual that connection is referred to as a first-degree friend. In social network 250, Player 201 has two first-degree friends. That is, Player 201 is directly connected to Friend 11 211 and Friend 21 221. In a social graph, it is possible for individuals to be connected to other individuals through their first-degree friends (i.e., friends of friends). As described above, each edge required to connect a player to another user is considered the degree of separation. For example, FIG. 2 shows that Player 201 has three second-degree friends to which he is connected via his connection to his first-degree friends. Second-degree Friend 12 212 and Friend 22 222 are connected to Player 201 via his first-degree Friend 11 211. The limit on the depth of friend connections, or the number of degrees of separation for associations, that Player 201 is allowed is typically dictated by the restrictions and policies implemented by social networking system 120 a.
In various embodiments, Player 201 can have Nth-degree friends connected to him through a chain of intermediary degree friends as indicated in FIG. 2. For example, Nth-degree Friend 1N 219 is connected to Player 201 via second-degree Friend 32 232 and one or more other higher-degree friends. Various embodiments may take advantage of and utilize the distinction between the various degrees of friendship relative to Player 201.
In particular embodiments, a player (or player character) can have a social graph within an online multiplayer game that is maintained by the game engine and another social graph maintained by a separate social networking system. FIG. 2 depicts an example of in-game social network 260 and out-of-game social network 250. In this example, Player 201 has out-of-game connections 255 to a plurality of friends, forming out-of-game social network 250. Here, Friend 11 211 and Friend 21 221 are first-degree friends with Player 201 in his out-of-game social network 250. Player 201 also has in-game connections 265 to a plurality of players, forming in-game social network 260. Here, Friend 21 221, Friend 31 231, and Friend 41 241 are first-degree friends with Player 201 in his in-game social network 260. In some embodiments, it is possible for a friend to be in both the out-of-game social network 250 and the in-game social network 260. Here, Friend 21 221 has both an out-of-game connection 255 and an in-game connection 265 with Player 201, such that Friend 21 221 is in both Player 201's in-game social network 260 and Player 201's out-of-game social network 250.
As with other social networks, Player 201 can have second-degree and higher-degree friends in both his in-game and out of game social networks. In some embodiments, it is possible for Player 201 to have a friend connected to him both in his in-game and out-of-game social networks, wherein the friend is at different degrees of separation in each network. For example, if Friend 22 222 had a direct in-game connection with Player 201, Friend 22 222 would be a second-degree friend in Player 201's out-of-game social network, but a first-degree friend in Player 201's in-game social network. In particular embodiments, a game engine can access in-game social network 260, out-of-game social network 250, or both.
In particular embodiments, the connections in a player's in-game social network can be formed both explicitly (e.g., users must “friend” each other) and implicitly (e.g., system observes user behaviors and “friends” users to each other). Unless otherwise indicated, reference to a friend connection between two or more players can be interpreted to cover both explicit and implicit connections, using one or more social graphs and other factors to infer friend connections. The friend connections can be unidirectional or bidirectional. It is also not a limitation of this description that two players who are deemed “friends” for the purposes of this disclosure are not friends in real life (i.e., in disintermediated interactions or the like), but that could be the case.
A game event may be an outcome of an engagement, a provision of access, rights and/or benefits, or the obtaining of some assets (e.g., health, money, strength, inventory, land, etc.). A game engine determines the outcome of a game event according to a variety of factors, such as the game rules, a player character's in-game actions, player character state, game state, interactions of other player characters, and random calculations. Engagements can include simple tasks (e.g., plant a crop, clean a stove), complex tasks (e.g., build a farm or business, run a café), or other events.
An online game can be hosted by a game networking system, which can be accessed over any suitable network with an appropriate client system. A player may have a game system account on game system, wherein the game system account can contain a variety of information about the player (e.g., the player's personal information, player character state, game state, etc.). In various embodiments, an online game can be embedded into a third-party website. The game can be hosted by the networking system of the third-party website, or it can be hosted on game system and merely accessed via the third-party website. The embedded online game can be hosted solely on a server of game system or using a third-party vendor server. In addition, any combination of the functions of the present disclosure can be hosted on or provided from any number of distributed network resources. For example, one or more executable code objects that implement all or a portion of the game can be downloaded to a client system for execution.
FIG. 3 illustrates a flow diagram of an example of a method for detecting and scoring churn in an online social game. At operation 302, online engagements of a group of players of an online game are monitored during a churn prediction model training period. The churn prediction model training period includes the last first number of days (e.g., last 90 days). For example, a player's engagement may include the number of days the player has played or accessed the online game for each week for a period of 90 days. It should be noted that players from the group of players have already installed the online game during the churn model training period. As such, the maximum online engagement of a player may be seven days a week for the last 90 days. The minimum online engagement of a player may be zero days a week for the last 90 days. Also, the online engagement may vary week by week.
At operation 304, online engagement scores for the group of players are computed based on a number of days the group of players has played on the online game within a periodic number of days (e.g., a week) within the churn model training period (e.g. last 90 days). A score is assigned based on the online engagement. For example, a score of 1 may be assigned when the player has played the online game one day out of a week or a score of 4 may be assigned when the player has played the online game one day a week for four weeks.
At operation 306, exponential weights are assigned to the online engagement scores so that a weight of an online engagement score is higher when occurred more recently. The exponential weights are used to compute a weighted exponential moving average of the online engagement scores of the group of players of the online game during the churn model training period (e.g., last 90 days). The weight is chosen so that a player's engagement score is ranked higher when it occurs more recently as opposed to a player who has strong early engagement but recently tapered off. FIG. 9 illustrates an example of a table 900 illustrating the weighting scheme with their corresponding online engagement scores. Column 902 represents scores of players in the group from 4 weeks prior. Column 904 represents scores of players in the group from 3 weeks prior. Column 906 represents scores of players in the group from 2 weeks prior. Column 908 represents scores of the players the directly preceding week. Column 910 represents the weighted scores of players in the group.
At operation 308, the weighted exponential moving average of the online engagement scores of the group of players of the online game is used to determine an online engagement threshold value of a churn prediction model for the online game. The churn prediction model is generated by training a simple naïve Bayesian classifier that computes the posterior probabilities of a player to be a likely churner based on the learned distributions as well as the priors. For example, the prior probabilities turn out to be 60% for a user to stay in the game and 40% for a user to churn. In that example, the churn model derives a threshold value of 2.4 for the engagement score, meaning that the churn model predicts a player to be a churner if the engagement score is below that threshold value of 2.4.
In one embodiment, the churn score computation algorithm may be as follows:
Churn−score=C.w1*0.4+(0.6)*((C.w2*0.4)+(0.6)*(C.w3*0.4+(0.6)*(C.w4*0.4)))
where w1=s number of days played in previous week, w2=s number of days played 2 weeks ago, w3=s number of days played 3 weeks ago, w4=s number of days played 4 weeks ago
At operation 310, the online engagement threshold value is applied to a weighted exponential moving average of an online engagement score of a player during an observation period comprising the last second number of days (e.g., last 30 days) to determine a churn probability of the player within a prediction period comprising the next third number of days (e.g., the next 30 days). For example, a player having a weighted exponential moving average online engagement score of 2.1 is likely to churn because the score is less than the threshold value of 2.4.
In one embodiment, a probability of whether the player is likely to churn within the next 30 days may be derived by comparing the score of the player and the threshold value.
To illustrate the different time period, FIG. 8 is a block diagram illustrating an example of a timeline for churn prediction. The model training period 812 is before the present date, today 810. The model training period 812 may include for example 90 days. The time period 802 represents a one month period 60 to 90 days before today 810. The time period 804 represents a one month period 30 to 60 days before today 810. The observation period 806 represents a one month period 0 to 30 days before today 810. The observation period 806 is associated with the player. The model training period 812 is associated with the group of players. The prediction period 808 represents the next 30 days after today 810.
FIG. 4 illustrates a flow diagram of an example of a method for increasing retention using churn prediction.
At operation 402, a churn probability of a player with the churn rate model applied to an online engagement history of the player is determined using the process as previously described with respect to FIG. 3.
At operation 404, a message is generated to the player to keep the player engaged in the online game when the churn probability of the player exceeds a predetermined churn probability threshold.
At operation 406, a message is generated to the player to request the player to complete a task in the online game when the churn probability of the player exceeds a predetermined churn probability threshold. For example, the player is invited to complete a new easier task or is given clues to complete an existing task.
At operation 408, another player connected to the player via a social network is identified to help the player complete a task in the online game when the churn probability of the player exceeds a predetermined churn probability threshold.
At operation 410, a message is generated to the player to request help from the other player to complete the task in the online game of the player.
Data Flow
FIG. 5A illustrates an example data flow between the components of system 500. In particular embodiments, system 500 can include client system 530, social networking system 520 a, and game networking system 520 b. The components of system 500 can be connected to each other in any suitable configuration, using any suitable type of connection. The components may be connected directly or over any suitable network. Client system 530, social networking system 520 a, and game networking system 520 b can each have one or more corresponding data stores such as local data store 535, social data store 545, and game data store 565, respectively. Social networking system 520 a and game networking system 520 b can also have one or more servers that can communicate with client system 530 over an appropriate network. Social networking system 520 a and game networking system 520 b can have, for example, one or more internet servers for communicating with client system 530 via the Internet. Similarly, social networking system 520 a and game networking system 520 b can have one or more mobile servers for communicating with client system 530 via a mobile network (e.g., GSM, PCS, Wi-Fi, WPAN, etc.). In some embodiments, one server may be able to communicate with client system 530 over both the Internet and a mobile network. In other embodiments, separate servers can be used.
Client system 530 can receive and transmit data 523 to and from game networking system 520 b. This data can include, for example, webpages, messages, game inputs, game displays, HTTP packets, data requests, transaction information, updates, and other suitable data. At some other time, or at the same time, game networking system 520 b can communicate data 543, 547 (e.g., game state information, game system account information, page info, messages, data requests, updates, etc.) with other networking systems, such as social networking system 520 a (e.g., Facebook, Myspace, etc.). Client system 530 can also receive and transmit data 527 to and from social networking system 520 a. This data can include, for example, webpages, messages, social graph information, social network displays, HTTP packets, data requests, transaction information, updates, and other suitable data.
Communication between client system 530, social networking system 520 a, and game networking system 520 b can occur over any appropriate electronic communication medium or network using any suitable communications protocols. For example, client system 530, as well as various servers of the systems described herein, may include Transport Control Protocol/Internet Protocol (TCP/IP) networking stacks to provide for datagram and transport functions. Of course, any other suitable network and transport layer protocols can be utilized.
In addition, hosts or end-systems described herein may use a variety of higher layer communications protocols, including client-server (or request-response) protocols, such as the HyperText Transfer Protocol (HTTP) and other communications protocols, such as HTTP-S, FTP, SNMP, TELNET, and a number of other protocols, may be used. In addition, a server in one interaction context may be a client in another interaction context. In particular embodiments, the information transmitted between hosts may be formatted as HyperText Markup Language (HTML) documents. Other structured document languages or formats can be used, such as XML, and the like. Executable code objects, such as JavaScript and ActionScript, can also be embedded in the structured documents.
In some client-server protocols, such as the use of HTML over HTTP, a server generally transmits a response to a request from a client. The response may comprise one or more data objects. For example, the response may comprise a first data object, followed by subsequently transmitted data objects. In particular embodiments, a client request may cause a server to respond with a first data object, such as an HTML page, which itself refers to other data objects. A client application, such as a browser, will request these additional data objects as it parses or otherwise processes the first data object.
In particular embodiments, an instance of an online game can be stored as a set of game state parameters that characterize the state of various in-game objects, such as, for example, player character state parameters, non-player character parameters, and virtual item parameters. In particular embodiments, game state is maintained in a database as a serialized, unstructured string of text data as a so-called Binary Large Object (BLOB). When a player accesses an online game on game networking system 520 b, the BLOB containing the game state for the instance corresponding to the player can be transmitted to client system 530 for use by a client-side executed object to process. In particular embodiments, the client-side executable may be a FLASH-based game, which can de-serialize the game state data in the BLOB. As a player plays the game, the game logic implemented at client system 530 maintains and modifies the various game state parameters locally. The client-side game logic may also batch game events, such as mouse clicks, and transmit these events to game networking system 520 b. Game networking system 520 b may itself operate by retrieving a copy of the BLOB from a database or an intermediate memory cache (memcache) layer. Game networking system 520 b can also de-serialize the BLOB to resolve the game state parameters and execute its own game logic based on the events in the batch file of events transmitted by the client to synchronize the game state on the server side. Game networking system 520 b may then re-serialize the game state, now modified, into a BLOB and pass this to a memory cache layer for lazy updates to a persistent database.
With a client-server environment in which the online games may run, one server system, such as game networking system 520 b, may support multiple client systems 530. At any given time, there may be multiple players at multiple client systems 530 all playing the same online game. In practice, the number of players playing the same game at the same time may be very large. As the game progresses with each player, multiple players may provide different inputs to the online game at their respective client systems 530, and multiple client systems 530 may transmit multiple player inputs and/or game events to game networking system 520 b for further processing. In addition, multiple client systems 530 may transmit other types of application data to game networking system 520 b.
In particular embodiments, a computed-implemented game may be a text-based or turn-based game implemented as a series of web pages that are generated after a player selects one or more actions to perform. The web pages may be displayed in a browser client executed on client system 530. As an example and not by way of limitation, a client application downloaded to client system 530 may operate to serve a set of webpages to a player. As another example and not by way of limitation, a computer-implemented game may be an animated or rendered game executable as a stand-alone application or within the context of a webpage or other structured document. In particular embodiments, the computer-implemented game may be implemented using Adobe Flash-based technologies. As an example and not by way of limitation, a game may be fully or partially implemented as a SWF object that is embedded in a web page and executable by a Flash media player plug-in. In particular embodiments, one or more described webpages may be associated with or accessed by social networking system 520 a. This disclosure contemplates using any suitable application for the retrieval and rendering of structured documents hosted by any suitable network-addressable resource or website.
Application event data of a game is any data relevant to the game (e.g., player inputs). In particular embodiments, each application datum may have a name and a value, and the value of the application datum may change (i.e., be updated) at any time. When an update to an application datum occurs at client system 530, either caused by an action of a game player or by the game logic itself, client system 530 may need to inform game networking system 520 b of the update. For example, if the game is a farming game with a harvest mechanic (such as Zynga FarmVille), an event can correspond to a player clicking on a parcel of land to harvest a crop. In such an instance, the application event data may identify an event or action (e.g., harvest) and an object in the game to which the event or action applies. For illustration purposes and not by way of limitation, system 500 is discussed in reference to updating a multi-player online game hosted on a network-addressable system (such as, for example, social networking system 520 a or game networking system 520 b), where an instance of the online game is executed remotely on a client system 530, which then transmits application event data to the hosting system such that the remote game server synchronizes game state associated with the instance executed by the client system 530.
In particular embodiment, one or more objects of a game may be represented as an Adobe Flash object. Flash may manipulate vector and raster graphics, and supports bidirectional streaming of audio and video. “Flash” may mean the authoring environment, the player, or the application files. In particular embodiments, client system 530 may include a Flash client. The Flash client may be configured to receive and run Flash application or game object code from any suitable networking system (such as, for example, social networking system 520 a or game networking system 520 b). In particular embodiments, the Flash client may be run in a browser client executed on client system 530. A player can interact with Flash objects using client system 530 and the Flash client. The Flash objects can represent a variety of in-game objects. Thus, the player may perform various in-game actions on various in-game objects by make various changes and updates to the associated Flash objects. In particular embodiments, in-game actions can be initiated by clicking or similarly interacting with a Flash object that represents a particular in-game object. For example, a player can interact with a Flash object to use, move, rotate, delete, attack, shoot, or harvest an in-game object. This disclosure contemplates performing any suitable in-game action by interacting with any suitable Flash object. In particular embodiments, when the player makes a change to a Flash object representing an in-game object, the client-executed game logic may update one or more game state parameters associated with the in-game object. To ensure synchronization between the Flash object shown to the player at client system 530, the Flash client may send the events that caused the game state changes to the in-game object to game networking system 520 b. However, to expedite the processing and hence the speed of the overall gaming experience, the Flash client may collect a batch of some number of events or updates into a batch file. The number of events or updates may be determined by the Flash client dynamically or determined by game networking system 520 b based on server loads or other factors. For example, client system 530 may send a batch file to game networking system 520 b whenever 50 updates have been collected or after a threshold period of time, such as every minute.
As used herein, the term “application event data” may refer to any data relevant to a computer-implemented game application that may affect one or more game state parameters, including, for example and without limitation, changes to player data or metadata, changes to player social connections or contacts, player inputs to the game, and events generated by the game logic. In particular embodiments, each application datum may have a name and a value. The value of an application datum may change at any time in response to the game play of a player or in response to the game engine (e.g., based on the game logic). In particular embodiments, an application data update occurs when the value of a specific application datum is changed. In particular embodiments, each application event datum may include an action or event name and a value (such as an object identifier). Thus, each application datum may be represented as a name-value pair in the batch file. The batch file may include a collection of name-value pairs representing the application data that have been updated at client system 530. In particular embodiments, the batch file may be a text file and the name-value pairs may be in string format.
In particular embodiments, when a player plays an online game on client system 530, game networking system 520 b may serialize all the game-related data, including, for example and without limitation, game states, game events, user inputs, for this particular user and this particular game into a BLOB and stores the BLOB in a database. The BLOB may be associated with an identifier that indicates that the BLOB contains the serialized game-related data for a particular player and a particular online game. In particular embodiments, while a player is not playing the online game, the corresponding BLOB may be stored in the database. This enables a player to stop playing the game at any time without losing the current state of the game the player is in. When a player resumes playing the game next time, game networking system 520 b may retrieve the corresponding BLOB from the database to determine the most-recent values of the game-related data. In particular embodiments, while a player is playing the online game, game networking system 520 b may also load the corresponding BLOB into a memory cache so that the game system may have faster access to the BLOB and the game-related data contained therein.
Social Networking System 520 a and Game Networking System 520 b communicate with a Churn Prediction Server 501. An API may be provided to interface both Social Networking System 520 a and Game networking system 520 b with the Churn Prediction Server 501. The Churn Prediction Server 501 may be configured to analyze data including for example, a frequency of users online engagements in the Social Networking System 520 a and/or the Game Networking System 520 b. Based on the analysis of the data, the Churn Prediction Server 501 is able to predict whether a user is likely to churn in the Game Networking System 520 b and/or the Social Networking System 520 a. Furthermore, the Churn Prediction Server 501 can also be configured to provide recommendations to the Game Networking System 520 b on how to improve retaining the user/player to continue playing on the Game Networking System 520 b.
FIG. 5B is an example of the Churn Prediction server 501. The Churn Prediction Server 501 may include an analysis module 502, a recommendation module 504, and a storage device 516. The analysis module 502 is configured to analyze data related to player engagements/interactions on the Game Networking System 520 b and/or the Social Networking System 520 a. The analysis module 502 includes an online engagement monitoring module 506, an online engagement score module 508, a moving average computation module 510, a churn prediction module 512, and a churn probability module 514.
The recommendation module 504 is configured to provide a recommendation to the Game Networking System 520 b on strategies for improving retaining a player on the Game Networking System 520 b and increasing the player's online engagements and interactions on the Game Networking System 520 b.
The storage device 516 may store data related to the modules 506, 508, 510, 512, 514, and the recommendation module 504 for further analysis. The storage device 516 may store historical trends and baseline values of users based on the data related to user communications and interactions on the Game Networking System 520 b and/or the Social Networking System 520 a.
The online engagement monitoring module 506 monitors online engagements of a group of players of an online game during a churn prediction model training period, the training period comprising the last first number of days.
The online engagement score module 508 computes online engagement scores for the group of players based on a number of days the group of players has played on the online game within a periodic number of days within the churn model training period.
The moving average computation module 510 assigns exponential weights to the online engagement scores so that a weight of an online engagement score is higher when occurred more recently. The moving average computation module 510 then uses the exponential weights to compute a weighted exponential moving average of the online engagement scores of the group of players of the online game during the churn model training period.
The churn prediction module 512 uses the weighted exponential moving average of the online engagement scores of the group of players of the online game to determine an online engagement threshold value of a churn prediction model for the online game.
The churn probability module 514 applies the online engagement threshold value to a weighted exponential moving average of an online engagement score of a player during an observation period comprising the last second number of days to determine a churn probability of the player within a prediction period comprising the next third number of days.
The storage device 516 stores the weighted exponential moving average of the online engagement scores of the group of players of the online game during the churn model training period, the online engagement threshold value of a churn prediction model for the online game for the churn model training period, and the churn probability of the player within the prediction period.
System and Methods
In particular embodiments, one or more described webpages may be associated with a networking system or networking service. However, alternate embodiments may have application to the retrieval and rendering of structured documents hosted by any type of network addressable resource or web site. Additionally, as used herein, a user may be an individual, a group, or an entity (such as a business or third party application).
Particular embodiments may operate in a wide area network environment, such as the Internet, including multiple network addressable systems. FIG. 6 illustrates an example network environment, in which various example embodiments may operate. Network cloud 660 generally represents one or more interconnected networks, over which the systems and hosts described herein can communicate. Network cloud 660 may include packet-based wide area networks (such as the Internet), private networks, wireless networks, satellite networks, cellular networks, paging networks, and the like. As FIG. 6 illustrates, particular embodiments may operate in a network environment comprising one or more networking systems, such as social networking system 620 a, game networking system 620 b, and one or more client systems 630. The components of social networking system 620 a and game networking system 620 b operate analogously; as such, hereinafter they may be referred to simply at networking system 620. Client systems 630 are operably connected to the network environment via a network service provider, a wireless carrier, or any other suitable means.
Networking system 620 is a network addressable system that, in various example embodiments, comprises one or more physical servers 622 and data stores 624. The one or more physical servers 622 are operably connected to computer network 660 via, by way of example, a set of routers and/or networking switches 626. In an example embodiment, the functionality hosted by the one or more physical servers 122 may include web or HTTP servers, FTP servers, as well as, without limitation, webpages and applications implemented using Common Gateway Interface (CGI) script, PHP Hyper-text Preprocessor (PHP), Active Server Pages (ASP), Hyper Text Markup Language (HTML), Extensible Markup Language (XML), Java, JavaScript, Asynchronous JavaScript and XML (AJAX), Flash, ActionScript, and the like.
Physical servers 622 may host functionality directed to the operations of networking system 620. Hereinafter servers 622 may be referred to as server 622, although server 622 may include numerous servers hosting, for example, networking system 620, as well as other content distribution servers, data stores, and databases. Data store 624 may store content and data relating to, and enabling, operation of networking system 620 as digital data objects. A data object, in particular embodiments, is an item of digital information typically stored or embodied in a data file, database, or record. Content objects may take many forms, including: text (e.g., ASCII, SGML, HTML), images (e.g., jpeg, tif and gif), graphics (vector-based or bitmap), audio, video (e.g., mpeg), or other multimedia, and combinations thereof. Content object data may also include executable code objects (e.g., games executable within a browser window or frame), podcasts, etc. Logically, data store 624 corresponds to one or more of a variety of separate and integrated databases, such as relational databases and object-oriented databases, that maintain information as an integrated collection of logically related records or files stored on one or more physical systems. Structurally, data store 624 may generally include one or more of a large class of data storage and management systems. In particular embodiments, data store 624 may be implemented by any suitable physical system(s) including components, such as one or more database servers, mass storage media, media library systems, storage area networks, data storage clouds, and the like. In one example embodiment, data store 624 includes one or more servers, databases (e.g., MySQL), and/or data warehouses. Data store 624 may include data associated with different networking system 620 users and/or client systems 630.
Client system 630 is generally a computer or computing device including functionality for communicating (e.g., remotely) over a computer network. Client system 630 may be a desktop computer, laptop computer, personal digital assistant (PDA), in- or out-of-car navigation system, smart phone or other cellular or mobile phone, or mobile gaming device, among other suitable computing devices. Client system 630 may execute one or more client applications, such as a web browser (e.g., Microsoft Internet Explorer, Mozilla Firefox, Apple Safari, Google Chrome, and Opera), to access and view content over a computer network. In particular embodiments, the client applications allow a user of client system 630 to enter addresses of specific network resources to be retrieved, such as resources hosted by networking system 620. These addresses can be Uniform Resource Locators (URLs) and the like. In addition, once a page or other resource has been retrieved, the client applications may provide access to other pages or records when the user “clicks” on hyperlinks to other resources. By way of example, such hyperlinks may be located within the webpages and provide an automated way for the user to enter the URL of another page and to retrieve that page.
A webpage or resource embedded within a webpage, which may itself include multiple embedded resources, may include data records, such as plain textual information, or more complex digitally encoded multimedia content, such as software programs or other code objects, graphics, images, audio signals, videos, and so forth. One prevalent markup language for creating webpages is the Hypertext Markup Language (HTML). Other common web browser-supported languages and technologies include the Extensible Markup Language (XML), the Extensible Hypertext Markup Language (XHTML), JavaScript, Flash, ActionScript, Cascading Style Sheet (CSS), and, frequently, Java. By way of example, HTML enables a page developer to create a structured document by denoting structural semantics for text and links, as well as images, web applications, and other objects that can be embedded within the page. Generally, a webpage may be delivered to a client as a static document; however, through the use of web elements embedded in the page, an interactive experience may be achieved with the page or a sequence of pages. During a user session at the client, the web browser interprets and displays the pages and associated resources received or retrieved from the website hosting the page, as well as, potentially, resources from other websites.
When a user at a client system 630 desires to view a particular webpage (hereinafter also referred to as target structured document) hosted by networking system 620, the user's web browser, or other document rendering engine or suitable client application, formulates and transmits a request to networking system 620. The request generally includes a URL or other document identifier as well as metadata or other information. By way of example, the request may include information identifying the user, such as a user ID, as well as information identifying or characterizing the web browser or operating system running on the user's client computing device 630. The request may also include location information identifying a geographic location of the user's client system or a logical network location of the user's client system. The request may also include a timestamp identifying when the request was transmitted.
Although the example network environment described above and illustrated in FIG. 6 described with respect to social networking system 620 a and game networking system 620 b, this disclosure encompasses any suitable network environment using any suitable systems. As an example and not by way of limitation, the network environment may include online media systems, online reviewing systems, online search engines, online advertising systems, or any combination of two or more such systems.
FIG. 7 illustrates an example computing system architecture, which may be used to implement a server 622 or a client system 630. In one embodiment, hardware system 700 comprises a processor 702, a cache memory 704, and one or more executable modules and drivers, stored on a tangible computer readable medium, directed to the functions described herein. Additionally, hardware system 700 may include a high performance input/output (I/O) bus 706 and a standard I/O bus 708. A host bridge 710 may couple processor 702 to high performance I/O bus 706, whereas I/O bus bridge 712 couples the two buses 706 and 708 to each other. A system memory 714 and one or more network/communication interfaces 716 may couple to bus 706. Hardware system 700 may further include video memory (not shown) and a display device coupled to the video memory. Mass storage 718 and I/O ports 720 may couple to bus 708. Hardware system 700 may optionally include a keyboard, a pointing device, and a display device (not shown) coupled to bus 708. Collectively, these elements are intended to represent a broad category of computer hardware systems, including but not limited to general purpose computer systems based on the x86-compatible processors manufactured by Intel Corporation of Santa Clara, Calif., and the x86-compatible processors manufactured by Advanced Micro Devices (AMD), Inc., of Sunnyvale, Calif., as well as any other suitable processor.
The elements of hardware system 700 are described in greater detail below. In particular, network interface 716 provides communication between hardware system 700 and any of a wide range of networks, such as an Ethernet (e.g., IEEE 802.3) network, a backplane, etc. Mass storage 718 provides permanent storage for the data and programming instructions to perform the above-described functions implemented in servers 422, whereas system memory 714 (e.g., DRAM) provides temporary storage for the data and programming instructions when executed by processor 702. I/O ports 720 are one or more serial and/or parallel communication ports that provide communication between additional peripheral devices, which may be coupled to hardware system 700.
Hardware system 700 may include a variety of system architectures and various components of hardware system 700 may be rearranged. For example, cache 704 may be on-chip with processor 702. Alternatively, cache 704 and processor 702 may be packed together as a “processor module,” with processor 702 being referred to as the “processor core.” Furthermore, certain embodiments of the present disclosure may not require nor include all of the above components. For example, the peripheral devices shown coupled to standard I/O bus 708 may couple to high performance I/O bus 706. In addition, in some embodiments, only a single bus may exist, with the components of hardware system 700 being coupled to the single bus. Furthermore, hardware system 700 may include additional components, such as additional processors, storage devices, or memories.
An operating system manages and controls the operation of hardware system 700, including the input and output of data to and from software applications (not shown). The operating system provides an interface between the software applications being executed on the system and the hardware components of the system. Any suitable operating system may be used, such as the LINUX Operating System, the Apple Macintosh Operating System, available from Apple Computer Inc. of Cupertino, Calif., UNIX operating systems, Microsoft (r) Windows(r) operating systems, BSD operating systems, and the like. Of course, other embodiments are possible. For example, the functions described herein may be implemented in firmware or on an application-specific integrated circuit.
Furthermore, the above-described elements and operations can be comprised of instructions that are stored on non-transitory storage media. The instructions can be retrieved and executed by a processing system. Some examples of instructions are software, program code, and firmware. Some examples of non-transitory storage media are memory devices, tape, disks, integrated circuits, and servers. The instructions are operational when executed by the processing system to direct the processing system to operate in accord with the disclosure. The term “processing system” refers to a single processing device or a group of inter-operational processing devices. Some examples of processing devices are integrated circuits and logic circuitry. Those skilled in the art are familiar with instructions, computers, and storage media.
Miscellaneous
One or more features from any embodiment may be combined with one or more features of any other embodiment without departing from the scope of the disclosure.
A recitation of “a”, “an,” or “the” is intended to mean “one or more” unless specifically indicated to the contrary. In addition, it is to be understood that functional operations, such as “awarding”, “locating”, “permitting” and the like, are executed by game application logic that accesses, and/or causes changes to, various data attribute values maintained in a database or other memory.
The present disclosure encompasses all changes, substitutions, variations, alterations, and modifications to the example embodiments herein that a person having ordinary skill in the art would comprehend. Similarly, where appropriate, the appended claims encompass all changes, substitutions, variations, alterations, and modifications to the example embodiments herein that a person having ordinary skill in the art would comprehend.
For example, the methods, game features and game mechanics described herein may be implemented using hardware components, software components, and/or any combination thereof. By way of example, while embodiments of the present disclosure have been described as operating in connection with a networking website, various embodiments of the present disclosure can be used in connection with any communications facility that supports web applications. Furthermore, in some embodiments the term “web service” and “website” may be used interchangeably and additionally may refer to a custom or generalized API on a device, such as a mobile device (e.g., cellular phone, smart phone, personal GPS, personal digital assistance, personal gaming device, etc.), that makes API calls directly to a server. Still further, while the embodiments described above operate with business-related virtual objects (such as stores and restaurants), the invention can be applied to any in-game asset around which a harvest mechanic is implemented, such as a virtual stove, a plot of land, and the like. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense. It will, however, be evident that various modifications and changes may be made thereunto without departing from the broader spirit and scope of the disclosure as set forth in the claims and that the disclosure is intended to cover all modifications and equivalents within the scope of the following claims.
The Abstract of the Disclosure is provided to comply with 37 C.F.R. §1.72(b), requiring an abstract that will allow the reader to quickly ascertain the nature of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, it can be seen that various features are grouped together in a single embodiment for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed embodiment. Thus the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separate embodiment.

Claims (20)

What is claimed is:
1. A computer-implemented method comprising:
monitoring online engagements of a group of players of an online game during a training period;
using at least one processor to compute respective online engagement scores for the
group of players based on how many days each respective player has played the online game within a subset of the training period;
assigning respective exponential weights to the online engagement scores so that the respective exponential weights of the online engagement scores increase with an increase in recency within the training period;
using the exponential weights to compute a group moving average, the group moving average comprising a weighted exponential moving group average of the online engagement scores of the group of players of the online game during the training period;
using the group moving average to determine an online engagement threshold value of a churn prediction model for the online game; and
applying the online engagement threshold value to a player moving average to determine a churn probability of a player for a prediction period outside the training period, the player moving average comprising a weighted exponential moving player average of an online engagement score of the player during an observation period within the training period.
2. The computer-implemented method of claim 1, wherein the observation period is shorter than the training period.
3. The computer-implemented method of claim 1, wherein the online engagement scores for the group of players are based on respective numbers of days per week the group of players played on the online game during the training period.
4. The computer-implemented method of claim 1, further comprising:
generating a message to the player to keep the player engaged in the online game when the churn probability of the player exceeds a predetermined churn probability threshold.
5. The computer-implemented method of claim 1, further comprising:
generating a message to the player to request the player to complete a task in the online game when the churn probability of the player exceeds a predetermined churn probability threshold.
6. The computer-implemented method of claim 1, further comprising: identifying another player connected to the player via a social network to help the player complete a task in the online game when the churn probability of the player exceeds a predetermined churn probability threshold; and generating a message to the player to request help from said another player to complete the task in the online game.
7. The computer-implemented method of claim 1, further comprising:
generating a message to the player to promote another online game when the churn probability of the player exceeds a predetermined churn probability threshold.
8. An apparatus comprising:
an online engagement monitoring module configured to monitor online engagements of a group of players of an online game during a training period;
an online engagement score module configured to compute respective online engagement scores for the group of players based on how many days each respective player has played the online game within a subset of the training period;
a moving average computation module configured to assign respective exponential weights to the online engagement scores so that the respective exponential weights of the online engagement scores increase with an increase in recency within the training period, and to use the exponential weights to compute a group moving average, the group moving average comprising a weighted exponential moving average of the online engagement scores of the group of players of the online game during the training period;
a churn prediction module configured to use the group moving average to determine an online engagement threshold value of a churn prediction model for the online game;
a churn probability module configured to apply the online engagement threshold value to a player moving average to determine a churn probability of a player for a prediction period outside the training period, the player moving average comprising a weighted exponential moving˜average of an online engagement score of the player during an observation period within the training period; and
a storage device coupled to the churn probability module, the storage device configured to store the group moving average, the player moving average, and the churn probability of the player for the prediction period.
9. The apparatus of claim 8, wherein the observation period is shorter than the training period.
10. The apparatus of claim 8, wherein the online engagement scores for the group of players are based on respective numbers of days per week the group of players played on the online game during the training period.
11. The apparatus of claim 8, further comprising:
a recommendation module configured to generate a message to the player to keep the player engaged in the online game when the churn probability of the player exceeds a predetermined churn probability threshold.
12. The apparatus of claim 8, further comprising:
a recommendation module configured to generate a message to the player to request the player to complete a task in the online game when the churn probability of the player exceeds a predetermined churn probability threshold.
13. The apparatus of claim 8, further comprising: a recommendation module configured to identify another player connected to the player via a social network to help the player complete a task in the online game when the churn probability of the player exceeds a predetermined churn probability threshold, and to generate a message to the player to request help from said another player to complete the task in the online game.
14. The apparatus of claim 8, further comprising:
a recommendation module configured to generate a message to the player to promote another online game when the churn probability of the player exceeds a predetermined churn probability threshold.
15. A non-transitory computer-readable storage medium storing a set of instructions that, when executed by a processor, cause the processor to perform operations, comprising:
monitoring online engagements of a group of players of an online game during a training period
computing respective online engagement scores for the group of players based on how many days each respective player has played the online game within a subset of the training period;
assigning respective exponential weights to the online engagement scores so that the respective exponential weights of the online engagement scores increase with an increase in recency within the using training period;
using the exponential weights to compute a group moving average, the group moving average comprising a weighted exponential moving group average of the online engagement scores of the group of players of the online game during the training period;
using the group moving average to determine an online engagement threshold value of a churn prediction model for the online game; and
applying the online engagement threshold value to a player moving average to determine a churn probability of a player for a prediction period outside the training period, the player moving average comprising a weighted exponential moving˜average of an online engagement score of the player during an observation period within the training period.
16. The non-transitory computer-readable storage medium of claim 15, wherein the observation period is shorter than the training period.
17. The non-transitory computer-readable storage medium of claim 15, wherein the online engagement scores for the group of players are based on respective numbers of days per week the group of players played on the online game during the training period.
18. The non-transitory computer-readable storage medium of claim 15, further comprising:
generating a message to the player to promote another online game when the churn probability of the player exceeds a predetermined churn probability threshold.
19. The non-transitory computer-readable storage medium of claim 15, further comprising:
generating a message to the player to request the player to complete a task in the online game when the churn probability of the player exceeds a predetermined churn probability threshold.
20. The non-transitory computer-readable storage medium of claim 15, further comprising: identifying another player connected to the player via a social network to help the player complete a task in the online game when the churn probability of the player exceeds a predetermined churn probability threshold; and generating a message to the player to request help from said another player to complete the task in the online game.
US13/436,315 2012-01-19 2012-03-30 Method to detect and score churn in online social games Active US8790168B1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US13/436,315 US8790168B1 (en) 2012-01-19 2012-03-30 Method to detect and score churn in online social games
US14/341,903 US10518167B2 (en) 2012-01-19 2014-07-28 Method to detect and score churn in online social games
US16/700,642 US11278805B2 (en) 2012-01-19 2019-12-02 Method to detect and score churn in online social games

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201261588589P 2012-01-19 2012-01-19
US13/436,315 US8790168B1 (en) 2012-01-19 2012-03-30 Method to detect and score churn in online social games

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/341,903 Continuation US10518167B2 (en) 2012-01-19 2014-07-28 Method to detect and score churn in online social games

Publications (1)

Publication Number Publication Date
US8790168B1 true US8790168B1 (en) 2014-07-29

Family

ID=51212054

Family Applications (3)

Application Number Title Priority Date Filing Date
US13/436,315 Active US8790168B1 (en) 2012-01-19 2012-03-30 Method to detect and score churn in online social games
US14/341,903 Active 2033-03-15 US10518167B2 (en) 2012-01-19 2014-07-28 Method to detect and score churn in online social games
US16/700,642 Active US11278805B2 (en) 2012-01-19 2019-12-02 Method to detect and score churn in online social games

Family Applications After (2)

Application Number Title Priority Date Filing Date
US14/341,903 Active 2033-03-15 US10518167B2 (en) 2012-01-19 2014-07-28 Method to detect and score churn in online social games
US16/700,642 Active US11278805B2 (en) 2012-01-19 2019-12-02 Method to detect and score churn in online social games

Country Status (1)

Country Link
US (3) US8790168B1 (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140274382A1 (en) * 2013-03-12 2014-09-18 King.Com Limited FHS: Smarter Contact Selectors
US20150341232A1 (en) * 2014-05-22 2015-11-26 Facebook, Inc. Daily Counts and Usage Probabilities For a User of an Online Service
US20150360129A1 (en) * 2014-06-12 2015-12-17 International Business Machines Corporation Managing a population of players of online games
US20160089608A1 (en) * 2014-09-30 2016-03-31 International Business Machines Corporation Computer-implemented method for determining game mechanics in business process gamification
US20160107086A1 (en) * 2014-10-21 2016-04-21 Roblox Corporation Game Retention Value Optimization System
CN107634850A (en) * 2017-08-10 2018-01-26 腾讯科技(深圳)有限公司 A kind of application state acquisition methods and its equipment, storage medium, server
US10035070B2 (en) 2013-02-06 2018-07-31 King.Com Ltd. Computer game elements, systems, and methods therefor
US10353764B1 (en) 2018-11-08 2019-07-16 Amplero, Inc. Automated identification of device status and resulting dynamic modification of device operations
US10518167B2 (en) 2012-01-19 2019-12-31 Zynga Inc. Method to detect and score churn in online social games
CN111821694A (en) * 2020-07-24 2020-10-27 北京达佳互联信息技术有限公司 Loss prevention method and device for new game user, electronic equipment and storage medium
CN113457166A (en) * 2021-07-20 2021-10-01 网易(杭州)网络有限公司 Game player churn information processing method, device, equipment and storage medium

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11645288B2 (en) * 2017-11-03 2023-05-09 International Business Machines Corporation Reassigning gamer clusters based on engagement
US11395091B2 (en) * 2020-07-02 2022-07-19 Cisco Technology, Inc. Motion detection triggered wake-up for collaboration endpoints
CN111803957B (en) * 2020-07-17 2024-02-09 网易(杭州)网络有限公司 Method, device, computer equipment and medium for predicting players of online games
US11896908B1 (en) 2021-08-26 2024-02-13 Mythical, Inc. Systems and methods for combining permanent registry information and in-game activity information to determine release logistics
US11617960B1 (en) 2021-08-26 2023-04-04 Mythical, Inc. Systems and methods for using permanent registry information to predict player churn
US11383168B1 (en) 2021-11-02 2022-07-12 Mythical, Inc. Systems and methods for distribution of personalized in-game benefits based on unique digital articles that are recorded on a public permanent registry
US11583772B1 (en) 2022-05-31 2023-02-21 Mythical, Inc. Systems and methods for staking digital articles to upgrade player type in an online game supporting different player types
US11511193B1 (en) 2022-05-31 2022-11-29 Mythical, Inc. Systems and methods for staking combinations of digital articles to upgrade player type in an online game
US11607618B1 (en) 2022-08-17 2023-03-21 Mythical, Inc. Systems and methods for supporting different player types in a franchise game based on ownership of unique digital articles

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050251408A1 (en) * 2004-04-23 2005-11-10 Swaminathan S System and method for conducting intelligent multimedia marketing operations
US20070156673A1 (en) * 2005-12-30 2007-07-05 Accenture S.P.A. Churn prediction and management system
US20070185867A1 (en) * 2006-02-03 2007-08-09 Matteo Maga Statistical modeling methods for determining customer distribution by churn probability within a customer population
US20090132347A1 (en) * 2003-08-12 2009-05-21 Russell Wayne Anderson Systems And Methods For Aggregating And Utilizing Retail Transaction Records At The Customer Level
US20110218045A1 (en) * 2010-03-08 2011-09-08 University Of Southern California Predicting game player monetization based on player logs
US8194830B2 (en) * 2008-01-28 2012-06-05 International Business Machines Corporation Method for predicting churners in a telecommunications network
US8249231B2 (en) * 2008-01-28 2012-08-21 International Business Machines Corporation System and computer program product for predicting churners in a telecommunications network

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4955903B2 (en) * 2001-02-02 2012-06-20 オープンティブイ・インコーポレーテッド Interactive television system management method and computer-readable medium therefor
US7125336B2 (en) * 2001-12-18 2006-10-24 Nokia Corporation Distributed game over a wireless telecommunications network
US7813952B2 (en) * 2002-06-04 2010-10-12 Sap Ag Managing customer loss using customer groups
US20050227751A1 (en) * 2004-03-22 2005-10-13 Zanelli Edward J Video game contest
US20070220010A1 (en) * 2006-03-15 2007-09-20 Kent Thomas Ertugrul Targeted content delivery for networks
US7716149B2 (en) * 2006-04-11 2010-05-11 Palo Alto Research Center Incorporated Method, device, and program product for a social dashboard associated with a persistent virtual environment
US8668585B2 (en) * 2006-08-11 2014-03-11 Disney Enterprises, Inc. Location based gaming system
US8615419B2 (en) * 2008-05-07 2013-12-24 Nice Systems Ltd Method and apparatus for predicting customer churn
US8303413B2 (en) * 2008-06-27 2012-11-06 Microsoft Corporation Live hosting toolset
WO2010009349A1 (en) * 2008-07-18 2010-01-21 Wms Gaming, Inc. Communicating wagering game information using mesh networks
JP2012515932A (en) * 2009-01-21 2012-07-12 ミューシア エルティディー Computer-based system for music performance teaching
US8473970B2 (en) * 2010-02-25 2013-06-25 Oracle International Corporation Framework for integrating applications
US8478709B2 (en) * 2010-03-08 2013-07-02 Hewlett-Packard Development Company, L.P. Evaluation of client status for likelihood of churn
US20110264494A1 (en) * 2010-04-19 2011-10-27 Lechowicz Stephen P System for an incentive-based distribution of a marketing material
US20130132959A1 (en) * 2011-11-23 2013-05-23 Yahoo! Inc. System for generating or using quests
US8790168B1 (en) 2012-01-19 2014-07-29 Zynga Inc. Method to detect and score churn in online social games
US9174128B2 (en) * 2012-04-26 2015-11-03 Zynga Inc. Dynamic quests in game
US8814701B2 (en) * 2012-05-24 2014-08-26 Sap Ag Artificial intelligence avatar to engage players during game play

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090132347A1 (en) * 2003-08-12 2009-05-21 Russell Wayne Anderson Systems And Methods For Aggregating And Utilizing Retail Transaction Records At The Customer Level
US20050251408A1 (en) * 2004-04-23 2005-11-10 Swaminathan S System and method for conducting intelligent multimedia marketing operations
US20070156673A1 (en) * 2005-12-30 2007-07-05 Accenture S.P.A. Churn prediction and management system
US20070185867A1 (en) * 2006-02-03 2007-08-09 Matteo Maga Statistical modeling methods for determining customer distribution by churn probability within a customer population
US8194830B2 (en) * 2008-01-28 2012-06-05 International Business Machines Corporation Method for predicting churners in a telecommunications network
US8249231B2 (en) * 2008-01-28 2012-08-21 International Business Machines Corporation System and computer program product for predicting churners in a telecommunications network
US20110218045A1 (en) * 2010-03-08 2011-09-08 University Of Southern California Predicting game player monetization based on player logs

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Jaya Kawale, et. al., Churn Prediction in MMORPGs: A Social Influence Based Approach, Department of Computer Science and Engineering University of Minnesota, May 20, 2009. *

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11278805B2 (en) 2012-01-19 2022-03-22 Zynga Inc. Method to detect and score churn in online social games
US10518167B2 (en) 2012-01-19 2019-12-31 Zynga Inc. Method to detect and score churn in online social games
US10035070B2 (en) 2013-02-06 2018-07-31 King.Com Ltd. Computer game elements, systems, and methods therefor
US10946290B2 (en) 2013-02-06 2021-03-16 King.Com Ltd. Computer game elements, systems, and methods therefor
US11883747B2 (en) 2013-03-12 2024-01-30 King.Com Ltd. FHS: smarter contact selectors
US11103789B2 (en) 2013-03-12 2021-08-31 King.Com Ltd. FHS: smarter contact selectors
US10576367B2 (en) * 2013-03-12 2020-03-03 King.Com Ltd. FHS: smarter contact selectors
US20140274382A1 (en) * 2013-03-12 2014-09-18 King.Com Limited FHS: Smarter Contact Selectors
US10375198B2 (en) * 2014-05-22 2019-08-06 Facebook, Inc. Daily counts and usage probabilities for a user of an online service
US20150341232A1 (en) * 2014-05-22 2015-11-26 Facebook, Inc. Daily Counts and Usage Probabilities For a User of an Online Service
US20150360130A1 (en) * 2014-06-12 2015-12-17 International Business Machines Corporation Managing a population of players of online games
US20150360129A1 (en) * 2014-06-12 2015-12-17 International Business Machines Corporation Managing a population of players of online games
US20160089608A1 (en) * 2014-09-30 2016-03-31 International Business Machines Corporation Computer-implemented method for determining game mechanics in business process gamification
US9821223B2 (en) * 2014-10-21 2017-11-21 Roblox Corporation Game retention value optimization system
US20160107086A1 (en) * 2014-10-21 2016-04-21 Roblox Corporation Game Retention Value Optimization System
CN107634850A (en) * 2017-08-10 2018-01-26 腾讯科技(深圳)有限公司 A kind of application state acquisition methods and its equipment, storage medium, server
US10353764B1 (en) 2018-11-08 2019-07-16 Amplero, Inc. Automated identification of device status and resulting dynamic modification of device operations
CN111821694A (en) * 2020-07-24 2020-10-27 北京达佳互联信息技术有限公司 Loss prevention method and device for new game user, electronic equipment and storage medium
CN111821694B (en) * 2020-07-24 2024-05-21 北京达佳互联信息技术有限公司 Loss prevention method and device for new game user, electronic equipment and storage medium
CN113457166A (en) * 2021-07-20 2021-10-01 网易(杭州)网络有限公司 Game player churn information processing method, device, equipment and storage medium

Also Published As

Publication number Publication date
US11278805B2 (en) 2022-03-22
US20140335963A1 (en) 2014-11-13
US10518167B2 (en) 2019-12-31
US20200101381A1 (en) 2020-04-02

Similar Documents

Publication Publication Date Title
US11278805B2 (en) Method to detect and score churn in online social games
US11590424B2 (en) Systems and methods for determining game level attributes based on player skill level prior to game play in the level
US10675534B2 (en) Friend recommendation system
US20140004960A1 (en) Dynamic player match-making for social games
US9757650B2 (en) Sequencing and locations of selected virtual objects to trigger targeted game actions
US20200330878A1 (en) Systems and methods for providing efficient game access
US11241626B2 (en) Systems and methods to control movement based on a race event
US20150298007A1 (en) Systems and methods of automatic game creation
US20160067605A1 (en) Systems and methods for indicating positions of selected symbols in a target sequence
US20150283463A1 (en) Systems and methods of dynamically selecting contacts and promoting products
US10482100B1 (en) Method to detect and score users who are likely to make payments in online social games
US20140323226A1 (en) Systems and methods to send game invitations
US20150298008A1 (en) Systems and methods of incentivizing game play
US20140323225A1 (en) Systems and methods for segment-based customization for notifications for users
US9875501B2 (en) Systems and methods for modifying input detection areas
US20140323214A1 (en) Systems and methods present a game variant

Legal Events

Date Code Title Description
AS Assignment

Owner name: ZYNGA INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WOLTERS, HANS;BAER, JIM;KESWANI, GIRISH;REEL/FRAME:028416/0114

Effective date: 20120611

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

CC Certificate of correction
MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551)

Year of fee payment: 4

AS Assignment

Owner name: BANK OF AMERICA, N.A., AS LENDER, CALIFORNIA

Free format text: NOTICE OF GRANT OF SECURITY INTEREST IN PATENTS;ASSIGNOR:ZYNGA INC.;REEL/FRAME:049147/0546

Effective date: 20181220

AS Assignment

Owner name: ZYNGA INC., CALIFORNIA

Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:BANK OF AMERICA, N.A., AS LENDER;REEL/FRAME:054701/0393

Effective date: 20201211

AS Assignment

Owner name: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT, NORTH CAROLINA

Free format text: NOTICE OF GRANT OF SECURITY INTEREST IN PATENTS;ASSIGNOR:ZYNGA INC.;REEL/FRAME:054719/0490

Effective date: 20201211

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8

AS Assignment

Owner name: ZYNGA INC., CALIFORNIA

Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:060163/0437

Effective date: 20220523