Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
  • G06Q30/00—Commerce
  • G06Q30/02—Marketing; Price estimation or determination; Fundraising
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
  • G06Q30/00—Commerce
  • G06Q30/02—Marketing; Price estimation or determination; Fundraising
  • G06Q30/0201—Market modelling; Market analysis; Collecting market data
  • G06Q30/0206—Price or cost determination based on market factors
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
  • G06Q30/00—Commerce
  • G06Q30/02—Marketing; Price estimation or determination; Fundraising
  • G06Q30/0241—Advertisements
  • G06Q30/0242—Determining effectiveness of advertisements
  • G06Q30/0243—Comparative campaigns
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
  • G06Q30/00—Commerce
  • G06Q30/02—Marketing; Price estimation or determination; Fundraising
  • G06Q30/0241—Advertisements
  • G06Q30/0242—Determining effectiveness of advertisements
  • G06Q30/0245—Surveys
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
  • G06Q30/00—Commerce
  • G06Q30/02—Marketing; Price estimation or determination; Fundraising
  • G06Q30/0241—Advertisements
  • G06Q30/0247—Calculate past, present or future revenues
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
  • G06Q30/00—Commerce
  • G06Q30/02—Marketing; Price estimation or determination; Fundraising
  • G06Q30/0241—Advertisements
  • G06Q30/0273—Determination of fees for advertising
  • G06Q30/0275—Auctions
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
  • H04L51/52—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail for supporting social networking services

Definitions

• This invention relates to selecting and presenting advertisements to users in an online service. More particularly, this invention relates to selecting and presenting advertisements to users in an online service based on previously received user feedback responses related to the advertisements.
• Online services such as social networking services, search engines, news aggregators, Internet shopping services, and content delivery services, have become a popular venue for presenting advertisements to prospective buyers.
• Some online services provide their services free of charge or charge only minimal fees. Instead, the online services generate advertisements by presenting the advertisements to users or when the users take certain actions based on the presented advertisements (e.g., clicking of the advertisements).
• the advertisement-based online service model has spawned diverse types of online services.
• the pricing structure widely used in online services for assessing advertisement fees includes, for example, Cost Per Impression (CPI) and Cost Per Action (CPA).
• CPI Cost Per Impression
• CPA Cost Per Action
• the CPI-based pricing structure assesses advertisement fees based on the number of counts an advertisement is loaded and displayed on a user's screen, typically in response to a user's request for a content item.
• the CPA-based pricing structure assesses advertisement fees based on actions taken by the users after the advertisements are displayed on the screen.
• the actions taken into account for the CPA-based pricing structure may include, among others, the following: (i) clicking on the advertisement, (ii) registration to the advertiser's service or product and (iii) conclusion of a sale of a service or product.
• some online services charge a flat fee for displaying an advertisement for a certain amount of time.
• Some online services adopt a bidding system that requires multiple advertisers to compete for advertisement space.
• An advertisement with a higher bidding price is selected and presented to maximize the advertisement fees.
• the bidding price may be based on CPI, CPA or other expected revenue values.
• the bidding system may also employ a cap for limiting the amount of advertisement fees for a set period of time (e.g., day or month).
• Attractive content items tend to increase user traffic and increase the overall advertisement fees collected by the online services.
• online services strive to provide more interesting and attractive content items to the users.
• the number and content of the advertisements may diminish the attractiveness of the content items.
• the content items may become over-populated with advertisements and render the content items less appealing. Further, advertisements irrelevant to the user may degrade user's overall experience associated with the online services.
• some online services analyze information about users and their activities (e.g., search terms used) to target advertisements to the users. These online services estimate or predict the current context of the users' Internet usage based on the user input or user characteristics, and target advertisements most likely to be of interest to the user.
• Embodiments of the invention relate to selecting advertisements for presentation to a user of an online service.
• the online service selects the one or more advertisements from a pool of advertisements based in part on feedback about the advertisements received from a group of users who have previously viewed the advertisements.
• the online service can take into account not only the expected revenue that it will receive from presenting an advertisement to a user, but also the value to the online service of presenting content to its users that is interesting and that creates a positive experience for the users.
• each advertisement is associated with a bid price, from which the online service can determine an expected revenue to the online service if the
• the online service provider also receives feedback from a group of users representing the level of interest explicitly indicated by the group of users for at least a subset of the advertisements. For each of at least a subset of the advertisements, an expected revenue value for presenting the advertisement to a particular user is calculated based on the bid price. A total value for the advertisement is then computed based on the feedback received for the advertisement.
• One or more advertisements are then selected from the plurality of advertisements based at least in part on the total values of the advertisements, thereby accounting for both the direct monetary value to the online service as well as the indirect value to the online service of a positive user experience for its users. The selected one or more advertisements are then sent to the particular user.
• a modifier for each advertisement is computed based on the feedback received from the group of users. Then, then total value of each advertisement is computed by adding the modifier for each advertisement to the expected revenue value of each advertisement. In one embodiment, the modifier is computed by estimating the feedback response from the particular user based on a statistical model. The statistical model may take into account the feedback received from the group of users.
• the online service generates a content item in response to receiving a request for the content item from the particular user.
• the content item may be embedded with the selected advertisements and then sent to the particular user.
• the content item may also include one or more graphical user elements (e.g., icons, symbols, a string of characters or any visual elements) or any combination thereof for receiving the feedback response about the selected advertisements from the user.
• the modifier is computed by deducting a second value from a first value.
• the first value is computed by multiplying a first coefficient to a number of positive feedback responses previously received from the other users.
• the second value is computed by multiplying a second coefficient to a number of negative feedback responses previously received.
• the first and second coefficients may be modified to place emphasis on positive feedback responses or negative feedback responses as well as change weight given to users' expected interest in the advertisement and weight given to the value of the advertisement to the online service provider.
• FIG. 1 is a conceptual diagram illustrating an online service system for selecting and presenting advertisements, according to one embodiment.
• FIG. 2A is a block diagram illustrating an online service computing device, according to one embodiment.
• FIG. 2B is a block diagram illustrating an advertisement selector, according to one embodiment.
• FIG. 3A is a block diagram illustrating a user device for a user to view
• FIG. 3B is a graphical user interface image illustrating a content item loaded and displayed by an Internet browser, according to one embodiment.
• FIG. 3C is a graphical user interface image of a media player displaying an advertisement, according to one embodiment.
• FIG. 4 is a flowchart illustrating processes for selecting and presenting
• Embodiments select advertisements to be presented to a user based on feedback responses previously received from other users where the feedback responses represent the level of interest to the advertisements expressed by the other users.
• a plurality of advertisements may compete for advertisement via an online service.
• the online service takes into account feedback responses previously collected from a group of users as well as revenue that the online service is expected to earn by presenting certain advertisements to the user.
• An online service computing device computes a total value of an advertisement based on an estimated revenue value for presenting an advertisement and a modifier representing the user's estimated interest in the advertisements.
• the online service selects or prioritizes the advertisements based on the total values. Advertisements with more positive feedback responses and/or less negative feedback responses tend to have higher total values, and therefore, such advertisements are more likely to be selected for presentation to the users. In this way, the users' overall experience with the online service can be enhanced, and therefore, attract more users to the online service.
• An expected revenue value represents an advertisement fee expected to be collected by presenting an advertisement to a user.
• the expected revenue value represents the value of the advertisement to an online service provider.
• the expected revenue value can be derived or may be the same as bid price of an advertisement.
• the expected revenue value may be, for example, Cost Per Impression (CPI), Cost Per Click Through (CPC), Cost Per Lead (CPL), Cost Per Sale (CPS) or Cost Per Transaction (CPT).
• a modifier represents a user's level of interest in an advertisement estimated by the online service.
• a higher modifier indicates higher likelihood that the advertisement is of interest to the user. Conversely, a lower modifier indicates less likelihood that the advertisement is of interest to the user.
• the modifier is computed from feedback responses previously received from users with respect to the advertisement.
• An total value refers to a combination of the estimated revenue value of an advertisement and a user's expected interest in the advertisement. Different weights may be assigned to the expected revenue value and the modifiers to change emphasis on the user's expected interest or the estimated revenue value in selecting the advertisements to be presented to the user.
• a feedback response received from a user indicates the user's interest in the advertisement as determined by the user.
• a positive feedback response indicates that an advertisement is of interest to the user.
• a negative feedback response indicates that the user has no interest or has minimal interest in an advertisement.
• Some conventional online services take into account the user's likely interest in an advertisement when determining which advertisements to present to the user. For example, some conventional online services consider factors such as the user's demographic profile to estimate the click-through-rate of the user on an advertisement. However, such click- through-rate does not provide an accurate measure of the user's level of interest because the user may decide not to click the advertisement even when the advertisement is of interest to the user or vice versa. Further, selecting advertisement based on the click-through-rate or other similar schemes remain focused on increasing advertisement revenue collected by an online service provider. Hence, even if an advertisement significantly degrades user experience, such advertisement is likely to be presented to the user if an advertiser commits to pay a higher advertisement fee for the advertisement.
• the advertisement degrades the user experience, more users may refrain from using the online service to access content items, leading to decreased or less increase in user traffic.
• the decreased user traffic will decrease the overall advertisement fee collected by the online service provider over time.
• the user experience is enhanced by relevant and value-adding
• Embodiments take into account a user's expected interest in the advertisement when selecting and/or prioritizing multiple advertisements that compete for presentation to the user via the online services. Advertisers may submit bid prices for advertisements to present the advertisements via the online services. The higher the bid prices, the more likely that a corresponding advertisement is to be presented via the online services.
• a total value of an advertisement is obtained by adding a premium value to an expected revenue value of the advertisement if the advertisement is likely to be of interest to the user whereas the total value is obtained by deducting a discount value from an expected revenue value when the advertisement is likely to be of no interest to the user. After obtaining the total values, the total values are compared to select
• the premium value and discount value may be estimated based on various statistical models.
• the premium value and the discount value for a user are determined based on previous feedback responses from other users previously presented with the advertisements.
• the feedback responses may indicate the other users'
• Such feedback responses may function as a proxy for determining the other user's interest in the advertisements.
• An advertisement may be of interest to the users in various ways including, but not limited to: (i) providing information about services or products that users are searching for, (ii) increase awareness or knowledge on matters helpful to users, (iii) help users save time or costs and (iv) provide entertainment to users.
• an advertise may be of no interest to the user in various ways including, but not limited to: (i) providing information irrelevant to users, (ii) covering products or services that offend users, (iii) promoting illegal or unethical actions, and (iv) including misleading or inaccurate information.
• FIG. 1 is a conceptual diagram illustrating an online service system 100 for selecting and presenting advertisements to users 110, according to one embodiment.
• the online service system 100 includes an online service computing device 108 that performs one or more of the following functions: (i) receive a plurality of advertisements 106 and related information from one or more advertisers 104, (ii) select and/or prioritize the advertisements 112 for presentation to the users 110, (iii) send advertisements 112 (either embedded in content items or separate from the content items) to the users, and (iv) receive feedback responses 114 about the advertisements 112 from the users 110.
• the advertisers 104, the users 110 and the online service computing device 108 may communicate via a network (e.g., Internet).
• a network e.g., Internet
• the advertisers 104 submit advertisements 106 for dissemination to users 110 via the online service computing device 108.
• the advertisers 104 may include, for example, corporations, public entities (e.g., government), and private individuals desiring to distribute advertisements via the online service system 100.
• the advertisers 104 may also provide information associated with advertisements such as the characteristics of the products or services being advertised, the profile of targeted users, the advertisement fees (i.e., expected revenue values) that the advertisers are willing to pay, and the total cap amount of advertisement fee for a certain duration (e.g., daily and monthly).
• the advertisements 106 may be in various digital forms such as graphical images (such as so-called banner advertisements), string of alphanumeric characters, audio or video file and any combinations thereof.
• the advertisements may also be in the form of a link to other online resources or machine executable instructions.
• the advertisements may be included in contents items generated and sent from the online service computing device 108 or sent as data separate from the content items.
• the online service computing device 108 is a computing device that processes requests from the advertisers 104 and the users 110 to provide various types of online services, for example, as described below in detail with reference to FIGS. 2 A and 2B.
• the online services provided by the online service computing device 108 include, but are not limited to, social networking service, Internet search service, data processing, online shopping services and media streaming services.
• the online service computing device 108 receives requests for content items from the users 110 and provides the content items to the users 100.
• the content items provided by the online service computing device 108 include, but are not limited to, feeds, web pages, images, audio/video files, documents, executable programs, images, search results, and processed data.
• the content items 112 may be embedded with the advertisements 106.
• the users 110 may choose to provide the feedback responses 114 about the advertisements 112 to the online service computing device 108 by interacting with the content item.
• the content item may include graphical user interface elements such as icons, numbers, symbols and any visual elements or any combination thereof for receiving the feedback responses 114.
• the content item may also include non-graphical user interface elements such as auditory icons for receiving feedback responses 114 from visually impaired users.
• the feedback response may be provided by presenting the user with two options: (i) one option associated with a negative feedback response (i.e., low or no interest to the user) and (ii) the other option associated with a positive feedback response (i.e., high interest to the user).
• the feedback response may be provided simply by clicking a "like” icon or a “dislike” icon displayed on the screen of the user's computing device, as described below in detail with reference to FIG. 3B or choosing a number as described below in detail with reference to FIG. 3C. Reducing the number of options is advantageous because data gathering can be facilitated and users are generally more willing to provide feedback responses when presented with a smaller number of choices.
• the advertisers 104 and the users 110 are illustrated in FIG. 1 as communicating directly with the online service computing device 108, the advertisers 104 and the users 110 will communicate with the online service computing device 108 using their computing devices in most applications.
• the computing devices used by advertisers 104 and the users 110 may include, but are not limited to, desktop computers, laptop computers, mobile phones, setup boxes and game consoles.
• Example architecture of a computing device for users (hereinafter referred to as a "user device”) is described below in detail with reference to FIG. 3 A.
• FIG. 2A is a block diagram illustrating the online service computing device 108, according to one embodiment.
• the online service computing device 108 may include, among other components, an advertiser communication module 210, an advertisement database 220, an advertisement selector 230, a content repository 240, a content item processor 250, a feedback response evaluator 260, a user communication module 270 and a social networking service database 246.
• One or more of these components may be embodied as software, hardware, firmware or any combination thereof. Further, one or more of these components may be combined into a single component.
• the advertiser communication module 210 and the user communication module 270 may be combined into a single module.
• the advertiser communication module 210 is hardware, software, firmware or a combination thereof for communicating with the advertisers 104.
• the advertisers 104 send advertisements 106 and information related to the advertisements to the advertiser
• the advertiser database 220 is hardware, software, firmware or a combination thereof for storing advertisements and information related to the advertisements.
• the advertiser database 220 is connected to the advertiser communication module 210 to receive advertisements and other related information from the advertiser communication module 210.
• the information related to advertisement includes, for example, the characteristics of the products or services being advertised, the profile of targeted users, the bidding price for advertisement that the advertisers are willing to pay for presenting advertisements, the maximum amount of advertisement fee for a predetermined duration (e.g., daily and monthly), and user feedback responses 114 received for the advertisements.
• the advertisement selector 230 is hardware, software, firmware or any combination thereof.
• the advertisement selector 230 outputs indexes of one or more advertisements 234 selected for presentation to the users 110. If multiple advertisements 234 are to be presented to the users 110, the advertisement selector 230 can prioritize the advertisements.
• advertisements are embedded in the content items served by the online service computing device 108. In this embodiment, a selected advertisement with the highest priority is placed at the most prominent location of the content item whereas other selected advertisements with lower priority are placed at less prominent locations of the content item.
• the content repository 240 stores resource data for generating the content items as requested by the users 110.
• the resource data for generating the content items may include, but are not limited to, documents, image files, video files and audio files.
• the resource data in the content repository 240 include feeds or data provided by the users 110 for sharing.
• the content item processor 250 is hardware, software, firmware or any combination thereof
• the content item processor 250 receives indexes 234 of the one or more selected advertisements and retrieves the advertisements 236 corresponding to the indexes 234 from the advertisement database 220 after receiving the requests 272. Also, the content item processor 250 receives resource data 244 from the content repository 240, and combines the advertisements 236 and the resource data 244 to generate content items for the users 110.
• the content items generated by the content item processor 250 may be web pages formatted to include images and texts. If the web pages include multiple locations where advertisements may be placed,
• the generated content items 254 are sent to the users 110 via the user communication module 270.
• the content item processor 236 does not embed advertisements in the content items. Instead, the advertisement selector 230 selects the advertisements to be sent to the users 110, and sends the advertisements to the users 110 via the user communication module 270. The content item processor 250 generates the content items without including any advertisements.
• the feedback response evaluator 260 is hardware, software, firmware or any combinations thereof for processing user feedback responses 114 received from the users 110.
• the feedback response evaluator 260 is coupled to the user communication module 270 to receive feedback response data 274 extracted by the user communication module 270.
• the feedback response data 274 may include, for example, an identifier of the advertisement and a feedback response value associated with the advertisement.
• the feedback response value may represent a user's liking/dis liking of the advertisements that functions as a proxy for the user's interest in the advertisements as determined by the user.
• the feedback response value can have one of two values (e.g., zero to indicate a user's disliking of an advertisement and one to indicate the user's liking of the advertisement).
• the feedback response value could be one of multiple values to indicate the degree of liking or disliking of an advertisement (e.g., zero indicating strong disliking of an advertisement, higher values progressively indicating more favorable assessment of the advertisement, and five indicating the most favorable assessment of the advertisement).
• the feedback response evaluator 260 identifies the advertisement associated with the feedback response data 274 based on the identifier, retrieves a current feedback response value of the advertisement from the advertisement database 220, updates the feedback response value to reflect the newly received feedback response data 274, and stores the updated feedback response value in the advertisement database 220.
• the updated feedback response value may then be retrieved by the advertisement selector 230 to select advertisements for subsequent presentation to the users 110.
• the user communication module 270 is hardware, software, firmware or a combination thereof for communicating with the users 110 via a network.
• the user communication module 270 is coupled to the content item processor 250 to forward requests 272 received from the users 110 for the content items and to send the content items 254 generated by the content item processor 250 to the users 110.
• the user communication module 270 is also coupled to the feedback response evaluator 260 to send any feedback response data 274 extracted from data received from the users 110.
• the online service computing device 108 provides social networking services that allow users to establish relationships, share information and facilitate communication among the users.
• the online service computing device 108 includes a social networking service database 246.
• the social networking service database 246 stores, among other information, relationship between users (e.g., "friends" or “followers") and profile information of each user.
• the social networking database 246 may also store privacy information indicating the range of information to be shared with different groups of users.
• the social networking service database 246 provides information to the content item processor 250 so that the content item processor 250 may compile and generate a content item customized for each user based on the user's relationship with other users.
• the online service computing device 108 may be embodied in a single server or multiple servers. In embodiments where the online service computing device 108 is embodied on multiple servers, each server embodies a subset of the components illustrated in FIG. 2 A. Further, each server may be located at different geographic locations to serve users in different geographic locations.
• components of the online service computing device 108 illustrated in FIG. 2 are stored in a computer-readable storage medium. Instructions of the software modules are retrieved and executed by a central processor in the online service computing device 108.
• the computer-readable storage medium for storing the software modules may be volatile memory such as RAM, non-volatile memory such as a flash memory or a combination thereof.
• FIG. 2B is a block diagram illustrating an advertisement selector 230, according to one embodiment.
• the advertisement selector 230 may include, among other components, an expected revenue calculator 274, a modifier calculator 278, a total value calculator 282 and an advertisement ranker 286.
• One or more of these components may be embodied as hardware, software, firmware of a combination thereof.
• the expected revenue calculator 274 receives a bid price 290 from the
• the advertisement database and computes expected revenue corresponding to the bid price 290.
• the computation of expected revenue may include normalizing the bid price 290 into a normalized value for adjustment and comparison.
• the bid price 290 indicates an
• the bid price may be expressed in terms of different pricing structure such as Cost Per Impression (CPI), Cost Per Action (CPA) and fee commitments under any other fee structure.
• the expected revenue calculator 274 may normalize such bid price expressed in different fee structures into expected revenue values under the same cost structure. For example, if a bid price is expressed in Cost Per Click (CPC), this bid price can be converted into CPI using the following equation (1):
• eCTR is an estimated Cost Per Click-Through. Conversion of an expected revenue value in one fee structure to another fee structure is well known in the art, and hence, a detailed description thereof is omitted herein for the sake of brevity.
• the expected revenue calculator 274 may perform other normalization such as currency conversion if the advertisement fees are expressed in different currencies.
• the modifier calculator 278 computes a modifier (i.e., a premium value to be added to the normalized expected revenue value or a discount value to be deducted from the normalized expected revenue value).
• the modifier may be in the units of dollar or other currencies so that the modifier may be added or deducted from the expected revenue value.
• the modifier calculator 278 receives user feedback statistical data 292 from the advertisement database 220 and computes the modifier based on the user feedback statistical data 292.
• the user feedback statistical data 292 represent the probability P(TU) of positive user feedback responses and the probability P(TD) of negative user feedback responses previously received for an advertisement.
• P(TU) is computed as a ratio of the number of positive user feedback responses relative to the total number of feedback responses for an advertisement
• P(TD) is computed as a ratio of the number of negative user feedback responsive relative to the total number of feedback responses for the advertisement.
• the modifier calculator 278 computes a modifier FM X for an advertisement X, for example, using the following equation:
• FM X a P(TU) x - b P(TD) x equation (2) where "a” is a coefficient of a positive value representing weight to be given to the positive user feedback responses, “b” is a coefficient of a positive value representing weight to be given to the negative user feedback responses, P(TU) X is the probability of positive feedback responses from users for the advertisement X and P(TD) X is the probability of negative feedback responses from the users.
• the coefficients "a” and “b” may be set to place emphasis on positive feedback responses or negative feedback responses. Further, the coefficients "a” and “b” may also indicate weight given to the user's expected interest in the advertisement and weight given to the value of the advertisement to the online service provider in selecting or prioritizing the advertisements. By increasing “a” and/or "b" coefficients relative to expected revenue values, a total value becomes more dependent on user feedback responses.
• the modifier is computed by taking into account one or more variables in addition to the probability of positive feedback responses and the probability of negative feedback responses.
• the additional variables taken into account in determining the modifier may include, but are not limited to: (i) Click-Through Rate (CTR) of
• advertisements (ii) the rate of clicks that results in sale of products or services, (iii) the time the user retains the content item on the user's computer, (iv) types of positive or negative feedback responses, (v) the length of advertisement for audio or video advertisements, and (vi) click length indicating the amount of time after the user clicks an advertisement and then returns to previous webpage.
• the modifier calculator 278 retrieves the user profile of the user requesting the content item, and computes the modifiers to take into account user characteristics such as age, gender, location and the marital status of the user. In one embodiment, the modifier calculator 278 computes modifiers for each particular user by taking into account only feedback responses received from other users with demographic profile similar to the particular user or feedback responses received from other users having social relationships, as stored in the social networking service database 246.
• the modifier calculator 278 may use a statistical model to estimate the probability of positive user feedback responses and the probability of negative user feedback responses.
• the statistical model may take into account various factors such as the category of products or services being advertised, demographics of purchasers, track records of advertisements on other similar products or services, and user feedback responses on other advertisements from the same advertiser.
• the actual number of positive user feedback responses P(TU) X and the negative user feedback responses P(TD) X in equation (2) are replaced with the predicted number of positive user feedback responses eP(TU) and the predicted number of negative feedback responses eP(TD) to obtain the modifier.
• the statistical model may also be used when there are a small number of feedback responses. The statistical model may take into account feedback responses previously received from the user as well as various factors such as the category of products or services being advertised, demographics of purchasers, track records of other similar products or services, and user feedback responses on other advertisements from the same advertiser.
• the total value calculator 282 computes total values.
• a total value is a combination of the advertisement fee to the online service provider (i.e., the advertisement fee collected) and a user's expected interest in the advertisement.
• the total value calculator 282 receives normalized expected revenue values 276 from the expected revenue calculator 274 and the modifiers 280 from the modifier calculator 278.
• bid prices of the advertisements are processed into expected revenue values that are expressed in terms of CPI.
• the total value in the form of adjusted CPI (i.e., aCPI) for an advertisement X is computed using the following equation:
• CPI X represents CPI for advertisement X
• FM X represents a modifier for adjusting the CPI value
• the advertisement ranker 286 compares the total values of multiple
• the advertisement ranker 286 receives the total values 284 from the total value calculator 282, processes the total values (if needed), and selects the advertisements with higher total values for presentation to the users 110.
• the advertisement ranker 286 outputs the indexes 288 of the selected advertisements to the content item processor 250. If multiple advertisements are selected by the advertisement ranker 286, the selected advertisements may be prioritized for placement at different locations of the content item. That is, selected advertisements with higher total values may be placed at a more prominent location of the content item. In embodiments where advertisements are sent separate from the content items, the
• advertisement selector 230 retrieves the advertisements corresponding to the indexes, and sends the selected advertisements to the users 110.
• the expected revenue calculator 274, the modifier calculator 278, the total value calculator 282 and the advertisement ranker 286 are illustrated in FIG. 2B as separate components, one or more of these components may be combined into a single module. Also, one or more components illustrated in FIG. 2B may be omitted. For example, the expected revenue calculator 274 may be omitted if no normalization is needed.
• FIG. 3 A is a block diagram illustrating a user device 310 for viewing
• the user device 310 is accessed by a user to receive and access advertisements and content items from the online service computing device 108.
• the user device 310 may be various devices with communication capability including, but not limited to, desktop computers, laptop computers, mobile phones, setup boxes and game consoles.
• the user device 310 may be a personal device (e.g., personal laptop computer) used by a single user or a shared/public device (e.g., interactive kiosks) used by multiple users.
• the user device 310 may include, among other components, a screen 320, a communication module 330, a central processor 340, an input device 350 and memory 360. These components of the user device 310 are connected to each other via a bus 344.
• the screen 320 displays images or texts associated with the content items.
• the screen 320 may be embodied using various display technology such as liquid crystal display (LCD).
• LCD liquid crystal display
• the central processor 220 executes various operations on the user device 310 by executing computer instructions stored in the memory 360.
• the central processor 340 communicates with the screen 320, the input device 350, the communication module 330 and the memory 360 via the bus 344 to control operations of these components.
• the communication module 330 is hardware, software, firmware or a combination thereof for transmitting and receiving signals for communicating with the online service computing device 108.
• the communicated signals may include data corresponding to content items, advertisements, and user feedback responses associated with the
• the memory 360 is a computer readable storage medium for storing instructions executed by the central processor 340.
• the memory 360 may be volatile memory such as RAM, non- volatile memory such as a flash memory or a combination thereof.
• the memory 360 may store various software modules including, among others, an operating system, user applications and a service interface 364.
• the service interface 364 is a set of instructions executed by the central processor 340 to interact with the online service computing device 108.
• the service interface 364 sends requests for content items to the online service computing device 108, receives the content items and/or advertisements in response to the requests, and presents the content items and/or advertisements to the users.
• the service interface 364 also receives user input associated with feedback responses about the received advertisements, and sends the user feedback responses to the online service computing device 108.
• the service interface 364 is embodied as an Internet browser.
• the service interface 364 receives the content items and renders graphical user interface images, for example, as described below in detail with reference to FIG. 3B.
• the service interface 364 is embodied as an application (e.g., media player) for loading and presenting a media content item to the users.
• the service interface 364 receives and displays the advertisements in an area of the screen occupied by a graphical user interface of the service interface 364, for example, as described in detail with reference to FIG. 3C.
• FIG. 3B is a graphical user interface image illustrating a content item loaded and displayed by an Internet browser, according to one embodiment.
• the content item in FIG. 3B is received from an online social networking service that provides various media content items posted and shared by multiple users.
• the user content item includes a navigation area 380, a newsfeed display area 382 and an advertisement area 384.
• the navigation area 380 allows users to navigate to different services provided by the online service. By clicking different tabs (e.g., "newsfeed,” “applications,” “photos,” “links,” “video,” and “more"), the browser sends requests to the online service computing device 108 requesting content items corresponding to the clicked tab, receives the updated content items, and renders images on the screen by processing the received content items.
• tabs e.g., "newsfeed,” “applications,” “photos,” “links,” “video,” and “more
• the newsfeed display area 382 displays a newsfeed provided by "friends” or other users sharing contents via online service computing device 108.
• the user "Joe Smith” accessing the content item 370 has “Jared,” “Julieta” and “Sabra-Anne” as friends, and can share messages or other media files (e.g., images or video file) with these friends by typing in a message and adding media files in user interface area 371.
• Uploading and displaying of a newsfeed in a social networking service can be performed, for example, as described in U.S. Patent Application Serial No. 11/503,242 entitled “Communicating a Newsfeed of Media Content Based on a Member's Interactions in a Social Network Environment," filed on August 11, 2006, which is incorporated by reference herein in its entirety.
• the advertisement area 384 displays three advertisements 372A, 374A and 376A. Below each advertisement, feedback response icons are displayed. Specifically, each of the areas 372B, 374B and 376B includes a "thumbs up” icon indicating a favorable or positive user feedback response, and a "thumbs down” icon indicating an unfavorable or negative user feedback response.
• the Internet browser sends signal to the online service computing device 108 to indicate a positive or negative feedback response from the user.
• the number of positive and negative user feedback responses previously received from other users is also displayed adjacent to "Like" and "Dislike" characters in the areas 372B, 374B and 376B.
• FIG. 3B is merely illustrative. Various other content items in various other layouts may be displayed on the screen 320 using the Internet browser.
• the content items accessed by the Internet browser may include search results for a search term, online news articles and information related to online shopping.
• FIG. 3C is a graphical user interface image for a media player displaying an advertisement, according to one embodiment. Unlike the embodiment of FIG. 3B, the embodiment of FIG. 3C is associated with a media player that plays multimedia files such as MP3 files.
• the user interface 386 of the media player includes a title box 392, a control box 388, an advertisement box 394 and an advertisement rating box 390.
• the title box 392 indicates the title of the media file currently being played on the media player.
• the control box 388 includes control icons for controlling various operations of the media player.
• the advertisement area 394 displays advertisements received from the online service computing device 108.
• the advertisement rating area 390 is used for receiving a user feedback response for an advertisement displayed in the area 394.
• the advertisement displayed in the area 394 is selected and received from the online service computing device 108.
• a user viewing the advertisement may click any one of numbers 1 to 5 to provide negative or positive feedback responses as to the advertisement displayed in the area 394.
• the number "1" represents the most negative feedback response.
• Feedback responses become progressively more positive as the number increases, and the number "5" represents the most positive feedback response.
• the media player sends a signal to the online service computing device 108 indicating the user feedback response for the advertisement displayed in the area 394.
• the advertisement displayed in the user interface 386 may be included in the content item received from the online service computing device 108.
• the media player extracts the advertisement from the content item and displays the advertisement in the area 394.
• the advertisement may be received separately from the content item. That is, the advertisement is not embedded in the content item but received as data separate from the online data.
• the user interface for the media player displayed in FIG. 3C is merely illustrative. Various other user interfaces may be used to display advertisements and receive user feedback responses for the displayed advertisements. Further, although FIG. 3C is described with reference to a media player, other embodiments may place advertisements on other applications or use a different mechanism to receive user feedback responses associated with the displayed advertisement.
• FIG. 4 is a flowchart illustrating processes of selecting or prioritizing
• the advertisement selector 230 receives 402 information associated with advertisements from the advertisement database 220.
• the information received at the advertisement selector 230 may include, for example, indexes of advertisements, expected revenue values associated with the advertisements, user feedback responses previously collected for the advertisements and statistical data associated with the advertisements.
• the advertisement selector 230 then normalizes 406 the expected revenue values associated with the advertisements.
• the expected revenue values may be expressed in terms of different cost structures such as CPI and CPA.
• the advertisement selector 230 normalizes the expected revenue values expressed in different cost structures by converting the expected revenue values into normalized expected revenue values (e.g., CPI) under a single unified cost structure.
• the advertisement selector 230 computes 410 the modifiers representing the user's expected interest in the advertisements.
• a modifier of an advertisement is computed by (i) obtaining a first value by multiplying a coefficient to the number of positive user feedback responses related to the advertisement, (ii) obtaining a second value by multiplying another coefficient to the number of negative user feedback responses related to the advertisement, and (iii) deducting the second value from the first value.
• a higher modifier represents a higher value of the advertisement to the users.
• the advertisement selector 230 then computes 414 the total values based on the normalized expected revenue values and the modifiers.
• the total values are obtained by adding the modifiers to the normalized expected revenue values.
• the advertisement selector 230 selects and prioritizes 418 the advertisements for presentation to the users 110 based on the total values of the advertisements. In one embodiment, the advertisement selector 230 selects one or more advertisements with higher total values.
• the selected advertisements are then sent 424 to the user 110.
• the selected advertisements are then sent 424 to the user 110.
• the selected advertisements are included in a content item and then sent to the user.
• the advertisements are sent to the user 110 separate from a content item.
• the feedback response evaluator 260 receives 426 a user feedback response about the advertisements from the user.
• the feedback response evaluator 260 updates 430 the modifiers of the advertisements presented to the user based on the user feedback response received from the user. Then the process returns to computing 414 the total values based on the updated modifiers and repeats subsequent processes 418 through 426.
• normalizing 410 the expected revenue values may follow computing 406 of the modifier. Further, some processes may be omitted. For example, the process of normalizing the expected revenue value may be omitted if all of the expected revenue values stored in the advertisement database 220 are expressed in the same cost structure.
• receiving the user feedback response and updating the modifier are performed in real-time.
• the online service computing device 108 may instantly effect the changes in the modifiers and reflect the changed modifiers in selecting or prioritizing advertisements.
• the feedback responses received from users are stored and then batch processed to update the modifiers of multiple advertisements at a certain interval.
• the advertisements are received from a device other than the online service computing device 108.
• the online service computing device 108 determines the advertisements to be presented to the user and sends an identifier of the advertisements to the user device 310.
• the user device 310 retrieves an advertisement corresponding to the identifier from the device storing advertisements.
• the actual advertisement fee charged to an advertiser for presenting an advertisement may be computed in various ways. In one embodiment, after the
• fCPI(i) CPI(i+l) + FM(i+l) - FM(i) equation (4)
• i represents the rank of the advertisement based on aCPI x (lower i indicates higher priority of the advertisement)
• CPI (i+1) represents CPI value for an advertisement ranked at i+1
• FM(i+l) represent a modifier for an advertisement ranked at i+1
• FM(i) represents a modifier for an advertisement ranked at i.
• equation (4) ensures that the advertisers are charged less than the bidding price.
• Equation (6) indicates that an advertiser for 1 th advertisement is charged fCPI(i) that is lower than the bid price CPI(i). Adjusting the fees charged to the advertisers based on fCPI(i) is advantageous because the advertisers are charged less for the advertisements that are of value or interest to the users, promoting advertisers to submit advertisements that are more value or interest to the users. In other words, the online service provider subsidizes advertisements of value or interest to the users in the form of reduced advertisement fees to the advertisers.
• the advertisers are charged with advertisement fees that are unadjusted from the bidding CPI values. That is, the advertisers are simply charged by the bidding price submitted for each advertisement.
• Suitable computer-readable storage medium may include, among others, volatile (e.g., RAM) and/or non-volatile (e.g., ROM, disk) memory.

Landscapes

• Business, Economics & Management (AREA)
• Engineering & Computer Science (AREA)
• Strategic Management (AREA)
• Accounting & Taxation (AREA)
• Development Economics (AREA)
• Finance (AREA)
• Entrepreneurship & Innovation (AREA)
• Physics & Mathematics (AREA)
• Economics (AREA)
• Marketing (AREA)
• Game Theory and Decision Science (AREA)
• General Business, Economics & Management (AREA)
• General Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• Data Mining & Analysis (AREA)
• Computing Systems (AREA)
• Computer Networks & Wireless Communication (AREA)
• Signal Processing (AREA)
• Management, Administration, Business Operations System, And Electronic Commerce (AREA)
• Information Transfer Between Computers (AREA)

Priority Applications (3)

Applications Claiming Priority (2)

Publications (1)

Family

ID=43926407

Family Applications (1)

Country Status (5)

Cited By (4)

Families Citing this family (66)

Citations (4)

Family Cites Families (7)

• 2009
  • 2009-11-03 US US12/611,874 patent/US20110106630A1/en not_active Abandoned
• 2010
  • 2010-10-15 WO PCT/US2010/052956 patent/WO2011056388A1/en not_active Ceased
  • 2010-10-15 CA CA2778608A patent/CA2778608A1/en not_active Abandoned
  • 2010-10-15 AU AU2010315776A patent/AU2010315776A1/en not_active Abandoned
  • 2010-10-15 JP JP2012537896A patent/JP5695655B2/ja not_active Expired - Fee Related

Patent Citations (4)

Also Published As

Similar Documents

Legal Events