US20160364757A1 - Method and system for sponsored search results placement in a search results page - Google Patents
Method and system for sponsored search results placement in a search results page Download PDFInfo
- Publication number
- US20160364757A1 US20160364757A1 US14/896,590 US201514896590A US2016364757A1 US 20160364757 A1 US20160364757 A1 US 20160364757A1 US 201514896590 A US201514896590 A US 201514896590A US 2016364757 A1 US2016364757 A1 US 2016364757A1
- Authority
- US
- United States
- Prior art keywords
- search results
- sponsored search
- user
- sponsored
- placement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
- G06Q30/0255—Targeted advertisements based on user history
- G06Q30/0256—User search
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
- G06F16/24578—Query processing with adaptation to user needs using ranking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
-
- G06F17/3053—
-
- G06F17/30554—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computing arrangements using knowledge-based models
- G06N5/04—Inference or reasoning models
-
- G06N99/005—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
- G06Q30/0269—Targeted advertisements based on user profile or attribute
Definitions
- the present teaching relates to methods, systems, and programming for search results placement.
- the present teaching relates to methods systems, and programming for sponsored search results placement in a search results page.
- Online search methodology provides users with search results that match the users' search interest.
- Current search technology can offer users with suitable and personalized searching experience in addition to the content-based search results, a search results page may also include one or more sponsored search results matching the users' search keywords.
- the availability of placing the sponsored search results in a search results page allows the advertisers to bid for placement in a paid listing of search results on terms that are relevant to their business. The advertisers pay the amount of their bids only when a customer clicks on their listing. Therefore, good placement of sponsored search results helps the advertisers to achieve their goals or maximize the success.
- publishers that offer spaces to place the sponsored search results also benefits from improved user experience to achieve more revenue from advertising.
- a user When a user inputs a search query on a search engine nested on a publisher web site, as bid auction on the sponsored search results spots takes place when a search for one or more keywords occurs. All bids for the one or more keywords that target the user's geographic location, the day and time of the search, etc. are then compared and a winner is determined in situations where there are multiple spots available on the search engine results page (SERP), there can be multiple winners whose positions on the page are influenced by the amount each has bid.
- SERP search engine results page
- user behaviors are utilized to provide personalized search results.
- the search engine collects the profile information associated with the user, and obtains historical behaviors of the user from a database.
- the search engine further analyzes the user behaviors such as browsing history, purchasing history or ad related activities via the publisher website, etc. to determine how likely the user clicks the sponsored search results and/or make purchases through the landing page links. Because various elements may affect the presentation of the sponsored search results as well as the user experience, the search engine adopts prediction models to determine the rankings and placement of the sponsored search results. For example, the search engine may construct a prediction model based on the bids and the user behaviors to determine the rankings and placement of the sponsored search results. However, bids and user behaviors related prediction focuses on the relevance of the sponsored search results and the search keywords. Information associated with the sponsored search results themselves is neglected and thus, causing a bottle-neck in the performance of the sponsored search results.
- the present teaching relates to methods, systems, and programming or search results placement.
- the present teaching relates to methods, systems, and programming for sponsored search results placement in a search results page.
- a method, implemented on a computing device having at least one processor, storage, and a communication platform connected to a network for placing sponsored search results in a search results page includes receiving a search query from a user; extracting one or more keywords from the search query; receiving a plurality of sponsored search results related to the one or more keywords; determining placement of the plurality of sponsored search results based on correlations of the plurality of sponsored search results; and presenting to the user, a search results page containing the plurality of sponsored search results.
- the method may further include obtaining profile information of the user; retrieving user behaviors from a database based on the profile information; and determining the placement of the plurality of sponsored search results based on the user behaviors.
- the method may further include estimating a user likelihood factor for each sponsored search result based on the user behaviors; and determining the placement of the plurality of sponsored search results based on the user likelihood factors, wherein the user likelihood factor indicates a chance that the user clicks the sponsored search result.
- the method may further include determining the placement of the plurality of sponsored search results based on qualities of the plurality of sponsored search results, which includes obtaining a plurality of quality factors associated with each sponsored search result; estimating a quality grade for each sponsored search result based on the plurality of quality factors; and determining the placement of the plurality of sponsored search results based on the quality grades.
- the method may further include obtaining a creative associated with each sponsored search result; estimating a correlation factor for each sponsored search result based on the creatives; and determining the placement of the plurality of sponsored search results based on the correlation factors, wherein the correlation factor indicates an interaction level between a sponsored search result and other sponsored search results to be placed together on the search results page.
- the method may further include predicting a number of clicks on each sponsored search result based on user behaviors, qualities of the plurality of sponsored search results, and the correlations of the plurality of sponsored search results using a machine learning model; and determining the placement of the plurality of sponsored search results based an the predicted numbers of clicks.
- a method, implemented on a computing device having at least one processor, storage, and a communication platform connected to a network for placing sponsored search results in a search results page includes receiving a search query from a user; extracting one or more keywords from the search query; receiving a plurality of sponsored search results related to the one or more keywords; determining placement of the plurality of sponsored search results based on behaviors associated with the user and qualities of the plurality of sponsored search results; and presenting to the user, a search results page containing the plurality of sponsored search results.
- the method may further include predicting a number of clicks on each sponsored search result based on the behaviors associated with the user and the qualities of the plurality of sponsored search results using a machine learning model; and determining the placement of the plurality of sponsored search results based on the predicted numbers of clicks.
- a system having at least one processor, storage, and a communication platform connected to a network for placing sponsored search results in a search results page includes a user interfacing module configured to receive a search query from a user; a keywords extractor configured to extract one or more keywords from the search query, a teething module configured to receive a plurality of sponsored search results related to the one or more keywords; a decision module configured to determine placement of the plurality of sponsored search results based on correlations of the plurality of sponsored search results; and a presenting module configured to present to the user, a search results page containing the plurality of sponsored search results.
- the system may further include a user profile collector configured to obtain profile information of the user; and a user behavior analyzer configured to retrieve user behaviors from a database based on the profile information, wherein the decision module is further configured to determine the placement of the plurality of sponsored search results based on the user behaviors.
- the user behavior analyzer may be further configured to estimate a user likelihood factor for each sponsored search result based on the user behaviors, the user likelihood factor indicating a chance that the user clicks the sponsored search result.
- the decision module may be further configured to determine the placement of the plurality of sponsored search results based on qualities of the plurality of sponsored search results, which includes obtaining a plurality of quality factors, associated with each sponsored search result; estimating a quality grade for each sponsored search result based on the plurality of quality factors; and determining the placement of the plurality of sponsored search results based on the quality grades.
- the system may farther include a creative extractor configured to obtain a creative associated with each sponsored search result; and a correlation analyzer configured to estimate a correlation factor for each sponsored search result based on the motives, the correlation factor indicating an interaction level between a sponsored search result and other sponsored search results to be placed together on the search results page, wherein the decision module is further configured to determine the placement of the plurality of sponsored search results based on the correlation factors.
- the system may further include a clicks prediction module configured to predict a number of clicks on each sponsored search result based on user behaviors, qualities of the plurality of sponsored search results, and the correlations of the plurality of sponsored search results using a machine learning model, wherein the decision module is further configured to determine the placement of the plurality of sponsored search results based on the predicted numbers of clicks.
- a clicks prediction module configured to predict a number of clicks on each sponsored search result based on user behaviors, qualities of the plurality of sponsored search results, and the correlations of the plurality of sponsored search results using a machine learning model
- the decision module is further configured to determine the placement of the plurality of sponsored search results based on the predicted numbers of clicks.
- a non-transitory machine-readable medium having information recorded thereon for placing sponsored search results in a search results page, wherein the information, when read by the machine, causes the machine to perform receiving a search query from a user extracting one or more keywords from the search query; receiving a plurality of sponsored search results related to the one or more keywords; determining placement of the plurality of sponsored search results based on correlations of the plurality of sponsored search results; and presenting to the user, a search results page containing the plurality of sponsored search results.
- FIG. 1 illustrates an exemplary system diagram for placing sponsored search results in a search result page, according to an embodiment of the present teaching
- FIG. 2 illustrates an exemplary system diagram for placing sponsored search results in a search result page, according to another embodiment of the present teaching
- FIG. 3 illustrates an exemplary search results generation engine and placement engine, according to an embodiment of the present teaching
- FIG. 4 illustrates an exemplary flowchart of the process for presenting a search result page including the sponsored search results, according to an embodiment of the present teaching
- FIG. 5 illustrates an exemplary diagram of a placement engine, according to an embodiment of the present teaching
- FIG. 6 illustrates an exemplary flowchart of the process for placing the sponsored search results, according to an embodiment of the present teaching
- FIG. 7 illustrates an exemplary diagram of a placement engine, according to another embodiment of the present teaching.
- FIG. 8 illustrates an exemplary flowchart of the process for placing the sponsored search results, according to another embodiment of the present teaching
- FIG. 9 illustrates an exemplary placement of the sponsored search results, according to an embodiment of the present teaching.
- FIG. 10 illustrates an exemplary diagram of a placement engine, according to yet another embodiment of the present teaching
- FIG. 11 illustrates an exemplary flowchart of the process for placing the sponsored search results, according to yet another embodiment of the present teaching
- FIG. 12 illustrates an exemplary placement of the sponsored search results, according to another embodiment of the present teaching.
- FIG. 13 depicts a general mobile device architecture on which the present teaching can be implemented.
- FIG. 14 depicts a general computer architecture on which the present teaching can be implemented.
- terms, such as “a,” “an,” or “the,” again, may be understood to convey a singular usage or to convey a plural usage, depending at least in part upon context.
- the term “based on” may be understood as not necessarily intended to convey an exclusive set of factors and may, instead allow for existence of additional factors not necessarily expressly described, again, depending at least in part on context.
- the present teaching incorporates user behaviors associated with the user inputting a search query, quality factors of the sponsored search results related to the search query, and correlation factors of the sponsored search results to attain a novel and strengthened prediction model to predict numbers of clicks on the sponsored search results and determine the placement of the sponsored search results in a search results page.
- the present teaching offers the most appropriate placement of the sponsored search results as well as personalized search results that better meet the user's interest. Meanwhile, it contributes to enhance user experience with the publisher website, which in turn, keeps loyalty of the users as well as more new users.
- FIG. 1 illustrates an exemplary system diagram for placing sponsored search results in a search result page, according to an embodiment of the present teaching.
- a user 102 initiates a search on a search engine nested on a publisher website
- the publisher 104 releases a bid request to the advertisers 106 via a network 110 .
- a bid process on the available ad spots in connection with one or more search keywords automatically occurs.
- An intermediate agency such as an ad exchange determines the winning bids in accordance with the number of available ad spots on the publisher website.
- the search engine searches for content-based search results from a variety of content sources 112 .
- a search results generation engine 114 then fetches the content-based search results from the variety of content sources 112 and the sponsored search results from a database 108 to be presented to the user in accordance with the winning bids.
- the search results generation engine 114 further communicates with a placement engine 116 to determine the placement of the sponsored search results in accordance with the available ad spots on the publisher website.
- the user 102 may connect to the network via various types of devices, for example, a desktop computer, a laptop computer, a mobile device, a built-in device in a motor vehicle, etc.
- the network 110 may be a single network or a combination of multiple networks.
- the network 110 may be a local area network (LAN), a wide area network (WAN), to public network, a private network, a proprietary network, a Public Telephone Switched Network (PSTN), the Internet, a wireless communication network, a virtual network, or any combination thereof.
- the publisher 104 may be any entity that hosts one or more spots in its properties (e.g., web sites, applications, etc,) for presenting search results to the user 102 .
- the publisher 104 may also be a search engine, a blogger, a television station, a newspaper issuer, a web page host, a content portal, an online service provider, or a game server.
- the advertiser 106 may be any entity that provides inventory to be displayed on the publisher's webpage.
- the inventory may be electrical devices, fashion items, soft drinks, travel services, merchandize coupons etc.
- the advertisers 106 present the inventory related to the search keywords.
- the search results page generation engine 114 and the placement engine 116 operates as independent service providers and directly connect to network 110 .
- FIG. 2 illustrates an exemplary system diagram for placing sponsored search results in a search result page, according to another embodiment of the present teaching.
- the system environment illustrated herewith is similar to FIG. 1 , except that the placement engine 116 operates as a backend system of the search results page generation engine 114 for determining the placement of sponsored search results in a search results page.
- the placement engine 116 may be incorporated into the search results page generation engine 114 as one entity.
- FIG. 3 illustrates an exemplary search results generation engine and placement engine, according to an embodiment of the present teaching.
- a user 02 initiates a search query which is transmitted to a search query processor 304 .
- the search query processor 304 forwards it to a web server 306 , and meantime, stores the search query in a query log database 332 .
- An ad space detector 308 detects available ad spaces on the search results page to be produced in response to the search query, and forwards the number of the available ad spaces and one or more keywords related to the search query to a bid requestor 310 .
- a bid on the available ad spaces and related to the search keywords is generated at the bid requestor 319 , and forwarded to advertisers via an ad exchange 312 .
- a bid receiver 314 receives all bids upon the available ad spaces and the search keywords, and forwards the bids to a bid processor 316 .
- the bid processor 316 ranks the received bids used on the amount that is bid, and forwards the bid rankings to a bid selector 318 .
- the bid selector 318 selects a number of high bids to be placed on the available ad spaces on the search results page, and forwards the selected bids to an ad requestor 320 .
- the ad requestor 320 Upon receiving the selected bids, the ad requestor 320 sends a request to obtain ads to be placed on the search results page corresponding to the selected bids via the ad exchange 312 .
- the ad exchange 312 further forwards the candidate ads in response to the selected bids to the candidate ads receiver 322 .
- a placement engine 116 receives the candidate ads, i.e., the sponsored search results in response to the search query, and determines the arrangement of the sponsored search results on the search results page. Further, the search results generation engine 114 fetches the sponsored search results with determined arrangement from the placement engine 116 and content-based search results from various content sources 112 via a search engine 328 . The search results generation engine 114 incorporates the content-based search results and the sponsored search results into a search results page 334 and presents the search results page 334 to the user 302 .
- FIG. 4 illustrates an exemplary flowchart of the process for presenting a search results page including the sponsored search results, according to an embodiment of the present teaching.
- the process for presenting a search results page may include receiving a search query from a user 402 ; searching content-based search results in response to the search query 404 ; providing the content-based search results to a search results.
- search generation engine 406 retrieving one or more keywords from the search query 408 ; determining available ad spaces on the search results page to be produced in response to the search query 410 ; sending to bid request to a plurality of advertisers 412 ; selecting a plurality of sponsored search results based on the received bids 414 ; determining placement of the sponsored search results 416 ; and presenting search results in response to the search query including the content-based search results and the sponsored search results with the determined placement 418 .
- FIG. 5 illustrates an exemplary diagram of a placement engine, according to an embodiment of the present teaching.
- the placement engine 116 includes a user interfacing module 502 configured to receive a search query from the user 102 ; a keyword extractor 504 configured to extract one or more keywords from the received search query; a receiving module 510 configured to receive a plurality of sponsored search results related to the extracted keywords 508 ; a decision module 524 configured to determine placement of the plurality of sponsored search results based. on a variety of factors; and a presenting module 526 configured to present the search results page containing, the plurality of sponsored search results.
- the placement engine 116 may further include a user behavior analyzing module 506 configured to retrieve behavior information associated with the user from a database, analyze the behavior information, and provide the behavior related factor for predicting clicks on the sponsored search results.
- a user behavior analyzing module 506 configured to retrieve behavior information associated with the user from a database, analyze the behavior information, and provide the behavior related factor for predicting clicks on the sponsored search results.
- the placement engine 116 may further include a quality factors analyzing module 512 configured to obtain a plurality of quality factors associated with each sponsored search result, analyze the plurality of quality factors, and provide the quality related factors for predicting clicks on the sponsored search results.
- a quality factors analyzing module 512 configured to obtain a plurality of quality factors associated with each sponsored search result, analyze the plurality of quality factors, and provide the quality related factors for predicting clicks on the sponsored search results.
- the placement engine 116 may further include a clicks prediction module 518 configured to receive inputs from the user behavior analyzing module 506 and the quality factor analyzing module 512 , and predict a number of clicks on each sponsored search result to be placed on the search results page.
- the clicks prediction module 518 may select one of the dicks prediction models 516 via a prediction model selector 514 .
- the clicks prediction model is trained to evaluate each sponsored search result using historical data related to the performance of the sponsored search results. According to the present embodiment, the clicks prediction module 518 selects a trained machine learning model for clicks prediction.
- the placement engine 116 may further includes a ranking module 520 configured to rank the plurality of sponsored search results based on the results of the clicks prediction, and forward the rankings to the decision module 524 to determine the placement.
- the decision module 524 may refer to a space layout 522 to determine the actual positions of the available ad spots on the search results page.
- FIG. 6 illustrates an exemplary flowchart of the process for placing the sponsored search results, according to an embodiment of the present teaching.
- the process for placing the sponsored search results may include receiving user behavior analyzing results 602 ; receiving quality factors analyzing results 604 ; predicting clicks for sponsored search results using machine learning model 606 ; ranking the sponsored search results based on the clicks prediction 608 ; and assigning spaces to the sponsored search results 610 based on the ranking.
- FIG. 7 illustrates an exemplary diagram of a placement engine, according to another embodiment of the present teaching.
- the user behavior analyzing module 506 shown in FIG. 5 may further include a user profile collector 702 configured to obtain profile information of the user inputting the search query via the user interfacing module 502 ; a user behavior classifier 706 configured to classify the user behaviors into different categories; and a user behavior analyzer 708 configured to retrieve the user behaviors from a database 704 based on the profile information, and estimate a user likelihood factor for each sponsored search result.
- the user behavior database 704 may store the user behaviors being observed on the publisher web site in the past time periods.
- the user behaviors may be allocated into different categories such as navigation history 710 , demographic information 712 , ad related activities 714 , etc.
- the clicks prediction module 518 may apply long-term historical user behaviors and/or short-term historical user behaviors to achieve more accurate prediction.
- the in some embodiment, the estimated likelihood factor indicates a chance that the user clicks the sponsored search result based on the user behaviors in the past.
- the user behavior analyzing module 506 shown in FIG. 5 may further include a quality factors extractor 720 configured to obtain a plurality of quality factors associated with each sponsored search result; a quality factors categorizer 722 configured to classify the ad quality indicators; and a quality factors analyzer 726 configured to estimate a quality grade for each sponsored search result based on the quality factors.
- the quality factors of an ad, i.e., a sponsored search result may be defined in multiple categories such as historical click through ratio (CTR) 724 , landing page quality 728 , geographic performance 730 , ad relevance 732 , etc.
- CTR historical click through ratio
- FIG. 8 illustrates an exemplary flowchart of the process for placing the sponsored search results, according to another embodiment of the present teaching.
- the process for placing the sponsored search results may include receiving a search query from a user 802 ; collecting profile information associated with the user 804 ; retrieving historical user behavior information 806 ; extracting search keywords From the search query 810 ; receiving a plurality of sponsored search results 812 based on the user behaviors and the quality factors; analyzing the user behaviors and estimating likelihoods of clicks on the sponsored search results based on the user behaviors 808 .
- the process for placing the sponsored search results may further include extracting quality factors from the sponsored search results 814 ; analyzing the quality factors and estimating quality factors for the sponsored search results 816 ; predicting the clicks on the sponsored search results using a trained machine learning model 818 ; ranking the sponsored search results based on the predicted clicks 820 ; and assigning available ad spaces to the sponsored search results 822 .
- FIG. 9 illustrates an exemplary placement of the sponsored search results, according to an embodiment of the present teaching.
- An exemplary search result page includes four ad spaces: space 902 , space 904 , space 906 , and space 908 .
- Four ads (Ad # 1 , Ad # 2 , Ad # 3 , and Ad # 4 ) are selected to be placed in spaces 902 908 , respectively.
- An initial ranking of the four ads based on the amount they bid shows that Ad # 1 ranks at a first place, Ad # 2 ranks at a second place, Ad # 3 tanks at a third place, and Ad # 4 ranks at a fourth place.
- quality factors analysis results show that Ad # 1 has low quality, Ad # 2 has high quality, Ad # 3 has high quality, and Ad # 4 has medium quality.
- Ad # 1 receives to user likelihood to click
- Ad # 2 receives low user likelihood to click
- Ad # 3 receives high user likelihood to click
- Ad # 4 receives medium user likelihood to click.
- Ad # 1 is predicted to have 5,000 clicks
- Ad # 2 is predicted to have 15,000 clicks
- Ad # 3 is predicted to have 20,000 clicks
- Ad # 4 is predicted to have 8,000 clicks.
- the final ranking differs from the initial ranking in that Ad # 3 ranks at the first place, Ad # 4 ranks at the third place, and Ad # 1 ranks at the fourth place. Accordingly, Ad # 3 is placed in space 902 , Ad # 2 is placed in space 904 , Ad # 4 is placed in space 906 , and Ad # 1 is placed in space 908 .
- predicting ad clicks in accordance with the user behaviors and the ads quality factors not only provides the user with suitable sponsored search results placement and personalized searching experience, but also increases the revenue of the publisher web site by more accurate ad displaying.
- FIG. 10 illustrates an exemplary diagram of a placement engine, according to yet another embodiment of the present teaching.
- the placement engine 116 shown in FIG. 7 may further include a creative extractor 1002 configured to obtain a creative associated with each sponsored search results; and a correlation analyzer 1004 configured to estimate a correlation factor for each sponsored search result based on the creativtes.
- the correlation factor in the present embodiment indicates an interactional level between a sponsored search result and other sponsored search results to be placed together on the search results page.
- the estimated correlation factors are further inputted into the clicks prediction module 518 to estimate the clicks on the sponsored search results.
- the ad creative includes all the information for visually rendering the ad itself on a publisher web site such as descriptions, format extensions (i.e., site links), layout, etc.
- the present embodiment introduces the correlation influence of other sponsored search results to be placed in the same page to provide more appropriate display. For example, if higher ranked ads have at least one “very good” ad, current ad is less likely to be clicked; or if all higher ranked ads are not “very good” current one is more likely to be clicked.
- utilizing the correlation influence of other sponsored search results in addition to the user behaviors and the ad quality factors can produce more accurate prediction on the ad clicks, which leads to more appropriate ad placement.
- FIG. 11 illustrates an exemplary flowchart of the process for placing the sponsored search results, according to yet another embodiment of the present teaching.
- the process fir placing the sponsored search results may include receiving a search query from a user 1102 ; collecting profile information associated with the user 1104 ; retrieving historical user behavior information 1106 ; extracting search keywords from the search query 1110 ; receiving a plurality of sponsored search results in response to the search query 1122 ; analyzing the user behaviors and estimating likelihoods of clicks on the sponsored search results 1108 ; extracting quality factors from the sponsored search results 1112 ; analyzing the quality factors and estimating the quality grades 1114 ; extracting creatives from the sponsored search results 1124 ; analyzing the creatives and estimating correlation factors for the sponsored search results 1126 ; predicting clicks using a machine learning model based on the user behaviors, quality factors, and correlation factors 1116 ; ranking the sponsored search results based on the clicks prediction 1118 ; and assigning spaces to the sponsored search results 1120
- FIG. 12 illustrates an exemplary placement of the sponsored search results, according to another embodiment of the present teaching.
- the exemplary placement introduces an additional correlation factor estimation to predict the clicks on the sponsored search results.
- the analysis on the quality factors and the user behaviors shows the same results as in FIG. 9 , in addition, the correlation factors analysis shows that Ad # 1 receives low influence from other ads, Ad # 2 receives low influence from other ads.
- Ad # 3 receives high influence from other ads, and Ad # 4 receives medium influence from other ads.
- the clicks prediction by incorporating the correlation factors analysis shows that Ad # 1 is predicted to have 6,000 clicks, Ad # 2 is predicted to have 19,000 clicks.
- Ad # 3 is predicted to have 18,000 clicks, and Ad # 4 is predicted to have 8,000 clicks.
- the final ranking by incorporating the correlation factors analysis Shows that Ad # 2 exceeds Ad # 3 , and ranks at the first place. Consequently, Ad # 2 replaces Ad # 3 to be placed on the best ad space 902 .
- the present embodiment combines the user behaviors, the sponsored search result internal features (i.e., the quality factors), and the sponsored search result external features (i.e., the correlation factors) to attain a strengthened prediction model, in particular, by evaluating the impact of other sponsored search results to be placed together on the search results page, the present teaching offers the most appropriate placement of the sponsored search results, improves user experience, and attracts more new users.
- the sponsored search result internal features i.e., the quality factors
- the sponsored search result external features i.e., the correlation factors
- FIG. 13 depicts a general mobile device architecture on which the present teaching can be implemented in this example
- the user device is a mobile device 1300 , including but is not limited to, a smart phone, a tablet, a music player, a handled gaming console, a global positioning system (GPS) receiver, a smart-TV, wearable devices, etc.
- the mobile device 1300 in this example includes one or more central processing units (CPUs) 1302 , or more graphic processing units (GPUs) 1304 , a display 1306 , a memory 1308 , a communication platform 1310 , such as a wireless communication module, storage 1312 , and one or more input/output (I/O) devices 1314 .
- CPUs central processing units
- GPUs graphic processing units
- storage 1312 storage 1312
- I/O input/output
- any other suitable component such as but not limited to a system bus or a controller (not shown), may also be included in the mobile device 1300 .
- a mobile operating system 1316 e.g., iOS, Android, Windows Phone, etc.
- the applications 1318 may include a browser or any other suitable mobile apps for sending a search query and rendering the search results page including the sponsored search results page through the mobile device 1300 . Execution of the applications 1318 may cause the mobile device 1300 to perform the processing as described above in the present teaching.
- presentation of a search results page including sponsored search results may be made by the GPU 1304 in conjunction with the display 1306 .
- a request for loading a search results page in response to a search query may be inputted by the user via the I/O devices 1314 and transmitted via the communication platform 1310 .
- computer hardware platforms may be used as the hardware platform(s) for one or more of the elements described herein.
- the hardware elements, operating systems, and programming languages of such computers are conventional in nature, and it is presumed that those skilled in the an are adequately familiar therewith to adapt those technologies to implement the processing essentially as described herein.
- a computer with user interface elements may be used to implement a personal computer (PC) or other type of work station or terminal device, although a computer may also act as a server if appropriately programmed, it is believed that those skilled in the an are familiar with the structure, programming, and general operation of such computer equipment and as a result the drawings should be self-explanatory.
- FIG. 14 depicts a general computer architecture on which the present teaching can be implemented and has a functional block diagram illustration of a computer hardware platform that includes user interface elements.
- the computer may be a general-purpose computer or a special purpose computer.
- This computer 1400 can be used to implement any components of the system for placing sponsored search results in a search results page as described herein. Different components of the systems disclosed in the present teaching can all be implemented on one or more computers such as computer 1400 , via its hardware, software program, firmware, or a combination thereof. Although only one such computer is shown, for convenience, the computer functions relating to placing the sponsored search results page may be implemented in a distributed fashion on a number of similar platforms, to distribute the processing load.
- the computer 1400 for example, includes COM ports 1402 connected to and from a network connected thereto to facilitate data communications.
- the computer 1400 also includes a CPU 1404 , in the form of one or more processors, for executing program instructions.
- the exemplary computer platform includes an internal communication bus 1406 , program storage and data storage of different forms, e.g., disk 1408 , read only memory (ROM) 1410 , or random access memory (RAM) 1412 , for various data files to be processed and/or communicated by the computer, as well as possibly program instructions to be executed by the CPU 1404 .
- the computer 1400 also includes an I/O component 1414 , supporting input/output flows between the computer and other components therein such as user interface elements 1416 .
- the computer 1400 may also receive programming and data via network communications.
- aspects of the methods of placing sponsored search results in a search results page may be embodied in programming.
- Program aspects of the technology may be thought of as “products” or “articles of manufacture” typically in the form of executable code and/or associated. data that is carried on or embodied in a type of machine readable medium.
- Tangible non-transitory “storage” type media include any or all of the memory or other storage for the computers, processors or the like, or associated modules thereof, such as various semiconductor memories, tape drives, disk drives and the like, which may provide storage at any time for the software programming.
- All or portions of the software may at times be communicated through a network such as the Internet or various other telecommunication networks. Such communications, for example, may enable loading of the software from one computer or processor into another.
- another type of media that may bear the software elements includes optical, electrical, and electromagnetic waves, such as used across physical interfaces between local devices, through wired and optical landline networks and over various air-links, The physical elements that carry such waves, such as wired or wireless links, optical links or the like, also may be considered as media bearing the software.
- terms such as computer or machine “readable mediums” refer to any medium that participates in providing instructions to a processor for execution.
- Non-volatile storage media include, for example, optical or magnetic disks, such as any of the storage devices in any computer(s) or the like, which may be used to implement the system or any of its components as shown in the drawings.
- Volatile storage media include dynamic memory, such as a main memory of such a computer platform.
- Tangible transmission media include coaxial cables; copper wire and fiber optics, including the wires that form a bus within a computer system.
- Carrier-wave transmission media can take the form of electric or electromagnetic signals, or acoustic or light waves such as those generated during radio frequency (RF) and infrared (IR) data communications.
- Computer-readable media therefore include for example at floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, DVD or DVD-ROM, any other optical medium, punch cards paper tape, any other physical storage medium with patterns of holes, a RAM, a PROM and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave transporting data or instructions, cables or links transporting such a carrier wave, or any other medium from which a computer can read programming code and/or data. Many of these forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to a processor for execution.
Abstract
Description
- 1. Technical Field
- The present teaching relates to methods, systems, and programming for search results placement. In particular, the present teaching relates to methods systems, and programming for sponsored search results placement in a search results page.
- 2. Discussion of Technical Background
- Online search methodology provides users with search results that match the users' search interest. Current search technology can offer users with suitable and personalized searching experience in addition to the content-based search results, a search results page may also include one or more sponsored search results matching the users' search keywords. The availability of placing the sponsored search results in a search results page allows the advertisers to bid for placement in a paid listing of search results on terms that are relevant to their business. The advertisers pay the amount of their bids only when a customer clicks on their listing. Therefore, good placement of sponsored search results helps the advertisers to achieve their goals or maximize the success. On the other hand, publishers that offer spaces to place the sponsored search results also benefits from improved user experience to achieve more revenue from advertising.
- When a user inputs a search query on a search engine nested on a publisher web site, as bid auction on the sponsored search results spots takes place when a search for one or more keywords occurs. All bids for the one or more keywords that target the user's geographic location, the day and time of the search, etc. are then compared and a winner is determined in situations where there are multiple spots available on the search engine results page (SERP), there can be multiple winners whose positions on the page are influenced by the amount each has bid. According to some search scheme, user behaviors are utilized to provide personalized search results. When a user inputs a search query via a publisher's website, the search engine collects the profile information associated with the user, and obtains historical behaviors of the user from a database. The search engine further analyzes the user behaviors such as browsing history, purchasing history or ad related activities via the publisher website, etc. to determine how likely the user clicks the sponsored search results and/or make purchases through the landing page links. Because various elements may affect the presentation of the sponsored search results as well as the user experience, the search engine adopts prediction models to determine the rankings and placement of the sponsored search results. For example, the search engine may construct a prediction model based on the bids and the user behaviors to determine the rankings and placement of the sponsored search results. However, bids and user behaviors related prediction focuses on the relevance of the sponsored search results and the search keywords. Information associated with the sponsored search results themselves is neglected and thus, causing a bottle-neck in the performance of the sponsored search results.
- Therefore, there is a need to provide an improved solution for placing the sponsored search results to solve the above-mentioned problems.
- The present teaching relates to methods, systems, and programming or search results placement. In particular, the present teaching relates to methods, systems, and programming for sponsored search results placement in a search results page.
- According to an embodiments of the present teaching, a method, implemented on a computing device having at least one processor, storage, and a communication platform connected to a network for placing sponsored search results in a search results page includes receiving a search query from a user; extracting one or more keywords from the search query; receiving a plurality of sponsored search results related to the one or more keywords; determining placement of the plurality of sponsored search results based on correlations of the plurality of sponsored search results; and presenting to the user, a search results page containing the plurality of sponsored search results.
- In some embodiment, the method may further include obtaining profile information of the user; retrieving user behaviors from a database based on the profile information; and determining the placement of the plurality of sponsored search results based on the user behaviors.
- In some embodiment, the method may further include estimating a user likelihood factor for each sponsored search result based on the user behaviors; and determining the placement of the plurality of sponsored search results based on the user likelihood factors, wherein the user likelihood factor indicates a chance that the user clicks the sponsored search result.
- In some embodiment, the method may further include determining the placement of the plurality of sponsored search results based on qualities of the plurality of sponsored search results, which includes obtaining a plurality of quality factors associated with each sponsored search result; estimating a quality grade for each sponsored search result based on the plurality of quality factors; and determining the placement of the plurality of sponsored search results based on the quality grades.
- In some embodiment, the method may further include obtaining a creative associated with each sponsored search result; estimating a correlation factor for each sponsored search result based on the creatives; and determining the placement of the plurality of sponsored search results based on the correlation factors, wherein the correlation factor indicates an interaction level between a sponsored search result and other sponsored search results to be placed together on the search results page.
- In some embodiment, the method may further include predicting a number of clicks on each sponsored search result based on user behaviors, qualities of the plurality of sponsored search results, and the correlations of the plurality of sponsored search results using a machine learning model; and determining the placement of the plurality of sponsored search results based an the predicted numbers of clicks.
- According to another embodiment of the present teaching, a method, implemented on a computing device having at least one processor, storage, and a communication platform connected to a network for placing sponsored search results in a search results page includes receiving a search query from a user; extracting one or more keywords from the search query; receiving a plurality of sponsored search results related to the one or more keywords; determining placement of the plurality of sponsored search results based on behaviors associated with the user and qualities of the plurality of sponsored search results; and presenting to the user, a search results page containing the plurality of sponsored search results.
- In some embodiment, the method may further include predicting a number of clicks on each sponsored search result based on the behaviors associated with the user and the qualities of the plurality of sponsored search results using a machine learning model; and determining the placement of the plurality of sponsored search results based on the predicted numbers of clicks.
- According to yet another embodiment of the present teaching, a system having at least one processor, storage, and a communication platform connected to a network for placing sponsored search results in a search results page includes a user interfacing module configured to receive a search query from a user; a keywords extractor configured to extract one or more keywords from the search query, a teething module configured to receive a plurality of sponsored search results related to the one or more keywords; a decision module configured to determine placement of the plurality of sponsored search results based on correlations of the plurality of sponsored search results; and a presenting module configured to present to the user, a search results page containing the plurality of sponsored search results.
- In some embodiment, the system may further include a user profile collector configured to obtain profile information of the user; and a user behavior analyzer configured to retrieve user behaviors from a database based on the profile information, wherein the decision module is further configured to determine the placement of the plurality of sponsored search results based on the user behaviors.
- In some embodiment, the user behavior analyzer may be further configured to estimate a user likelihood factor for each sponsored search result based on the user behaviors, the user likelihood factor indicating a chance that the user clicks the sponsored search result.
- In some embodiment, the decision module may be further configured to determine the placement of the plurality of sponsored search results based on qualities of the plurality of sponsored search results, which includes obtaining a plurality of quality factors, associated with each sponsored search result; estimating a quality grade for each sponsored search result based on the plurality of quality factors; and determining the placement of the plurality of sponsored search results based on the quality grades.
- In some embodiment, the system may farther include a creative extractor configured to obtain a creative associated with each sponsored search result; and a correlation analyzer configured to estimate a correlation factor for each sponsored search result based on the motives, the correlation factor indicating an interaction level between a sponsored search result and other sponsored search results to be placed together on the search results page, wherein the decision module is further configured to determine the placement of the plurality of sponsored search results based on the correlation factors.
- In some embodiment, the system may further include a clicks prediction module configured to predict a number of clicks on each sponsored search result based on user behaviors, qualities of the plurality of sponsored search results, and the correlations of the plurality of sponsored search results using a machine learning model, wherein the decision module is further configured to determine the placement of the plurality of sponsored search results based on the predicted numbers of clicks.
- According to yet another embodiment of the present teaching, a non-transitory machine-readable medium having information recorded thereon for placing sponsored search results in a search results page, wherein the information, when read by the machine, causes the machine to perform receiving a search query from a user extracting one or more keywords from the search query; receiving a plurality of sponsored search results related to the one or more keywords; determining placement of the plurality of sponsored search results based on correlations of the plurality of sponsored search results; and presenting to the user, a search results page containing the plurality of sponsored search results.
- The methods, systems, and/or programming described herein are further described in terms of exemplary embodiments. These exemplary embodiments are described in detail with reference to the drawings. These embodiments are non-limiting exemplary embodiments, in which like reference numerals represent similar structures throughout the several views of the drawings, and wherein:
-
FIG. 1 illustrates an exemplary system diagram for placing sponsored search results in a search result page, according to an embodiment of the present teaching; -
FIG. 2 illustrates an exemplary system diagram for placing sponsored search results in a search result page, according to another embodiment of the present teaching; -
FIG. 3 illustrates an exemplary search results generation engine and placement engine, according to an embodiment of the present teaching; -
FIG. 4 illustrates an exemplary flowchart of the process for presenting a search result page including the sponsored search results, according to an embodiment of the present teaching; -
FIG. 5 illustrates an exemplary diagram of a placement engine, according to an embodiment of the present teaching; -
FIG. 6 illustrates an exemplary flowchart of the process for placing the sponsored search results, according to an embodiment of the present teaching; -
FIG. 7 illustrates an exemplary diagram of a placement engine, according to another embodiment of the present teaching; -
FIG. 8 illustrates an exemplary flowchart of the process for placing the sponsored search results, according to another embodiment of the present teaching; -
FIG. 9 illustrates an exemplary placement of the sponsored search results, according to an embodiment of the present teaching; -
FIG. 10 illustrates an exemplary diagram of a placement engine, according to yet another embodiment of the present teaching; -
FIG. 11 illustrates an exemplary flowchart of the process for placing the sponsored search results, according to yet another embodiment of the present teaching; -
FIG. 12 illustrates an exemplary placement of the sponsored search results, according to another embodiment of the present teaching; -
FIG. 13 depicts a general mobile device architecture on which the present teaching can be implemented; and -
FIG. 14 depicts a general computer architecture on which the present teaching can be implemented. - In the following detailed description, numerous specific details are set forth by way of examples in order to provide a thorough understanding of the relevant teachings. However, it should be apparent to those skilled in the art that the present, teachings may be practiced without such details. In other instances, well known methods, procedures, systems, components, and/or circuitry have been described at a relatively high-level, without detail, in order to avoid unnecessarily obscuring aspects of the present teachings.
- Throughout the specification and claims, terms may have nuanced meanings suggested or implied in context beyond an explicitly stated meaning. Likewise, the phrase “in one embodiment/example” as used herein does not necessarily refer to the same embodiment and the phrase “in another embodiment/example” as used herein does not necessarily refer to a different embodiment. It is intended, for example, that claimed subject matter include combinations of example embodiments in whole or in part.
- In general, terminology may be understood at least in part from usage in context. For example, terms, such as “and”, “or”, or “and/or,” as used herein may include a variety of meanings that may depend at least in part upon the context in which such terms are used. Typically, “or” if used to associate a list, such as A, B or C, is intended to mean A, B, and C, here used in the inclusive sense, as well as A, B or C, here used in the exclusive sense. In addition, the term “one or more” as used herein depending at least in part upon context, may be used to describe any feature, structure, or characteristic in a singular sense or may be Used to describe combinations of features, structures or characteristics in a plural sense. Similarly, terms, such as “a,” “an,” or “the,” again, may be understood to convey a singular usage or to convey a plural usage, depending at least in part upon context. In addition, the term “based on” may be understood as not necessarily intended to convey an exclusive set of factors and may, instead allow for existence of additional factors not necessarily expressly described, again, depending at least in part on context.
- The present teaching incorporates user behaviors associated with the user inputting a search query, quality factors of the sponsored search results related to the search query, and correlation factors of the sponsored search results to attain a novel and strengthened prediction model to predict numbers of clicks on the sponsored search results and determine the placement of the sponsored search results in a search results page. In particular by evaluating the correlation influence of other sponsored search results to be placed together on the search results page, the present teaching offers the most appropriate placement of the sponsored search results as well as personalized search results that better meet the user's interest. Meanwhile, it contributes to enhance user experience with the publisher website, which in turn, keeps loyalty of the users as well as more new users.
- Additional novel features will be set forth in part in the description which follows, and in part will become apparent to those skilled in the art upon examination of the following and the accompanying drawings or may be learned by production or operation of the examples. The novel features of the present teachings may be realized and attained by practice or use of various aspects of the methodologies, instrumentalities and combinations set forth in the detailed examples discussed below.
-
FIG. 1 illustrates an exemplary system diagram for placing sponsored search results in a search result page, according to an embodiment of the present teaching. When auser 102 initiates a search on a search engine nested on a publisher website, thepublisher 104 releases a bid request to theadvertisers 106 via anetwork 110. A bid process on the available ad spots in connection with one or more search keywords automatically occurs. An intermediate agency such as an ad exchange determines the winning bids in accordance with the number of available ad spots on the publisher website. Meanwhile, the search engine searches for content-based search results from a variety ofcontent sources 112. A search resultsgeneration engine 114 then fetches the content-based search results from the variety ofcontent sources 112 and the sponsored search results from adatabase 108 to be presented to the user in accordance with the winning bids. The search resultsgeneration engine 114 further communicates with aplacement engine 116 to determine the placement of the sponsored search results in accordance with the available ad spots on the publisher website. - The
user 102 may connect to the network via various types of devices, for example, a desktop computer, a laptop computer, a mobile device, a built-in device in a motor vehicle, etc. Thenetwork 110 may be a single network or a combination of multiple networks. For example, thenetwork 110 may be a local area network (LAN), a wide area network (WAN), to public network, a private network, a proprietary network, a Public Telephone Switched Network (PSTN), the Internet, a wireless communication network, a virtual network, or any combination thereof. Thepublisher 104 may be any entity that hosts one or more spots in its properties (e.g., web sites, applications, etc,) for presenting search results to theuser 102. Thepublisher 104 may also be a search engine, a blogger, a television station, a newspaper issuer, a web page host, a content portal, an online service provider, or a game server. Theadvertiser 106 may be any entity that provides inventory to be displayed on the publisher's webpage. The inventory may be electrical devices, fashion items, soft drinks, travel services, merchandize coupons etc. In response to the search query inputted by theuser 102, theadvertisers 106 present the inventory related to the search keywords. According to the illustrated embodiment, the search resultspage generation engine 114 and theplacement engine 116 operates as independent service providers and directly connect to network 110. -
FIG. 2 illustrates an exemplary system diagram for placing sponsored search results in a search result page, according to another embodiment of the present teaching. The system environment illustrated herewith is similar toFIG. 1 , except that theplacement engine 116 operates as a backend system of the search resultspage generation engine 114 for determining the placement of sponsored search results in a search results page. In some embodiment, theplacement engine 116 may be incorporated into the search resultspage generation engine 114 as one entity. -
FIG. 3 illustrates an exemplary search results generation engine and placement engine, according to an embodiment of the present teaching. A user 02 initiates a search query which is transmitted to asearch query processor 304. Upon receiving the search query, thesearch query processor 304 forwards it to aweb server 306, and meantime, stores the search query in aquery log database 332. Anad space detector 308 detects available ad spaces on the search results page to be produced in response to the search query, and forwards the number of the available ad spaces and one or more keywords related to the search query to abid requestor 310. A bid on the available ad spaces and related to the search keywords is generated at the bid requestor 319, and forwarded to advertisers via anad exchange 312. Abid receiver 314 receives all bids upon the available ad spaces and the search keywords, and forwards the bids to abid processor 316. Thebid processor 316 ranks the received bids used on the amount that is bid, and forwards the bid rankings to abid selector 318. Thebid selector 318 selects a number of high bids to be placed on the available ad spaces on the search results page, and forwards the selected bids to anad requestor 320. Upon receiving the selected bids, thead requestor 320 sends a request to obtain ads to be placed on the search results page corresponding to the selected bids via thead exchange 312. Thead exchange 312 further forwards the candidate ads in response to the selected bids to thecandidate ads receiver 322. - According to the present embodiment, a
placement engine 116 receives the candidate ads, i.e., the sponsored search results in response to the search query, and determines the arrangement of the sponsored search results on the search results page. Further, the searchresults generation engine 114 fetches the sponsored search results with determined arrangement from theplacement engine 116 and content-based search results fromvarious content sources 112 via asearch engine 328. The search resultsgeneration engine 114 incorporates the content-based search results and the sponsored search results into a search resultspage 334 and presents the search resultspage 334 to the user 302. -
FIG. 4 illustrates an exemplary flowchart of the process for presenting a search results page including the sponsored search results, according to an embodiment of the present teaching. According to the embodiment illustrated inFIG. 3 , the process for presenting a search results page may include receiving a search query from auser 402; searching content-based search results in response to thesearch query 404; providing the content-based search results to a search results.generation engine 406; retrieving one or more keywords from thesearch query 408; determining available ad spaces on the search results page to be produced in response to thesearch query 410; sending to bid request to a plurality ofadvertisers 412; selecting a plurality of sponsored search results based on the receivedbids 414; determining placement of the sponsored search results 416; and presenting search results in response to the search query including the content-based search results and the sponsored search results with thedetermined placement 418. -
FIG. 5 illustrates an exemplary diagram of a placement engine, according to an embodiment of the present teaching. Theplacement engine 116 according to the illustrated embodiment includes a user interfacing module 502 configured to receive a search query from theuser 102; akeyword extractor 504 configured to extract one or more keywords from the received search query; areceiving module 510 configured to receive a plurality of sponsored search results related to the extractedkeywords 508; adecision module 524 configured to determine placement of the plurality of sponsored search results based. on a variety of factors; and apresenting module 526 configured to present the search results page containing, the plurality of sponsored search results. - In some embodiment, the
placement engine 116 may further include a user behavior analyzing module 506 configured to retrieve behavior information associated with the user from a database, analyze the behavior information, and provide the behavior related factor for predicting clicks on the sponsored search results. - In some embodiment, the
placement engine 116 may further include a qualityfactors analyzing module 512 configured to obtain a plurality of quality factors associated with each sponsored search result, analyze the plurality of quality factors, and provide the quality related factors for predicting clicks on the sponsored search results. - In some embodiment, the
placement engine 116 may further include aclicks prediction module 518 configured to receive inputs from the user behavior analyzing module 506 and the qualityfactor analyzing module 512, and predict a number of clicks on each sponsored search result to be placed on the search results page. Theclicks prediction module 518 may select one of thedicks prediction models 516 via aprediction model selector 514. In some embodiment, the clicks prediction model is trained to evaluate each sponsored search result using historical data related to the performance of the sponsored search results. According to the present embodiment, theclicks prediction module 518 selects a trained machine learning model for clicks prediction. - In some embodiment, the
placement engine 116 may further includes aranking module 520 configured to rank the plurality of sponsored search results based on the results of the clicks prediction, and forward the rankings to thedecision module 524 to determine the placement. In some embodiment, thedecision module 524 may refer to aspace layout 522 to determine the actual positions of the available ad spots on the search results page. -
FIG. 6 illustrates an exemplary flowchart of the process for placing the sponsored search results, according to an embodiment of the present teaching. According to the embodiment illustrated inFIG. 5 , the process for placing the sponsored search results may include receiving userbehavior analyzing results 602; receiving qualityfactors analyzing results 604; predicting clicks for sponsored search results usingmachine learning model 606; ranking the sponsored search results based on theclicks prediction 608; and assigning spaces to the sponsoredsearch results 610 based on the ranking. -
FIG. 7 illustrates an exemplary diagram of a placement engine, according to another embodiment of the present teaching. According to the illustrated embodiment, the user behavior analyzing module 506 shown inFIG. 5 may further include auser profile collector 702 configured to obtain profile information of the user inputting the search query via the user interfacing module 502; auser behavior classifier 706 configured to classify the user behaviors into different categories; and auser behavior analyzer 708 configured to retrieve the user behaviors from adatabase 704 based on the profile information, and estimate a user likelihood factor for each sponsored search result. In some embodiment, theuser behavior database 704 may store the user behaviors being observed on the publisher web site in the past time periods. The user behaviors may be allocated into different categories such asnavigation history 710,demographic information 712, ad relatedactivities 714, etc. Theclicks prediction module 518 may apply long-term historical user behaviors and/or short-term historical user behaviors to achieve more accurate prediction. The in some embodiment, the estimated likelihood factor indicates a chance that the user clicks the sponsored search result based on the user behaviors in the past. - In some embodiment, the user behavior analyzing module 506 shown in
FIG. 5 may further include aquality factors extractor 720 configured to obtain a plurality of quality factors associated with each sponsored search result; a quality factors categorizer 722 configured to classify the ad quality indicators; and a quality factors analyzer 726 configured to estimate a quality grade for each sponsored search result based on the quality factors. In some embodiment, the quality factors of an ad, i.e., a sponsored search result may be defined in multiple categories such as historical click through ratio (CTR) 724,landing page quality 728,geographic performance 730,ad relevance 732, etc. -
FIG. 8 illustrates an exemplary flowchart of the process for placing the sponsored search results, according to another embodiment of the present teaching. According to the embodiment inFIG. 7 , the process for placing the sponsored search results may include receiving a search query from auser 802; collecting profile information associated with theuser 804; retrieving historicaluser behavior information 806; extracting search keywords From thesearch query 810; receiving a plurality of sponsoredsearch results 812 based on the user behaviors and the quality factors; analyzing the user behaviors and estimating likelihoods of clicks on the sponsored search results based on theuser behaviors 808. - In some embodiment, the process for placing the sponsored search results may further include extracting quality factors from the sponsored search results 814; analyzing the quality factors and estimating quality factors for the sponsored search results 816; predicting the clicks on the sponsored search results using a trained
machine learning model 818; ranking the sponsored search results based on the predictedclicks 820; and assigning available ad spaces to the sponsored search results 822. -
FIG. 9 illustrates an exemplary placement of the sponsored search results, according to an embodiment of the present teaching. An exemplary search result page includes four ad spaces:space 902,space 904,space 906, andspace 908. Four ads (Ad # 1,Ad # 2,Ad # 3, and Ad #4) are selected to be placed inspaces 902 908, respectively. An initial ranking of the four ads based on the amount they bid shows thatAd # 1 ranks at a first place,Ad # 2 ranks at a second place,Ad # 3 tanks at a third place, andAd # 4 ranks at a fourth place. Further, quality factors analysis results show thatAd # 1 has low quality,Ad # 2 has high quality,Ad # 3 has high quality, andAd # 4 has medium quality. Even further, user behaviors analysis results show thatAd # 1 receives to user likelihood to click,Ad # 2 receives low user likelihood to click,Ad # 3 receives high user likelihood to click, andAd # 4 receives medium user likelihood to click. Based or the quality factors analysis and the user behaviors analysis,Ad # 1 is predicted to have 5,000 clicks,Ad # 2 is predicted to have 15,000 clicks,Ad # 3 is predicted to have 20,000 clicks, andAd # 4 is predicted to have 8,000 clicks. Based on the predicted clicks on the four ads, the final ranking differs from the initial ranking in thatAd # 3 ranks at the first place,Ad # 4 ranks at the third place, andAd # 1 ranks at the fourth place. Accordingly,Ad # 3 is placed inspace 902,Ad # 2 is placed inspace 904,Ad # 4 is placed inspace 906, andAd # 1 is placed inspace 908. - According to the embodiments set forth above, predicting ad clicks in accordance with the user behaviors and the ads quality factors not only provides the user with suitable sponsored search results placement and personalized searching experience, but also increases the revenue of the publisher web site by more accurate ad displaying.
-
FIG. 10 illustrates an exemplary diagram of a placement engine, according to yet another embodiment of the present teaching. According to the illustrated embodiment, theplacement engine 116 shown inFIG. 7 may further include acreative extractor 1002 configured to obtain a creative associated with each sponsored search results; and acorrelation analyzer 1004 configured to estimate a correlation factor for each sponsored search result based on the creativtes. The correlation factor in the present embodiment indicates an interactional level between a sponsored search result and other sponsored search results to be placed together on the search results page. The estimated correlation factors are further inputted into theclicks prediction module 518 to estimate the clicks on the sponsored search results. - In some embodiment, the ad creative includes all the information for visually rendering the ad itself on a publisher web site such as descriptions, format extensions (i.e., site links), layout, etc.
- On the contrary to the embodiment shown in FIG., 7, which focuses on individual sponsored search result itself, the present embodiment introduces the correlation influence of other sponsored search results to be placed in the same page to provide more appropriate display. For example, if higher ranked ads have at least one “very good” ad, current ad is less likely to be clicked; or if all higher ranked ads are not “very good” current one is more likely to be clicked. Thus, utilizing the correlation influence of other sponsored search results in addition to the user behaviors and the ad quality factors can produce more accurate prediction on the ad clicks, which leads to more appropriate ad placement.
-
FIG. 11 illustrates an exemplary flowchart of the process for placing the sponsored search results, according to yet another embodiment of the present teaching. According to the embodiment illustrated inFIG. 10 , the process fir placing the sponsored search results may include receiving a search query from auser 1102; collecting profile information associated with theuser 1104; retrieving historicaluser behavior information 1106; extracting search keywords from thesearch query 1110; receiving a plurality of sponsored search results in response to thesearch query 1122; analyzing the user behaviors and estimating likelihoods of clicks on the sponsoredsearch results 1108; extracting quality factors from the sponsoredsearch results 1112; analyzing the quality factors and estimating thequality grades 1114; extracting creatives from the sponsoredsearch results 1124; analyzing the creatives and estimating correlation factors for the sponsoredsearch results 1126; predicting clicks using a machine learning model based on the user behaviors, quality factors, andcorrelation factors 1116; ranking the sponsored search results based on theclicks prediction 1118; and assigning spaces to the sponsored search results 1120. -
FIG. 12 illustrates an exemplary placement of the sponsored search results, according to another embodiment of the present teaching. The exemplary placement introduces an additional correlation factor estimation to predict the clicks on the sponsored search results. The analysis on the quality factors and the user behaviors shows the same results as inFIG. 9 , in addition, the correlation factors analysis shows thatAd # 1 receives low influence from other ads,Ad # 2 receives low influence from other ads.Ad # 3 receives high influence from other ads, andAd # 4 receives medium influence from other ads. The clicks prediction by incorporating the correlation factors analysis shows thatAd # 1 is predicted to have 6,000 clicks,Ad # 2 is predicted to have 19,000 clicks.Ad # 3 is predicted to have 18,000 clicks, andAd # 4 is predicted to have 8,000 clicks. The final ranking by incorporating the correlation factors analysis Shows thatAd # 2 exceedsAd # 3, and ranks at the first place. Consequently,Ad # 2 replacesAd # 3 to be placed on thebest ad space 902. - The present embodiment combines the user behaviors, the sponsored search result internal features (i.e., the quality factors), and the sponsored search result external features (i.e., the correlation factors) to attain a strengthened prediction model, in particular, by evaluating the impact of other sponsored search results to be placed together on the search results page, the present teaching offers the most appropriate placement of the sponsored search results, improves user experience, and attracts more new users.
-
FIG. 13 depicts a general mobile device architecture on which the present teaching can be implemented in this example, the user device is amobile device 1300, including but is not limited to, a smart phone, a tablet, a music player, a handled gaming console, a global positioning system (GPS) receiver, a smart-TV, wearable devices, etc. Themobile device 1300 in this example includes one or more central processing units (CPUs) 1302, or more graphic processing units (GPUs) 1304, adisplay 1306, amemory 1308, acommunication platform 1310, such as a wireless communication module,storage 1312, and one or more input/output (I/O)devices 1314. Any other suitable component, such as but not limited to a system bus or a controller (not shown), may also be included in themobile device 1300. As shown inFIG. 13 , amobile operating system 1316, e.g., iOS, Android, Windows Phone, etc., and one ormore applications 1318 may be loaded into thememory 1308 from thestorage 1312 in order to be executed by theCPU 1302. Theapplications 1318 may include a browser or any other suitable mobile apps for sending a search query and rendering the search results page including the sponsored search results page through themobile device 1300. Execution of theapplications 1318 may cause themobile device 1300 to perform the processing as described above in the present teaching. For example, presentation of a search results page including sponsored search results may be made by theGPU 1304 in conjunction with thedisplay 1306. A request for loading a search results page in response to a search query may be inputted by the user via the I/O devices 1314 and transmitted via thecommunication platform 1310. - To implement the present teaching, computer hardware platforms may be used as the hardware platform(s) for one or more of the elements described herein. The hardware elements, operating systems, and programming languages of such computers are conventional in nature, and it is presumed that those skilled in the an are adequately familiar therewith to adapt those technologies to implement the processing essentially as described herein. A computer with user interface elements may be used to implement a personal computer (PC) or other type of work station or terminal device, although a computer may also act as a server if appropriately programmed, it is believed that those skilled in the an are familiar with the structure, programming, and general operation of such computer equipment and as a result the drawings should be self-explanatory.
-
FIG. 14 depicts a general computer architecture on which the present teaching can be implemented and has a functional block diagram illustration of a computer hardware platform that includes user interface elements. The computer may be a general-purpose computer or a special purpose computer. Thiscomputer 1400 can be used to implement any components of the system for placing sponsored search results in a search results page as described herein. Different components of the systems disclosed in the present teaching can all be implemented on one or more computers such ascomputer 1400, via its hardware, software program, firmware, or a combination thereof. Although only one such computer is shown, for convenience, the computer functions relating to placing the sponsored search results page may be implemented in a distributed fashion on a number of similar platforms, to distribute the processing load. - The
computer 1400, for example, includesCOM ports 1402 connected to and from a network connected thereto to facilitate data communications. Thecomputer 1400 also includes aCPU 1404, in the form of one or more processors, for executing program instructions. The exemplary computer platform includes an internal communication bus 1406, program storage and data storage of different forms, e.g.,disk 1408, read only memory (ROM) 1410, or random access memory (RAM) 1412, for various data files to be processed and/or communicated by the computer, as well as possibly program instructions to be executed by theCPU 1404. Thecomputer 1400 also includes an I/O component 1414, supporting input/output flows between the computer and other components therein such asuser interface elements 1416. Thecomputer 1400 may also receive programming and data via network communications. - Hence, aspects of the methods of placing sponsored search results in a search results page, as outlined above, may be embodied in programming. Program aspects of the technology may be thought of as “products” or “articles of manufacture” typically in the form of executable code and/or associated. data that is carried on or embodied in a type of machine readable medium. Tangible non-transitory “storage” type media include any or all of the memory or other storage for the computers, processors or the like, or associated modules thereof, such as various semiconductor memories, tape drives, disk drives and the like, which may provide storage at any time for the software programming.
- All or portions of the software may at times be communicated through a network such as the Internet or various other telecommunication networks. Such communications, for example, may enable loading of the software from one computer or processor into another. Thus, another type of media that may bear the software elements includes optical, electrical, and electromagnetic waves, such as used across physical interfaces between local devices, through wired and optical landline networks and over various air-links, The physical elements that carry such waves, such as wired or wireless links, optical links or the like, also may be considered as media bearing the software. As used herein, unless restricted to tangible “storage” media, terms such as computer or machine “readable mediums” refer to any medium that participates in providing instructions to a processor for execution.
- Hence, a machine readable medium may take many forms, including but not limited to, a tangible storage medium, a carrier wave medium or physical transmission medium. Non-volatile storage media include, for example, optical or magnetic disks, such as any of the storage devices in any computer(s) or the like, which may be used to implement the system or any of its components as shown in the drawings. Volatile storage media include dynamic memory, such as a main memory of such a computer platform. Tangible transmission media include coaxial cables; copper wire and fiber optics, including the wires that form a bus within a computer system. Carrier-wave transmission media can take the form of electric or electromagnetic signals, or acoustic or light waves such as those generated during radio frequency (RF) and infrared (IR) data communications. Common forms of computer-readable media therefore include for example at floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, DVD or DVD-ROM, any other optical medium, punch cards paper tape, any other physical storage medium with patterns of holes, a RAM, a PROM and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave transporting data or instructions, cables or links transporting such a carrier wave, or any other medium from which a computer can read programming code and/or data. Many of these forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to a processor for execution.
- Those skilled in the art will recognize that the present teachings are amenable to a variety of modifications and/or enhancements. For example, although the implementation of various components described above may be embodied in a hardware device, it can also be implemented as a software only solution—e.g., an installation on an existing server. In addition, the units of the host and the client nodes as disclosed herein can be implemented as a firmware, firmware/software combination, firmware/hardware combination, or a hardware/firmware/software combination.
- While the foregoing has described what are considered to be the best mode and/or other examples, it is understood that various modifications may be made therein and that the subject matter disclosed herein may be implemented in various forms and examples, and that the teachings may be applied in numerous applications, only some of which have been described herein. It is intended by the following claims to claim any and all applications, modifications and variations that fall within the true scope of the present teachings.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/241,563 US20210248643A1 (en) | 2015-06-09 | 2021-04-27 | Method and system for sponsored search results placement in a search results page |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2015/081046 WO2016197316A1 (en) | 2015-06-09 | 2015-06-09 | Method and system for sponsored search results placement in a search results page |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2015/081046 A-371-Of-International WO2016197316A1 (en) | 2015-06-09 | 2015-06-09 | Method and system for sponsored search results placement in a search results page |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/241,563 Division US20210248643A1 (en) | 2015-06-09 | 2021-04-27 | Method and system for sponsored search results placement in a search results page |
Publications (1)
Publication Number | Publication Date |
---|---|
US20160364757A1 true US20160364757A1 (en) | 2016-12-15 |
Family
ID=57502942
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/896,590 Abandoned US20160364757A1 (en) | 2015-06-09 | 2015-06-09 | Method and system for sponsored search results placement in a search results page |
US17/241,563 Pending US20210248643A1 (en) | 2015-06-09 | 2021-04-27 | Method and system for sponsored search results placement in a search results page |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/241,563 Pending US20210248643A1 (en) | 2015-06-09 | 2021-04-27 | Method and system for sponsored search results placement in a search results page |
Country Status (2)
Country | Link |
---|---|
US (2) | US20160364757A1 (en) |
WO (1) | WO2016197316A1 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111488510A (en) * | 2020-04-17 | 2020-08-04 | 支付宝(杭州)信息技术有限公司 | Method and device for determining related words of small program, processing equipment and search system |
US10839033B1 (en) * | 2019-11-26 | 2020-11-17 | Vui, Inc. | Referring expression generation |
US11172040B2 (en) * | 2018-08-06 | 2021-11-09 | Baidu Online Network Technology (Beijing) Co., Ltd. | Method and apparatus for pushing information |
CN114357292A (en) * | 2021-12-29 | 2022-04-15 | 阿里巴巴(中国)有限公司 | Model training method, device and storage medium |
US11481698B2 (en) * | 2016-01-08 | 2022-10-25 | Alibaba Group Holding Limited | Data-driven method and apparatus for handling user inquiries using collected data |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100049644A1 (en) * | 2008-08-25 | 2010-02-25 | Google Inc. | Content item slot scheduling |
US20120143672A1 (en) * | 2010-12-06 | 2012-06-07 | Siyu You | Systems and Methods for List Ranking and Ads Placement Using Interaction Freatures |
US20130144717A1 (en) * | 2011-12-05 | 2013-06-06 | Yellowpages.Com, Llc | System and Method for Hyper Local Advertisements in a Mobile Communication Network |
US20140058793A1 (en) * | 2012-08-21 | 2014-02-27 | Microsoft Corporation | Forecasting a number of impressions of a prospective advertisement listing |
US20140181634A1 (en) * | 2012-12-20 | 2014-06-26 | Google Inc. | Selectively Replacing Displayed Content Items Based on User Interaction |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090192983A1 (en) * | 2008-01-28 | 2009-07-30 | Yahoo! Inc. | Method and system for mining, ranking and visualizing lexically similar search queries for advertisers |
US8762364B2 (en) * | 2008-03-18 | 2014-06-24 | Yahoo! Inc. | Personalizing sponsored search advertising layout using user behavior history |
US20100042487A1 (en) * | 2008-08-12 | 2010-02-18 | Yosef Barazani | Apparatus and Method of Monetizing Hyperlinks |
US8019746B2 (en) * | 2009-03-02 | 2011-09-13 | Yahoo! Inc. | Optimized search result columns on search results pages |
CN103336796A (en) * | 2013-06-09 | 2013-10-02 | 北京百度网讯科技有限公司 | Method and system for displaying door buster directly |
CN104462397A (en) * | 2014-12-10 | 2015-03-25 | 北京国双科技有限公司 | Promotion information processing method and promotion information processing device |
US10963915B2 (en) * | 2018-03-23 | 2021-03-30 | The Bartley J. Madden Foundation | Machine-learning based systems and methods for optimizing search engine results |
-
2015
- 2015-06-09 US US14/896,590 patent/US20160364757A1/en not_active Abandoned
- 2015-06-09 WO PCT/CN2015/081046 patent/WO2016197316A1/en active Application Filing
-
2021
- 2021-04-27 US US17/241,563 patent/US20210248643A1/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100049644A1 (en) * | 2008-08-25 | 2010-02-25 | Google Inc. | Content item slot scheduling |
US20120143672A1 (en) * | 2010-12-06 | 2012-06-07 | Siyu You | Systems and Methods for List Ranking and Ads Placement Using Interaction Freatures |
US20130144717A1 (en) * | 2011-12-05 | 2013-06-06 | Yellowpages.Com, Llc | System and Method for Hyper Local Advertisements in a Mobile Communication Network |
US20140058793A1 (en) * | 2012-08-21 | 2014-02-27 | Microsoft Corporation | Forecasting a number of impressions of a prospective advertisement listing |
US20140181634A1 (en) * | 2012-12-20 | 2014-06-26 | Google Inc. | Selectively Replacing Displayed Content Items Based on User Interaction |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11481698B2 (en) * | 2016-01-08 | 2022-10-25 | Alibaba Group Holding Limited | Data-driven method and apparatus for handling user inquiries using collected data |
US11928617B2 (en) | 2016-01-08 | 2024-03-12 | Alibaba Group Holding Limited | Data-driven method and apparatus for handling user inquiries using collected data |
US11172040B2 (en) * | 2018-08-06 | 2021-11-09 | Baidu Online Network Technology (Beijing) Co., Ltd. | Method and apparatus for pushing information |
US10839033B1 (en) * | 2019-11-26 | 2020-11-17 | Vui, Inc. | Referring expression generation |
US11461420B2 (en) * | 2019-11-26 | 2022-10-04 | Vui, Inc. | Referring expression generation |
CN111488510A (en) * | 2020-04-17 | 2020-08-04 | 支付宝(杭州)信息技术有限公司 | Method and device for determining related words of small program, processing equipment and search system |
CN114357292A (en) * | 2021-12-29 | 2022-04-15 | 阿里巴巴(中国)有限公司 | Model training method, device and storage medium |
Also Published As
Publication number | Publication date |
---|---|
WO2016197316A1 (en) | 2016-12-15 |
US20210248643A1 (en) | 2021-08-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20210248643A1 (en) | Method and system for sponsored search results placement in a search results page | |
US10789304B2 (en) | Method and system for measuring user engagement with content items | |
US9600600B2 (en) | Method and system for evaluating query suggestions quality | |
US8812362B2 (en) | Method and system for quantifying user interactions with web advertisements | |
US20230041467A1 (en) | Method and system for measuring user engagement with content items | |
US9471570B2 (en) | Method and system for user selection of query suggestions | |
US20140188593A1 (en) | Selecting an advertisement for a traffic source | |
US8849694B1 (en) | Predicting promotional message response based on device distance | |
US10699198B2 (en) | Method and system for cold-start item recommendation | |
US20160267520A1 (en) | Method and system for online user engagement measurement | |
CN108596695B (en) | Entity pushing method and system | |
US20170076327A1 (en) | Method and system for dynamically providing advertisements for comparison | |
KR20190007875A (en) | Method for providing marketing management data for optimization of distribution and logistic and apparatus therefor | |
US20140279736A1 (en) | Method and system for mapping short term ranking optimization objective to long term engagement | |
US20130254025A1 (en) | Item ranking modeling for internet marketing display advertising | |
US20130006760A1 (en) | Systems and methods for presenting comparative advertising | |
US20220358175A1 (en) | Method and system of personalized blending for content recommendation | |
US20160275569A1 (en) | Method and system for advertisement coordination | |
KR101998399B1 (en) | Mobile commerce system and service method using big data | |
KR20180121734A (en) | Method and system for automating advertisement media mix | |
WO2016095130A1 (en) | Method and system for exploring crowd sourced user curated native advertisements | |
WO2015184607A1 (en) | Method and system for advertisement coordination | |
US20160124580A1 (en) | Method and system for providing content with a user interface | |
US20170371880A1 (en) | Method and system for providing a search result | |
CN110827044A (en) | Method and device for extracting user interest mode |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: YAHOO! INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ZHANG, SHANSHAN;WANG, QINGQUAN;ZHU, SIYU;AND OTHERS;SIGNING DATES FROM 20090814 TO 20151119;REEL/FRAME:037243/0370 |
|
AS | Assignment |
Owner name: YAHOO HOLDINGS, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:YAHOO! INC.;REEL/FRAME:042963/0211 Effective date: 20170613 |
|
AS | Assignment |
Owner name: OATH INC., NEW YORK Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:YAHOO HOLDINGS, INC.;REEL/FRAME:045240/0310 Effective date: 20171231 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
AS | Assignment |
Owner name: VERIZON MEDIA INC., NEW YORK Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:OATH INC.;REEL/FRAME:054258/0635 Effective date: 20201005 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |