WO2014110048A1 - Browser interface for accessing supple-mental content associated with content pages - Google Patents

Browser interface for accessing supple-mental content associated with content pages Download PDF

Info

Publication number
WO2014110048A1
WO2014110048A1 PCT/US2014/010530 US2014010530W WO2014110048A1 WO 2014110048 A1 WO2014110048 A1 WO 2014110048A1 US 2014010530 W US2014010530 W US 2014010530W WO 2014110048 A1 WO2014110048 A1 WO 2014110048A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
page
user
computing device
display
Prior art date
Application number
PCT/US2014/010530
Other languages
French (fr)
Inventor
Brett Richard TAYLOR
Ameet Nirmal VASWANI
Peter Frank HILL
Jason Daniel LANDRY
Ranganath Atreya
Yang Xu
Charley Ames
Christopher James SULLINS
Original Assignee
Amazon Technologies, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/737,596 external-priority patent/US20140195890A1/en
Priority claimed from US13/737,760 external-priority patent/US20140195337A1/en
Application filed by Amazon Technologies, Inc. filed Critical Amazon Technologies, Inc.
Publication of WO2014110048A1 publication Critical patent/WO2014110048A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9535Search customisation based on user profiles and personalisation

Definitions

  • FIG. 1 is a pictorial diagram of a computing device having a display upon which a content item is presented in a first page and upon which supplemental content is presented in a second, flipped page in response to a user interaction with the computing device, the user interaction occurring while the content item is being presented in the first page on the display.
  • FIG. 2 is a pictorial diagram of a computing device having a display upon which one or more content items are presented in a first page, and upon which supplemental content is presented in one or more flipped panels in the first page in response to a user interaction with the computing device, the user interaction occurring while the content items are being presented in the first page on the display.
  • FIG.3 is a block diagram illustrative of an operating environment in which supplemental content may be provided to a computing device for presentation in a flipped page or pane according to one embodiment.
  • FIG. 3A is a block diagram illustrative of an operating environment in which supplemental content may be provided to a computing device for presentation in a second orientation.
  • FIG. 4 is a flow diagram of an illustrative process for obtaining supplemental content for presentation in a flipped page or pane.
  • FIG. 4A is a block diagram illustrative of components of a computing device for use in presenting a content item in a first orientation and presenting supplemental content to the content item in a second orientation.
  • FIGS. 5A, 5B and 5C are illustrative user interfaces generated on the computing device that prompt a user to provide information for configuring supplemental content to be displayed to a user DETAILED DESCRIPTION
  • aspects of the present disclosure relate to presenting one or more content items in a first page on a display of a computing device and automatically presenting supplemental content in a second,“flipped” page on the display following detection of a user interaction with the computing device.
  • One aspect of the disclosure is a browser user interface than enables a user to flip a content page over (e.g., via a touchscreen gesture) to view supplemental content (e.g., page metadata) associated with the page. While viewing the supplemental content on the back side of the page in some embodiments, the user can perform a second or reverse flip operation to return to the original page.
  • the content items presented in the first page may, for example, be optimized for aesthetic reasons (e.g., due to screen resolution limitations such as limited screen“real estate”), or may simply be presented in their original form.
  • supplemental content may be presented in a flipped page on the display of the computing device.
  • the flipped page (which may also be referred to herein as the back side of the page) may present, for example, the“flip” or“back” side of the first page.
  • the flipped page may replace the first page on the display.
  • the flipped page may also present, for example, the content items as presented in the first page, with one or more portions, or panels, of the first page flippable to present supplemental content corresponding to the content items presented in the first page.
  • the supplemental content may include virtually any associated information in which the user may be interested and/or that is related or similar to the initial content. Accordingly, rather than presenting such supplemental content upon an affirmative request or search by the user, the supplemental content is presented to the user automatically when the user interacts with the computing device, e.g., when performing a flick or swipe gesture which simulates flipping the page over, among other possible user interactions.
  • the look and feel of the page may be preserved when the flip operation is performed to create an impression that the back side of the page is part of the same site.
  • FIG. 1 depicts a practical example of a presentation of such supplemental content in a flipped page following detection of a user interaction with a computing device 100, the detection occurring while the content item is being displayed in a first page on the display.
  • an initial content item 102 is presented in a first page on a display 104 of a computing device 100, for example via a browser application.
  • the content item 102 is a webpage describing an item available for purchase from a retail website. More specifically, in the illustrated example, the item available for purchase is a platinum diamond ring and the webpage includes information 106 related to the ring, such as an image of the ring, a customer review rating for the ring, seller data, price data and availability data.
  • the webpage includes various software selection/controls 108 for purchasing the ring, adding the ring to an electronic shopping cart or wish list and searching for related items available for purchase.
  • the illustrated user interface also provides a flip indicator 116 in the bottom right corner of the display 104, to indicate that the page may be flipped over to view supplemental content associated with the content item 102.
  • the flip indicator may appear in any corner or side of the display, or the flip indicator may be an icon or some other visual indicator appearing anywhere on the display.
  • the browser may modify the visual appearance of the flip indicator with movement or animation to reveal to the user that the page may be flipped over.
  • the bottom right corner may be animated to“peel back” slightly when the page is initially displayed, in order to indicate to the user that the page may be flappable.
  • the flip indicator may only be presented when supplemental content is available for the particular page or content item 102 being viewed.
  • supplemental content 114 also referred to as page metadata
  • the browser may create a visual appearance of the content page being flipped over to reveal the back side (e.g. the flipped page).
  • the illustrated supplemental content 114 includes, for example, video content 110 related to the ring, as well as search results 112 related to the ring.
  • video content 110 related to the ring
  • search results 112 related to the ring.
  • a user who is browsing a website may automatically be presented with additional information related to a webpage (or contents within a webpage) simply by flipping the page, and thus, the user is not required to actively search for such information. This can result in intuitive and more efficient navigation of information related to the content item and/or of interest to the user, without requiring affirmative input by the user.
  • presenting the supplemental content item in an alternative or flipped page may allow for a more aesthetically pleasing presentation of the content item than in the first page, and enable the user to delve deeper into certain content.
  • the user interface for the flipped page may also provide a reverse flip indicator 120, for example in the bottom left corner of the display 104, to indicate that the page may be flipped back to the first page presenting the content item 102.
  • the user the user interface for the flipped page may also provide an additional flip indicator, for example in the bottom right corner of the display 104, to indicate that the page may be flipped over again multiple times to present additional levels of supplemental content and/or page metadata related to the supplemental content 114 and/or the content item 102.
  • the user may be given the option to flip pages“forward” a virtually unlimited number of additional supplemental content pages or items, and the option to flip pages“backward” to return to prior flipped pages and/or the first page.
  • the user may be given the option to use the browser’s back button to reverse flip, or flip pages backward, as described above.
  • the option to use the browser’s back button in this way may also be a user-configurable setting.
  • the browser may display two types of“back” buttons or controls when the user flips multiple levels into the page: a single-level button for going back one level, and a“return to original page” button for going back multiple levels to the original page that was flipped.
  • the supplemental content 114 is typically, but not necessarily, provided by a data source (or combination of data sources) other than the source of the content page 102.
  • the supplemental content 114 may be supplied by an entity that operates independently of the retail website, without the involvement of the site’s owner or operator.
  • the disclosed interface may be used to present supplemental content for virtually any page or content item, including preexisting web pages.
  • FIG. 2 Another practical example of presentation of supplemental content in accordance with the present disclosure is illustrated in FIG. 2.
  • various initial content items 204A e.g., a music video in the illustrated example
  • 206A e.g., information about the artist
  • 208A e.g., information about upcoming shows by the artist
  • 210A e.g., information about where to buy the music featured in the video
  • each of the content items 204A, 206A, 208A, and 210A are presented on different panels or portions of the first page which may be individually flipped to view supplemental content.
  • supplemental content items 204B, 206B, 208B and 210B to the content items 204A, 206A, 208A and 210A are presented in flipped panels on the display 204 of the computing device 100.
  • the supplemental content items 204B, 206B, 208B and 210B may include some of the content items 204A, 206A, 208A and 210A previously presented on the display 204, as well as additional information related to the content items 204A, 206A, 208A and 210A and/or of possible interest to the user.
  • the depicted supplemental content/additional information includes metadata 204B related to the music video, such as a fan comments (as depicted in FIG. 2) and the ability for the user to add her own comment.
  • the back side of the page may also include a form or text entry box for the user to enter and submit comments associated with the page or content item. These user-entered comments may then be presented to other users viewing the back side of the page.
  • Metadata 204B (not shown) for the music video may include, for example, customer review ratings, information about the production of the music video, another version of the music video (e.g. a director’s cut, artist commentary, behind- the-scenes, live versions, remixes, etc.) and so on.
  • FIG. 2 depicts each panel corresponding to content items 204A, 206A, 208A and 210A in a“flipped” state to present supplemental content items 204B, 206B, 208B and 210B, this is merely to illustrate that multiple panels may be in different flipped states concurrently.
  • any number of flippable panels may be in a flipped state at any given time, allowing the user to access additional content and information while still viewing the original content items.
  • the user may want to flip through one or more of the panels 206A, 208A and 210A to access and view supplemental content while continuing to watch the music video at content item 204A (e.g., the user may not flip the panel corresponding to content item 204A).
  • the user may flip back and forth among multiple content item panels while the first page as a whole continues to be displayed.
  • other scenarios may also be possible.
  • the display and/or user interface may present an option for the user to flip a single panel (e.g., content item 206A presenting a summary of artist information) of the first page and present a second page replacing the view of the first page with supplemental content (e.g., content item 206B with expanded or more detailed artist information) related to or associated with the content item of the single panel.
  • supplemental content e.g., content item 206B with expanded or more detailed artist information
  • supplemental content may include virtually any type of information that may be related to the initial content item and/or be of interest to the user and that a content item may include any form of digital content. Accordingly, the terms “content,”“digital content” and“content item” are interchangeable herein. Examples of content items include, but are not limited to, music, songs, albums, movies, television shows, television broadcasts, radio broadcasts, videos, video games, documents, audio books, electronic books (“eBooks”), images, maps, articles, webpages or other multimedia works. Supplemental content for such content items may also include digital content, e.g., movies, webpages, documents, etc. and can provide additional information regarding the content item.
  • the supplemental content includes information typically presented with or as part of the content item in the first page, but this supplemental content is perhaps removed from the presentation in the first page so as to simplify or“de-clutter” said presentation.
  • U.S. Pat. Nos. 7,159,023, 8,145,542, and 8,271,878, describe some of the many types of metadata that can be presented using the disclosed user interface, and describe methods that may be used to generate or obtain such metadata.
  • the supplemental content could include a different form of the initial content.
  • the supplemental content could be a different version, format or size of the initial content.
  • the supplemental content could be a version of the original content in a different resolution (e.g. a mobile view, a table view, a desktop view, etc.) or displayed using 3D technology.
  • the information may then be presented on the display 104 in the flipped page following user interaction with the computing device 100.
  • the supplemental content information includes information obtained independently from the content item.
  • the supplemental content may be displayed to the user in the flipped page with the original content or, in other embodiments, may be displayed on its own.
  • Supplemental content may also include website-level metadata (e.g., related websites, website traffic rank, the date/time when the website was created or published, etc.).
  • this website-level metadata may be presented to the user when the user flips the home page associated with the website.
  • the size of the back side of the page may be fixed, or capped, so that a limit may be placed on how much supplemental content can be displayed.
  • Supplemental content may also include advertising content provided by content or service providers such as reviews (e.g. of products or services), channels (e.g. product and/or service review websites, multimedia review channels,“how to” channels, and the like) and advertisements related to a content item presented in the first page.
  • content or service providers such as reviews (e.g. of products or services), channels (e.g. product and/or service review websites, multimedia review channels,“how to” channels, and the like) and advertisements related to a content item presented in the first page.
  • a first page may present an article related to a particular product (e.g., a car)
  • supplemental content may include an advertisement for that product (e.g., an ad for the car, a video review about the car) which may be text-based, graphical, audio-visual, interactive, and so on.
  • the supplemental content may also provide options for the user to view and/or flip the page for more information about the product, such as technical specifications, additional user reviews, suggestions or recommendations on where the product may be available for purchase. Some or all of the supplemental content may be targeted for the user based on, for example, their location (e.g., suggestions on where to buy may be based on the user’s location) and/or other demographic information (e.g. age, gender).
  • content or service providers may be able to associate certain supplemental content (e.g., a channel, an advertisement, an advertisement incentive such as a coupon or reward, an application, etc.) with a content item, and to bid to have their supplemental content provided for display on a flipped page or panel corresponding to the content item.
  • the provider of the overall system may also provide incentives to users for flipping over pages and/or page elements, such as by occasionally revealing a prize or discount offer on the back side of a flipped page or page element.
  • the ads and other supplemental content presented to a user on the back side of the page may be selected dynamically from a pool of supplemental content associated with the page.
  • a history of the user’s past flip operations may be taken into consideration in deciding what supplemental content to present.
  • ad content may be associated with keywords or a certain series or sequence of flips events.
  • the overall system may also track the series or sequence of flips and select ads based on a specific pattern in the series or sequence.
  • the browser may create the appearance that the page is being flipped over an additional time to reveal the target (advertiser) page associated with the ad.
  • an ad may itself be flippable to reveal further supplemental content associated with the ad, such as corresponding ad or advertiser metadata, such as an average rating of the advertiser.
  • the supplemental content 114 may include information that may be removed from the webpage presented in the first page in order to simplify the presentation or make the presentation more aesthetically pleasing.
  • the price data, customer review rating, seller data, availability data and software controls could be removed from the webpage and instead included in the supplemental content. Accordingly, only the image and brief description of the ring offered for purchase on the webpage may be presented in the first page to the user.
  • the example illustrated in FIG. 1 the supplemental content 114 may include information that may be removed from the webpage presented in the first page in order to simplify the presentation or make the presentation more aesthetically pleasing.
  • the price data, customer review rating, seller data, availability data and software controls could be removed from the webpage and instead included in the supplemental content. Accordingly, only the image and brief description of the ring offered for purchase on the webpage may be presented in the first page to the user.
  • the supplemental content 204B, 206B, 208B and 210B may include additional information that is related not only to the music video presented in the first page, but to the particular artist presented in the first page.
  • FIG. 1 and 2 each depict only two pages (e.g., a first page and a flipped page, or a first page with one or more flipped panels), in some embodiments additional pages presenting different supplemental content can be provided when the device is flipped any number of times (e.g., as the user might, for example, while “flipping” through a book or a catalog).
  • different supplemental content can be displayed if device 100 is flipped in different directions (e.g., from left to right, right to left, top to bottom, bottom to top, etc.).
  • a swipe gesture in which a representation of a corner of the content page is dragged away from a corner of the touchscreen, touching and dragging a corner to simulate“peeling” a page corner back to flip the page, long-press followed by a swipe gesture, pinching or squeezing two or more fingers on an area of the display, etc.
  • a keyboard action e.g., pressing a“page down” key
  • some other manipulation of an input device e.g., flicking the computing device quickly to the left, right, up or down to simulate a “flipping” action, rotating, shaking, tilting and/or spinning of the computing device, etc.
  • the display of the computing device may expose the possibility of different user interactions on a single page to allow the user to flip to different pages.
  • the single page may allow the user to swipe from right-to-left to flip to a first flipped page, swipe from left-to-right to flip to a second flipped page (or to reverse flip back to the first page, or to a previous flipped page in a series or stack of flipped pages etc.), and so on.
  • the browser may use animation to create the appearance of a physical page being flipped over to expose its back side.
  • the browser may additionally or alternatively support other user actions for causing the supplemental content to be displayed. For example, the user could swipe the original page to the side to cause the“supplemental content” page to slide-in in place of the original page. As another example, the user could perform a gesture that causes an overlay page containing the supplemental content to be displayed over the original page.
  • the user may be presented with the ability to flip certain panels or portions of a first page, either instead of or in addition to the ability to flip the first page as a whole.
  • the panels or portions may for example correspond to particular content items presented on the first page.
  • Supplemental content associated with the particular content item for a panel may be presented in response to detection of a user interaction to flip the panel.
  • only the particular panel may be flipped, replacing the particular content item with the associated supplemental content, while the rest of the first page remains in the same visual state as before the flip.
  • the user may be allowed to flip more than one panel of the first page, either sequentially or in parallel.
  • the user may be allowed to“unflip” (e.g., reverse flip) a panel back to its original“unflipped” visual state, and in some cases the user may be allowed to flip a panel multiple times to view additional supplemental content. Further, in some cases the user may be allowed to flip and/or reverse flip one or more panels from a first visual state to a second visual state, then flip the page to view different supplemental content, and then reverse flip the page back view to the second visual state.
  • the display of the computing device may be configured to detect any possible combination of user interactions to present the virtually unlimited number of display states involving one or more flipped panels and/or pages. As described herein, embodiments describing flipping the page shall be understood to include and cover embodiments or variations involving flipping a panel or portion of the page, or combinations thereof.
  • the display may also present various user interface features to indicate to a user whether and how a page or panel may be flipped.
  • a corner of the display may present a triangular and/or three-dimensional representation of the upper right corner (or any corner) of the page (or panel) slightly peeled back to provide an indication to the user that can flip the page (or panel) by touching that corner and swiping away from the corner edge to simulate peeling the page (or panel) back in order to flip the page (or panel).
  • the display may provide an indication or suggestion that flicking the device quickly to the left (or any direction) may flip the page, much as one would physically flip a card or piece of paper to see what is on the other side.
  • the display may also present an indication that no supplemental content is available for a page or panel, for example, by greying out and disabling a display element ordinarily used to flip the page, or by not presenting the display element altogether.
  • the display may also be configured to present an icon or other graphic to provide the user with a visual indication or preview of the type of supplemental content that may be available on the flipped page or panel.
  • content presented in a first page on the display may be a textual article or review about a product, while supplemental content available on the flipped page may be a gallery of images of the product.
  • the display may present a“gallery icon,” for example in one corner of the first page display, to provide an indication that the user may flip the page to view the gallery of images of the product.
  • Any type of icon or other graphic may be presented depending on the type of supplemental content available, including but not limited to a video icon to indicate video content, a text icon to indicate additional text icon, a comment icon to indicate comment-based content (e.g., view user comments, and/or the ability for the user to comment and/or provide annotation on a content item or page), a music icon to indicate music-based content, a question mark icon to indicate search or query based content, and so on.
  • the content item presented in the first page on the display of the computing device may be an image or movie clip of a person, place or object
  • the supplemental content item may include video or audio content featuring the person, place or object; biographical or historical information regarding the person, place or object; links to other information relating to or referencing the person, place or object; other images of the person, place or object; search results for the person, place or object; etc.
  • supplemental content is automatically presented in a flipped page on the display without requiring the user to actively seek the information included in such supplemental content.
  • a student may use a device to read text displayed on a first page.
  • the student“flips the page” the student may, for example, see a video related to the text. If the student flips the page again to a third page, a test could be presented to the student. When the student has completed the test or finished watching the video, the student may flip the page back to the first page. While this example describes a first page and two flipped pages, any number of flipped pages may be available and presented for display. Further, in some examples, certain panels or portions of the page may be flipped by the student.
  • the third page presenting a test to the student may include one or more panels for each question on the test, which the student may selectively flip to view the answer to the question and/or explanation of the answer.
  • a user may use a search engine to perform a web search for content matching certain search criteria.
  • the first page may present search results, for example, links to content matching the search criteria.
  • the display may provide an option for the user to flip the page to view supplemental content such as an indication of which links in the search results are“better quality” based on various criteria (e.g. click-through rates, how long users stayed on a page corresponding to a particular link, etc.).
  • supplemental content may also present search results from different search engines, suggested or related search terms, information about trending topics for the search criteria or related searches, and so on.
  • panels corresponding to particular search result items may be flipped to display supplemental content such as a quick preview of a search result item or other information related to the search result item (e.g. about the web site, when the search result item was published).
  • FIG. 3 is a block diagram illustrative of an operating environment 300 capable of operating as described herein.
  • the operating environment 300 may include an intermediary system 330 which serves as an intermediary between computing devices 400 and content or service providers 340, such as web sites.
  • the computing devices 400 that access the content or service providers 340 can include various types of computing devices, such as tablets, mobile phones (including smartphones), electronic book readers, desktop computers, laptop computers, personal digital assistants (PDAs), other wireless devices, set- top or other television boxes, media players, game platforms and kiosks, among others.
  • Illustrative components of computing devices 400 are described in greater detail with reference to a computing device 400 as described in the paragraphs in Appendix A herein and as illustrated in FIG.
  • the intermediary system 330 may, for example, be or act as a proxy server, a partial rendering engine for specific browsers or device types, a CDN, an Internet Service Provider (“ISP”) system, or a combination thereof.
  • Each computing device 400 runs a browser application 50 (“browser”) capable of retrieving and displaying content pages according to standard protocols.
  • the browsers 50 may be designed or configured to retrieve web pages via the intermediary system 330.
  • each computing device 400 may include a configuration information data store 418 that stores information used by the computing device 400 to configure the presentation of supplemental content in one or more flipped pages following detection of user interaction with the computing device 400 in accordance with the present disclosure.
  • configuration information may include, but is not be limited to, metadata associated with the content item presented in the first page, watermarking data associated with the content item presented in the first page, contextual data associated with the content item presented in the first page, user supplied configuration data, third party supplied configuration data, user profile data, device profile data, content profile data and the like.
  • the computing device 400 may, for example, retrieve configuration information from the configuration information data store 418 in response to a user interaction to flip the page in order to obtain supplemental content related to the content item to be presented in the second flipped page.
  • the configuration information identifies what information is to be included in the supplemental content.
  • the features and functionality disclosed herein can be implemented collectively by the browser 50 and intermediary system 330.
  • the intermediary system 330 in addition to returning the requested page (or content item), may return a second page (or other unit of content) containing metadata for the requested page.
  • the browser 50 may then store this second page and/or page metadata in a local cache, and would present it via the display in response to the user performing a flip operation.
  • the browser 50 can request and retrieve the metadata page from the intermediary system 330 when the user initiates the flip operation.
  • the user interfaces and features disclosed can be implemented without an intermediary system 330. For example, when the browser 50 requests a page from a URL, the browser 50 can concurrently send a request to a metadata server for the metadata associated with the requested page and store the metadata in its local cache for later display in response to a user flipping the page.
  • the browsers 50 may be (or may include) conventional web browsers that are not specifically designed or configured to display page previews. In other embodiments, the browsers 50 may be specifically designed to handle specific tasks associated with the display of page previews.
  • the content or service providers 340 may include or consist of, for example, ordinary web sites and/or web services.
  • Each content site 34 may include a server 342 that serves content, such as web pages, in response to URL requests.
  • the pages for which supplemental content may be generated can be conventional web pages that do not include any special coding or formatting to support the generation of supplemental content as described herein.
  • the intermediary system 330 may support the use of special tags for designating whether or how supplemental content should be generated for particular pages. Where special tags are supported, a content provider may, for example, embed tags in a content page indicating, for example, which visual elements or sections of the page should be associated with supplemental content.
  • the intermediary system 330 includes a supplemental content service 312, an advertiser interface 324 an advertisement data store 326 and a click- through tracking data store 328. (In some embodiments, the advertiser interface 324, the advertisement data store 326 and the click-through tracking data store 328 are omitted.)
  • the supplemental content service 312 obtains and/or generates supplemental content related to a content item in response to a request from the computing device 400.
  • the supplemental content may be associated with one or more content items being presented in a first page (or panel) on the display of the computing device 400 and is configured to be presented in a flipped page (or panel) on the display of the computing device following user interaction with the device.
  • the supplemental content item may itself be, for example, a webpage, a document, an image, a software application, etc. or may be an overlay of information that is presented in conjunction with the content item.
  • the advertiser interface 324 allows an advertising entity, including in some embodiments content or service providers 340 and/or other third-party advertisers, to associate supplemental advertising content (e.g., a channel, an advertisement or ad, a coupon, an application, etc.) with a content item.
  • supplemental advertising content e.g., a channel, an advertisement or ad, a coupon, an application, etc.
  • the advertiser interface 324 may allow the advertising entity to associate supplemental content with keywords which may be related to the content item.
  • Supplemental advertising content associated with a content item may also include, for example, particular pages or web Universal Resource Locators (“URLs”), and/or classes of pages or web URLS for the content item.
  • the advertiser interface 324 may also allow the advertising entity to place a bid to have their supplemental content displayed on a flipped page or panel corresponding to the content item.
  • the bid may include various parameters such as a bid price, a number of times the supplemental content is to be displayed or made available on a flipped page or panel, a time of day at which the supplemental content is to be displayed or made available on a flipped page or panel, desired target characteristics of users who may presented the supplemental content (e.g., demographic information such as age, gender, location, etc.).
  • the intermediary system 330 or browser 50 may then select supplemental content associated with content items to be displayed based, for example, on the highest bid amount and/or other parameters associated with the bid.
  • the browser 50 may maintain a number of ads in a local cache, and dynamically select ads from the cache to display on flipped pages based on keyword matching or any other criteria.
  • the advertiser interface 324 may include a website or an area of a website hosted by a server.
  • the advertisement data store 328 may store advertisements (and other supplemental content) uploaded by the advertising entity to enable quick and efficient retrieval by the intermediary system 330 or browser 50.
  • the click-through tracking data store 328 may, for example, record flip events, click-through events for advertisements, and other supplemental content for purposes of charging the advertising entity a fee.
  • the browser 50 may report page flip user interaction events to the intermediary system 330, and the intermediary system 330 may use these reported flip events to log advertisement impression events for any ads displayed on the back of the page.
  • the advertising entity may be charged for the advertisement impression events.
  • One benefit or this approach is that it does not require the involvement of, or payment of money to, the operators of the websites on which the ads are effectively being displayed.
  • FIG. 3A Another illustrative example of an operating environment 300 and various components according to some embodiments are described in greater detail with reference to the operating environment 300 as described in the paragraphs in Appendix A herein and as illustrated in FIG. 3 of the’193 Application, which is reproduced as FIG. 3A of the present disclosure.
  • Any and all of the components of the operating environment 300 as described in the ’193 Application and in Appendix A herein may be included in the operating environment 300 described in the present disclosure, including, for example, an application service 310, an application data store 304, a supplemental content data store 314 and network data source(s) 302 and any number of additional components, systems and/or subsystems as described in the’193 Application and in Appendix A herein.
  • the supplemental content data store 314 as described in the’193 Application and in Appendix A herein may be local to the supplemental content service 312, may be remote from the supplemental content service 312, may local to the content or service provider 340 and/or may be a network-based service itself.
  • the supplemental content service 312 as illustrated in FIG. 3 of the present disclosure may include additional components, systems and/or subsystems as described in the’193 Application and in Appendix A herein, to obtain and/or generate supplemental content.
  • components of the supplemental content service 312 may include a computing device interface 320 for receiving and transmitting requests for supplemental content from computing device 400, an external data source interface 316 for obtaining supplemental content information from network data sources 302 and an application service interface 322 for obtaining applications which may be supplemental content from application service 315.
  • the supplemental content service 312 can further include a content request processing component 318 for processing requests for supplemental content received from one or more computing devices 400, generating requested supplemental content and ultimately publishing supplemental content.
  • Process for Flipping a Page to View Supplemental Content (FIG. 4)
  • FIG. 4 illustrates one embodiment of a process 400A for obtaining a supplemental content item to be presented on the back of a first page.
  • the process 400A is implemented by the computing device 400 (e.g., via the browser 50 as illustrated in FIG. 3 herein and/or via the user interface component 412 as described in the ’193 Application and in Appendix A herein).
  • the process 400A begins in a block 422 in which interactions between the user and user’s computing device are monitored (e.g., via the monitoring component 413 of the computing device 400 as described in the’193 Application and in Appendix A herein).
  • the monitoring component 413 monitors interactions between the user and the computing device while content items are being presented in a first page with respect to the display 406 of the computing device 400.
  • configuration information may be retrieved in block 426 (e.g., from the configuration information data store 418 described with reference to FIG. 3).
  • the retrieved configuration information may describe how and what supplemental content information is to be presented in the flipped page or panel on the display 406 of the computing device 400.
  • supplemental content is requested in block 428 based on the configuration information.
  • page metadata may be automatically retrieved by the browser 50 in the background after the first page has loaded, so that the page metadata may be readily available for display if the user initiates a flip.
  • the browser 50 or intermediary system 330 may be configured to predictively determine whether supplemental content and/or page metadata may be pre-fetched or pre-forwarded based, for example, on how frequently the user invokes the flip the page feature.
  • the supplemental content service 312 may provide the supplemental content to the computing device in response to this request.
  • previously obtained supplemental content information may also be retrieved for inclusion in the supplemental content for presentation in the flipped page in a block 430.
  • the computing device 400 may present the supplemental content in the flipped page, or in the flipped panel of the first page, on the display 406 of the computing device 400.
  • the supplemental content for the initial content item is automatically presented in the flipped page or panel following detection of user interaction with the computing device 400, the detection occurring while the content item was being presented in the first page on the display of the device.
  • supplemental content may be made accessible via an intuitive user interface presented on the display of the device, in a manner which does not substantially reduce the amount of screen“real estate” available for display of the first page (e.g., through the utilization of small, unobtrusive and intuitive flip indictors as described with reference to FIGS. 1 and 2 above), This feature is particularly beneficial for devices such as tablets and smartphones with smaller screen resolutions.
  • the automatic presentation of the supplemental content also frees the user from affirmatively seeking or searching for the information contained in the supplemental content.
  • the supplemental content enables the provider of the content to avoid including superfluous information related to the content item when the content item is presented in a first page. Following presentation of the supplemental content in the flipped page, the method 400A may end.
  • a user can configure the presentation of supplemental content in a flipped page.
  • a user may utilize a supplemental content configuration user interface of a configuration application to configure how and what information is to be included in supplemental content that is to be presented in a flipped page.
  • the configuration application may, for example, be hosted by the intermediary system, and/or may be accessible via a menu option of the browser 50.
  • supplemental content configuration options may include what types of supplemental content should be displayed (e.g., ads, site-level data, links to related sites, product metadata, price comparison data, product recommendations, user comments, etc.), which content provider(s) should the supplemental content be obtained from, whether the supplemental content should be retrieved and cached preemptively in the background (e.g., always or when Wi-Fi is available), whether to enable the intermediary system to deliver personalized metadata based on the monitored behaviors of the user, and the like. Additional examples of supplemental content configuration options and sample user interfaces and processes are described in greater detail in the’193 Application, as described in the paragraphs in Appendix A herein and with reference to FIGS.
  • references to“when the device is rotated” or“when you rotate your device” with regard to FIGS. 7A-7C of the ’193 Application and as described in Appendix A herein may be replaced with references to“when the page is flipped” or“when you flip the page” to illustrate how a user may configure the presentation of supplemental content in a flipped page.
  • the intermediary system 330 may be implemented by or on a computing system that comprises one or more physical computing devices (physical servers, storage arrays, routers, etc.), each of which may include a processor and memory.
  • the computing system may, in some cases, include computing devices that are distributed geographically, in which case some of the disclosed server-side tasks may be performed remotely from others.
  • the various functions of the intermediary system 330 may be embodied in code modules executed by the computing system.
  • the code modules may be persistently stored on any type or types of non-transitory computer storage devices or media (magnetic disks, solid state memories, optical drives, etc.).
  • the intermediary system 330 may alternatively be embodied partly or wholly in specialized computer hardware, such as in custom designed ASICs or FPGAs.
  • the various components and functions of the intermediary system 330 can also be implemented in one or more virtual machines or cloud resources, rather than in dedicated servers.
  • the browser 50 may include executable code stored on any type of non-transitory storage medium, including code for implementing the client-side functions (including the various user interface features) described herein.
  • the intermediary system 330 may be omitted. In such embodiments, the intermediary system 330 may alternatively be implemented on a separate network-accessible server system that does not act as an intermediary between the browsers 50 and content sites 340. Further, as described herein, supplemental content could alternatively be generated by the browsers.
  • the user interfaces disclosed herein can also be implemented within other types of document viewers capable of retrieving and displaying documents.
  • the user interfaces may be implemented within a word processing program, a PDF reader, or a news reader.
  • the disclosed features may also be incorporated into other types of mobile applications, including news reader and e-book reader applications.
  • the user can flip over a news story page to view links to related stories, a biography of the reporter, ads associated with keywords appearing in the story, etc.
  • a system for providing supplemental content comprising:
  • a browser component including executable code that directs a user computing device operative to:
  • supplemental content data is associated with initial content presented in a first page on the display of the user computing device, and wherein the supplemental content data is configured to be presented in a flipped page on the display of the remote computing device;
  • a computing device in communication with the one or more data stores, said computing device operative to:
  • At least one of the one or more data stores comprises an external data store from which data is obtained via one or more application programming interfaces.
  • said computing device is further operative to: receive a plurality of requests for supplemental content data associated with the same or similar initial content, wherein the plurality of requests are received from a plurality of user computing devices;
  • a non-transitory storage medium having stored thereon a browser component, said browser component including executable code that directs a user computing device having a touchscreen to perform a process that comprises:
  • a user interface component that presents content in a first page on a display of a computing device
  • a monitoring component that detects a user gesture to flip the first page to a second page, wherein the user gesture occurs in relation to the computing device; and a content selection component that obtains second content from one or more sources external to the computing device,
  • the user interface component presents at least a portion of the obtained second content.
  • the first page is a full-screen view of the content and the second page is a full-screen view of at least the portion of the second content.
  • a computer-implemented method for presenting content on a display of a computing device comprising:
  • a computing device that is operable to present content in multiple pages comprising:
  • a memory operative to store content
  • a display operative to present at least a first content item
  • processing unit in communication with the memory and the display, the processing unit operative to:
  • the computing device is further configured to detect a user interaction indicative of a request to flip the second page to the third page, and in response to detecting the user interaction indicative of a request to flip the second page to the third page, the computing device is configured to display the second plurality of supplemental content items.
  • a system for enabling users to view supplemental content associated with pages of content sites comprising:
  • server system that stores advertisements in association with particular content pages of content sites, said server system comprising one or more physical servers;
  • a browser component that is configured to run on user computing devices, said browser component including executable code that directs a user computing device to perform a process that comprises:
  • the server system includes a user interface that includes functionality for an advertiser to submit an advertisement, and to designate at least one content page for which the advertisement is to be displayed on a back side.
  • the advertisement comprises at least on one of multimedia content, a product advertisement, a service advertisement, an advertising channel and an advertisement incentive.
  • server system is configured to receive, from an advertising entity, a bid to provide, to a user computing device, an advertisement associated with a particular content page.
  • non-transitory storage medium of clause 43 wherein the touchscreen gesture is a swipe gesture in which a representation of a corner of the content page is dragged away from a corner of the touchscreen.
  • the process further comprises, while the back side of the content page is displayed, detecting a second touchscreen gesture representing a second request to flip the page over, and responding to the second touch screen gesture by creating a visual appearance of the page being flipped back to reveal a front side.
  • a system for providing advertising content comprising:
  • a browser component including executable code that directs a user computing device operative to:
  • a computing device in communication with the one or more data stores, said computing device operative to:
  • the initial content comprises at least one of multimedia content, a webpage, a document, an image and a software application.
  • the advertising content data comprises at least one of a product advertisement, a service advertisement, an advertising channel and an advertisement incentive.
  • the advertising channel comprises at least one of multimedia content, a webpage, a document, an image and a software application.
  • the bid is a bid to provide the advertising content data to a plurality of remote computing devices in response to a request from the plurality of remote computing devices for advertising content data associated with the content item, and wherein said computing device is further operative to obtain the requested advertising content data from the one or more data stores based at least in part on the bid.
  • the bid comprises at least one of a bid price, a number of times the advertising content data is to be provided to a remote computing device, a time of day at which the advertising content data is to be provided to a remote computing device and a set of characteristics of users of remote computing devices to which the advertising content data is to be provided.
  • Conditional language used herein such as, among others, “can,” “could,” “might,” “may,”“e.g.,” and the like, unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain embodiments include, while other embodiments do not include, certain features, elements and/or steps. Thus, such conditional language is not generally intended to imply that features, elements and/or steps are in any way required for one or more embodiments or that one or more embodiments necessarily include logic for deciding, with or without author input or prompting, whether these features, elements and/or steps are included or are to be performed in any particular embodiment.
  • FIG. 3A is a reproduction of FIG. 3 of U.S. Patent Application No. 13/069,193 (“the’193 Application”)
  • supplemental content for an initial content item may be provided for presentation in a second orientation following detection of user interaction with the computing device, the detection occurring while the content item is being presented in a first orientation with respect to the display of the computing device.
  • the operating environment 300 may include a supplemental content service 312 that obtains and/or generates supplemental content related to a content item in response to a request from the computing device 400.
  • the supplemental content may be associated with a content item being presented in a first orientation on the display of the computing device 400 and is configured to be presented in a second orientation on the display of the computing device following user interaction with the device.
  • information used to generate supplemental content is stored in a supplemental content data store 314 accessible by the supplemental content service 312. While the supplemental content data store 314 is depicted in FIG. 3A as being local to the supplemental content service 312, those skilled in the relevant art will appreciate that the supplemental content data store 314 may be remote from the supplemental content service 312 and/or may be a network-based service itself.
  • Supplemental content information may include, but is not limited to metadata associated with the content item, recommendations data, related links data or other digital content, among others.
  • supplemental content information may include virtually any type of data that may be related to the content item and/or of interest to the user with respect to the content item.
  • the supplemental content item may itself be a webpage, a document, an image, a software application, etc. or may be an overlay of information that is presented in conjunction with the content item.
  • All or a portion of the supplemental content information for a content item may be obtained from external sources rather than the supplemental content data store 314.
  • external sources may include, but are not limited to, network data sources 302, other computing devices 400 and application services 310.
  • Network data sources 302 may include but are not limited to websites, social network services, telecommunication services, microblog services, content feed services, e-commerce services, etc.
  • the application service 310 stores one or more software applications in an application data store 304 and makes such applications available to others for free, purchase or rental.
  • the applications made available by the application service can be developed for use with smaller, hand-held computing devices, but can also be used with other computing devices without departing from the scope of the present disclosure.
  • Such applications can be pre-installed on computing devices or downloaded by users from one or more application services 310.
  • the content item and the supplemental content item described herein may be an application.
  • supplemental content service 312 and the application service 310 are each depicted in FIG. 3A as implemented by a single computing device in the operating environment 300, this is illustrative only.
  • Each of the supplemental content service 312 and the application service 310 may be embodied in a plurality of computing devices, each executing an instance of the supplemental content service 312 or application service 310, respectively.
  • a server or other computing device implementing the supplemental content service 312 or the application service 310 may include memory, processing unit(s) and computer-readable medium drive(s), all of which may communicate with one another by way of a communication bus.
  • a network interface may provide connectivity over a network 306 and/or other networks or computing systems.
  • the processing unit(s) may communicate to and from memory containing program instructions that the processing unit(s) executes in order to operate the service.
  • the memory generally includes RAM, ROM and/or other non-transitory and auxiliary memory.
  • the supplemental content service 312 can include a computing device interface 320 for receiving and transmitting requests for supplemental content from computing device 400, an external data source 316 for obtaining supplemental content information from network data sources 302 and an application service interface 322 for obtaining applications which, as described above, may themselves be supplemental content from application service 310.
  • the supplemental content service 312 can further include a content request processing component 318 for processing requests for supplemental content received from one or more computing devices 400, generating requested supplemental content and ultimately publishing supplemental content.
  • the supplemental content service 312 may correspond to a number of computing devices, such as server computing devices.
  • the external data source interface 316, the content request processing component 318, the computing device interface 320 and the application service interface 322 may be implemented in a single computing device, or component, or across multiple computing devices or components.
  • all or some of the functions of the external data source interface 316, the content request component 318, the computing device interface 320 and the application service interface 322 may be combined and implemented in a single component or computing device.
  • supplemental content service 312 may include any one of a number of additional hardware and software components that would be utilized in the illustrative computerized operating environment to carry out the illustrative functions of the supplemental content service 312 and/or any of the individually identified components.
  • the operating environment 300 may include any number of computing devices 400, each associated with a user to whom a supplemental content item may be presented as described above.
  • the computing device 400 is a mobile phone that offers advanced computing ability and connectivity.
  • computing devices 400 may correspond to a wide variety of devices or components that are capable of initiating, receiving or facilitating communications over a wired and/or wireless communication network including, but not limited to, personal computing devices, electronic book readers, handheld computing devices, integrated components for inclusion in computing devices, home electronics, appliances, vehicles, machinery, land line telephones, VoIP telephones, cordless telephones, cellular telephones, feature phones, modems, personal digital assistants, laptop computers, tablet computers, gaming devices, media players and the like.
  • the computing devices 400 include a wide variety of software and hardware components for establishing communications over one or more communication networks, including communications network 306.
  • Communications network 306 may be a wireless communications network, a wired communications network, an IP-based wireless communications network or any combination thereof. Illustrative components of computing device 400 will be described in greater detail with regard to FIG. 4A. Although the present disclosure refers to a computing device 400, one skilled in the relevant art will appreciate that a computing device may in some instance herein correspond to, or otherwise be referred to as, a mobile communication device, a wireless computing device or a wireless device. Accordingly, reference to a computing device 100, 200, 400 or 700 should not be interpreted as limiting to any particular functionality, operation or type of device, whether wired or wireless, or whether having advanced computing ability/connectivity.
  • the operating environment 300 can include any number of additional components, systems and/or subsystems for facilitating communications with the computing devices 400, the network data sources 302, the application service 310 and/or the supplemental content service 312.
  • the additional components can include one or more switches or switching centers (in GSM embodiments, Mobile Switching Centers (or MSCs)) for establishing communications with the computing devices 400 via wireless communication network, such as a cellular radio access network, an IP-based wireless communication network based on the family of IEEE 802.11 technical standards (“WiFi”) or IEEE 802.16 standards (“WiMax”), a converged wireless communications network such as Unlicensed Mobile Access (“UMA”) or General Access Network (“GAN”) and other wired and wireless networks.
  • GSM Global System for Mobile Communications
  • MSCs Mobile Switching Centers
  • a switching center may include interfaces for establishing various communications with other networks, such as the Internet, intranets, private networks, mesh networks and point-to-point networks.
  • networks such as the Internet, intranets, private networks, mesh networks and point-to-point networks.
  • the network 306 is illustrated as a single communication network, one skilled in the relevant art will appreciate that the network may be made up of any number of wired or wireless communication networks, public or private communication networks and/or network connections.
  • FIG. 4A which is a reproduction of FIG. 4 of the ’193 Application, illustrative components of a computing device 400 for use in requesting supplemental content data and presenting the supplemental content related to the content item in a second orientation will be described.
  • the computing device 400 may include one or more processing units 402, such as one or more CPUs.
  • the computing device 400 performs functions by using the processing unit(s) 402 to execute instructions found in program components stored in the memory 408.
  • the computing device 400 may also include one or more sensor(s) 403 (e.g., an accelerometer, a gyroscope, a gravimeter, an infrared sensor, a microwave sensor, an ultrasonic sensor, camera, etc.), one or more input devices 404 (e.g., keyboard, mouse device, specialized selection keys, touchscreen display, stylist, joystick, game controller, microphone, camera, etc.) and one or more display(s) 406 (e.g., liquid crystal display, LED display, electronic paper display, etc.).
  • sensor(s) 403 e.g., an accelerometer, a gyroscope, a gravimeter, an infrared sensor, a microwave sensor, an ultrasonic sensor, camera, etc.
  • input devices 404 e.
  • Any one or combination of such input mechanisms 403, 404 may generate an indication/signal that may be used to recognize a user interaction with the computing device 400 has occurred that is appropriate to cause presentation of supplemental content in a second orientation on the display 406 of the computing device 400. Accordingly, when such an indication is received during presentation of a content item in a first orientation, presentation in a second orientation of supplemental content related to the content item is triggered.
  • the computing device 400 may also include a memory 408, which may correspond to any combination of volatile and/or non-volatile storage mechanisms.
  • the memory 408 may store various program components and data necessary for operating the computing device 400, obtaining supplemental content, presenting content items and supplemental content and publishing supplemental content to other computing devices.
  • the memory 408 may contain an operating system component 410 and program components such as a user interface component 412, a monitoring component 413 and a supplemental content component 415.
  • Memory 408 may also store or have access to an application platform 414 that hosts one or more applications (either pre-installed on the computing device 400 or downloaded from one or more application services 310) for implementation by the computing device 400.
  • memory 408 may store or have access to content and/or supplemental content information for presentation in various orientations on the display 406 of the computing device 400.
  • memory 408 may include or have access to a content data store 416 that stores content items (or links thereto) to be presented in a first orientation, as well as supplemental content related to said content items that is to be presented in a second orientation.
  • Memory 408 may also include or have access to a configuration information data store 418 that stores information used by the computing device 400 to configure the presentation of supplemental content in a second orientation, or any of numerous other orientations, following detection of user interaction with the computing device 400 in accordance with the present disclosure.
  • configuration information may include, but is not be limited to, metadata associated with the content item presented in the first orientation, watermarking data associated with the content item presented in the first orientation, contextual data associated with the content item presented in the first orientation, user supplied configuration data, third party supplied configuration data, user profile data, device profile data, content profile data and the like.
  • the computing device 400 may retrieve configuration information from the configuration information data store 418 to obtain supplemental content related to the content item to be presented in the second orientation.
  • the configuration information identifies what information is to be included in the supplemental content.
  • the supplemental content information may be retrieved from the content data store 416 or may be retrieved from an external data source, such as one or more network data sources 302 or the application service 310.
  • the configuration information may alternatively or additionally include formatting information that defines how the supplemental content information is to be presented in the second orientation.
  • the configuration information supplied by the user is generated using a software development tool or configuration application that is made available to users, potentially through a supplemental content configuration user interface, along with the content item that is to be subject to the presentation of the supplemental content.
  • a software development tool or configuration application that is made available to users, potentially through a supplemental content configuration user interface, along with the content item that is to be subject to the presentation of the supplemental content.
  • An example of such a configuration application is depicted in FIGS.5A, 5B and 5C and will be described in more detail below.
  • the configuration information is supplied by a third party, such as a provider or developer of the content item subject to the presentation of the supplemental content, or by other users who have consumed the content item subject to the presentation of the supplemental content.
  • the configuration information may be maintained by the supplemental content service 312 (which may have obtained the configuration information from another computing device 400, network data source 302 or the application service 310) and provided to the configuration information data store 418.
  • the configuration information may be derived from a profile of the user maintained in memory 408 of the computing device 400, maintained by the supplemental content service 312 or maintained by another network data source 302.
  • the user profile data may include various information describing the user’s preferences for content, websites, services, applications, etc. and thus, may be used to configure how and what supplemental content information is to be presented in the second orientation on the user’s computing device. Content profile data and device profile data may similarly be used.
  • Metadata associated with the content item subject to the presentation of the supplemental content may be used to configure what and how the supplemental content is to be presented in the second orientation.
  • the metadata associated with the eBook e.g., the author, title, ISBN number, publication date, distribution date, main characters, synopsis, image of book jacket, etc.
  • the metadata can also include contextual content information, such as places, people, things or times referenced in specific portions of the content or the content as a whole.
  • Contextual content information may include, but is not limited to, data that helps interpret the content item, facts or circumstances that surround or are related to the content item, conditions under which a content item was created presented or experienced and an environment or setting in which a content item was created.
  • the contextual content information could also include the portion of the book currently being read, which could be referenced by page number or location or the actual content at that location. For example, if the content on a page of an eBook being presented to the user relates to actions happening in New York City, NY, the supplemental content information could include information about New York City such as the current weather, news or publicly accessible wiki information.
  • the metadata information may include watermarking data associated with the initial content item.
  • the movie may be digitally watermarked and the digital watermark may contain information that can be extracted and used to determine how and what supplemental content information is to be presented in the second orientation.
  • the watermark might be used to identify contextual information such as particular objects in the portion of video (e.g. places, people, items, products, etc.) that can be used to determine what supplemental content information to display with respect to the content item when the user is viewing that particular portion of the content.
  • image recognition techniques can be used to extract metadata from images or video
  • audio recognition techniques can be used to extract metadata from audio.
  • a user may be viewing a movie in one orientation of the device (e.g. landscape) when the user notices a particular shoe being worn by one of the actresses that the user would like to find more information about and potentially purchase.
  • the shoe, or similar shoes may be recognized by the previously mentioned techniques (e.g. watermarking, image recognition, etc.).
  • the user can then rotate the device to a second orientation (e.g. portrait) and product details of the shoe, pricing and an option to purchase the shoe can be displayed.
  • the identified contextual item(s) need not be currently in the frame of the movie, but may have been previously displayed within some time window before the user oriented the device in the second orientation.
  • the user may be initially presented with a list of items in the second orientation for selection by the user.
  • the input devices 404 of the computing device 400 may also be used to detect external context information associated with the device or user.
  • that external context information is stored in the external context information data store 420.
  • External context information is an additional type of metadata that is used to configure what and how the supplemental content is to be presented in the second orientation.
  • the external context information can be, for example, a location of the device, a determination of the user of the device, the speed of the device, the ambient temperature around the device, a time of day, a day of the year, a season of the year, the ambient light around the device, among many other possibilities.
  • This information can be detected by any number of input devices 404, such as global positioning system (GPS) sensors, signal strength sensors (i.e. to determine proximity to one or more fixed position wireless transmitters), thermometers, cameras, light sensors, clocks, among other possibilities.
  • GPS global positioning system
  • the user may be presented with photographs of sailboats located in Seattle’s Lake Union, with a sunrise in the background and crew members dressed in heavy coats.
  • FL may be presented with photographs of a sailboat, adorned with short-pants wearing passengers, coasting into a fiery sunset.
  • further embodiments can use both contextual content information and external context information to configure what and how the supplemental content is to be presented in the second orientation.
  • both the context of the people, places, and time of the content being consumed can be used in combination with the people, places and time that the content is being consumed on the device.
  • the supplemental content component 415 may be equivalent in functionality to the content request processing component 318 (and or other components) of the supplemental content service 312.
  • the content request processing component 318 may have more limited functionality and/or specialized functionality, such as functionality to implement peer-to-peer communication.
  • a user can configure the presentation of supplemental content in a second orientation.
  • a user may utilize a supplemental content configuration user interface of a configuration application to configure how and what information is to be included in supplemental content that is to be presented in a second orientation.
  • the supplemental content configuration user interface for the content item may be downloaded from the application service 310 along with the content item, when the content item is itself an application.
  • supplemental content configuration user interface is made available by the supplemental content service 312 or from another network data source 302, such as a website that the user frequently browses.
  • the configuration application that includes the supplemental content configuration user interface is installed on the computing device 400 and is agnostic to any particular content items or providers of content items, and thus, can be used to configure supplemental content for any initial content item obtained and presented by the computing device 400.
  • a supplemental content configuration user interface 704 offered by a website the user frequently browses is illustrated.
  • the options can be pre-selected, but the supplemental content configuration user interface allows the user to manipulate what supplemental content is to be displayed.
  • the supplemental content configuration user interface 704 is presented on a display 702 of a computing device 700 and is used to configure supplemental content for content items, e.g., webpages retrieved from the frequently browsed website.
  • the supplemental content configuration user interface 704 prompts the user with a message to configure how and what information the user would like to see displayed when the user rotates the device from a landscape (first) position to a portrait (second) position while browsing a webpage on the website (and vice versa). If the user wishes to proceed with making appropriate edits to the configuration, the user may select the“video” button 706 or the“search results” button 708. If the user selects the“video” button 706, the user interface shown in FIG. 5B is displayed to the user. If the user selects the“search results” button 708, then the user interface depicted in FIG. 5C is displayed to the user.
  • the supplemental content configuration user interface 704 will then prompt the user with options 712 to see video content that may be related to the initial content item (e.g., the webpage being browsed). Accordingly, if the user would like to see displayed video content related to the webpage being browsed when he or she rotates her device, the user may select the corresponding“Yes” option. In the illustrated example, if the user selects the “Yes” option, the supplemental content configuration user interface 704 also prompts the user to select a video content source from which to retrieve the supplemental content that the user would like to view after rotating his or her computing device 700.
  • the user may select from options 714 to select a source for the video content.
  • the source is a video content sharing service, a social networking service, some other network service or any other website from which video content may be downloaded or streamed.
  • the user may enter or browse for a link to a particular item of video content available from a source.
  • the user may enter or browse for a link to a source of video content itself, in which case context information or other metadata associated with the webpage may be used to search for and identify an item of video content.
  • the supplemental content for the webpage may be configured to include video content related to the webpage and/or in which the user is interested.
  • each time the user rotates the computing device 700 while browsing the website video content identified using the provided link will be presented in the second orientation on the display of the computing device 700.
  • additional supplemental content is displayed on computing device 700.
  • different supplemental content is displayed on device 700.
  • the supplemental content configuration user interface 704 prompts the user with options to see search results related to the contents of the webpage when the user rotates his or her computing device 700. If the user would like to see such search results, the user may select a “Yes” option from a list of options 716. In the illustrated example, the supplemental content configuration user interface 704 may also prompt the user to select a search engine that the user would prefer to generate the search results from a list of search engine options 718. Once the user selects the desired search engine, the user may complete configuration in the illustrated example by selecting the“Finish” button.
  • the configuration information is stored in configuration information data store 418 (FIG. 4A), while in other embodiments the configuration information is stored remote from the device (e.g. at the website used to configure supplemental content, within a cloud- based storage service or other network accessible data storage). In embodiments in which the configuration information is stored remote from device 400, the configuration information can be accessed directly by supplemental content service 312 in order to determine what supplemental content to supply and how to supply them.
  • a user interaction with computing device 700 is detected during presentation of a webpage from the frequently browsed website, the user will automatically be presented a video related to the webpage in a second orientation on the display 702, as well as search results related to the webpage as generated by the user’s preferred search engine.
  • the user may retrieve a webpage from the website at a first universal resource locator (URL).
  • URL universal resource locator
  • the device detects the user interaction indicating that supplemental content is to be displayed in a second orientation, a request including a second URL is passed to the website indicating such.
  • the supplemental content service retrieves the configuration information to determine the supplemental content to send back to the computing device and transmits the supplemental content for display in the second orientation in response to the request.
  • supplemental content configuration user interface 704 depicted in FIGS. 5A, 5B and 5C and described above is an illustrative supplemental content configuration user interface only and that different configuration applications may be used for different content items, different types of content items, different supplemental content and different types of supplemental content.
  • configuration applications may include more, less or different configuration options that those depicted in FIGS.5A, 5B and 5C, and the configuration options may depend on the initial content item(s) to be provided with supplemental content, the supplemental content desired and/or the provider/developer of the configuration application.
  • configuration applications may further enable a user, developer or provider to configure the user interaction with the computing device that will trigger the presentation of a supplemental content in a second orientation.
  • presentation may be triggered based on a detection of an audible command, image detection of a user gesture, selection of an existing software control (e.g., dragging of a scroll bar), a keyboard action (e.g., pressing a“page down” key) or some other manipulation of an input device (e.g., shaking of the computing device rather than rotating the computing device).
  • the user input that triggers the presentation of the supplemental content could also be the detection of a user’s eye gaze direction (e.g.
  • the supplemental content that is displayed in the second orientation can be determined, at least in part, based on the gaze direction of the user. For example, if the user is looking at a particular object in an image in the first orientation, the supplemental content displayed in the second orientation may include content about that particular object.
  • example supplemental content configuration user interface guides the user to configure how and what information the user would like to see when the user rotates the device from a landscape (first) position to a portrait (second) position
  • other supplemental content configuration user interfaces can guide the user to configure how and what information the user would like to see in any number of possible orientations or ranges of orientations (e.g., when rotated to a third position, pricing and availability information is displayed).
  • presentation of the initial content item, as well as presentation of the supplemental content may vary depending on the type of computing device or the display of the computing device.
  • the display may be a projector or television that is remotely connected to the computing device, as opposed to integral with the computing device. Accordingly, presentation of the supplemental content item by the projector or television may be triggered by selecting a “page down” key on the computing device.
  • the supplemental content may be presented concurrently with the content item in the display of the computing device (whether the display is integral or not) using a split-screen.
  • the display of the computing device may actually be two or more displays, such as when a desktop computer is equipped with two monitors.
  • the content item may be presented on a first monitor, while the supplemental content may be presented on the other monitor, and the orientation in which the content item is presented on the first monitor may be the same or different as the orientation in which the supplemental content is presented on the other monitor.

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

A user of a computing device may view a content page on a display of a computing device. One aspect of the disclosure is a browser user interface than enables the user to flip the content page (or portion thereof) over (e.g., via a touchscreen gesture) to view supplemental content, such as metadata, associated with the content page (or portion thereof). While viewing the metadata on the back side of the content page in some embodiments, the user can perform a second or reverse flip operation to return to the original page. The user may be presented with options to flip the page backward and forward multiple times to view multiple flipped pages presenting additional supplemental content. The supplemental content may include virtually any information in which the user may be interested and/or that is related or similar to the content page.

Description

BROWSER INTERFACE FOR ACCESSING SUPPLEMENTAL CONTENT ASSOCIATED WITH CONTENT PAGES CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application is related to commonly owned, U.S. Patent Application No. 13/069,193, entitled Presenting Supplemental Content, filed March 22, 2011 (“the’193 Application”), portions of which are substantially reproduced herein in Appendix A and in FIGS. 3A, 4A, 5A, 5B and 5C. BACKGROUND
[0002] The continued proliferation of digital content items has led to an increase in the availability of such content items, as well as an increase in the availability of electronic computing devices used for consuming these content items. For instance, users now consume electronic books, videos, songs, documents, webpages, images, applications, etc. on an assortment of stationary and/or portable computing devices. As the number of content items and devices continues to increase, users become increasingly interested in enhancing their experiences while consuming these content items. For example, while consuming an item of digital content, users are often naturally curious about information that is related to the content item and/or that is similar to the content item. However, given the vast amount of information that can be considered related or similar to the content item being consumed by the user, a typical user would generally prefer a user interface which enables the user to efficiently and intuitively access such information. BRIEF DESCRIPTION OF DRAWINGS
[0003] Throughout the drawings, reference numbers may be re-used to indicate correspondence between referenced elements. The drawings are provided to illustrate example embodiments described herein and are not intended to limit the scope of the disclosure. [0004] FIG. 1 is a pictorial diagram of a computing device having a display upon which a content item is presented in a first page and upon which supplemental content is presented in a second, flipped page in response to a user interaction with the computing device, the user interaction occurring while the content item is being presented in the first page on the display.
[0005] FIG. 2 is a pictorial diagram of a computing device having a display upon which one or more content items are presented in a first page, and upon which supplemental content is presented in one or more flipped panels in the first page in response to a user interaction with the computing device, the user interaction occurring while the content items are being presented in the first page on the display.
[0006] FIG.3 is a block diagram illustrative of an operating environment in which supplemental content may be provided to a computing device for presentation in a flipped page or pane according to one embodiment.
[0007] FIG. 3A is a block diagram illustrative of an operating environment in which supplemental content may be provided to a computing device for presentation in a second orientation.
[0008] FIG. 4 is a flow diagram of an illustrative process for obtaining supplemental content for presentation in a flipped page or pane.
[0009] FIG. 4A is a block diagram illustrative of components of a computing device for use in presenting a content item in a first orientation and presenting supplemental content to the content item in a second orientation.
[0010] FIGS. 5A, 5B and 5C are illustrative user interfaces generated on the computing device that prompt a user to provide information for configuring supplemental content to be displayed to a user DETAILED DESCRIPTION
[0011] Aspects of the present disclosure relate to presenting one or more content items in a first page on a display of a computing device and automatically presenting supplemental content in a second,“flipped” page on the display following detection of a user interaction with the computing device. One aspect of the disclosure is a browser user interface than enables a user to flip a content page over (e.g., via a touchscreen gesture) to view supplemental content (e.g., page metadata) associated with the page. While viewing the supplemental content on the back side of the page in some embodiments, the user can perform a second or reverse flip operation to return to the original page. The content items presented in the first page may, for example, be optimized for aesthetic reasons (e.g., due to screen resolution limitations such as limited screen“real estate”), or may simply be presented in their original form. However, when the user interacts with the computing device (e.g., via a user gesture to“flip” the page), supplemental content may be presented in a flipped page on the display of the computing device. The flipped page (which may also be referred to herein as the back side of the page) may present, for example, the“flip” or“back” side of the first page. In some embodiments the flipped page may replace the first page on the display. The flipped page may also present, for example, the content items as presented in the first page, with one or more portions, or panels, of the first page flippable to present supplemental content corresponding to the content items presented in the first page. The supplemental content may include virtually any associated information in which the user may be interested and/or that is related or similar to the initial content. Accordingly, rather than presenting such supplemental content upon an affirmative request or search by the user, the supplemental content is presented to the user automatically when the user interacts with the computing device, e.g., when performing a flick or swipe gesture which simulates flipping the page over, among other possible user interactions. In some embodiments, the look and feel of the page (including design, colors, font, etc.) may be preserved when the flip operation is performed to create an impression that the back side of the page is part of the same site.
[0012] FIG. 1 depicts a practical example of a presentation of such supplemental content in a flipped page following detection of a user interaction with a computing device 100, the detection occurring while the content item is being displayed in a first page on the display. In FIG. 1, an initial content item 102 is presented in a first page on a display 104 of a computing device 100, for example via a browser application. In the illustrated example, the content item 102 is a webpage describing an item available for purchase from a retail website. More specifically, in the illustrated example, the item available for purchase is a platinum diamond ring and the webpage includes information 106 related to the ring, such as an image of the ring, a customer review rating for the ring, seller data, price data and availability data. In addition, in the illustrated example, the webpage includes various software selection/controls 108 for purchasing the ring, adding the ring to an electronic shopping cart or wish list and searching for related items available for purchase.
[0013] The illustrated user interface also provides a flip indicator 116 in the bottom right corner of the display 104, to indicate that the page may be flipped over to view supplemental content associated with the content item 102. In other embodiments the flip indicator may appear in any corner or side of the display, or the flip indicator may be an icon or some other visual indicator appearing anywhere on the display. In some embodiments, the browser may modify the visual appearance of the flip indicator with movement or animation to reveal to the user that the page may be flipped over. Thus in the illustrated example, the bottom right corner may be animated to“peel back” slightly when the page is initially displayed, in order to indicate to the user that the page may be flappable. In some embodiments the flip indicator may only be presented when supplemental content is available for the particular page or content item 102 being viewed. When the user interacts with the computing device 100 (e.g., when the user flips the page as described herein) as indicated by the direction of arrow 118, and such interaction is detected, supplemental content 114 (also referred to as page metadata) is automatically presented in a second, flipped page on the display 104 of the computing device 100. Further, in response to a user interaction to flip the page, such as via a touchscreen gesture, the browser may create a visual appearance of the content page being flipped over to reveal the back side (e.g. the flipped page). The illustrated supplemental content 114 includes, for example, video content 110 related to the ring, as well as search results 112 related to the ring. As will be appreciated from the illustrated example, a user who is browsing a website may automatically be presented with additional information related to a webpage (or contents within a webpage) simply by flipping the page, and thus, the user is not required to actively search for such information. This can result in intuitive and more efficient navigation of information related to the content item and/or of interest to the user, without requiring affirmative input by the user. Moreover, presenting the supplemental content item in an alternative or flipped page may allow for a more aesthetically pleasing presentation of the content item than in the first page, and enable the user to delve deeper into certain content.
[0014] In some embodiments, and as illustrated in FIG. 1, the user interface for the flipped page may also provide a reverse flip indicator 120, for example in the bottom left corner of the display 104, to indicate that the page may be flipped back to the first page presenting the content item 102. Further, in some embodiments, the user the user interface for the flipped page may also provide an additional flip indicator, for example in the bottom right corner of the display 104, to indicate that the page may be flipped over again multiple times to present additional levels of supplemental content and/or page metadata related to the supplemental content 114 and/or the content item 102. Thus the user may be given the option to flip pages“forward” a virtually unlimited number of additional supplemental content pages or items, and the option to flip pages“backward” to return to prior flipped pages and/or the first page. In some embodiments, rather than provide a separate reverse flip indicator the user may be given the option to use the browser’s back button to reverse flip, or flip pages backward, as described above. The option to use the browser’s back button in this way may also be a user-configurable setting. The browser may display two types of“back” buttons or controls when the user flips multiple levels into the page: a single-level button for going back one level, and a“return to original page” button for going back multiple levels to the original page that was flipped.
[0015] The supplemental content 114 is typically, but not necessarily, provided by a data source (or combination of data sources) other than the source of the content page 102. For instance, in the example of FIG. 1, the supplemental content 114 may be supplied by an entity that operates independently of the retail website, without the involvement of the site’s owner or operator. Thus, the disclosed interface may be used to present supplemental content for virtually any page or content item, including preexisting web pages.
[0016] Another practical example of presentation of supplemental content in accordance with the present disclosure is illustrated in FIG. 2. As depicted in FIG.2, various initial content items 204A (e.g., a music video in the illustrated example), 206A (e.g., information about the artist), 208A (e.g., information about upcoming shows by the artist), and 210A (e.g., information about where to buy the music featured in the video) are displayed in a first page on a display 202 of a computing device 200. In this example, each of the content items 204A, 206A, 208A, and 210A are presented on different panels or portions of the first page which may be individually flipped to view supplemental content. When the user interacts with the computing device 200 (e.g. by flipping one or more of the panels corresponding to the content items 204A, 206A, 208A and 210A), as indicated by arrow 212, supplemental content items 204B, 206B, 208B and 210B to the content items 204A, 206A, 208A and 210A are presented in flipped panels on the display 204 of the computing device 100. In the illustrated example, the supplemental content items 204B, 206B, 208B and 210B may include some of the content items 204A, 206A, 208A and 210A previously presented on the display 204, as well as additional information related to the content items 204A, 206A, 208A and 210A and/or of possible interest to the user. The depicted supplemental content/additional information includes metadata 204B related to the music video, such as a fan comments (as depicted in FIG. 2) and the ability for the user to add her own comment. In some embodiments, the back side of the page may also include a form or text entry box for the user to enter and submit comments associated with the page or content item. These user-entered comments may then be presented to other users viewing the back side of the page.
[0017] Other types of metadata 204B (not shown) for the music video may include, for example, customer review ratings, information about the production of the music video, another version of the music video (e.g. a director’s cut, artist commentary, behind- the-scenes, live versions, remixes, etc.) and so on. Although FIG. 2 depicts each panel corresponding to content items 204A, 206A, 208A and 210A in a“flipped” state to present supplemental content items 204B, 206B, 208B and 210B, this is merely to illustrate that multiple panels may be in different flipped states concurrently. Thus in other examples, any number of flippable panels may be in a flipped state at any given time, allowing the user to access additional content and information while still viewing the original content items. For example, the user may want to flip through one or more of the panels 206A, 208A and 210A to access and view supplemental content while continuing to watch the music video at content item 204A (e.g., the user may not flip the panel corresponding to content item 204A). In some examples the user may flip back and forth among multiple content item panels while the first page as a whole continues to be displayed. However, other scenarios may also be possible. For example, the display and/or user interface may present an option for the user to flip a single panel (e.g., content item 206A presenting a summary of artist information) of the first page and present a second page replacing the view of the first page with supplemental content (e.g., content item 206B with expanded or more detailed artist information) related to or associated with the content item of the single panel. In each of the specific examples described above, the user may have the option to flip the page or panel forward any number of times to view different supplemental content, as well as the option to flip the page or panel back to view the original content item.
[0018] Although specific examples are provided in FIGS. 1 and 2, those skilled in the relevant art will appreciate that the supplemental content may include virtually any type of information that may be related to the initial content item and/or be of interest to the user and that a content item may include any form of digital content. Accordingly, the terms “content,”“digital content” and“content item” are interchangeable herein. Examples of content items include, but are not limited to, music, songs, albums, movies, television shows, television broadcasts, radio broadcasts, videos, video games, documents, audio books, electronic books (“eBooks”), images, maps, articles, webpages or other multimedia works. Supplemental content for such content items may also include digital content, e.g., movies, webpages, documents, etc. and can provide additional information regarding the content item. In some embodiments, the supplemental content includes information typically presented with or as part of the content item in the first page, but this supplemental content is perhaps removed from the presentation in the first page so as to simplify or“de-clutter” said presentation. U.S. Pat. Nos. 7,159,023, 8,145,542, and 8,271,878, describe some of the many types of metadata that can be presented using the disclosed user interface, and describe methods that may be used to generate or obtain such metadata.
[0019] Although described as supplemental content or secondary content, it should be understood this content could include a different form of the initial content. In some embodiments, the supplemental content could be a different version, format or size of the initial content. For example, the supplemental content could be a version of the original content in a different resolution (e.g. a mobile view, a table view, a desktop view, etc.) or displayed using 3D technology. The information may then be presented on the display 104 in the flipped page following user interaction with the computing device 100. In other embodiments, the supplemental content information includes information obtained independently from the content item. In some embodiments, the supplemental content may be displayed to the user in the flipped page with the original content or, in other embodiments, may be displayed on its own. Supplemental content may also include website-level metadata (e.g., related websites, website traffic rank, the date/time when the website was created or published, etc.). In some embodiments this website-level metadata may be presented to the user when the user flips the home page associated with the website. In some embodiments, the size of the back side of the page may be fixed, or capped, so that a limit may be placed on how much supplemental content can be displayed.
[0020] Supplemental content may also include advertising content provided by content or service providers such as reviews (e.g. of products or services), channels (e.g. product and/or service review websites, multimedia review channels,“how to” channels, and the like) and advertisements related to a content item presented in the first page. For example, a first page may present an article related to a particular product (e.g., a car), and supplemental content may include an advertisement for that product (e.g., an ad for the car, a video review about the car) which may be text-based, graphical, audio-visual, interactive, and so on. The supplemental content may also provide options for the user to view and/or flip the page for more information about the product, such as technical specifications, additional user reviews, suggestions or recommendations on where the product may be available for purchase. Some or all of the supplemental content may be targeted for the user based on, for example, their location (e.g., suggestions on where to buy may be based on the user’s location) and/or other demographic information (e.g. age, gender). In some embodiments, content or service providers may be able to associate certain supplemental content (e.g., a channel, an advertisement, an advertisement incentive such as a coupon or reward, an application, etc.) with a content item, and to bid to have their supplemental content provided for display on a flipped page or panel corresponding to the content item. The provider of the overall system may also provide incentives to users for flipping over pages and/or page elements, such as by occasionally revealing a prize or discount offer on the back side of a flipped page or page element.
[0021] The ads and other supplemental content presented to a user on the back side of the page may be selected dynamically from a pool of supplemental content associated with the page. In such embodiments, a history of the user’s past flip operations may be taken into consideration in deciding what supplemental content to present. In some embodiments, ad content may be associated with keywords or a certain series or sequence of flips events. The overall system may also track the series or sequence of flips and select ads based on a specific pattern in the series or sequence. Further, in some instances, when a user selects an ad on the back of a page, the browser may create the appearance that the page is being flipped over an additional time to reveal the target (advertiser) page associated with the ad. In some embodiments, an ad may itself be flippable to reveal further supplemental content associated with the ad, such as corresponding ad or advertiser metadata, such as an average rating of the advertiser.
[0022] Given the above, one can provide an almost limitless number of practical examples in which aspects of the present disclosure may be implemented. For instance, with respect to the example illustrated in FIG. 1, the supplemental content 114 may include information that may be removed from the webpage presented in the first page in order to simplify the presentation or make the presentation more aesthetically pleasing. For instance, the price data, customer review rating, seller data, availability data and software controls could be removed from the webpage and instead included in the supplemental content. Accordingly, only the image and brief description of the ring offered for purchase on the webpage may be presented in the first page to the user. With respect to the example illustrated in FIG. 2, the supplemental content 204B, 206B, 208B and 210B may include additional information that is related not only to the music video presented in the first page, but to the particular artist presented in the first page. Although FIG. 1 and 2 each depict only two pages (e.g., a first page and a flipped page, or a first page with one or more flipped panels), in some embodiments additional pages presenting different supplemental content can be provided when the device is flipped any number of times (e.g., as the user might, for example, while “flipping” through a book or a catalog). In one example, different supplemental content can be displayed if device 100 is flipped in different directions (e.g., from left to right, right to left, top to bottom, bottom to top, etc.).
[0023] There are myriad user interactions that can be implemented within the browser or computing device to enable users to“flip the page” and trigger the presentation of a supplemental content in a flipped page. For example, such presentation may be triggered based detection of an audible command, image detection of a user gesture, selection of an existing software control (e.g., dragging of a scroll bar), detection of a touchscreen gesture with the display (e.g. touching a corner or predetermined area of the display, swiping from one edge or corner to another, a swipe gesture in which a representation of a corner of the content page is dragged away from a corner of the touchscreen, touching and dragging a corner to simulate“peeling” a page corner back to flip the page, long-press followed by a swipe gesture, pinching or squeezing two or more fingers on an area of the display, etc.), a keyboard action (e.g., pressing a“page down” key) or some other manipulation of an input device (e.g., flicking the computing device quickly to the left, right, up or down to simulate a “flipping” action, rotating, shaking, tilting and/or spinning of the computing device, etc.). In some embodiments the display of the computing device may expose the possibility of different user interactions on a single page to allow the user to flip to different pages. For example, the single page may allow the user to swipe from right-to-left to flip to a first flipped page, swipe from left-to-right to flip to a second flipped page (or to reverse flip back to the first page, or to a previous flipped page in a series or stack of flipped pages etc.), and so on. In some embodiments, when the user flips the page, the browser may use animation to create the appearance of a physical page being flipped over to expose its back side. The browser may additionally or alternatively support other user actions for causing the supplemental content to be displayed. For example, the user could swipe the original page to the side to cause the“supplemental content” page to slide-in in place of the original page. As another example, the user could perform a gesture that causes an overlay page containing the supplemental content to be displayed over the original page.
[0024] As mentioned above, in some embodiments the user may be presented with the ability to flip certain panels or portions of a first page, either instead of or in addition to the ability to flip the first page as a whole. The panels or portions may for example correspond to particular content items presented on the first page. Supplemental content associated with the particular content item for a panel may be presented in response to detection of a user interaction to flip the panel. In such an example, only the particular panel may be flipped, replacing the particular content item with the associated supplemental content, while the rest of the first page remains in the same visual state as before the flip. In some cases the user may be allowed to flip more than one panel of the first page, either sequentially or in parallel. In some cases the user may be allowed to“unflip” (e.g., reverse flip) a panel back to its original“unflipped” visual state, and in some cases the user may be allowed to flip a panel multiple times to view additional supplemental content. Further, in some cases the user may be allowed to flip and/or reverse flip one or more panels from a first visual state to a second visual state, then flip the page to view different supplemental content, and then reverse flip the page back view to the second visual state. The display of the computing device may be configured to detect any possible combination of user interactions to present the virtually unlimited number of display states involving one or more flipped panels and/or pages. As described herein, embodiments describing flipping the page shall be understood to include and cover embodiments or variations involving flipping a panel or portion of the page, or combinations thereof.
[0025] The display may also present various user interface features to indicate to a user whether and how a page or panel may be flipped. For example, in some embodiments a corner of the display may present a triangular and/or three-dimensional representation of the upper right corner (or any corner) of the page (or panel) slightly peeled back to provide an indication to the user that can flip the page (or panel) by touching that corner and swiping away from the corner edge to simulate peeling the page (or panel) back in order to flip the page (or panel). In other embodiments, the display may provide an indication or suggestion that flicking the device quickly to the left (or any direction) may flip the page, much as one would physically flip a card or piece of paper to see what is on the other side. In some embodiments the display may also present an indication that no supplemental content is available for a page or panel, for example, by greying out and disabling a display element ordinarily used to flip the page, or by not presenting the display element altogether. [0026] In some embodiments the display may also be configured to present an icon or other graphic to provide the user with a visual indication or preview of the type of supplemental content that may be available on the flipped page or panel. For example, content presented in a first page on the display may be a textual article or review about a product, while supplemental content available on the flipped page may be a gallery of images of the product. In this example the display may present a“gallery icon,” for example in one corner of the first page display, to provide an indication that the user may flip the page to view the gallery of images of the product. Any type of icon or other graphic may be presented depending on the type of supplemental content available, including but not limited to a video icon to indicate video content, a text icon to indicate additional text icon, a comment icon to indicate comment-based content (e.g., view user comments, and/or the ability for the user to comment and/or provide annotation on a content item or page), a music icon to indicate music-based content, a question mark icon to indicate search or query based content, and so on.
[0027] As yet another example, the content item presented in the first page on the display of the computing device may be an image or movie clip of a person, place or object, and the supplemental content item may include video or audio content featuring the person, place or object; biographical or historical information regarding the person, place or object; links to other information relating to or referencing the person, place or object; other images of the person, place or object; search results for the person, place or object; etc. Accordingly, whenever a user flips the computing device (or otherwise interacts with the computing devices as described below in other embodiments) while the image of the person, place or object is being presented in a first page on the display of the computing device, such supplemental content is automatically presented in a flipped page on the display without requiring the user to actively seek the information included in such supplemental content.
[0028] In another example, a student may use a device to read text displayed on a first page. When the student“flips the page” the student may, for example, see a video related to the text. If the student flips the page again to a third page, a test could be presented to the student. When the student has completed the test or finished watching the video, the student may flip the page back to the first page. While this example describes a first page and two flipped pages, any number of flipped pages may be available and presented for display. Further, in some examples, certain panels or portions of the page may be flipped by the student. For example, the third page presenting a test to the student may include one or more panels for each question on the test, which the student may selectively flip to view the answer to the question and/or explanation of the answer.
[0029] In other example, a user may use a search engine to perform a web search for content matching certain search criteria. The first page may present search results, for example, links to content matching the search criteria. The display may provide an option for the user to flip the page to view supplemental content such as an indication of which links in the search results are“better quality” based on various criteria (e.g. click-through rates, how long users stayed on a page corresponding to a particular link, etc.). In another variation of this example, supplemental content may also present search results from different search engines, suggested or related search terms, information about trending topics for the search criteria or related searches, and so on. In another variation, panels corresponding to particular search result items may be flipped to display supplemental content such as a quick preview of a search result item or other information related to the search result item (e.g. about the web site, when the search result item was published).
[0030] FIG. 3 is a block diagram illustrative of an operating environment 300 capable of operating as described herein. The operating environment 300 may include an intermediary system 330 which serves as an intermediary between computing devices 400 and content or service providers 340, such as web sites. The computing devices 400 that access the content or service providers 340 can include various types of computing devices, such as tablets, mobile phones (including smartphones), electronic book readers, desktop computers, laptop computers, personal digital assistants (PDAs), other wireless devices, set- top or other television boxes, media players, game platforms and kiosks, among others. Illustrative components of computing devices 400 are described in greater detail with reference to a computing device 400 as described in the paragraphs in Appendix A herein and as illustrated in FIG. 4 of the’193 Application, which is reproduced as FIG.4A of the present disclosure.. [0031] In some embodiments, the intermediary system 330 may, for example, be or act as a proxy server, a partial rendering engine for specific browsers or device types, a CDN, an Internet Service Provider (“ISP”) system, or a combination thereof. Each computing device 400 runs a browser application 50 (“browser”) capable of retrieving and displaying content pages according to standard protocols. The browsers 50 may be designed or configured to retrieve web pages via the intermediary system 330. In some embodiments, each computing device 400 may include a configuration information data store 418 that stores information used by the computing device 400 to configure the presentation of supplemental content in one or more flipped pages following detection of user interaction with the computing device 400 in accordance with the present disclosure. Such configuration information may include, but is not be limited to, metadata associated with the content item presented in the first page, watermarking data associated with the content item presented in the first page, contextual data associated with the content item presented in the first page, user supplied configuration data, third party supplied configuration data, user profile data, device profile data, content profile data and the like. The computing device 400 may, for example, retrieve configuration information from the configuration information data store 418 in response to a user interaction to flip the page in order to obtain supplemental content related to the content item to be presented in the second flipped page. In one embodiment, the configuration information identifies what information is to be included in the supplemental content.
[0032] In some embodiments, the features and functionality disclosed herein can be implemented collectively by the browser 50 and intermediary system 330. For example, when the browser 50 requests a page (or content item) from a URL through the intermediary system 330, the intermediary system 330, in addition to returning the requested page (or content item), may return a second page (or other unit of content) containing metadata for the requested page. The browser 50 may then store this second page and/or page metadata in a local cache, and would present it via the display in response to the user performing a flip operation. Alternatively, the browser 50 can request and retrieve the metadata page from the intermediary system 330 when the user initiates the flip operation. [0033] The user interfaces and features disclosed can be implemented without an intermediary system 330. For example, when the browser 50 requests a page from a URL, the browser 50 can concurrently send a request to a metadata server for the metadata associated with the requested page and store the metadata in its local cache for later display in response to a user flipping the page.
[0034] In some embodiments, the browsers 50 may be (or may include) conventional web browsers that are not specifically designed or configured to display page previews. In other embodiments, the browsers 50 may be specifically designed to handle specific tasks associated with the display of page previews.
[0035] The content or service providers 340 may include or consist of, for example, ordinary web sites and/or web services. Each content site 34 may include a server 342 that serves content, such as web pages, in response to URL requests. The pages for which supplemental content may be generated can be conventional web pages that do not include any special coding or formatting to support the generation of supplemental content as described herein. In some embodiments, however, the intermediary system 330 may support the use of special tags for designating whether or how supplemental content should be generated for particular pages. Where special tags are supported, a content provider may, for example, embed tags in a content page indicating, for example, which visual elements or sections of the page should be associated with supplemental content.
[0036] As shown in FIG. 3, the intermediary system 330 includes a supplemental content service 312, an advertiser interface 324 an advertisement data store 326 and a click- through tracking data store 328. (In some embodiments, the advertiser interface 324, the advertisement data store 326 and the click-through tracking data store 328 are omitted.) The supplemental content service 312 obtains and/or generates supplemental content related to a content item in response to a request from the computing device 400. As described herein, the supplemental content may be associated with one or more content items being presented in a first page (or panel) on the display of the computing device 400 and is configured to be presented in a flipped page (or panel) on the display of the computing device following user interaction with the device. Moreover, the supplemental content item may itself be, for example, a webpage, a document, an image, a software application, etc. or may be an overlay of information that is presented in conjunction with the content item.
[0037] The advertiser interface 324 allows an advertising entity, including in some embodiments content or service providers 340 and/or other third-party advertisers, to associate supplemental advertising content (e.g., a channel, an advertisement or ad, a coupon, an application, etc.) with a content item. In some embodiments the advertiser interface 324 may allow the advertising entity to associate supplemental content with keywords which may be related to the content item. Supplemental advertising content associated with a content item may also include, for example, particular pages or web Universal Resource Locators (“URLs”), and/or classes of pages or web URLS for the content item. The advertiser interface 324 may also allow the advertising entity to place a bid to have their supplemental content displayed on a flipped page or panel corresponding to the content item. The bid may include various parameters such as a bid price, a number of times the supplemental content is to be displayed or made available on a flipped page or panel, a time of day at which the supplemental content is to be displayed or made available on a flipped page or panel, desired target characteristics of users who may presented the supplemental content (e.g., demographic information such as age, gender, location, etc.). The intermediary system 330 or browser 50 may then select supplemental content associated with content items to be displayed based, for example, on the highest bid amount and/or other parameters associated with the bid. For example, in one embodiment the browser 50 may maintain a number of ads in a local cache, and dynamically select ads from the cache to display on flipped pages based on keyword matching or any other criteria. In some embodiments, the advertiser interface 324 may include a website or an area of a website hosted by a server.
[0038] The advertisement data store 328 may store advertisements (and other supplemental content) uploaded by the advertising entity to enable quick and efficient retrieval by the intermediary system 330 or browser 50. The click-through tracking data store 328 may, for example, record flip events, click-through events for advertisements, and other supplemental content for purposes of charging the advertising entity a fee. Additionally, according to one embodiment, the browser 50 may report page flip user interaction events to the intermediary system 330, and the intermediary system 330 may use these reported flip events to log advertisement impression events for any ads displayed on the back of the page. In some embodiments the advertising entity may be charged for the advertisement impression events. One benefit or this approach is that it does not require the involvement of, or payment of money to, the operators of the websites on which the ads are effectively being displayed.
[0039] Another illustrative example of an operating environment 300 and various components according to some embodiments are described in greater detail with reference to the operating environment 300 as described in the paragraphs in Appendix A herein and as illustrated in FIG. 3 of the’193 Application, which is reproduced as FIG. 3A of the present disclosure. Any and all of the components of the operating environment 300 as described in the ’193 Application and in Appendix A herein may be included in the operating environment 300 described in the present disclosure, including, for example, an application service 310, an application data store 304, a supplemental content data store 314 and network data source(s) 302 and any number of additional components, systems and/or subsystems as described in the’193 Application and in Appendix A herein. Further, in some embodiments, the supplemental content data store 314 as described in the’193 Application and in Appendix A herein may be local to the supplemental content service 312, may be remote from the supplemental content service 312, may local to the content or service provider 340 and/or may be a network-based service itself.
[0040] Further, the supplemental content service 312 as illustrated in FIG. 3 of the present disclosure may include additional components, systems and/or subsystems as described in the’193 Application and in Appendix A herein, to obtain and/or generate supplemental content. For example, components of the supplemental content service 312 may include a computing device interface 320 for receiving and transmitting requests for supplemental content from computing device 400, an external data source interface 316 for obtaining supplemental content information from network data sources 302 and an application service interface 322 for obtaining applications which may be supplemental content from application service 315. The supplemental content service 312 can further include a content request processing component 318 for processing requests for supplemental content received from one or more computing devices 400, generating requested supplemental content and ultimately publishing supplemental content. Process for Flipping a Page to View Supplemental Content (FIG. 4)
[0041] FIG. 4 illustrates one embodiment of a process 400A for obtaining a supplemental content item to be presented on the back of a first page. In one embodiment, the process 400A is implemented by the computing device 400 (e.g., via the browser 50 as illustrated in FIG. 3 herein and/or via the user interface component 412 as described in the ’193 Application and in Appendix A herein). The process 400A begins in a block 422 in which interactions between the user and user’s computing device are monitored (e.g., via the monitoring component 413 of the computing device 400 as described in the’193 Application and in Appendix A herein). In one embodiment, the monitoring component 413 monitors interactions between the user and the computing device while content items are being presented in a first page with respect to the display 406 of the computing device 400. Once such an interaction (e.g., such as one of the user interactions the user may perform to flip the page or a panel of the page) is detected in a block 424, configuration information may be retrieved in block 426 (e.g., from the configuration information data store 418 described with reference to FIG. 3). The retrieved configuration information may describe how and what supplemental content information is to be presented in the flipped page or panel on the display 406 of the computing device 400. In the illustrated method, once the configuration information is retrieved, supplemental content is requested in block 428 based on the configuration information. In other embodiments, once the configuration information is retrieved, page metadata may be automatically retrieved by the browser 50 in the background after the first page has loaded, so that the page metadata may be readily available for display if the user initiates a flip. Additionally in some embodiments, the browser 50 or intermediary system 330 may be configured to predictively determine whether supplemental content and/or page metadata may be pre-fetched or pre-forwarded based, for example, on how frequently the user invokes the flip the page feature.
[0042] As described above, the supplemental content service 312 may provide the supplemental content to the computing device in response to this request. In some embodiments, previously obtained supplemental content information may also be retrieved for inclusion in the supplemental content for presentation in the flipped page in a block 430. Next in block 432 the computing device 400 may present the supplemental content in the flipped page, or in the flipped panel of the first page, on the display 406 of the computing device 400.
[0043] As a result of process 400A, the supplemental content for the initial content item is automatically presented in the flipped page or panel following detection of user interaction with the computing device 400, the detection occurring while the content item was being presented in the first page on the display of the device. Thus, supplemental content may be made accessible via an intuitive user interface presented on the display of the device, in a manner which does not substantially reduce the amount of screen“real estate” available for display of the first page (e.g., through the utilization of small, unobtrusive and intuitive flip indictors as described with reference to FIGS. 1 and 2 above), This feature is particularly beneficial for devices such as tablets and smartphones with smaller screen resolutions. The automatic presentation of the supplemental content also frees the user from affirmatively seeking or searching for the information contained in the supplemental content. In addition, the supplemental content enables the provider of the content to avoid including superfluous information related to the content item when the content item is presented in a first page. Following presentation of the supplemental content in the flipped page, the method 400A may end. User Configuration
[0044] In some embodiments, a user can configure the presentation of supplemental content in a flipped page. In one embodiment, a user may utilize a supplemental content configuration user interface of a configuration application to configure how and what information is to be included in supplemental content that is to be presented in a flipped page. The configuration application may, for example, be hosted by the intermediary system, and/or may be accessible via a menu option of the browser 50.
[0045] Some examples of supplemental content configuration options may include what types of supplemental content should be displayed (e.g., ads, site-level data, links to related sites, product metadata, price comparison data, product recommendations, user comments, etc.), which content provider(s) should the supplemental content be obtained from, whether the supplemental content should be retrieved and cached preemptively in the background (e.g., always or when Wi-Fi is available), whether to enable the intermediary system to deliver personalized metadata based on the monitored behaviors of the user, and the like. Additional examples of supplemental content configuration options and sample user interfaces and processes are described in greater detail in the’193 Application, as described in the paragraphs in Appendix A herein and with reference to FIGS. 7A-7C of the’193 Application, which are reproduced as FIGS. 5A-5C of the present disclosure. While the examples described in the’193 Application and in Appendix A herein are provided with respect to a user rotating the computing device from a first orientation to a second orientation, the examples are equally applicable to the present disclosure with respect to a user flipping the page as described herein. For example, references to“when the device is rotated” or“when you rotate your device” with regard to FIGS. 7A-7C of the ’193 Application and as described in Appendix A herein may be replaced with references to“when the page is flipped” or“when you flip the page” to illustrate how a user may configure the presentation of supplemental content in a flipped page. System Implementation and Variations
[0046] The intermediary system 330 may be implemented by or on a computing system that comprises one or more physical computing devices (physical servers, storage arrays, routers, etc.), each of which may include a processor and memory. The computing system may, in some cases, include computing devices that are distributed geographically, in which case some of the disclosed server-side tasks may be performed remotely from others. The various functions of the intermediary system 330 may be embodied in code modules executed by the computing system. The code modules may be persistently stored on any type or types of non-transitory computer storage devices or media (magnetic disks, solid state memories, optical drives, etc.). Some or all of the disclosed processes of the intermediary system 330 may alternatively be embodied partly or wholly in specialized computer hardware, such as in custom designed ASICs or FPGAs. The various components and functions of the intermediary system 330 can also be implemented in one or more virtual machines or cloud resources, rather than in dedicated servers. The browser 50 may include executable code stored on any type of non-transitory storage medium, including code for implementing the client-side functions (including the various user interface features) described herein.
[0047] In some embodiments, the intermediary system 330 may be omitted. In such embodiments, the intermediary system 330 may alternatively be implemented on a separate network-accessible server system that does not act as an intermediary between the browsers 50 and content sites 340. Further, as described herein, supplemental content could alternatively be generated by the browsers.
[0048] Although described in the context of content“items” or“pages,” the methods disclosed herein are also applicable to other documents and units of content. For example, the disclosed methods can be used to provide supplemental content related to Word documents, spreadsheet files, PDF documents, and various other types of documents.
[0049] Although described in the context of a browser, the user interfaces disclosed herein can also be implemented within other types of document viewers capable of retrieving and displaying documents. For example, the user interfaces may be implemented within a word processing program, a PDF reader, or a news reader.
[0050] The disclosed features may also be incorporated into other types of mobile applications, including news reader and e-book reader applications. For example, the user can flip over a news story page to view links to related stories, a biography of the reporter, ads associated with keywords appearing in the story, etc.
[0051] The foregoing embodiments may be better understood in view of the following clauses:
1. A system for providing supplemental content, the system comprising:
one or more data stores that store supplemental content data; and a browser component including executable code that directs a user computing device operative to:
request supplemental content data, wherein the supplemental content data is associated with initial content presented in a first page on the display of the user computing device, and wherein the supplemental content data is configured to be presented in a flipped page on the display of the remote computing device;
detect a user interaction with the user computing device, wherein the user interaction is indicative of a request to flip the first page to the flipped page, wherein the user interaction occurs while the initial content is being presented in the first page; and
automatically present the supplemental content in the flipped page on the display after detection of the user interaction; and
a computing device in communication with the one or more data stores, said computing device operative to:
receive, from the user computing device, a request for supplemental content data;
obtain the supplemental content data from the one or more data stores; and
transmit the supplemental content data to the user computing device for automatic presentation in association with the flipped page on the display of the user computing device.
2. The system of clause 1, wherein the first page is presented on the entire display and the flipped page is presented on the entire display, and wherein the supplemental content is automatically presented by presenting the flipped page instead of the first page on the display.
3. The system of clause 1, wherein the first page is presented on a portion of the display and the flipped page is presented on the portion of the display, and wherein the supplemental content is automatically presented by presenting the flipped page instead of the first page on the portion of the display.
4. The system of clause 1, wherein at least one of the one or more data stores comprises an external data store from which data is obtained via one or more application programming interfaces.
5. The system of clause 1, wherein said computing device is further operative to: receive a plurality of requests for supplemental content data associated with the same or similar initial content, wherein the plurality of requests are received from a plurality of user computing devices;
determine which supplemental content data is suitable for the same or similar initial content;
obtain the supplemental content data suitable for the same or similar content from the one or more data stores; and
transmit the supplemental content data suitable for the same or similar initial content to at least one of the user computing devices that requested the supplemental content data.
6. A non-transitory storage medium having stored thereon a browser component, said browser component including executable code that directs a user computing device having a touchscreen to perform a process that comprises:
retrieving a content page of a content site, and displaying the content page on the touchscreen;
receiving, from a content source that is separate from the content site, supplemental content associated with the content page;
detecting a touchscreen gesture representing a user request to flip the content page over; and
in response to the touchscreen gesture, creating a visual appearance of the content page being flipped over to reveal a back side, and displaying the supplemental content on said back side.
7. The non-transitory storage medium of clause 6, wherein the touchscreen gesture is a swipe gesture in which a representation of a corner of the content page is dragged away from a corner of the touchscreen.
8. The non-transitory storage medium of clause 6, wherein the process further comprises, while the back side of the content page is displayed, detecting a second touchscreen gesture representing a second request to flip the page over, and responding to the second touchscreen gesture by creating a visual appearance of the page being flipped back to reveal a front side. 9. The non-transitory storage medium of clause 6, wherein the process further comprises, while the back side of the content page is displayed, detecting a second touchscreen gesture representing a second request to flip the page over, and responding to the second touchscreen gesture by creating a visual appearance of the page being flipped to reveal a third page.
10. The non-transitory storage medium of clause 6, wherein the supplemental content includes links to related pages of other content sites.
11. The non-transitory storage medium of clause 6, wherein the supplemental content includes at least one advertisement associated with the content page.
12. The non-transitory storage medium of clause 6, wherein the browser component is configured to receive and cache the supplemental content in the background prior to detection of the touchscreen event.
13. The non-transitory storage medium of clause 6, wherein the browser component is configured to receive the supplemental content over a network from an intermediary system that serves as an intermediary system between the browser component and the content site.
14. The non-transitory storage medium of clause 6, wherein the browser component includes functionality for a user to specify, via configuration settings, types of supplemental content to be displayed on back sides of content pages.
15. A computer-readable, non-transitory storage medium having computer- executable components for providing content, the computer-executable components comprising:
a user interface component that presents content in a first page on a display of a computing device;
a monitoring component that detects a user gesture to flip the first page to a second page, wherein the user gesture occurs in relation to the computing device; and a content selection component that obtains second content from one or more sources external to the computing device,
wherein after detection of the user gesture, the user interface component presents at least a portion of the obtained second content. 16. The computer-readable, non-transitory storage medium of clause 15, wherein the first page is a full-screen view of the content and the second page is a full-screen view of at least the portion of the second content.
17. The computer-readable, non-transitory storage medium of clause 15, wherein the content in the first page is optimized for a first screen resolution and the second content in the second page is optimized for a second screen resolution.
18. The computer-readable, non-transitory storage medium of clause 15, wherein the first screen resolution is optimized for presentation on a display of a desktop computer and the second screen resolution is optimized for presentation on a display of a mobile computing device.
19. A computer-implemented method for presenting content on a display of a computing device, the computer-implemented method comprising:
detecting a user interaction with the computing device while first content is presented in a first page on the display, said user interaction being a touchscreen gesture indicative of a request to view second content related to the first content; requesting second content determined to be related to the first content presented in the first page, wherein the second content is to be presented in a second page on the display; and
after detection of said user interaction with the computing device, automatically presenting, on the display, at least a portion of the second content in the second page.
20. The computer-implemented method of clause 19, wherein the second content is determined to be related to the first content based at least on one of metadata associated with the content presented on the display in the first page, watermarking data associated with the content presented on the display in the first page, contextual data associated with the content presented on the display in the first page, user supplied configuration data, user profile data, content profile data, device profile data and third party supplied configuration data. 21. The computer-implemented method of clause 19, wherein the user interaction with the computing device is detected based on data received from at least one of a sensor and an input device.
22. The computer-implemented method of clause 19, wherein the first content being presented on the display in the first page comprises at least one of multimedia content, a webpage, a document, an image and a software application.
23. The computer-implemented method of clause 19, wherein the second content presented on the display in the second page is different from the first content.
24. The computer-implemented method of clause 19, wherein the second content presented on the display in the second page comprises both contextual data related to the first content and contextual data related to the device.
25. The computer-implemented method of clause 19, wherein the second content presented on the display in the second page comprises a software application.
26. The computer-implemented method of clause 19, wherein the second content presented on the display in the second page comprises data obtained from an external source that is remotely accessible by the computing device.
27. The computer-implemented method of clause 26, wherein the data is obtained from the external source via one or more application programming interfaces.
28. The computer-implemented method of clause 19, wherein the second page is an overlay page presented over the first page.
29. A computing device that is operable to present content in multiple pages comprising:
a memory operative to store content;
a display operative to present at least a first content item;
a processing unit in communication with the memory and the display, the processing unit operative to:
cause the display of the first content item in a first page;
obtain, from a server, a selection of at least one of a plurality of supplemental content items for presentation in a second page, wherein the first content item contains information different from the at least one of the plurality of supplemental content items;
detect a user interaction indicative of a request to flip the first page to the second page;
in response to detecting the user interaction indicative of a request to flip the first page to the second page, cause the display of the at least one of the plurality of supplemental content items in the second page.
30. The computing device of clause 29, wherein the processing unit is further operative to obtain, from a server, a selection of a second plurality of supplemental content items for presentation in a third page,
wherein the computing device is further configured to detect a user interaction indicative of a request to flip the second page to the third page, and in response to detecting the user interaction indicative of a request to flip the second page to the third page, the computing device is configured to display the second plurality of supplemental content items.
31. The computing device of clause 29, wherein in response to detecting the user interaction indicative of a request to flip the second page to the third page, the computing device is configured to cause the display of:
the first content item;
the plurality of supplemental content items; and
the seond plurality of supplemental content items.
32. The computing device of clause 29, wherein the processing unit is further operative to format the plurality of supplemental content items for presentation on the display in the second page.
33. The computing device of clause 29, wherein the first page is a full-screen view of the first content item and the second page is a full-screen view of at least the portion of the plurality of supplemental content items.
34. The computing device of clause 29, further comprising a sensor, wherein detection of user interaction indicative of a request to flip the first page to the second page and detection of user interaction indicative of a request to flip the second page to the third page are detected by the sensor.
35. The computing device of clause 29, wherein the first content item being displayed in the first page comprises a webpage, and the user selected plurality of supplemental content items displayed in the second page comprises information related to the webpage.
36. The computing device of clause 29, wherein only a portion of the first content item is displayed in the first page and the plurality of supplemental content items displayed in the second page includes more than the portion of the first content item.
37. A system for enabling users to view supplemental content associated with pages of content sites, the system comprising:
a server system that stores advertisements in association with particular content pages of content sites, said server system comprising one or more physical servers; and
a browser component that is configured to run on user computing devices, said browser component including executable code that directs a user computing device to perform a process that comprises:
receiving, over a network, a content page of a content site, and displaying the content page on a touchscreen of the user computing device;
receiving, from the server system, one or more advertisements associated with the content page;
detecting a touchscreen gesture representing a user request to flip the content page over; and
in response to the touch screen gesture, creating a visual appearance of the content page being flipped over to reveal a back side, and displaying the one or more advertisements on said back side.
38. The system of clause 37, wherein the server system includes a user interface that includes functionality for an advertiser to submit an advertisement, and to designate at least one content page for which the advertisement is to be displayed on a back side. 39. The system of clause 37, wherein the advertisement comprises at least on one of multimedia content, a product advertisement, a service advertisement, an advertising channel and an advertisement incentive.
40. The system of clause 37, wherein the server system is configured to receive, from an advertising entity, a bid to provide, to a user computing device, an advertisement associated with a particular content page.
41. The system of clause 37, wherein the browser component is configured to report a page flip event to the server system in response to the gesture, and the server system is responsive to the page flip event by recording an advertisement impression event in connection with each of the one or more advertisements.
42. The system of clause 37, wherein the browser component is configured to report a series of page flip events to the server system, and the server system is responsive to the reported series of page flip events by selecting the advertisement based at least partly on a particular pattern in the series of page flip events.
43. A non-transitory storage medium having stored thereon a browser component, said browser component including executable code that directs a user computing device having a touchscreen to perform a process that comprises:
retrieving a content page of a content site, and displaying the content page on the touchscreen;
receiving, from a content source that is separate from the content site, advertising content associated with the content page;
detecting a touchscreen gesture representing a user request to flip the content page over; and
in response to the touchscreen gesture, creating a visual appearance of the content page being flipped over to reveal a back side, and displaying advertising content on said back side.
44. The non-transitory storage medium of clause 43, wherein the touchscreen gesture is a swipe gesture in which a representation of a corner of the content page is dragged away from a corner of the touchscreen. 45. The non-transitory storage medium of clause 43, wherein the process further comprises, while the back side of the content page is displayed, detecting a second touchscreen gesture representing a second request to flip the page over, and responding to the second touch screen gesture by creating a visual appearance of the page being flipped back to reveal a front side.
46. The non-transitory storage medium of clause 43, wherein the process further comprises, while the back side of the content page is displayed, detecting a second touchscreen gesture representing a second request to flip the page over, and responding to the second touch screen gesture by creating a visual appearance of the page being flipped to reveal advertiser information.
47. The non-transitory storage medium of clause 43, wherein the advertising content includes links to related pages of other content sites.
48. The non-transitory storage medium of clause 43, wherein the browser component is configured to receive and cache the advertising content in the background prior to detection of the touchscreen event.
49. The non-transitory storage medium of clause 43, wherein the browser component is configured to receive the advertising content over a network from an intermediary system that serves as an intermediary system between the browser component and the content site.
50. The non-transitory storage medium of clause 43, wherein the browser component includes functionality for a user to specify, via configuration settings, types of advertising content to be displayed on back sides of content pages.
51. A system for providing advertising content, the system comprising:
one or more data stores that store advertising content data; and a browser component including executable code that directs a user computing device operative to:
detect a user interaction with the user computing device, wherein the user interaction is indicative of a request to flip a first page presented on a display of the user computing device over to a second page, wherein the user interaction occurs while an initial content item is being presented in the first page; and
automatically present advertising content in the second page on the display after detection of the user interaction; and
a computing device in communication with the one or more data stores, said computing device operative to:
receive, from a first remote computing device, a request to associate a content item with advertising content data and a bid;
associate the content item with the advertising content data;
receive, from a user computing device, a request for initial content data;
obtain the initial content data and advertising content data associated with the initial content data from the one or more data stores; and transmit the initial content data and the advertising content data to the user computing device.
52. The system of clause 51, wherein the user interaction is a touchscreen gesture in which a representation of a corner of the content page is dragged by the user away from a corner of the display.
53. The system of clause 51, wherein the initial content comprises at least one of multimedia content, a webpage, a document, an image and a software application.
54. The system of clause 51, wherein the advertising content data comprises at least one of a product advertisement, a service advertisement, an advertising channel and an advertisement incentive.
55. The system of clause 54, wherein the advertising channel comprises at least one of multimedia content, a webpage, a document, an image and a software application.
56. The system of clause 51, wherein the first page is presented on a portion of the display and the second page is presented on the portion of the display, and wherein the advertising content is automatically presented by presenting the second page instead of the first page on the portion of the display. 57. The system of clause 51, wherein at least one of the one or more data stores comprises an external data store from which data is obtained via one or more application programming interfaces.
58. The system of clause 51, wherein the bid is a bid to provide the advertising content data to a plurality of remote computing devices in response to a request from the plurality of remote computing devices for advertising content data associated with the content item, and wherein said computing device is further operative to obtain the requested advertising content data from the one or more data stores based at least in part on the bid.
59. The system of clause 51, wherein the bid comprises at least one of a bid price, a number of times the advertising content data is to be provided to a remote computing device, a time of day at which the advertising content data is to be provided to a remote computing device and a set of characteristics of users of remote computing devices to which the advertising content data is to be provided.
60. The system of clause 51, wherein the initial content data is optimized for a first screen resolution and the advertising content data is optimized for a second screen resolution.
61. The system of clause 60, wherein the first screen resolution is optimized for presentation on a display of a desktop computer and the second screen resolution is optimized for presentation on a display of a mobile computing device.
62. The system of clause 51, wherein said computer device is further operative to: associate the content item with the advertising content data based at least on one of metadata associated with the content item, watermarking data associated with the content item, contextual data associated with the content item, user supplied configuration data, user profile data, content profile data, device profile data and third party supplied configuration data. Conclusion
[0052] Depending on the embodiment, certain acts, events, or functions of any of the processes or algorithms described herein can be performed in a different sequence, can be added, merged, or left out altogether (e.g., not all described operations or events are necessary for the practice of the algorithm). Moreover, in certain embodiments, operations or events can be performed concurrently, e.g., through multi-threaded processing, interrupt processing, or multiple processors or processor cores or on other parallel architectures, rather than sequentially.
[0053] Conditional language used herein, such as, among others, "can," "could," "might," "may,"“e.g.,” and the like, unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain embodiments include, while other embodiments do not include, certain features, elements and/or steps. Thus, such conditional language is not generally intended to imply that features, elements and/or steps are in any way required for one or more embodiments or that one or more embodiments necessarily include logic for deciding, with or without author input or prompting, whether these features, elements and/or steps are included or are to be performed in any particular embodiment. The terms“comprising,”“including,”“having,” and the like are synonymous and are used inclusively, in an open-ended fashion, and do not exclude additional elements, features, acts, operations and so forth. Also, the term“or” is used in its inclusive sense (and not in its exclusive sense) so that when used, for example, to connect a list of elements, the term“or” means one, some, or all of the elements in the list.
[0054] Conjunctive language such as the phrase“at least one of X, Y and Z,” unless specifically stated otherwise, is to be understood with the context as used in general to convey that an item, term, etc. may be either X, Y or Z, or a combination thereof. Thus, such conjunctive language is not generally intended to imply that certain embodiments require at least one of X, at least one of Y and at least one of Z to each be present.
[0055] While the above detailed description has shown, described and pointed out novel features as applied to various embodiments, it can be understood that various omissions, substitutions and changes in the form and details of the devices or algorithms illustrated can be made without departing from the spirit of the disclosure. As can be recognized, certain embodiments of the inventions described herein can be embodied within a form that does not provide all of the features and benefits set forth herein, as some features can be used or practiced separately from others. The scope of certain inventions disclosed herein is indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.
APPENDIX A:
SELECTED PORTIONS OF U.S. PATENT APPLICATION NUMBER 13/069,193
[0056] With reference now to FIG. 3A, which is a reproduction of FIG. 3 of U.S. Patent Application No. 13/069,193 (“the’193 Application”), a block diagram illustrative of an operating environment 300 is described in which supplemental content for an initial content item may be provided for presentation in a second orientation following detection of user interaction with the computing device, the detection occurring while the content item is being presented in a first orientation with respect to the display of the computing device. The operating environment 300 may include a supplemental content service 312 that obtains and/or generates supplemental content related to a content item in response to a request from the computing device 400. As described above, the supplemental content may be associated with a content item being presented in a first orientation on the display of the computing device 400 and is configured to be presented in a second orientation on the display of the computing device following user interaction with the device. In one embodiment, information used to generate supplemental content is stored in a supplemental content data store 314 accessible by the supplemental content service 312. While the supplemental content data store 314 is depicted in FIG. 3A as being local to the supplemental content service 312, those skilled in the relevant art will appreciate that the supplemental content data store 314 may be remote from the supplemental content service 312 and/or may be a network-based service itself. Supplemental content information may include, but is not limited to metadata associated with the content item, recommendations data, related links data or other digital content, among others. One skilled in the art will appreciate that supplemental content information may include virtually any type of data that may be related to the content item and/or of interest to the user with respect to the content item. Moreover, the supplemental content item may itself be a webpage, a document, an image, a software application, etc. or may be an overlay of information that is presented in conjunction with the content item.
[0057] All or a portion of the supplemental content information for a content item may be obtained from external sources rather than the supplemental content data store 314. Such external sources may include, but are not limited to, network data sources 302, other computing devices 400 and application services 310. Network data sources 302 may include but are not limited to websites, social network services, telecommunication services, microblog services, content feed services, e-commerce services, etc. In one embodiment, the application service 310 stores one or more software applications in an application data store 304 and makes such applications available to others for free, purchase or rental. The applications made available by the application service can be developed for use with smaller, hand-held computing devices, but can also be used with other computing devices without departing from the scope of the present disclosure. Such applications can be pre-installed on computing devices or downloaded by users from one or more application services 310. Those skilled in the art will appreciate that either or both of the content item and the supplemental content item described herein may be an application.
[0058] While the supplemental content service 312 and the application service 310 are each depicted in FIG. 3A as implemented by a single computing device in the operating environment 300, this is illustrative only. Each of the supplemental content service 312 and the application service 310 may be embodied in a plurality of computing devices, each executing an instance of the supplemental content service 312 or application service 310, respectively. A server or other computing device implementing the supplemental content service 312 or the application service 310 may include memory, processing unit(s) and computer-readable medium drive(s), all of which may communicate with one another by way of a communication bus. A network interface may provide connectivity over a network 306 and/or other networks or computing systems. The processing unit(s) may communicate to and from memory containing program instructions that the processing unit(s) executes in order to operate the service. The memory generally includes RAM, ROM and/or other non-transitory and auxiliary memory.
[0059] As illustrated in FIG. 3A, the supplemental content service 312 can include a computing device interface 320 for receiving and transmitting requests for supplemental content from computing device 400, an external data source 316 for obtaining supplemental content information from network data sources 302 and an application service interface 322 for obtaining applications which, as described above, may themselves be supplemental content from application service 310. The supplemental content service 312 can further include a content request processing component 318 for processing requests for supplemental content received from one or more computing devices 400, generating requested supplemental content and ultimately publishing supplemental content.
[0060] One skilled in the relevant art will appreciate that the supplemental content service 312 may correspond to a number of computing devices, such as server computing devices. Additionally, the external data source interface 316, the content request processing component 318, the computing device interface 320 and the application service interface 322 may be implemented in a single computing device, or component, or across multiple computing devices or components. In addition, all or some of the functions of the external data source interface 316, the content request component 318, the computing device interface 320 and the application service interface 322 may be combined and implemented in a single component or computing device. One skilled in the relevant art will also appreciate that the supplemental content service 312 may include any one of a number of additional hardware and software components that would be utilized in the illustrative computerized operating environment to carry out the illustrative functions of the supplemental content service 312 and/or any of the individually identified components.
[0061] With continued reference to FIG. 3A, the operating environment 300 may include any number of computing devices 400, each associated with a user to whom a supplemental content item may be presented as described above. In one embodiment, the computing device 400 is a mobile phone that offers advanced computing ability and connectivity. Such mobile computing devices are commonly referred to as“smart phones.” However, those skilled in the art will appreciate that computing devices 400 may correspond to a wide variety of devices or components that are capable of initiating, receiving or facilitating communications over a wired and/or wireless communication network including, but not limited to, personal computing devices, electronic book readers, handheld computing devices, integrated components for inclusion in computing devices, home electronics, appliances, vehicles, machinery, land line telephones, VoIP telephones, cordless telephones, cellular telephones, feature phones, modems, personal digital assistants, laptop computers, tablet computers, gaming devices, media players and the like. In an illustrative embodiment, the computing devices 400 include a wide variety of software and hardware components for establishing communications over one or more communication networks, including communications network 306. Communications network 306 may be a wireless communications network, a wired communications network, an IP-based wireless communications network or any combination thereof. Illustrative components of computing device 400 will be described in greater detail with regard to FIG. 4A. Although the present disclosure refers to a computing device 400, one skilled in the relevant art will appreciate that a computing device may in some instance herein correspond to, or otherwise be referred to as, a mobile communication device, a wireless computing device or a wireless device. Accordingly, reference to a computing device 100, 200, 400 or 700 should not be interpreted as limiting to any particular functionality, operation or type of device, whether wired or wireless, or whether having advanced computing ability/connectivity.
[0062] In an illustrative embodiment, the operating environment 300 can include any number of additional components, systems and/or subsystems for facilitating communications with the computing devices 400, the network data sources 302, the application service 310 and/or the supplemental content service 312. The additional components can include one or more switches or switching centers (in GSM embodiments, Mobile Switching Centers (or MSCs)) for establishing communications with the computing devices 400 via wireless communication network, such as a cellular radio access network, an IP-based wireless communication network based on the family of IEEE 802.11 technical standards (“WiFi”) or IEEE 802.16 standards (“WiMax”), a converged wireless communications network such as Unlicensed Mobile Access (“UMA”) or General Access Network (“GAN”) and other wired and wireless networks. The operation of wireless communication networks are well known and will not be described in greater detail. Although not shown, a switching center may include interfaces for establishing various communications with other networks, such as the Internet, intranets, private networks, mesh networks and point-to-point networks. Although the network 306 is illustrated as a single communication network, one skilled in the relevant art will appreciate that the network may be made up of any number of wired or wireless communication networks, public or private communication networks and/or network connections. [0063] With reference now to FIG. 4A, which is a reproduction of FIG. 4 of the ’193 Application, illustrative components of a computing device 400 for use in requesting supplemental content data and presenting the supplemental content related to the content item in a second orientation will be described. The computing device 400 may include one or more processing units 402, such as one or more CPUs. The computing device 400 performs functions by using the processing unit(s) 402 to execute instructions found in program components stored in the memory 408. The computing device 400 may also include one or more sensor(s) 403 (e.g., an accelerometer, a gyroscope, a gravimeter, an infrared sensor, a microwave sensor, an ultrasonic sensor, camera, etc.), one or more input devices 404 (e.g., keyboard, mouse device, specialized selection keys, touchscreen display, stylist, joystick, game controller, microphone, camera, etc.) and one or more display(s) 406 (e.g., liquid crystal display, LED display, electronic paper display, etc.). Any one or combination of such input mechanisms 403, 404 may generate an indication/signal that may be used to recognize a user interaction with the computing device 400 has occurred that is appropriate to cause presentation of supplemental content in a second orientation on the display 406 of the computing device 400. Accordingly, when such an indication is received during presentation of a content item in a first orientation, presentation in a second orientation of supplemental content related to the content item is triggered.
[0064] The computing device 400 may also include a memory 408, which may correspond to any combination of volatile and/or non-volatile storage mechanisms. The memory 408 may store various program components and data necessary for operating the computing device 400, obtaining supplemental content, presenting content items and supplemental content and publishing supplemental content to other computing devices. For example, the memory 408 may contain an operating system component 410 and program components such as a user interface component 412, a monitoring component 413 and a supplemental content component 415. Memory 408 may also store or have access to an application platform 414 that hosts one or more applications (either pre-installed on the computing device 400 or downloaded from one or more application services 310) for implementation by the computing device 400. [0065] In addition to the program components, memory 408 may store or have access to content and/or supplemental content information for presentation in various orientations on the display 406 of the computing device 400. For example, memory 408 may include or have access to a content data store 416 that stores content items (or links thereto) to be presented in a first orientation, as well as supplemental content related to said content items that is to be presented in a second orientation.
[0066] Memory 408 may also include or have access to a configuration information data store 418 that stores information used by the computing device 400 to configure the presentation of supplemental content in a second orientation, or any of numerous other orientations, following detection of user interaction with the computing device 400 in accordance with the present disclosure. Such configuration information may include, but is not be limited to, metadata associated with the content item presented in the first orientation, watermarking data associated with the content item presented in the first orientation, contextual data associated with the content item presented in the first orientation, user supplied configuration data, third party supplied configuration data, user profile data, device profile data, content profile data and the like. Accordingly, and as will be described in more detail below, when a user interaction (such as rotation of the computing device 400) is detected by the monitoring component 413 during presentation of a content item in the first orientation with respect to the display, the computing device 400 may retrieve configuration information from the configuration information data store 418 to obtain supplemental content related to the content item to be presented in the second orientation. In one embodiment, the configuration information identifies what information is to be included in the supplemental content. The supplemental content information may be retrieved from the content data store 416 or may be retrieved from an external data source, such as one or more network data sources 302 or the application service 310. The configuration information may alternatively or additionally include formatting information that defines how the supplemental content information is to be presented in the second orientation.
[0067] In some embodiments, the configuration information supplied by the user (and/or others) is generated using a software development tool or configuration application that is made available to users, potentially through a supplemental content configuration user interface, along with the content item that is to be subject to the presentation of the supplemental content. An example of such a configuration application is depicted in FIGS.5A, 5B and 5C and will be described in more detail below. In other embodiments, the configuration information is supplied by a third party, such as a provider or developer of the content item subject to the presentation of the supplemental content, or by other users who have consumed the content item subject to the presentation of the supplemental content. In such embodiments, the configuration information may be maintained by the supplemental content service 312 (which may have obtained the configuration information from another computing device 400, network data source 302 or the application service 310) and provided to the configuration information data store 418. In yet other embodiments, the configuration information may be derived from a profile of the user maintained in memory 408 of the computing device 400, maintained by the supplemental content service 312 or maintained by another network data source 302. The user profile data may include various information describing the user’s preferences for content, websites, services, applications, etc. and thus, may be used to configure how and what supplemental content information is to be presented in the second orientation on the user’s computing device. Content profile data and device profile data may similarly be used.
[0068] In addition to, or in lieu of, the foregoing configuration information, metadata associated with the content item subject to the presentation of the supplemental content may be used to configure what and how the supplemental content is to be presented in the second orientation. For example, if the content item presented in the first orientation is an eBook, the metadata associated with the eBook (e.g., the author, title, ISBN number, publication date, distribution date, main characters, synopsis, image of book jacket, etc.) may be used to configure how and what supplemental content information is to be presented in the second orientation. The metadata can also include contextual content information, such as places, people, things or times referenced in specific portions of the content or the content as a whole. Contextual content information may include, but is not limited to, data that helps interpret the content item, facts or circumstances that surround or are related to the content item, conditions under which a content item was created presented or experienced and an environment or setting in which a content item was created. The contextual content information could also include the portion of the book currently being read, which could be referenced by page number or location or the actual content at that location. For example, if the content on a page of an eBook being presented to the user relates to actions happening in New York City, NY, the supplemental content information could include information about New York City such as the current weather, news or publicly accessible wiki information. In yet another embodiment, the metadata information may include watermarking data associated with the initial content item. For example, if the initial content item is a movie, the movie may be digitally watermarked and the digital watermark may contain information that can be extracted and used to determine how and what supplemental content information is to be presented in the second orientation. For example, the watermark might be used to identify contextual information such as particular objects in the portion of video (e.g. places, people, items, products, etc.) that can be used to determine what supplemental content information to display with respect to the content item when the user is viewing that particular portion of the content. In a further embodiment, in place of or in addition to the watermarking data, image recognition techniques can be used to extract metadata from images or video, and audio recognition techniques can be used to extract metadata from audio.
[0069] According to one example, a user may be viewing a movie in one orientation of the device (e.g. landscape) when the user notices a particular shoe being worn by one of the actresses that the user would like to find more information about and potentially purchase. In this example, the shoe, or similar shoes, may be recognized by the previously mentioned techniques (e.g. watermarking, image recognition, etc.). The user can then rotate the device to a second orientation (e.g. portrait) and product details of the shoe, pricing and an option to purchase the shoe can be displayed. In some embodiments, the identified contextual item(s) need not be currently in the frame of the movie, but may have been previously displayed within some time window before the user oriented the device in the second orientation. In cases in which there are many items that the user might be interested in, the user may be initially presented with a list of items in the second orientation for selection by the user.
[0070] Referring again to FIG. 4A, the input devices 404 of the computing device 400 may also be used to detect external context information associated with the device or user. In some embodiments, that external context information is stored in the external context information data store 420. External context information is an additional type of metadata that is used to configure what and how the supplemental content is to be presented in the second orientation. The external context information can be, for example, a location of the device, a determination of the user of the device, the speed of the device, the ambient temperature around the device, a time of day, a day of the year, a season of the year, the ambient light around the device, among many other possibilities. This information can be detected by any number of input devices 404, such as global positioning system (GPS) sensors, signal strength sensors (i.e. to determine proximity to one or more fixed position wireless transmitters), thermometers, cameras, light sensors, clocks, among other possibilities.
[0071] According to one example in which external context information can be used to configure what and how the supplemental content is to be presented in the second orientation, imagine that a user is reading an eBook about sailing. Additionally, this user is reading the book in the morning, while located in the city of Seattle, WA, on a very cold day. In this example, the device can detect from its internal clock that it is the morning, from its integrated GPS sensor that it is located in Seattle and from a remote service (or integrated temperature sensor) that it is 32°F in Seattle. When the device is moved into the second position, instead of providing supplemental content that is generically related to sailing, the supplemental content is now selected based off of these additional factors and/or indications from sensors 403 and/or input devices 404. Thus, in the second orientation, the user may be presented with photographs of sailboats located in Seattle’s Lake Union, with a sunrise in the background and crew members dressed in heavy coats. In contrast, the same user reading that book on a warm summer evening along the sugary coast of Panama City Beach, FL may be presented with photographs of a sailboat, adorned with short-pants wearing passengers, coasting into a fiery sunset. It should be understood that further embodiments can use both contextual content information and external context information to configure what and how the supplemental content is to be presented in the second orientation. Thus, for example, both the context of the people, places, and time of the content being consumed can be used in combination with the people, places and time that the content is being consumed on the device.
[0072] The above enumerated list of program components and data stores is representative and is not exhaustive of the types of functions performed, components implemented by the computing device 400 or the data stores accessible by the computing device 400. One skilled in the relevant art will appreciate that additional or alternative program components and data stores may be included in the computing device 400 to carry out other intended functions without departing from the scope of the present disclosure. Moreover, although the data stores depicted in FIG. 4A are depicted as being local to the computing device 400, those skilled in the art will appreciate that all or a portion of one or more of the data stores may be remote to the computing device 400. For example, in one embodiment, all or a portion of at least one of the depicted data stores is maintained by the supplemental content service 312. Finally, the supplemental content component 415 may be equivalent in functionality to the content request processing component 318 (and or other components) of the supplemental content service 312. Alternatively, the content request processing component 318 may have more limited functionality and/or specialized functionality, such as functionality to implement peer-to-peer communication.
[0073] As noted above, a user can configure the presentation of supplemental content in a second orientation. In one embodiment, a user may utilize a supplemental content configuration user interface of a configuration application to configure how and what information is to be included in supplemental content that is to be presented in a second orientation. The supplemental content configuration user interface for the content item may be downloaded from the application service 310 along with the content item, when the content item is itself an application. In yet another embodiment, supplemental content configuration user interface is made available by the supplemental content service 312 or from another network data source 302, such as a website that the user frequently browses. In yet another embodiment, the configuration application that includes the supplemental content configuration user interface is installed on the computing device 400 and is agnostic to any particular content items or providers of content items, and thus, can be used to configure supplemental content for any initial content item obtained and presented by the computing device 400.
[0074] With reference to FIG. 5A, which is a reproduction of FIG. 7A of the’193 Application, a supplemental content configuration user interface 704 offered by a website the user frequently browses is illustrated. In some embodiments, the options can be pre-selected, but the supplemental content configuration user interface allows the user to manipulate what supplemental content is to be displayed. In the illustrated example, the supplemental content configuration user interface 704 is presented on a display 702 of a computing device 700 and is used to configure supplemental content for content items, e.g., webpages retrieved from the frequently browsed website. As such, the supplemental content configuration user interface 704 prompts the user with a message to configure how and what information the user would like to see displayed when the user rotates the device from a landscape (first) position to a portrait (second) position while browsing a webpage on the website (and vice versa). If the user wishes to proceed with making appropriate edits to the configuration, the user may select the“video” button 706 or the“search results” button 708. If the user selects the“video” button 706, the user interface shown in FIG. 5B is displayed to the user. If the user selects the“search results” button 708, then the user interface depicted in FIG. 5C is displayed to the user.
[0075] As shown in FIG. 5B, which is a reproduction of FIG. 7B of the’193 Application, the supplemental content configuration user interface 704 will then prompt the user with options 712 to see video content that may be related to the initial content item (e.g., the webpage being browsed). Accordingly, if the user would like to see displayed video content related to the webpage being browsed when he or she rotates her device, the user may select the corresponding“Yes” option. In the illustrated example, if the user selects the “Yes” option, the supplemental content configuration user interface 704 also prompts the user to select a video content source from which to retrieve the supplemental content that the user would like to view after rotating his or her computing device 700. Accordingly, the user may select from options 714 to select a source for the video content. In one embodiment, the source is a video content sharing service, a social networking service, some other network service or any other website from which video content may be downloaded or streamed. In other embodiments, instead of selecting only a source, the user may enter or browse for a link to a particular item of video content available from a source. In other instances, the user may enter or browse for a link to a source of video content itself, in which case context information or other metadata associated with the webpage may be used to search for and identify an item of video content. In either case, the supplemental content for the webpage may be configured to include video content related to the webpage and/or in which the user is interested. Accordingly, each time the user rotates the computing device 700 while browsing the website, video content identified using the provided link will be presented in the second orientation on the display of the computing device 700. In other embodiments, each time the user rotates the computing device 700, additional supplemental content is displayed on computing device 700. In other embodiments, each time the user rotates computing device 700, different supplemental content is displayed on device 700. When the user has completed configuring the video content to be displayed as the supplemental content, the “Finish” button can be selected to exit the supplemental content configuration user interface.
[0076] As shown in FIG. 5C, which is a reproduction of FIG. 7C of the’193 Application, displayed when the user selects the“search results” button 708 of FIG. 5A, the supplemental content configuration user interface 704 prompts the user with options to see search results related to the contents of the webpage when the user rotates his or her computing device 700. If the user would like to see such search results, the user may select a “Yes” option from a list of options 716. In the illustrated example, the supplemental content configuration user interface 704 may also prompt the user to select a search engine that the user would prefer to generate the search results from a list of search engine options 718. Once the user selects the desired search engine, the user may complete configuration in the illustrated example by selecting the“Finish” button. Selecting the“Finish” button in either FIG. 5B or 5C causes the configuration information to be stored for later use. In some embodiments, the configuration information is stored in configuration information data store 418 (FIG. 4A), while in other embodiments the configuration information is stored remote from the device (e.g. at the website used to configure supplemental content, within a cloud- based storage service or other network accessible data storage). In embodiments in which the configuration information is stored remote from device 400, the configuration information can be accessed directly by supplemental content service 312 in order to determine what supplemental content to supply and how to supply them. Regardless of which mechanism is used, in this example, whenever a user interaction with computing device 700 is detected during presentation of a webpage from the frequently browsed website, the user will automatically be presented a video related to the webpage in a second orientation on the display 702, as well as search results related to the webpage as generated by the user’s preferred search engine. In practice, the user may retrieve a webpage from the website at a first universal resource locator (URL). When the device detects the user interaction indicating that supplemental content is to be displayed in a second orientation, a request including a second URL is passed to the website indicating such. The supplemental content service then retrieves the configuration information to determine the supplemental content to send back to the computing device and transmits the supplemental content for display in the second orientation in response to the request.
[0077] Those skilled in the relevant art will appreciate that the supplemental content configuration user interface 704 depicted in FIGS. 5A, 5B and 5C and described above is an illustrative supplemental content configuration user interface only and that different configuration applications may be used for different content items, different types of content items, different supplemental content and different types of supplemental content. In addition, configuration applications may include more, less or different configuration options that those depicted in FIGS.5A, 5B and 5C, and the configuration options may depend on the initial content item(s) to be provided with supplemental content, the supplemental content desired and/or the provider/developer of the configuration application. Although not shown, configuration applications may further enable a user, developer or provider to configure the user interaction with the computing device that will trigger the presentation of a supplemental content in a second orientation. For example, rather than triggering such presentation based on rotation of the computing device, presentation may be triggered based on a detection of an audible command, image detection of a user gesture, selection of an existing software control (e.g., dragging of a scroll bar), a keyboard action (e.g., pressing a“page down” key) or some other manipulation of an input device (e.g., shaking of the computing device rather than rotating the computing device). According to some embodiments, the user input that triggers the presentation of the supplemental content could also be the detection of a user’s eye gaze direction (e.g. via a camera), the movement of a user in relation to a camera associated with the computing device (e.g. a gesture, head movement, body movement, etc.) or the movement of the camera of the computing device in relation to a user. Likewise, the supplemental content that is displayed in the second orientation can be determined, at least in part, based on the gaze direction of the user. For example, if the user is looking at a particular object in an image in the first orientation, the supplemental content displayed in the second orientation may include content about that particular object. Those skilled in the art will appreciate that the foregoing examples are illustrative only and are not to be construed as limiting. Furthermore, although the example supplemental content configuration user interface guides the user to configure how and what information the user would like to see when the user rotates the device from a landscape (first) position to a portrait (second) position, other supplemental content configuration user interfaces can guide the user to configure how and what information the user would like to see in any number of possible orientations or ranges of orientations (e.g., when rotated to a third position, pricing and availability information is displayed).
[0078] Those skilled in the art will also appreciate that presentation of the initial content item, as well as presentation of the supplemental content may vary depending on the type of computing device or the display of the computing device. For example, the display may be a projector or television that is remotely connected to the computing device, as opposed to integral with the computing device. Accordingly, presentation of the supplemental content item by the projector or television may be triggered by selecting a “page down” key on the computing device. As yet another example, the supplemental content may be presented concurrently with the content item in the display of the computing device (whether the display is integral or not) using a split-screen. As yet another example, the display of the computing device may actually be two or more displays, such as when a desktop computer is equipped with two monitors. In such cases, the content item may be presented on a first monitor, while the supplemental content may be presented on the other monitor, and the orientation in which the content item is presented on the first monitor may be the same or different as the orientation in which the supplemental content is presented on the other monitor.

Claims

CLAIMS WHAT IS CLAIMED IS:
1. A system for providing supplemental content, the system comprising:
one or more data stores that store supplemental content data; and a browser component including executable code that directs a user computing device operative to:
request supplemental content data, wherein the supplemental content data is associated with initial content presented in a first page on the display of the user computing device, and wherein the supplemental content data is configured to be presented in a flipped page on the display of the remote computing device;
detect a user interaction with the user computing device, wherein the user interaction is indicative of a request to flip the first page to the flipped page, wherein the user interaction occurs while the initial content is being presented in the first page; and
automatically present the supplemental content in the flipped page on the display after detection of the user interaction; and
a computing device in communication with the one or more data stores, said computing device operative to:
receive, from the user computing device, a request for supplemental content data;
obtain the supplemental content data from the one or more data stores; and
transmit the supplemental content data to the user computing device for automatic presentation in association with the flipped page on the display of the user computing device.
2. The system of claim 1, wherein the first page is presented on the entire display and the flipped page is presented on the entire display, and wherein the supplemental content is automatically presented by presenting the flipped page instead of the first page on the display.
3. The system of claim 1, wherein the first page is presented on a portion of the display and the flipped page is presented on the portion of the display, and wherein the supplemental content is automatically presented by presenting the flipped page instead of the first page on the portion of the display.
4. The system of claim 1, wherein at least one of the one or more data stores comprises an external data store from which data is obtained via one or more application programming interfaces.
5. The system of claim 1, wherein said computing device is further operative to:
receive a plurality of requests for supplemental content data associated with the same or similar initial content, wherein the plurality of requests are received from a plurality of user computing devices;
determine which supplemental content data is suitable for the same or similar initial content;
obtain the supplemental content data suitable for the same or similar content from the one or more data stores; and
transmit the supplemental content data suitable for the same or similar initial content to at least one of the user computing devices that requested the supplemental content data.
6. A computer-readable, non-transitory storage medium having computer- executable components for providing content, the computer-executable components comprising:
a user interface component that presents content in a first page on a display of a computing device;
a monitoring component that detects a user gesture to flip the first page to a second page, wherein the user gesture occurs in relation to the computing device; and a content selection component that obtains second content from one or more sources external to the computing device,
wherein after detection of the user gesture, the user interface component presents at least a portion of the obtained second content.
7. The computer-readable, non-transitory storage medium of claim 6, wherein the first page is a full-screen view of the content and the second page is a full-screen view of at least the portion of the second content.
8. The computer-readable, non-transitory storage medium of claim 6, wherein the content in the first page is optimized for a first screen resolution and the second content in the second page is optimized for a second screen resolution.
9. The computer-readable, non-transitory storage medium of claim 6, wherein the first screen resolution is optimized for presentation on a display of a desktop computer and the second screen resolution is optimized for presentation on a display of a mobile computing device.
10. A computer-implemented method for presenting content on a display of a computing device, the computer-implemented method comprising:
detecting a user interaction with the computing device while first content is presented in a first page on the display, said user interaction being a touchscreen gesture indicative of a request to view second content related to the first content; requesting second content determined to be related to the first content presented in the first page, wherein the second content is to be presented in a second page on the display; and
after detection of said user interaction with the computing device, automatically presenting, on the display, at least a portion of the second content in the second page.
11. The computer-implemented method of claim 10, wherein the second content is determined to be related to the first content based at least on one of metadata associated with the content presented on the display in the first page, watermarking data associated with the content presented on the display in the first page, contextual data associated with the content presented on the display in the first page, user supplied configuration data, user profile data, content profile data, device profile data and third party supplied configuration data.
12. The computer-implemented method of claim 10, wherein the second content presented on the display in the second page comprises both contextual data related to the first content and contextual data related to the device.
13. The computer-implemented method of claim 10, wherein the second content presented on the display in the second page comprises data obtained from an external source that is remotely accessible by the computing device.
14. The computer-implemented method of claim 13, wherein the data is obtained from the external source via one or more application programming interfaces.
15. The computer-implemented method of claim 10, wherein the second page is an overlay page presented over the first page.
PCT/US2014/010530 2013-01-09 2014-01-07 Browser interface for accessing supple-mental content associated with content pages WO2014110048A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US13/737,596 US20140195890A1 (en) 2013-01-09 2013-01-09 Browser interface for accessing supplemental content associated with content pages
US13/737,760 US20140195337A1 (en) 2013-01-09 2013-01-09 Browser interface for accessing supplemental content associated with content pages
US13/737,596 2013-01-09
US13/737,760 2013-01-09

Publications (1)

Publication Number Publication Date
WO2014110048A1 true WO2014110048A1 (en) 2014-07-17

Family

ID=51167322

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2014/010530 WO2014110048A1 (en) 2013-01-09 2014-01-07 Browser interface for accessing supple-mental content associated with content pages

Country Status (1)

Country Link
WO (1) WO2014110048A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9946701B2 (en) 2015-02-11 2018-04-17 International Business Machines Corporation Selectively pinning sections of displayed content
CN113132784A (en) * 2019-12-30 2021-07-16 阿里巴巴集团控股有限公司 Interaction control method and device, electronic equipment and window display method
CN114020193A (en) * 2021-11-05 2022-02-08 挂号网(杭州)科技有限公司 Cross-page checking determination method and device, electronic equipment and storage medium
CN114756783A (en) * 2022-03-29 2022-07-15 重庆邮电大学 Fraud website identification method based on generation countermeasure network

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080235594A1 (en) * 2005-12-23 2008-09-25 Soujanya Bhumkar Methods and systems for enhancing internet experiences
US20110320437A1 (en) * 2010-06-28 2011-12-29 Yookyung Kim Infinite Browse
US20120020428A1 (en) * 2010-07-20 2012-01-26 Lg Electronics Inc. Electronic device, electronic system, and method of providing information using the same
US20120089933A1 (en) * 2010-09-14 2012-04-12 Apple Inc. Content configuration for device platforms
US20120192118A1 (en) * 2011-01-24 2012-07-26 Migos Charles J Device, Method, and Graphical User Interface for Navigating through an Electronic Document

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080235594A1 (en) * 2005-12-23 2008-09-25 Soujanya Bhumkar Methods and systems for enhancing internet experiences
US20110320437A1 (en) * 2010-06-28 2011-12-29 Yookyung Kim Infinite Browse
US20120020428A1 (en) * 2010-07-20 2012-01-26 Lg Electronics Inc. Electronic device, electronic system, and method of providing information using the same
US20120089933A1 (en) * 2010-09-14 2012-04-12 Apple Inc. Content configuration for device platforms
US20120192118A1 (en) * 2011-01-24 2012-07-26 Migos Charles J Device, Method, and Graphical User Interface for Navigating through an Electronic Document

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9946701B2 (en) 2015-02-11 2018-04-17 International Business Machines Corporation Selectively pinning sections of displayed content
US9996520B2 (en) 2015-02-11 2018-06-12 International Business Machines Corporation Selectively pinning sections of displayed content
US10592600B2 (en) 2015-02-11 2020-03-17 International Business Machines Corporation Selectively pinning sections of displayed content
CN113132784A (en) * 2019-12-30 2021-07-16 阿里巴巴集团控股有限公司 Interaction control method and device, electronic equipment and window display method
CN114020193A (en) * 2021-11-05 2022-02-08 挂号网(杭州)科技有限公司 Cross-page checking determination method and device, electronic equipment and storage medium
CN114020193B (en) * 2021-11-05 2024-06-04 挂号网(杭州)科技有限公司 Page crossing hook determination method and device, electronic equipment and storage medium
CN114756783A (en) * 2022-03-29 2022-07-15 重庆邮电大学 Fraud website identification method based on generation countermeasure network

Similar Documents

Publication Publication Date Title
US10108274B2 (en) Presenting supplemental content
US20140195890A1 (en) Browser interface for accessing supplemental content associated with content pages
JP6363758B2 (en) Gesture-based tagging to view related content
US20140195337A1 (en) Browser interface for accessing supplemental content associated with content pages
US20220272143A1 (en) Computer application promotion
US9535945B2 (en) Intent based search results associated with a modular search object framework
US10620804B2 (en) Optimizing layout of interactive electronic content based on content type and subject matter
US9875284B1 (en) Displaying search completion results
US9830388B2 (en) Modular search object framework
US20120227077A1 (en) Systems and methods of user defined streams containing user-specified frames of multi-media content
US20130086056A1 (en) Gesture based context menus
US20210042809A1 (en) System and method for intuitive content browsing
US20150317319A1 (en) Enhanced search results associated with a modular search object framework
JP6039613B2 (en) Display program, terminal device, display method, and distribution device
US20170185423A1 (en) Techniques for providing personalized behavior-based content
JP5580924B1 (en) Distribution device, terminal device, distribution method, and distribution program
US9310974B1 (en) Zoom-based interface navigation
WO2014110048A1 (en) Browser interface for accessing supple-mental content associated with content pages
US20160048875A1 (en) Entity based search advertising within a modular search object framework
KR101350525B1 (en) Method and apparatus for using tab corresponding to query to provide additional information
US10628848B2 (en) Entity sponsorship within a modular search object framework
JP6158903B2 (en) Information display program, information display device, information display method, and distribution device
JP5973480B2 (en) Information processing apparatus, information processing method, and program
JP6396394B2 (en) Display program, terminal device, display method, and distribution device
JP5923141B2 (en) Distribution device, terminal device, distribution method, distribution program, and server device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14737926

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14737926

Country of ref document: EP

Kind code of ref document: A1