WO2016172715A1 - Remplacement de contenu sur des affichages sur écran - Google Patents

Remplacement de contenu sur des affichages sur écran Download PDF

Info

Publication number
WO2016172715A1
WO2016172715A1 PCT/US2016/029227 US2016029227W WO2016172715A1 WO 2016172715 A1 WO2016172715 A1 WO 2016172715A1 US 2016029227 W US2016029227 W US 2016029227W WO 2016172715 A1 WO2016172715 A1 WO 2016172715A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
overlay
onscreen display
display
media content
Prior art date
Application number
PCT/US2016/029227
Other languages
English (en)
Inventor
Mitchell M. Holyoak
Original Assignee
Sorenson Media, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/820,490 external-priority patent/US9743153B2/en
Application filed by Sorenson Media, Inc. filed Critical Sorenson Media, Inc.
Publication of WO2016172715A1 publication Critical patent/WO2016172715A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2407—Monitoring of transmitted content, e.g. distribution time, number of downloads
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/812—Monomedia components thereof involving advertisement data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL

Definitions

  • Media consumption devices such as smart televisions (TVs) can access broadcast digital content and receive data, such as streaming media, from data networks (such as the Internet).
  • Streaming media refers to a service in which media content, such as movies or news, can be provided to an end user over a telephone line, cable, Internet, and so forth upon request. For example, a user can view a movie without having to leave their residence. Also, users can access various types of educational content, such as video lectures, without having to physically attend at a school or educational institution.
  • Content feeds may be generated at a central location and distributed to a variety of locations.
  • a television channel may be distributed from a content provider to a number of local broadcasters.
  • the content feeds can include advertisements inserted by advertisers or broadcasters to promote a product or provide additional information to a group of viewers.
  • Advertisers and providers can rely on fixed content feeds (e.g., content that is fixed at the time of broadcasting) to promote products or provide information to all viewers.
  • fixed content feeds e.g., content that is fixed at the time of broadcasting
  • advertisers or broadcasters can select when the fixed content is advertised based on an audience analysis and ratings provider, such as The Nielsen Company.
  • content or network providers such as local broadcasters, multi-channel networks, and other content owners/distributors
  • FIG. 1 illustrates a system diagram of a content distribution network according to one embodiment.
  • FIG. 2 illustrates a content manager to provide overlay content to a client device according to one embodiment.
  • FIG. 3 illustrates a flowchart of a method for enhancing a content feed according to one embodiment.
  • FIG. 4 illustrates a flowchart of a method for overlaying content on media content with a window to permit at least partial visibility of an onscreen display on the media content through the overlaying advertisements according to one embodiment.
  • FIG. 5 illustrates a compositing of media content, an onscreen display, and overlay content to create an image to display on a media consumption device according to one embodiment.
  • FIG. 6A illustrates the media content as a first layer and the onscreen display as a second layer above the media content according to one embodiment.
  • FIG. 6B illustrates the media content as the first layer with the overlay content as a third layer above the media content and the onscreen display according to one embodiment.
  • FIG. 6C illustrates the media content with the overlay content that includes the opacity window, where the opacity window is a variable-transparency window that can be a window to display layers beneath the overlay content to a viewer according to one embodiment.
  • FIG. 6D illustrates the media content with the overlay content, where the opacity window is set to a threshold opacity level to show the onscreen display behind the overlay content according to one embodiment.
  • FIG. 7A illustrates the media content as a first layer and the onscreen display as a second layer above the media content according to one embodiment.
  • FIG. 7B illustrates the media content as the first layer with the overlay content as a third layer above the broadcast content and the onscreen display according to one
  • FIG. 7C illustrates the media content with the overlay content that includes the opacity window according to one embodiment.
  • FIG. 7D illustrates the broadcast content with the overlay content according to one embodiment.
  • FIG. 7E illustrates a first portion and a second portion of the third layer.
  • FIG. 7F illustrates that the opacity window is a same size as the onscreen display.
  • FIG. 8 illustrates an expanding overlay format for an overlay content superimposed on a media content according to one embodiment.
  • FIG. 9A illustrates a microsite overlay format for an overlay content superimposed on a media content according to one embodiment
  • FIG. 9B illustrates a full screen experience of a microsite overlay format for an overlay content superimposed on a media content according to one embodiment
  • FIG. 10 illustrates an overlay content superimposed on a corner of broadcast content according to one embodiment.
  • FIG. 11 illustrates a diagrammatic representation of a machine in the example form of a computer system within which a set of instructions, for causing the machine to perform any one or more of the methodologies discussed herein, may be executed.
  • Broadcast television provides the same content to all viewers. Advertisers can integrate commercials in broadcast television prior to a signal being broadcast to a viewer. While advertising can be an engaging venue to advertise products or services, traditional media consumption advertising lacks targeted and personalized advertising. To increase an impact and effectiveness of the advertisement, an advertiser may be interested in targeting particular advertisements to particular sets of viewers, such as a viewer of a selected demographic or location.
  • Media consumption devices can receive content with material (e.g., contextually- relevant material) that can provide viewers with targeted or personalized advertising as well as an interactive viewing experience.
  • the material can be overlayed or superimposed over the broadcast content or media content (e.g., overlay content) to provide viewing content that is more relevant to a viewer.
  • the overlayed content can interfere with the onscreen display.
  • the onscreen display can be a setting of the media consumption device or other devices, such as a volume level indicator.
  • the onscreen display can be a menu of the media consumption device or other devices, such as a device controls menu.
  • the onscreen displays may be not be properly displayed, e.g., obscured or covered up.
  • a processing device of the client device can detect appearance of an onscreen display and adjust an overlay of the overlay content to avoid obscuring an area where the onscreen display may be located on a display screen of the media consumption device. For example, the processing device may determine a shape and a location of a portion of the onscreen display that extends underneath the overlay content and generate an opacity window of that size within the overlay content. The processing device may adjust levels of transparency of the opacity window to allow varying degrees of ability to view the onscreen display through the overlay content.
  • the word “content” can be used to refer to media or multimedia.
  • the word “content” can be used to refer to media or multimedia.
  • content can also be a specific term that means the subject matter of the medium rather than the medium itself.
  • the word “media” and some compound words that include “media” are instead referring to content, rather than to the channel through which the information is delivered to the end user/audience.
  • Media or media content can include graphical representations, such as: videos, such as films, TV shows, commercials, streaming video, and so forth; text; graphics; animations; still images;
  • interactivity content forms forms; and so forth.
  • An example of a type of content commonly referred to as a type of media is a "motion picture” referred to as "a film.”
  • FIG. 1 illustrates a system diagram of a content distribution and viewing data aggregation network 100 according to one example.
  • a content provider 102 can broadcast a content feed to a local provider 106.
  • the local provider 106 can include a headend 104 and an automatic content recognition (ACR) fingerprinter server 105.
  • the content feed from the content provider 102 can be received at the headend 104 of the local provider 106.
  • the headend 104 can generate a local content feed based on the received content feed.
  • the headend 104 can be a local affiliate broadcaster receiving a network channel with programming and advertisements from a national or global broadcaster.
  • the headend 104 can communicate the local content feed to the ACR fingerprinter server 105, an over-the-air (OTA) broadcaster 108, a multichannel video programming distributor (MVPD) 110, or a combination thereof.
  • the OTA broadcaster 108 or the MVPD 110 can communicate the local content feed to a media device.
  • media devices can include client devices 118 and 120, a set top box 114 that streams provider content to the client devices 118 and 120, as well as other devices 116 through which the user can stream the local content feed, e.g., wirelessly.
  • the OTA broadcaster 108 can broadcast the local content feed using traditional local television or radio channels.
  • the client devices 118 and 120 can include antennas (such as TV or radio antennas) and receive the local content feed.
  • the MVPD 110 (such as cable or satellite broadcaster) can communicate the local content feed to a set top box device 114.
  • the set top box device 114 can format the content feed for the client devices 118 and 120 and can communicate the formatted content feed to the client devices 118 and 120.
  • the client devices 118 and 120 can include a display device, such as a television screen or a touch screen, to display the local content to a viewer.
  • Various components of the content distribution and viewing data aggregation network 100 can be integrated or coupled to the client devices 118 and 120.
  • a smart television can include the antennas, the set-top box device 114, and a display device in a single unit.
  • the ACR fingerprint server 105 can analyze the local content feed and determine fingerprint information (e.g., fingerprints).
  • the ACR fingerprint server 105 can communicate the fingerprints to ACR system 124, ACR system 126, or a combination thereof.
  • the ACR systems 124 and 126 can be different ACR systems selected by device manufacturers that may employ different ACR technologies, such as smart TV manufacturers.
  • the ACR fingerprint server 105 can analyze the local content feed and capture fingerprints, which can include an ordered sequence of frames from the local content feed.
  • the ACR fingerprint server 105 can communicate the fingerprints to the ACR systems 124, ACR system 126, or a combination thereof.
  • the ACR systems 124 and 126 can be different ACR systems selected by device manufacturers, such as smart TV manufacturers.
  • the ACR fingerprint server 105 can format fingerprints for the different ACR systems 124 and 126.
  • the ACR systems 124 and 126 can establish communication connections with the different client devices 118 and 120, respectively.
  • the client devices 118 and 120 can communicate fingerprint information to the ACR systems 124 and 126, respectively.
  • the ACR system 124 or 126 When the ACR system 124 or 126 receives fingerprint information from the client device 118, the client device 120, or both, the ACR system 124 or 126 can match the received fingerprints with those generated by the ACR fingerprint server 105. When a match occurs and the content has been identified, the ACR system 124 or 126 can communicate ACR events to a computing system 128.
  • the ACR events can include: the client device 118 or 120 turning on, the client device 118 or 120 turning off, media content starting to be displayed on the client device 118 or 120, ending displaying the media content on the client device 118 or 120, the client device showing a startup screen (such as an Xbox® startup screen, Netflix® startup screen, or a Comcast® startup screen), a commercial starting to be displayed on the client device 118 or 120, ending displaying the commercial on the client device 118 or 120, changing a channel on the client device 118 or 120, or the client device 118 or 120 experiencing an unexpected occlusion.
  • the computing system can include a content manager 122 and a database 123.
  • the ACR system 124 or 126 can receive fingerprint information from the client device 118 or 120 and can match the received fingerprints with those generated by the ACR fingerprint server 105. When a match occurs and the content has been identified, the ACR system 124 or 126 can notify the client device 118 or 120 of the ACR events and then the client device 118 or 120 can communicate those ACR events to a content manager 122. Alternatively, or additionally, the ACR system 124 or 126 can directly communicate the ACR events to the content manager 122.
  • the fingerprint information can include: a display of advertisements in the local content feed to a viewer, a display of selected or flagged content in the local content feed to a viewer, a change of content channel at the client device 118 or 120, and so forth.
  • the event information from the different ACR systems 124 and 126 can be in different formats or orders and the content manager 122 can normalize the data into a common format before storing the data into a database stored at or across a network from the ACR system 124 or 126.
  • the content manager 122 can receive disparate data sets from the ACR systems 124 and 126 that include similar but not identical data, such as data with the same content but formatted differently.
  • the content manager 122 can process and reformat the disparate data sets to create a single data model or format (e.g., reformatted data sets) and the reformatted data sets can be populated into a database 123 in the content manager 122.
  • the content manager 122 can cleanse or filter data in the data sets.
  • some data sets can contain fields or data that can be irrelevant to the content manager 122.
  • the content manager 122 can cleanse or filter the irrelevant data (e.g., the data can be removed or ignored).
  • some data sets can include instances of incomplete or incorrect data or data sets and the content manager 122 can cleanse or filter the incomplete or incorrect data or data sets.
  • the content manager 122 can map fields of the data sets.
  • the content manager 122 when the content manager 122 receives a first data set from the ACR system 124 and a second data set from the ACR system 126, at least some of the data fields of the first data set and the second data set can be common to both the first and second data set. However, the common data fields can be located at different places in the first and second data sets. In this example, the content manager 122 can map the different data fields of the first and second data sets to normalized fields and have the same data fields in the same data field locations in the database 123. The content manager 122 can reorder common data field locations of the first viewing data and the second viewing data same data fields to the single data model (e.g., a single data format).
  • the single data model e.g., a single data format
  • the content manager 122 can derive data from the data sets. For example, data from the ACR system 124 or 126 may not contain all of the fields that are needed to fill the data fields in the database. However, the content manager 122 can use other fields in the data sets from the ACR systems 124 and 126 to derive data for these data fields.
  • the database 123 can include data fields for such as a state in a country field, a designated market area (DMA), and a county field or city field but the data sets from the ACR systems 124 and 126 may only include zone improvement plan (ZIP) codes.
  • the content manager 122 can use the ZIP codes to derive data for the fields in the database.
  • the data set may not contain any geographic location information, but can include an internet protocol (IP) address of the client device 118 or 120.
  • IP internet protocol
  • the content manager 122 can use a geo-IP lookup service to derive the state, DMA, county, city and ZIP code information.
  • the database 123 can include demographic fields such as an age field, a gender field, a household income field, and so forth.
  • the data sets from the ACR systems 124 and 126 may not include the demographic fields or demographic data.
  • the ACR systems 124 and 126 can provide the content manager 122 with the IP address of the client devices 118 and 120. The content manager 122 can use the IP addresses to determine the demographic data to populate the data fields in the database.
  • the ACR systems 124 or 126 can provide the IP addresses to a third party that can match the IP addresses to demographic data. The third party can then provide the matched demographic data to the content manager 122, thereby avoiding the content manager 122 knowing the IP addresses.
  • a field in a first data set from the ACR system 124 can include local time zone information, such as a mountain daylight time (MDT) zone, and a second data set from the ACR system 126 can include information from another time zone, such as a coordinated universal time (UTC) zone.
  • the database can store all data using the UTC and the content manager 122 can convert the local time to UTC before storing the data in the database 123.
  • the content manager 122 can use the normalized data to generate reports or data (viewing data) about user viewing behavior across different ACR technology vendors and smart TV or other Internet-connected video devices.
  • the content manager 122 and the client devices 118 and 120 can include communications interfaces to communicate information, such as overlay content, between the client devices 118 and 120 and the content manager 122.
  • the communication interface can communicate the information using a cellular network, a wireless network, or a combination thereof.
  • the communications network can be a cellular network employing a third generation partnership project (3GPP) release 8, 9, 10, 11, or 12 or Institute of Electronics and Electrical Engineers (IEEE) 802.16p, 802.16 ⁇ , 802.16m-2011, 802.16h-2010, 802.16j-2009, 802.16- 2009.
  • 3GPP third generation partnership project
  • IEEE Institute of Electronics and Electrical Engineers
  • the communications network can be a wireless network (such as a network using the Wi-Fi® technology developed by the Wi-Fi Alliance) that can follow an IEEE® standard developed by the Institute of Electrical and Electronics Engineers, Inc., such as the IEEE 802.11-2012, IEEE 802.1 lac, or IEEE 802.1 lad standards.
  • the communications network can be a Bluetooth® connection developed by Bluetooth Special Interest Group (SIG) such as Bluetooth vl.O, Bluetooth v2.0, Bluetooth v3.0, or Bluetooth v4.0.
  • the communications network can be a Zigbee® connection developed by the ZigBee Alliance such as IEEE 802.15.4-2003 (Zigbee 2003), IEEE 802.15.4-2006 (Zigbee 2006), IEEE 802.15.4-2007 (Zigbee Pro).
  • the content manager 122 can also instruct the client device 118 or 120 to replace portions of the local content feed received from the OTA broadcaster 108 or the MVPD 110 with overlay content. In another example, the content manager 122 can instruct the client device 118 or 120 to overlay or superimpose overlay content onto portions of the local content feed.
  • the content manager 122 can aggregate ACR information across multiple ACR systems 124 and 126 and can communicate overlay content to different client devices 118 and 120.
  • the client devices 118 and 120 can be from different device
  • the content manager 122 can also establish communication connections with other devices 116.
  • the other device 116 can communicate with the client device 118 or 120 and provide an additional screen (e.g., a second screen) to display overlay content.
  • the client devices 118 and 120 can receive the local content feed from the OTA broadcaster 108 or the MVPD 110 and display the local content feed to the user.
  • the other devices 116 can also communicate ACR event information to the ACR systems 124 and 126 when an ACR event occurs, as discussed in the preceding paragraphs.
  • the content manager 122 receives the ACR event information, the content manager 122 can communicate overlay content to the other devices 116.
  • the client devices 118 and 120 can continue to display the local content feed while the other devices 116 display the overlay content. In another example, the client devices 118 and 120 and the other devices 116 can both display the overlay content. In another example, the client devices 118 and 120 and the other devices 116 can display a portion of the overlay content and a portion of the local content feed. In another example, the client devices 118 and 120 and the other devices 116 can display different local content feeds, overlay content, or a combination thereof.
  • the client devices 118 and 120, the other devices 116, or a combination thereof can display the overlay content at the time the overlay content is received.
  • the client devices 118 and 120 and the other devices 116 can both display the overlay content.
  • the client devices 118 and 120 and the other devices 116 can display a portion of the overlay content and a portion of the local content feed.
  • the threshold period of time can be a predefined period of time or the content manager 122 can select a period of time for the client devices 118 and 120, the other devices 116, or a combination thereof, to delay displaying the overlay content.
  • FIG. 2 illustrates a content manager 222 to provide overlay content to, and collect viewing data from, client device 218 or 220 according to one embodiment.
  • the content manager 222 can include a management engine 206, an overlay database 208, an overlay decision engine 210, an overlay server 212, a reporting engine 214, a viewing database 216, and a data engine 230.
  • a content provider 202 can upload media content to the management engine 206.
  • a content provider 202 can also inform the management engine of media to be overlaid using a third party show identification (ID) such as Gracenotes® Tribune Media Services (TMS) ID.
  • ID third party show identification
  • TMS Gracenotes® Tribune Media Services
  • the management engine 206 can communicate the media content to an ACR system 224 or 226 and the ACR system 224 or 226 can produce its own fingerprint information. In another embodiment the management engine 206 can process the media content to produce fingerprints in the appropriate formats for the ACR systems 224 and 226 and communicate the fingerprints to the appropriate ACR system 224 or 226. Each ACR system 224 and 226 can use different formats for fingerprints.
  • fingerprints can be generated by fingerprinting every frame of a feed, every other frame of the feed, and so forth.
  • the ACR system 224 can generate a fingerprint for a frame of the feed by performing a discrete cosine transform (DCT) of the frame and designating a subset of the resulting coefficients (e.g., the low-frequency coefficients) as the fingerprint.
  • the client devices 218 and 220 can communicate fingerprint information to their respective ACR System 224 and 226.
  • Each fingerprint of a segment of the feed can be associated with a time index.
  • the time index can be a time stamp when the segment of the feed was received by the ACR system 224 or 226.
  • the time index can be a number of frames in the feed from an arbitrary starting point.
  • the management engine 206 can also receive overlay information from the content provider 202, where the overlay information can include overlay content and targeting information.
  • the management engine 206 can store the overlay information, including the overlay content or a reference to the overlay content, in the overlay database 208.
  • the overlay database 208 may be a single database or multiple databases.
  • the targeting information may be stored in one database and the overlay content may be stored in another database.
  • the ACR systems 224 and 226 can communicate to the client devices 218 and 220, respectively, ACR event information and broadcast content, where the ACR event
  • information can indicate when to trigger overlaying of content.
  • the client devices 218 and 220 can monitor the broadcast content and can send event information or fingerprint information to the ACR systems 224 and 226.
  • the event information or fingerprint information can indicate when an ACR event occurs.
  • the client devices 218 and 220 can send a request for an overlay to the overlay decision engine 210.
  • the overlay decision engine 210 can use targeting information retrieved from the overlay database 208 to determine the most suitable overlay and deliver appropriate overlay information, including information about the overlay server 212 to request the overlay from the client devices 218 and 220.
  • the client devices 218 and 220 can use the overlay information to request the appropriate overlay content from the overlay server 212.
  • the overlay server can provide the client devices 218 and 220 with the overlay content and the client devices 218 and 220 can display the overlay content.
  • the client device 218 or 220 can send a request to an overlay decision engine 210 requesting a media content overlay.
  • the request can include a media content identifier (ID).
  • the request can include overlay information or overlay parameters (as discussed in the proceeding paragraphs).
  • the overlay decision engine 210 can use the content ID, the overlay information, the overlay parameters, or a combination thereof to identify targeted overlay content.
  • the overlay decision engine 210 can use the content ID, overlay information, overlay parameters, or a combination thereof to identify an overlay format (as discussed in the proceeding paragraphs).
  • the overlay decision engine 210 can compare the content ID, overlay information, overlay parameters, or a combination thereof with an overlay database 208 to identify the targeted overlay content and the overlay format.
  • the overlay database 208 can be updated, by the content provider 202 or an advertiser, with new overlay content on a periodic or continuous basis. In one example, the overlay database 208 can be updated, by the content provider 202 or an advertiser, with overlay formats on a periodic or continuous basis.
  • the overlay decision engine 210 can return targeted overlay information to the client device 218 or 220, including reference information that references the overlay server 212.
  • the reference information can include information identifying a location of a content overlay at the overlay server 212 and information local to the client device 218 or 220.
  • the client device 218 or 220 send the reference information to the overlay server 212 and the overlay server 212 can identify and send the targeted overlay content to the client device 218 or 220.
  • the overlay server 212 can deliver the format information to the client device 218 or 220 independent of the overlay content.
  • the client device 218 or 220 can receive the overlay content and format the overlay content using the format information, such as populating a template already positioned as an overlay on top of the media content, for example.
  • the overlay server 212 can format the overlay content using the format information and deliver formatted overlay content to the client device 218 or 220 as a combined package of template and overlay content to directly be displayed over the media content.
  • the overlay server 212 can use the reference information to dynamically deliver localized or tailored messages to the client devices 218 or 220.
  • the overlay server 212 can deliver the targeted overlay content directly to the client device 218 or 220, such as via a wireless communications network.
  • the overlay server 212 can communicate the targeted overlay content to the client device 218 or 220 via a universal resource locator (URL).
  • the management engine 206 can associate the overlay content or the overlay format with the URL, where the URL can indicate a source location of the overlay content and the format of the overlay.
  • the overlay decision engine 210 can communicate the URL to the client device 218 or 220 and the client device 218 or 220 can retrieve the overlay content or the overlay format from that URL.
  • the overlay decision engine 210 can select the targeted content overlay that meets a greatest number of parameters and information. In another example, when multiple targeted overlay contents match the content ID, the overlay information, the overlay parameters, or a combination thereof, the overlay decision engine 210 can randomly select an overlay content that meets the parameters or the other information. In another example, when multiple targeted overlay contents match the content ID, the overlay information, the overlay parameters, or a combination thereof, the overlay decision engine 210 can select predetermined overlay content that matches other content ID, overlay information, or overlay parameters.
  • the overlay content can be populated with dynamic content (e.g., content that can be updated or refreshed at periodic intervals).
  • the client devices 218 and 220 can superimpose overlay content over the content feed when stored frame fingerprints match a client fingerprint, e.g., a sequence of frames having corresponding time stamps.
  • the client devices 218 and 220 can superimpose overlay content over the content feed in a hypertext markup language (HTML) browser.
  • the client devices 218 and/or 220 can superimpose alternative video over the content feed.
  • the client devices 218 and 220 can superimpose overlay content over a content feed from an OTA broadcaster or a cable broadcaster. When the overlay content is placed over the content feed, the overlay content can be displayed to the user via a display of the client devices 218 and 220.
  • the overlay content can include one or more call to actions options that can be displayed to a user.
  • the user can interact with the overlay content using an input device (such as a TV remote, keyboard, a smartphone, or a tablet) to create feedback information.
  • an input device such as a TV remote, keyboard, a smartphone, or a tablet
  • Another individual such as an advertiser, can access the feedback information and analyze the feedback information to determine desired information, such as user interest in the overlay content.
  • the client devices 218 and 220 can monitor the content feed to determine when the overlay content and content feed match ceases. In another example, the client devices 218 and 220 can monitor the content feed to determine when a threshold period of time expires. In one example, when the threshold period of time expires, the client device 218 or 220 can cease to superimpose the overlay content for display on the client device 218 or 220.
  • the overlay decision engine 210 can also analyze the event information to determine viewing data.
  • the viewing data can include: channel information indicating what media content the first client device or the second client device can have displayed; duration information indicating a period of time the first client device or the second client device displayed the media content; or user command information specifying a command received from a user device.
  • the overlay decision engine 210 can store the viewing data in the viewing database 216.
  • the viewing database can receive information from the client device 218 or 220 via the overlay decision engine 210.
  • the viewing database can also receive information from the ACR system 224 or the ACR system 226 via the data engine 230.
  • the ACR systems 224 and 226 can communicate data regarding what client devices 218 and 220 have displayed to the data engine 230.
  • the data engine can store the viewing data in the viewing database 216.
  • the viewing data in the viewing database 216 can also be augmented with additional data from a third party external database 228.
  • the viewing data in the viewing database 216 can be matched with a demographic database from a third party to augment the viewing data in the viewing database 216 with demographic data.
  • the overlay decision engine 210 can receive user interaction information from the client device 218 or 220.
  • the user interaction information can include information indicating how a user interacts with the client devices 218 and 220, such as pausing a program, changing a TV channel, muting the client devices 218 and 220, and so forth.
  • the overlay decision engine 210 can receive user feedback information from the client device 218 or 220.
  • the user feedback information can include user input information indicating a user reaction to a content overlay, such as content overlay like or dislike information or a request for additional information for a product or service shown in a content overlay.
  • the overlay decision engine 210 can store the user interaction information or user feedback information in the viewing database 216.
  • the ACR systems 224 and 226 can provide viewing data in different formats and via different communication schemes including, but not limited to: direct beaconing of each individual viewing event; direct beaconing of batched viewing events; file based transfer of batched viewing events, such as file transfer protocol (FTP), secure FTP (SFTP), or Amazon simple storage service (Amazon S3®); or other file transfer protocol.
  • the data engine 230 can normalize the viewing data that is received in different formats from the different ACR systems 224 and 226.
  • the data engine 230 can store the normalized viewing data in the viewing database 216.
  • the reporting engine 214 can query the data engine 230 to retrieve subsets of data from the viewing database 216.
  • the reporting engine 214 can process and analyze subsets of viewing data to create reports about content viewing behavior across client devices 218 and 220 and from ACR technology vendors associated with the client devices 218 and 220.
  • the data engine 230 can receive viewing data from the ACR system 224, the ACR system 226, or a combination thereof, normalize the viewing data and store it in the viewing database 216. In another example, the data engine 230 can retrieve viewing data from the viewing database 216. The data engine 230 can send the viewing data to the reporting engine 214. The reporting engine 214 can aggregate the viewing data and can create reports based on the aggregated viewing data to send to a user device 204.
  • FIG. 3 illustrates a diagram 300 of a method of the content manager providing an overlay to a client device according to one embodiment.
  • the method 300 may be at least partially performed by processing logic that may include hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (e.g., instructions executed by a processing device), firmware or a combination thereof.
  • the method 300 may be performed by processing logic of the content manager 122 or the computing system 128 of FIG. 1.
  • FIG. 3 illustrates a flowchart 300 of a method for enhancing a content feed according to one embodiment.
  • the method can begin with receiving, from a client device, an overlay request, wherein the overlay request comprises one or more overlay parameters (302).
  • the method can further include identifying, by a processing device, overlay content in an overlay database in view of the overlay parameters (304).
  • the method can further include identifying, by the processing device, an overlay format of the overlay content at the overlay database in view of the overlay parameters (306).
  • the method can further include
  • the processing device can recognize that the onscreen display is superimposed over the media content or integrated into the media content and determines a size and location of the onscreen display on the broadcast video content.
  • the processing device or an application running on the processing device can dynamically modify an alpha channel of at least a portion of the overlay content to allow the onscreen display on the media content to be viewable.
  • the alpha channel can be used to define the opacity of each pixel of the overlay content.
  • the alpha channel can be adjusted to range from fully transparent to completely opaque. In one example, the alpha channel can be adjusted to be fully transparent in the location where the onscreen display is located.
  • FIG. 4 illustrates a flowchart of a method 400 for overlaying content on media content with a window to permit at least partial visibility of an onscreen display on the media content through the overlaying advertisements according to one embodiment.
  • the method 400 may be at least partially performed by processing logic that may include hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (e.g., instructions executed by a processing device), firmware or a combination thereof.
  • the method 400 may be performed by processing logic of a client device or a server device. Alternatively, the method 400 may be performed by other processing devices in various types of user device, portable devices, televisions, projectors, or other media devices.
  • the processing logic can begin with receiving media content from a content feed (402).
  • the processing logic can send an overlay request to a management system to provide overlay content and an overlay format (404).
  • the processing logic can receive from the content manager the overlay content and the overlay format or a source location of the overlay content and the overlay format selected in view of overlay parameters (406).
  • the processing logic can superimpose the overlay content over the media content on a display using the overlay format (408).
  • the processing logic can determine whether there is an onscreen display overlayed on the media content or integrated into the media content (410).
  • the processing device can detect when an unrecognized object, such as an obstruction or an onscreen display, may be displayed on the media consumption device.
  • an unrecognized object such as an obstruction or an onscreen display
  • video can be fingerprinted by an ACR fingerprinter so that when the video may be displayed on a media consumption device, the video sequence can be used to identify content of the video.
  • the video played on a media consumption device can have an obstruction displayed over the media content.
  • the obstruction can be a mark in the video, such as a logo or watermark, that has been inserted into the video image.
  • the obstruction can be an onscreen display, such as a volume indicator or a programming guide.
  • the ACR fingerprinter may not recognize images of the video or may have a reduced content detection accuracy level or identification accuracy level.
  • the ACR fingerprinter may assume that there is an obstruction and an obstruction detecting fingerprint algorithm can be used to recognize the content and a location and size of the obstruction.
  • the obstruction detecting fingerprint algorithm may have hash values that represent rows and columns in a video frame of the video.
  • the number of rows and columns may vary based on how accurate an ACR fingerprinter may be set to detect an obstruction.
  • the ACR fingerprinter can test source hash values for each row and column of the video frame independently.
  • the rows and columns of the video frame that are not obstructed can match rows and columns of a source video.
  • the rows and columns that do not match can define where the obstruction may be located.
  • the rows and columns that do no match can define a predefined shape, such as a rectangle, associated with an onscreen display.
  • the video may not include an obstruction in the video frame, but rather a video or image from a different source.
  • the video image may not be the same as video images of the source video, then many or all of the hash values for the rows and columns may not match.
  • the hashing of the rows and columns can be done
  • every nth row and nth column can be hashed.
  • the n in nth can represent a number in a series of rows and columns of the columns or rows in the video image.
  • n can represent hashing such as every odd row and column or every even row and column.
  • every row and column can be hashed for every nth frame of media content. For example, when n is equal to 3, every row and column can be looked at over 3 different frames. For example, for a first frame, a first 1/3 of the first frame can be hashed. In this example, for the second frame, a second 1/3 of the second frame can be hashed and for a third frame, a third 1/3 of the third frame can be hashed.
  • the nth row can be different from the nth column.
  • the 2nd row and the 3rd column can be hashed.
  • different sets of rows and columns can be hashed for different frames.
  • the algorithm can cycle through the different rows and columns to use from frame to frame.
  • the ACR fingerprinter may spread the hash values for the rows and columns across multiple frames. For example, the ACR fingerprinter may reduce a size of area for fingerprinting by 50% by only using odd rows and columns on one video frame and then using even rows and columns on another video frame.
  • An advantage of reducing the size of area for fingerprinting can be to reduce a processing power and processing time for the ACR fingerprinter while maintaining a row and column level accuracy with in two frames of comparison.
  • the number or sequence of frames used in the preceding paragraphs is not intended to be limiting, e.g., the ACR fingerprinting for obstruction detection can use any number of frames (or skip any number of frames or portions of the frames) to reduce the fingerprint size.
  • the processing logic can access or maintain a database or list of a size, shape, and screen location of various onscreen displays for different media
  • the processing device can determine a type of a different media consumption device or a device coupled to the media consumption device and detect when an onscreen display may be displayed on the media consumption device.
  • the processing device can determine a type of the onscreen display and look up a size, shape, and screen location of the onscreen display by finding information associated with the type on the onscreen display for the media consumption device or the device coupled to the media consumption device.
  • an opacity level of a layer for the location of the onscreen display may be adjusted to enable a viewer to at least partially view the onscreen display.
  • the processing logic can determine a shape and a location of the onscreen display in the media content (412).
  • the processing logic can define a window in the overlay content that corresponds to the location and shape of the onscreen display in the media content (414).
  • the processing logic can set a transparency level of the overlay content in the window to permit the onscreen display in the media content to be at least partially visible through the overlay content (416).
  • the processing logic can iteratively determine whether the onscreen display is still detected (418).
  • FIG. 5 illustrates a compositing of media content 502, an onscreen display 504, and overlay content 506 to create an image to display on a media consumption device according to one embodiment.
  • Compositing can be a technique of creating a display image by stacking two or more videos or graphics on multiple tracks, such as the broadcast content 502, the onscreen display 504, and the overlay content 506.
  • a processing device can blend the videos or graphics together into one image.
  • each track can be a layer.
  • the highest layer or top layer, such as the overlay content 506, can be the most dominant layer, e.g., the layer that may be displayed in front of other layers.
  • the overlay content 506 can cover up the media content 502 (e.g., a lowest layer or bottom layer) and the onscreen display 504 (e.g., a middle layer).
  • the onscreen display 504 can cover up the media content 502.
  • the layers of an image may be received and composited at one or more devices.
  • the media content 502 can be stored or exist on a first device and can be sent to a second device via a communication channel, such as via a high definition multimedia interface (HDMI) channel or other communication channels.
  • the second device can composite the received media content 502 with the onscreen display 504 and the overlay content 506 and display the final composite image.
  • HDMI high definition multimedia interface
  • the media content 502 and the onscreen display 504 can be stored or exist on the first device and can be composited by the first device before being sent to the second device via the communication channel.
  • the second device can composite the received media content 502 and onscreen display 504 with the overlay content 506 before displaying the final composite image.
  • the media content 502, onscreen display 504 and overlay content 506 may all be stored or exist on a single device, where the single device can composite the media content 502, onscreen display 504 and overlay content 506 before displaying the composite image.
  • Compositing can include changing an opacity or transparency of at least a portion of one or more of layers of a composite image.
  • compositing can include altering opacity of a portion of the overlay content 506 (e.g., the dominant layer) so that a viewer can see part of the onscreen display 504 that is under or behind the overlay content 506.
  • the processing logic can define a window in the overlay content that corresponds to the location and shape of the onscreen display in the media content.
  • the processing logic can use a compositing technique of changing an opacity or transparency of the overlay content in the window to permit the onscreen display 504 to be at least partially visible through the overlay content 506.
  • FIGS. 6A-6D illustrate a composite image of media content 602, an onscreen display 604, and overlay content 606 with a opacity window 608 according to one
  • FIG. 6A illustrates the media content 602 as a first layer and the onscreen display 604 (e.g., a volume level indicator) as a second layer above the media content 602.
  • FIG. 6B illustrates the media content 602 as the first layer with the overlay content 606 as a third layer above the media content 602 and the onscreen display 604.
  • FIG. 6C illustrates the media content 602 with the overlay content 606 that includes the opacity window 608, where the opacity window 608 is a variable-transparency window that can be a window to display layers beneath the overlay content 606 to a viewer.
  • FIG. 6D illustrates the media content 602 with the overlay content 606, where the opacity window 608 is set to a threshold opacity level to allow the onscreen display 604 behind the overlay content 606 to be viewable through the overlay content.
  • FIGS. 7A-7F illustrate a composite image of media content 702, an onscreen display 704, and overlay content 706 with a opacity window 708 according to one
  • FIG. 7A illustrates the media content 702 as a first layer and the onscreen display 704 (e.g., a device controls menu) as a second layer above the media content 702.
  • FIG. 7B illustrates the media content 702 as the first layer with the overlay content 706 as a third layer above the broadcast content 702 and the onscreen display 704.
  • the third layer can cover up a portion of a viewable area of the media content 702 (e.g., a portion of a display screen or less than the full display screen).
  • the overlay content 706 is overlapping a portion of the onscreen display 704 such that the onscreen display is partially covered (the "Temp.” data bar is not seen).
  • FIG. 7C illustrates the media content 702 with the overlay content 706 that includes the opacity window 708, where the opacity window 708 is a variable-transparency window that can be a window to display layers beneath the overlay content 706 to a viewer. Note that the opacity window 708 can be located within the overlay content and can be a different size or shape than the onscreen display 704.
  • FIG. 7D illustrates the broadcast content 702 with the overlay content 706, where the opacity window 708 is set to a threshold opacity level to show the onscreen display 704 that is positioned behind the overlay content 706. As illustrated in FIG.
  • the overlay content 706 may only obscure a portion of the onscreen display 704 and the opacity window 708 can be a window within the overlay content 706 that allows the portion of the onscreen display 704 that is covered or obscured by the overlay content 706 to be viewable through the overlay content 706.
  • the third layer can cover the entire viewable area of the media content 702 (e.g., the full display screen).
  • FIG. 7E illustrates a first portion 710 and a second portion 712 of the third layer.
  • the first portion 710 of the third layer can be the overlay content 706 that displays content over the media content 702 and the second portion 712 of the third layer can be a fully transparent portion.
  • the second portion 712 does not further block a part of the media content 702 (e.g., the media content 702 not covered by the overlay content 706).
  • FIG. 7F illustrates that the opacity window 708 is a same size as the onscreen display 704.
  • the opacity window 708 can include a part of the first portion 710 and part of the second portion 712 of the third layer.
  • An advantage of the third layer covering the entire viewable area of the media content 702 and the opacity window 708 being the same size as the onscreen display 704 can be that the onscreen display 704 can remain viewable when the overlay content 706 changes a shape or size.
  • the size and shape of the overlay content can change from covering part of the viewable area in FIG. 9A to covering the entire viewable area in FIG. 9B.
  • the opacity window 708 when the opacity window 708 is the same size as the onscreen display 704, then the entire onscreen display remains viewable when the overlay content 706 changes size or shape.
  • the opacity window 708 can dynamically change shape or size in response to changes in a size or shape of the overlay content 706.
  • the management system 100 can select different overlay formats based on a content of the local content feed or user information received from the client device.
  • the overlay format information can include: an expanding overlay format; a synchronized overlay format; a template overlay format; a sequenced overlay format (e.g., different overlay content is a sequence); a video format, e.g., displaying alternate video content to the media content being played in an underlying broadcast by displaying an alternate video that targets interests of a user of the client device; or a microsite format.
  • FIGS. 6A-6D and 7A-7D illustrates a template overlay format for an overlay superimposed on media content.
  • the template overlay can be created and populated with personalized or localized information by matching overlay request parameters with external data.
  • FIG. 8 illustrates an expanding overlay format 800 for an overlay content 806 superimposed on a media content 802 according to one embodiment.
  • the overlay content 806 can include an opacity window 808 (the left-most portion up to the dashed lines) so that the onscreen display 804 can be viewable.
  • the expanding overlay format 800 can enable a user to press a button on an input device (such as a remote control) and trigger the overlay to show more information.
  • FIG. 9A illustrates a microsite overlay format 900 for an overlay content 906 superimposed on a media content 902 according to one embodiment.
  • the overlay content 906 can include an opacity window 908 (the right-most portion up to the dashed lines) so that the onscreen display 904 can be viewable.
  • Microsite overlays can enable a viewer to go from an overlay to a full screen experience.
  • FIG. 9B illustrates a full screen experience of a microsite overlay format 900 for an overlay content 906 superimposed on a media content 902 according to one embodiment.
  • the broadcast content 902 can be dismissed when the overlay content 906 is in a full screen mode.
  • the media content can be shown as a Picture-in-Picture (PiP) while the overlay content is displayed on the remainder of the screen.
  • PiP Picture-in-Picture
  • FIG. 10 illustrates an overlay content 1006 superimposed on a corner of broadcast content 1002 according to one embodiment.
  • the overlay content 1006 can include an opacity window 1008 (the top-most portion up to the dashed lines) in the corner of the media content 1002.
  • the illustrations of the overlay formats in the proceeding paragraphs are exemplary illustrations of overlay formats.
  • a format or location of the media content, overlay content, opacity window, and /or onscreen display can have a variety of formats and be located at a variety of locations on a display.
  • FIG. 11 illustrates a diagrammatic representation of a machine in the example form of a computer system or a server device 1100 within which a set of instructions, for causing the machine to perform any one or more of the methodologies discussed herein, may be executed.
  • the machine may be connected (e.g., networked) to other machines in a LAN, an intranet, an extranet, or the Internet.
  • the machine may operate in the capacity of a server or a client device in a client- server network environment, or as a peer machine in a peer-to-peer (or distributed) network environment.
  • the machine may be a personal computer (PC), a tablet PC, a set-top box (STB), a Personal Digital Assistant (PDA), a cellular telephone, a smartphone, a web appliance, a server, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine.
  • PC personal computer
  • PDA Personal Digital Assistant
  • STB set-top box
  • STB set-top box
  • a cellular telephone a smartphone
  • web appliance a web appliance
  • server a server
  • network router switch or bridge
  • the computer system 1100 may correspond to the processing device 130 of FIG. 1 or to the processing device 230 of FIG. 2.
  • the computer system 1100 may correspond to at least a portion of a cloud-based computer system.
  • the computer system 1100 includes a processing device 1102, a main memory 1104 (e.g., read-only memory (ROM), flash memory, dynamic random access memory (DRAM) (such as synchronous DRAM (SDRAM) or DRAM (RDRAM), etc.), a static memory 1106 (e.g., flash memory, static random access memory (SRAM), etc.), and a data storage device 1118, which communicate with each other via a bus 1130.
  • main memory 1104 e.g., read-only memory (ROM), flash memory, dynamic random access memory (DRAM) (such as synchronous DRAM (SDRAM) or DRAM (RDRAM), etc.
  • DRAM dynamic random access memory
  • SDRAM synchronous DRAM
  • RDRAM DRAM
  • static memory 1106 e.g., flash memory, static random access memory (SRAM), etc.
  • SRAM static random access memory
  • Processing device 1102 represents one or more general-purpose processing devices such as a microprocessor, central processing unit, or the like. More particularly, the processing device may be complex instruction set computing (CISC) microprocessor, reduced instruction set computer (RISC) microprocessor, very long instruction word (VLIW) microprocessor, or processor implementing other instruction sets, or processors implementing a combination of instruction sets. Processing device 1102 may also be one or more special- purpose processing devices such as an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), network processor, or the like. In one embodiment, processing device 1102 may include one or more processing cores. The processing device 1102 may execute the instructions 1126 of a mirroring logic for performing the operations discussed herein.
  • CISC complex instruction set computing
  • RISC reduced instruction set computer
  • VLIW very long instruction word
  • processing device 1102 may also be one or more special- purpose processing devices such as an application specific integrated circuit (ASIC), a field programmable gate array (
  • the computer system 1100 may further include a network interface device 1108 communicably coupled to a network 1120.
  • the computer system 1100 also may include a video display unit 1110 (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)), an alphanumeric input device 1112 (e.g., a keyboard), a cursor control device 1114 (e.g., a mouse), a signal generation device 1116 (e.g., a speaker), or other peripheral devices.
  • a video display unit 1110 e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)
  • an alphanumeric input device 1112 e.g., a keyboard
  • a cursor control device 1114 e.g., a mouse
  • signal generation device 1116 e.g., a speaker
  • computer system 1100 may include a graphics processing unit 1122, a video processing unit 1128, and an audio processing unit 1132.
  • the computer system 1100 may include a chipset (not illustrated), which refers to a group of integrated circuits, or chips, that are designed to work with the processing device 1102 and controls communications between the processing device 1102 and external devices.
  • the chipset may be a set of chips on a motherboard that links the processing device 1102 to very high-speed devices, such as main memory 1104 and graphic controllers, as well as linking the processing device 1102 to lower-speed peripheral buses of peripherals, such as USB, PCI or ISA buses.
  • the data storage device 1118 may include a computer-readable storage medium 1125 on which is stored instructions 1126 embodying any one or more of the methodologies of functions described herein.
  • the instructions 1126 may also reside, completely or at least partially, within the main memory 1104 and/or within the processing device 1102 during execution thereof by the computer system 1100; the main memory 1104 and the processing device 1102 also constituting computer-readable storage media.
  • the computer-readable storage medium 1125 may also be used to store instructions 1126 utilizing logic and/or a software library containing methods that call the above applications.
  • While the computer-readable storage medium 1125 is shown in an exemplary implementation to be a single medium, the term "computer-readable storage medium” should be taken to include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions.
  • the term “computer-readable storage medium” shall also be taken to include any medium that is capable of storing, encoding or carrying a set of instructions 1126 for execution by the machine and that cause the machine to perform any one or more of the methodologies of the present disclosure.
  • the term “computer-readable storage medium” shall accordingly be taken to include, but not be limited to, solid-state memories, optical media, and magnetic media. The following examples pertain to further embodiments.
  • the embodiments are described with reference to secure memory repartitioning in specific integrated circuits, such as in computing platforms or microprocessors.
  • the embodiments may also be applicable to other types of integrated circuits and programmable logic devices.
  • the disclosed embodiments are not limited to desktop computer systems or portable computers, such as the Intel® UltrabooksTM computers.
  • the disclosed embodiments are not limited to desktop computer systems or portable computers, such as the Intel® UltrabooksTM computers.
  • the disclosed embodiments are not limited to desktop computer systems or portable computers, such as the Intel® UltrabooksTM computers.
  • handheld devices tablets, other thin notebooks, systems on a chip (SoC) devices, and embedded applications.
  • Some examples of handheld devices include cellular phones, Internet protocol devices, digital cameras, personal digital assistants (PDAs), and handheld PCs.
  • Embedded applications typically include a microcontroller, a digital signal processor (DSP), a system on a chip, network computers (NetPC), set-top boxes, network hubs, wide area network (WAN) switches, or any other system that may perform the functions and operations taught below. It is described that the system may be any kind of computer or embedded system.
  • the disclosed embodiments may especially be used for low-end devices, like wearable devices (e.g., watches), electronic implants, sensory and control infrastructure devices, controllers, supervisory control and data acquisition (SCAD A) systems, or the like.
  • the apparatuses, methods, and systems described herein are not limited to physical computing devices, but may also relate to software optimizations for energy conservation and efficiency. As will become readily apparent in the description below, the embodiments of methods, apparatuses, and systems described herein (whether in reference to hardware, firmware, software, or a combination thereof) are vital to a 'green technology' future balanced with performance considerations.
  • Embodiments of the present invention may be provided as a computer program product or software which may include a machine or computer-readable medium having stored thereon instructions which may be used to program a computer (or other electronic devices) to perform one or more operations according to embodiments of the present invention.
  • operations of embodiments of the present invention might be performed by specific hardware components that contain fixed-function logic for performing the operations, or by any combination of programmed computer components and fixed- function hardware components.
  • Instructions used to program logic to perform embodiments of the invention may be stored within a memory in the system, such as DRAM, cache, flash memory, or other storage. Furthermore, the instructions may be distributed via a network or by way of other computer readable media.
  • a machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer), but is not limited to, floppy diskettes, optical disks, Compact Disc, Read-Only Memory (CD-ROMs), and magneto-optical disks, Read-Only Memory (ROMs), Random Access Memory (RAM), Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), magnetic or optical cards, flash memory, or a tangible, machine-readable storage used in the transmission of information over the Internet via electrical, optical, acoustical or other forms of propagated signals (e.g., carrier waves, infrared signals, digital signals, etc.). Accordingly
  • a design may go through various stages, from creation to simulation to fabrication.
  • Data representing a design may represent the design in a number of manners.
  • the hardware may be represented using a hardware description language or another functional description language.
  • a circuit level model with logic and/or transistor gates may be produced at some stages of the design process.
  • most designs, at some stage reach a level of data representing the physical placement of various devices in the hardware model.
  • the data representing the hardware model may be the data specifying the presence or absence of various features on different mask layers for masks used to produce the integrated circuit.
  • the data may be stored in any form of a machine readable medium.
  • a memory or a magnetic or optical storage such as a disc may be the machine readable medium to store information transmitted via optical or electrical wave modulated or otherwise generated to transmit such information.
  • an electrical carrier wave indicating or carrying the code or design is transmitted, to the extent that copying, buffering, or re-transmission of the electrical signal is performed, a new copy is made.
  • a communication provider or a network provider may store on a tangible, machine-readable medium, at least temporarily, an article, such as information encoded into a carrier wave, embodying techniques of embodiments of the present invention.
  • a module as used herein refers to any combination of hardware, software, and/or firmware.
  • a module includes hardware, such as a micro-controller, associated with a non-transitory medium to store code adapted to be executed by the micro-controller. Therefore, reference to a module, in one embodiment, refers to the hardware, which is specifically configured to recognize and/or execute the code to be held on a non-transitory medium. Furthermore, in another embodiment, use of a module refers to the non-transitory medium including the code, which is specifically adapted to be executed by the
  • module in this example, may refer to the combination of the microcontroller and the non-transitory medium. Often module boundaries that are illustrated as separate commonly vary and potentially overlap. For example, a first and a second module may share hardware, software, firmware, or a combination thereof, while potentially retaining some independent hardware, software, or firmware.
  • use of the term logic includes hardware, such as transistors, registers, or other hardware, such as programmable logic devices.
  • Use of the phrase 'configured to,' in one embodiment, refers to arranging, putting together, manufacturing, offering to sell, importing and/or designing an apparatus, hardware, logic, or element to perform a designated or determined task.
  • an apparatus or element thereof that is not operating is still 'configured to' perform a designated task if it is designed, coupled, and/or interconnected to perform said designated task.
  • a logic gate may provide a 0 or a 1 during operation.
  • a logic gate 'configured to' provide an enable signal to a clock does not include every potential logic gate that may provide a 1 or 0. Instead, the logic gate is one coupled in some manner that during operation the 1 or 0 output is to enable the clock. Note once again that use of the term
  • 'configured to' does not require operation, but instead focus on the latent state of an apparatus, hardware, and/or element, where in the latent state the apparatus, hardware, and/or element is designed to perform a particular task when the apparatus, hardware, and/or element is operating.
  • use of the phrases 'to,' 'capable of/to,' and or 'operable to,' in one embodiment refers to some apparatus, logic, hardware, and/or element designed in such a way to enable use of the apparatus, logic, hardware, and/or element in a specified manner.
  • use of to, capable to, or operable to, in one embodiment refers to the latent state of an apparatus, logic, hardware, and/or element, where the apparatus, logic, hardware, and/or element is not operating but is designed in such a manner to enable use of an apparatus in a specified manner.
  • a value includes any known representation of a number, a state, a logical state, or a binary logical state. Often, the use of logic levels, logic values, or logical values is also referred to as l's and 0's, which simply represents binary logic states. For example, a 1 refers to a high logic level and 0 refers to a low logic level.
  • a storage cell such as a transistor or flash cell, may be capable of holding a single logical value or multiple logical values.
  • the decimal number ten may also be represented as a binary value of 1010 and a hexadecimal letter A. Therefore, a value includes any known representation of a number, a state, a logical state, or a binary logical state. Often, the use of logic levels, logic values, or logical values is also referred to as l's and 0's, which simply represents binary logic states. For example, a 1 refers to a high logic level and 0 refers to a low logic level
  • states may be represented by values or portions of values.
  • a first value such as a logical one
  • a second value such as a logical zero
  • reset and set in one embodiment, refer to a default and an updated value or state, respectively.
  • a default value potentially includes a high logical value, i.e. reset
  • an updated value potentially includes a low logical value, i.e. set.
  • any combination of values may be utilized to represent any number of states.
  • a non-transitory machine-accessible/readable medium includes any mechanism that provides (i.e., stores and/or transmits) information in a form readable by a machine, such as a computer or electronic system.
  • a non-transitory machine- accessible medium includes random-access memory (RAM), such as static RAM (SRAM) or dynamic RAM (DRAM); ROM; magnetic or optical storage medium; flash memory devices; electrical storage devices; optical storage devices; acoustical storage devices; other form of storage devices for holding information received from transitory (propagated) signals (e.g., carrier waves, infrared signals, digital signals); etc., which are to be distinguished from the non-transitory mediums that may receive information there from.
  • RAM random-access memory
  • SRAM static RAM
  • DRAM dynamic RAM
  • ROM magnetic or optical storage medium
  • flash memory devices electrical storage devices
  • optical storage devices e.g., optical storage devices
  • acoustical storage devices other form of storage devices for holding information received from transitory (propagated) signals (e.g., carrier waves, infrared signals, digital signals); etc., which are to be distinguished from the non-transitory mediums that may receive information there from.
  • Instructions used to program logic to perform embodiments of the invention may be stored within a memory in the system, such as DRAM, cache, flash memory, or other storage. Furthermore, the instructions may be distributed via a network or by way of other computer readable media.
  • a machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer), but is not limited to, floppy diskettes, optical disks, Compact Disc, Read-Only Memory (CD-ROMs), and magneto-optical disks, Read-Only Memory (ROMs), Random Access Memory (RAM), Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), magnetic or optical cards, flash memory, or a tangible, machine-readable storage used in the transmission of information over the Internet via electrical, optical, acoustical or other forms of propagated signals (e.g., carrier waves, infrared signals, digital signals, etc.). Accordingly
  • example or “exemplary” are used herein to mean serving as an example, instance or illustration. Any aspect or design described herein as “example' or “exemplary” is not necessarily to be construed as preferred or advantageous over other aspects or designs. Rather, use of the words “example” or “exemplary” is intended to present concepts in a concrete fashion.
  • the term “or” is intended to mean an inclusive “or” rather than an exclusive “or.” That is, unless specified otherwise, or clear from context, "X includes A or B" is intended to mean any of the natural inclusive permutations.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

L'invention porte sur un procédé de remplacement de contenu sur des affichages sur écran. Le procédé peut en outre comprendre l'envoi d'une requête de recouvrement pour fournir un contenu de recouvrement et un format de recouvrement. Le procédé peut comprendre la réception du contenu de recouvrement et du format de recouvrement sélectionnés en vue de paramètres de recouvrement. Le procédé peut comprendre la superposition du contenu de recouvrement sur le contenu multimédia à l'aide du format de recouvrement. Le procédé peut comprendre la détection d'une présence d'un affichage sur écran. Le procédé peut comprendre la détermination d'un emplacement d'une partie de l'affichage sur écran qui s'étend sous le contenu de recouvrement. Le procédé peut comprendre la définition d'une fenêtre dans le contenu de recouvrement qui correspond à au moins l'emplacement de la partie de l'affichage sur écran. Le procédé peut comprendre le réglage d'un niveau de transparence du contenu de recouvrement dans la fenêtre pour permettre à la partie de l'affichage sur écran d'être au moins partiellement visible à travers le contenu de recouvrement.
PCT/US2016/029227 2015-04-23 2016-04-25 Remplacement de contenu sur des affichages sur écran WO2016172715A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201562151912P 2015-04-23 2015-04-23
US62/151,912 2015-04-23
US14/820,490 2015-08-06
US14/820,490 US9743153B2 (en) 2014-09-12 2015-08-06 Content replacement with onscreen displays

Publications (1)

Publication Number Publication Date
WO2016172715A1 true WO2016172715A1 (fr) 2016-10-27

Family

ID=57143675

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2016/029227 WO2016172715A1 (fr) 2015-04-23 2016-04-25 Remplacement de contenu sur des affichages sur écran

Country Status (1)

Country Link
WO (1) WO2016172715A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2021530922A (ja) * 2018-07-16 2021-11-11 ロク インコーポレイテッド 再生装置の動作を変更するリモコン信号の検出に応答した置換メディアコンテンツ再生の変更
CN114501063A (zh) * 2017-03-29 2022-05-13 六科股份有限公司 使用覆盖的定向内容放置
US11736757B2 (en) 2019-08-05 2023-08-22 Hoppr Ltd Method and system for providing content to a media playing device

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060117343A1 (en) * 2001-04-17 2006-06-01 Digeo, Inc. Apparatus and methods for advertising in a sequential manner and based upon user preference
US20060130095A1 (en) * 2004-12-15 2006-06-15 Daniel Willis Method and system for displaying of transparent ads
US20110026761A1 (en) * 2007-10-05 2011-02-03 Dolby Laboratories Licensing Corp. Media fingerprints that reliably correspond to media content
US20110247042A1 (en) * 2010-04-01 2011-10-06 Sony Computer Entertainment Inc. Media fingerprinting for content determination and retrieval
US20140282670A1 (en) * 2012-12-28 2014-09-18 Turner Broadcasting System, Inc. Method and system for detecting and resolving conflicts in an automatic content recognition based system
US20140289650A1 (en) * 2009-07-14 2014-09-25 Adobe Systems Incorporated Multi-Layer Computer Application with a Transparent Portion
US20140344871A1 (en) * 2006-06-07 2014-11-20 Sony Corporation Video-on-demand system
US20140359656A1 (en) * 2013-05-31 2014-12-04 Adobe Systems Incorporated Placing unobtrusive overlays in video content

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060117343A1 (en) * 2001-04-17 2006-06-01 Digeo, Inc. Apparatus and methods for advertising in a sequential manner and based upon user preference
US20060130095A1 (en) * 2004-12-15 2006-06-15 Daniel Willis Method and system for displaying of transparent ads
US20140344871A1 (en) * 2006-06-07 2014-11-20 Sony Corporation Video-on-demand system
US20110026761A1 (en) * 2007-10-05 2011-02-03 Dolby Laboratories Licensing Corp. Media fingerprints that reliably correspond to media content
US20140289650A1 (en) * 2009-07-14 2014-09-25 Adobe Systems Incorporated Multi-Layer Computer Application with a Transparent Portion
US20110247042A1 (en) * 2010-04-01 2011-10-06 Sony Computer Entertainment Inc. Media fingerprinting for content determination and retrieval
US20140282670A1 (en) * 2012-12-28 2014-09-18 Turner Broadcasting System, Inc. Method and system for detecting and resolving conflicts in an automatic content recognition based system
US20140359656A1 (en) * 2013-05-31 2014-12-04 Adobe Systems Incorporated Placing unobtrusive overlays in video content

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114501063A (zh) * 2017-03-29 2022-05-13 六科股份有限公司 使用覆盖的定向内容放置
JP2021530922A (ja) * 2018-07-16 2021-11-11 ロク インコーポレイテッド 再生装置の動作を変更するリモコン信号の検出に応答した置換メディアコンテンツ再生の変更
EP3824646A4 (fr) * 2018-07-16 2022-04-06 Roku, Inc. Modification de lecture d'un contenu de remplacement en réponse à une détection de signaux de commande à distance qui modifient le fonctionnement du dispositif de lecture
JP7285914B2 (ja) 2018-07-16 2023-06-02 ロク インコーポレイテッド 再生装置の動作を変更するリモコン信号の検出に応答した置換メディアコンテンツ再生の変更
US11937026B2 (en) 2018-07-16 2024-03-19 Roku, Inc. Responsive to detection of remote control signals that modify operation of the playback device
US11736757B2 (en) 2019-08-05 2023-08-22 Hoppr Ltd Method and system for providing content to a media playing device

Similar Documents

Publication Publication Date Title
US10057657B2 (en) Content replacement with onscreen displays
US11212582B2 (en) Providing restricted overlay content to an authorized client device
KR102197311B1 (ko) 콘텐츠 인식 핑거프린트 매칭에서의 채널 변경 검출
JP6750103B2 (ja) コンテンツフィンガープリンティングのためのフィンガープリントレイアウト
US11039222B2 (en) Targeted content placement using overlays
KR20180026377A (ko) 자동 콘텐츠 인식 핑거프린트 시퀀스 매칭
US11140435B2 (en) Interactive overlays to determine viewer data
WO2016172715A1 (fr) Remplacement de contenu sur des affichages sur écran

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16784095

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 090218)

122 Ep: pct application non-entry in european phase

Ref document number: 16784095

Country of ref document: EP

Kind code of ref document: A1