KR20210030494A - Enabling interactive control of live television broadcast streams - Google Patents

Abstract

The present invention provides a method for interactive control of a live television broadcast stream. The method includes receiving a streaming live media feed 103 from a television broadcaster 102 and displaying an overlay 212 on the media content M of the streaming live media feed 103. The overlay 212 includes playback control options that are not related to an intermediary feed source of the live media feed between the television broadcaster and the media device 115. The method comprises receiving a first selection input of the playback control option and determining that the first fingerprint 128, 208, 306 did not match the second fingerprint 128, 208, 306, thereby streaming the selection input. And determining that the first location in the media content M of the live media feed corresponds to the playback mode. In addition, the method includes overlaying the targeted overlay content on the streaming live media feed.

Description

Implementation of interactive control of live television broadcast streams {ENABLING INTERACTIVE CONTROL OF LIVE TELEVISION BROADCAST STREAMS}

The present invention relates to the use of automatic content recognition that enables interactive control of live television broadcast streams.

A media consuming device, such as a smart television (TV), can access broadcast digital content and receive data, such as streaming media, from a data network (eg, the Internet). Streaming media refers to a service capable of providing media content such as movies and news to end users through telephone lines, cables, and the Internet upon request. For example, users can watch movies without leaving their residence. In addition, users can access various types of educational content, such as video lectures, without actually attending a school or educational institution.

As the number of media consuming devices (or simply "media devices") continues to increase, video content creation and delivery may likewise increase. As the use of media devices (e.g., smart phones, tablets and smart televisions) to access streaming media increases, content or network providers (e.g., local broadcasters, multi-channel networks and other content owners/ Distributor) can distribute content appropriate to the context to viewers using streaming media (eg, media programs). For example, local broadcasters may include advertisements and interactive content contextually related to streaming media.

One aspect of the present invention provides a method of using automatic content recognition to enable interactive control of a live television broadcast stream. The method includes receiving a streaming live media feed from a television broadcaster in data processing hardware of the media device. Streaming live media feeds contain media content. The method also includes displaying the overlay on the media content of the streaming live media feed by the data processing hardware of the media device. The overlay includes a playback control option and is not associated with an intermediate feed source of the live media feed between the television broadcaster and the media device. The playback control option is also configured to control the playback mode of the media device for playing the streaming live media feed. The method further includes receiving a first selection input of a playback control option of the overlay at data processing hardware of the media device. The method also includes determining, by the data processing hardware of the media device, that the selection input of the playback control option corresponds to a fast forward playback mode or a rewind playback mode at a first location within the media content of the streaming live media feed. do. Further, the method includes receiving a second selection input at data processing hardware of the media device. The method further comprises a second location within the media content of the streaming live media feed based on the first fingerprint of at least one first frame of the media content of the streaming live media feed at the second location by the data processing hardware of the media device. It includes the step of determining. The second position corresponds to the second selection input. The method comprises determining, by data processing hardware in the media device, that a first fingerprint at a second location does not match a second fingerprint of at least one second frame of media content at the first location. It includes more. The method also includes overlaying the targeted overlay content onto the streaming live media feed by the data processing hardware of the media device. The targeted overlay content is contextually related to the media content at a second location within the media content of the streaming live media feed.

Implementations of the invention may include one or more of the following optional features. In some implementations, the method further includes determining, by the data processing hardware of the media device, to be contextually related to the media content at a second location within the media content of the streaming live media feed based on the user profile. . In some examples, the intermediate feed source of the streaming live media feed is one of aerial, satellite, internet-enabled, or set-top box. In some implementations, the second selection input is temporally followed by the first selection input.

In some examples, the method includes buffering the media content for a period of time by the data processing hardware of the media device. This time may be a duration between the first selection input of the reproduction control option and the second selection input of the reproduction control option.

In some implementations, determining each of the first location and the second location includes receiving, at data processing hardware of the media device, a query fingerprint corresponding to the media content from a content feed of the media device. Here, the query fingerprint represents sequential frames of media content from the content feed and includes a time stamp corresponding to a temporal position in the content feed. In some of these implementations, the step of determining each of the first and second locations can also be performed by the data processing hardware of the media device, wherein the query fingerprint is provided by the television broadcaster. And determining that it matches at least one frame fingerprint of the prints. The matched at least one frame fingerprint may be associated with each channel of the television broadcaster, each media program within each channel, and each location within each media program of each channel. In some implementations, when the matched at least one frame fingerprint is associated with each channel of the television broadcaster, determining each of the first and second positions is performed by the data processing hardware of the media device, by means of the data processing hardware of the media device. The printing further includes determining to correspond to each location in the media program of the live media feed from the television broadcaster based on the time stamp of the query fingerprint and the scheduling data for each channel.

Optionally, the method may further comprise transmitting at least one of the first location or the second location from the data processing hardware of the media device to the advertisement targeter. The ad targeter may be configured to identify overlay content for the viewer of the streaming live media feed based on the viewer's viewing habits. In some examples, the method includes transmitting, from the data processing hardware of the media device, an identifier of the media program associated with the first location as a viewing history to the advertisement targeter. Here, the advertisement targeter may be configured to identify the overlay content for the viewer of the streaming live media feed based on the viewing history and transmit the identified overlay content to the media device. In some configurations, the overlay includes a hypertext markup language browser.

Another aspect of the invention provides a system that uses automatic content recognition to enable interactive control of a live television broadcast stream. The system includes data processing hardware and memory hardware in communication with the data processing hardware. The memory hardware stores instructions that, when executed on the data processing hardware, cause the data processing hardware to perform operations. These operations include receiving a streaming live media feed from a television broadcaster. Streaming live media feeds contain media content. These operations also include displaying an overlay on the media content of the streaming live media feed. The overlay includes a playback control option and is not associated with an intermediary feed source of the live media feed between the television broadcaster and the media device. The playback control option is also configured to control the playback mode of the media device for playing the streaming live media feed. These operations further include receiving a first selection input of a playback control option of the overlay. These operations also include determining that the selection input of the playback control option corresponds to a fast forward playback mode or a rewind playback mode at a first location within the media content of the streaming live media feed. Further, these operations include receiving a second selection input. These operations also include determining a second location within the media content of the streaming live media feed based on a first fingerprint of a first frame of at least one of the media content of the media content of the streaming live media feed at the second location. Includes. The second position corresponds to the second selection input. The operations further include determining that the first fingerprint at the second location does not match a second fingerprint of at least one second frame of the media content at the first location. Additionally, these operations include overlaying the targeted overlay content on the streaming live media feed. The targeted overlay content is contextually related to the media content at a second location within the media content of the streaming live media feed.

Implementations of the invention may include one or more of the following optional features. In some implementations, the operations further include determining to be contextually related to the media content at a second location within the media content of the streaming live media feed based on the user profile. In some examples, the intermediary feed source of the streaming live media feed is one of aerial, satellite, internet enabled, or set-top box. In some implementations, the second selection input is temporally followed by the first selection input.

In some examples, these operations include buffering the media content for a period of time. This time may be a duration between the first selection input of the reproduction control option and the second selection input of the reproduction control option.

In some implementations, determining each of the first location and the second location includes receiving a query fingerprint corresponding to the media content from the content feed at the media device. Here, the query fingerprint represents sequential frames of media content from the content feed and includes a time stamp corresponding to a temporal position in the content feed. In some of these implementations, the act of determining each of the first and second locations also includes a query fingerprint of at least one of a plurality of frame fingerprints of the streaming live media feed provided by the television broadcaster. And determining that it matches with. The matched at least one frame fingerprint may be associated with each channel of the television broadcaster, each media program within each channel, and each location within each media program of each channel. In some implementations, when the matched at least one frame fingerprint is associated with each channel of the television broadcaster, based on the time stamp of the query fingerprint and the scheduling data for each channel, the query fingerprint is broadcast to the television. And determining that the live media feed from the caster corresponds to each location in the media program.

Optionally, these operations may further include transmitting at least one of the first location or the second location to the advertisement targeter. The ad targeter may be configured to identify overlay content for the viewer of the streaming live media feed based on the viewer's viewing habits. In some examples, these operations include sending an identifier of the media program associated with the first location as a viewing history to the ad targeter. Here, the advertisement targeter may be configured to identify the overlay content for the viewer of the streaming live media feed based on the viewing history and communicate the identified overlay content to the media device. In some configurations, the overlay includes a hypertext markup language browser.

The details of one or more implementations of the invention are set forth in the accompanying drawings and the description below. Other aspects, features and advantages will be apparent from the detailed description and drawings and claims.

1 shows a schematic diagram of an exemplary system diagram of a content distribution network.
2 shows a schematic diagram of an example of a content manager for providing overlay content to a client device.
FIG. 3 shows a schematic diagram of an exemplary system diagram of an automatic content recognition (ACR) content manager used to fingerprint media content and later control the delivery of interrupted programs.
4 shows a flow diagram of an exemplary ACR matching method for identifying a corresponding media program.
5 shows a flow diagram of an exemplary ACR method that detects interruption of a media program and provides an option to continue viewing the media program when the media program returns to a previously streamed channel.
6 shows a flow diagram of an exemplary method of ACR providing options on a media device to control delivery timing of a live media feed.
7 shows an exemplary schematic diagram of a machine in an exemplary form of a computer system on which a set of instructions may be executed that causes the machine to perform any one or more methods discussed herein.
Like reference numerals in the various drawings indicate like elements.

Broadcasting or streaming media content, such as television (TV) or Internet show broadcasting, is a media source that continues to gain popularity for obtaining digital media entertainment. Many users looking for such media content are of various types of media devices for streaming broadcast television content, including, for example, set-top boxes, aerial antennas, satellite dishes, or Internet-enabled devices including smart TVs or other media devices. Is being used more and more. The same TV channel can be streamed to (via) any of these media devices according to channel schedules for different media programs. Until now, no media device-level method has existed, regardless of the source of the television broadcast, that provides a way for the viewer to detect an interruption in viewing a media program and return the viewer to that media program when the media device returns to the same channel. .

The disclosed automatic content recognition (ACR) system facilitates this function, which will be discussed in more detail as follows. The ACR system may first identify a channel by performing fingerprinting of streaming media content received as a live media feed. The ACR system can access current scheduling information for the identified channel to identify the media program being viewed. When the ACR system detects that the media program is interrupted, such as a channel change, power loss, the media device goes to sleep, or the user turns the media device off, the ACR system writes the recorded ACR data to the media program at the end of viewing. You can record the channel and location, and its source. Later, when the user returns to the media device's channel, the ACR system can deliver an overlay to the media device's display requesting whether the user wants to continue viewing the previously interrupted media program. If the user chooses to continue watching the program, the overlay can trigger the streaming of the media program from the original source (or ACR buffering source) where the media program was stopped.

In some examples, the ACR system, which may include an ACR client running on the media device, may display an overlay on the display of the media device, which overlay sends a live media feed (e.g., a media program) to the media device. Includes selectable options to control the timing of streaming to. Upon receiving a selection signal indicating selection of an option through the input device, the ACR client may execute a control operation related to the selected option. In an alternative embodiment, this option is available through a remote controller paired to the media device, and its inputs can be adapted to the option selection. In various embodiments, the control action includes playing, pausing, fast forwarding or rewinding a program streamed to a live media feed, and other actions are contemplated, such as jumping to a specific section, chapter or episode of the media program. . In various embodiments, the source of the live media feed is one of an aerial, satellite, set-top box, internet-enabled or other source of various live media feeds.

If the location of the streaming is changed or paused, the ACR client will use one of the options in the overlay (or remote controller) to start playing in the media program when streaming resumes (via ACR data access to the media device). ) Can be represented. This location may be stored or buffered for use when starting to stream the media program upon receiving a selection signal indicating user-selected playback. As the ACR client tracks the automatic content recognition data, the ACR client can keep track of where the user of the media device has moved into the live media stream. In some cases, the live media stream is at the ACR server, at the ACR client, or at the ACR server in order to be able to move the live media feed streamed to the media device to a location indicated by user selection for control options. It can be buffered for a certain amount of time in a combination of ACR and ACR clients.

The disclosed ACR system may receive, from a media device, a query fingerprint comprising frames of an ordered sequence of content consumed by a user. The ACR system determines the distance between each frame fingerprint and the corresponding ones of the sequence of ordered frames, thereby storing a frame fingerprint by the system for individual frames of programs streaming to a plurality of television channels. And query fingerprints can be matched. The distance may include, for example, a number representing how different the two frames are from each other or the difference between the channels on which the two respective frames are being streamed. This distance may also be determined as the distance between an average of a group of frames and an average of a group of other frames, where fingerprints are a sequence of frames of media content. The ACR system may also determine when the channel is changed or when the TV stops streaming media content of the media program if the fingerprints for the media program no longer match during the television broadcast.

To provide media content to viewers, an individual or organization may stream media content to viewers, such as by delivering media content to viewers via the Internet. Media content used by an individual or organization may be media content (eg, video data) obtained from one or more live broadcast media feeds. For example, a media content provider may provide a user of a media device with a linear media channel (eg, media provided to viewers from a live media feed source) over the Internet or through other media.

The word “content” may be used to refer to media or multimedia. The word “content” may be a specific term that refers to the subject of the media, not the media itself. Likewise, the word “media” and some compound words including “media” (eg, multimedia, hypermedia) refer to content, not channels through which information is delivered to end users/viewers. The media or media content may include graphical representations such as videos, movies, television shows, advertisements, streaming video, and the like; text; graphic; animation; Still image; It may include interactive content types. An example of a content type commonly referred to as a media type is "movie" referred to as "film."

In some examples, a content overlay system or content overlay device may enable combining media content with specific, timely and/or targeted overlay content, such as advertisements. The content overlay system or content overlay device invites viewers to respond to a call to action within the content overlays (e.g., an invitation to engage in the content overlay) so that overlay content providers can interact with You can build a relationship. One of the benefits of inviting viewers to call-to-action is the ability for viewers to request additional information, ask questions, provide comments, and contact providers of advertised services or products. It may be to provide a return path or a subsequent path. Another benefit of inviting viewers to call-to-action is that the advertiser provides additional information, engages more with viewers, collects additional information about viewers, and provides information about the advertised product or service. It may be to provide a return path or a follow-up path through which you can answer questions about the viewer or the like. In another example, a content overlay system or content overlay device may enable an advertiser to use a cross-platform retargeting campaign when a viewer views and/or interacts with the overlay content of a media program.

1 is a system diagram of a content distribution network 100 according to an example. In the content distribution network 100, the content provider 102 may broadcast the content feed 103 to the local provider 106. The local provider 106 may include a head end 104 and an automatic content recognition (ACR) fingerprint server 105. The content feed 103 from the content provider 102 may be received at the head end 104 of the local provider 106.

In various implementations, the head end 104 can generate the local content feed 103 based on the received content feed 103. For example, the head end 104 may be a local affiliate broadcaster that receives a network channel with programming and advertising from a national or global broadcaster. In one example, the head end 104 may be the source of a broadcast feed prior to the broadcast facility transmitting the broadcast feed. In another example, the head end 104 may be a distribution amplifier. The distribution amplifier can receive a source feed and can produce multiple outputs for different devices at the same source feed. Output feeds can be routed to various distribution outlets, e.g. for broadcast over the air, to cable providers, to satellite providers and/or to online streaming providers. Can be sent to

The head end 104 transmits a local content feed 103 to the ACR fingerprint server 105, an over-the-air (OTA) broadcaster 108 and/or a multi-channel video programming distributor (MVPD) 110. I can. OTA broadcaster 108 and/or MVPD 110 may transmit local content feed 103 to media device 115. Some examples of media devices 115 include client devices 118 and 120 (e.g., smart TV), a set-top box 114 that streams provider content to client devices 118 and 120, and a user can Other devices 116 (eg, OTA antennas, satellite dishes, etc.) capable of streaming the content feed 103 are included.

In one example, the OTA broadcaster 108 may broadcast the local content feed 103 using traditional local television or radio channels. In this example, client devices 118 and 120 include antennas (eg, TV or radio antennas) and may receive a local content feed 103. In another example, the MVPD 110 (eg, a cable or satellite broadcaster) may transmit the local content feed 103 to the set-top box 114. In this example, the set-top box 114 can format the content feed 103 for the client devices 118 and 120 and send this formatted content feed 103 to the client devices 118 and 120. Client devices 118 and 120 may include a display device, such as a television screen or a touch screen, to display local content to a viewer. Various components of the content distribution network 100 may be integrated or coupled to the client devices 118 and 120. For example, a smart television may include an antenna, a set-top box 114, and a display device as a single unit.

The ACR fingerprint server 105 may analyze the local content feed 103 to determine fingerprint information (eg, fingerprints). In one example, the ACR fingerprint server 105 may be a device installed in a broadcast facility. The ACR fingerprint server 105 may receive a feed from the head end 104. The ACR fingerprint server 105 may fingerprint a feed and transmit the fingerprints 128a-n to a cloud-based web service. In some implementations, the ACR fingerprint server 105 may be installed within a broadcast facility to fingerprint the feed before it is delivered to a display device such as a television (TV).

The ACR fingerprint server 105 may transmit the fingerprints 128a-n to the ACR systems 124 and/or 126. The ACR systems 124 and 126 may be different ACR systems selected by a device manufacturer, such as a smart TV manufacturer. In some implementations, as described below, the ACR system 124 includes an ACR fingerprint sequence matcher 125. The ACR fingerprint sequence matcher 125 may match the frame fingerprints 128a-n with original video content from which corresponding video frames are derived. The ACR system 126 may or may not have an ACR fingerprint sequence matcher 125. Details regarding the ACR fingerprint sequence matcher 125 are described below with respect to FIG. 3, where a fingerprint sequence matcher may alternatively be located within the content manager 122.

The ACR fingerprint server 105 may analyze the local content feed 103 and capture fingerprints 128a-n that may include an ordered sequence of frames from the local content feed 103. The ACR fingerprint server 105 may transmit the fingerprints 128a-n to the ACR systems 124 and/or 126. The ACR systems 124 and 126 may be different ACR systems selected by a device manufacturer, such as a smart TV manufacturer. In one example, the ACR system 124 or 126 may include processing logic or processing devices to execute instructions or perform processes. In another example, ACR systems 124 and 126 may be ACR web services for different ACR vendors. The ACR fingerprint server 105 may enable use of indexing clients from multiple ACR vendors. For example, several consumer electronics manufacturers (CEMs), such as TV manufacturers, can independently select the ACR vendors to integrate into their electronic devices. To enable ACR-based functionality in a particular CEM device, the ACR system can index broadcast feeds using ACR vendors that CEMs select and integrate into CEM's television. One advantage of integrating multiple ACR vendors into the ACR fingerprint server 105 is that entities such as advertisers, advertising agencies and content providers can interface with a single platform to improve electronic devices from multiple CEMs. To be able to provide advertising and content experiences

In various implementations, the ACR fingerprint server 105 may include fingerprints 128a for different ACR systems 124 and 126 including different types of fingerprint technology, such as different fingerprint algorithms, for example. -n) can be formatted. ACR systems 124 and 126 may establish communication connections with different media devices 115, including client devices 118 and 120, respectively. The client devices 118 and 120 may transmit fingerprint information to the ACR systems 124 and 126, respectively. When the ACR system 124 or 126 receives ACR fingerprint information from the client devices 118 and/or 120, the ACR system 124 or 126 uses the received fingerprints 128a-n to ACR fingerprint. When the contents are matched with those generated by the server 105 and the contents are identified by matching, ACR events may be transmitted to the content manager 122.

In another example, the ACR systems 124 and 126 receive ACR fingerprint information from the client devices 118 and 120, and the received fingerprints 128a-n by the ACR fingerprint server 105 Match the generated ones. When a match is made and content is identified, the ACR systems 124 and/or 126 may notify the client device 118 or 120 of ACR events, and the client device 118 or 120 may then report these ACR events to the content manager. Can be sent to (122). Alternatively or additionally, ACR systems 124 and/or 126 transmit ACR events directly to content manager 122. The ACR fingerprint information includes displaying advertisements in the local content feed 103 to the viewer, displaying content selected or flagged in the local content feed 103 to the viewer, and a content channel in the client device 118 or 120 Changes may be included.

Event information from different ACR systems 124 and 126 may be generated in different formats, and the content manager 122 records the data in the ACR information database 123 (e.g., for convenience of description, the database ( 123)), you can normalize the data to a common format. For example, the content manager 122 may receive individual data sets containing similar but not identical data, such as data having the same content but formatted differently from the ACR systems 124 and 126. Content manager 122 may process and reformatting individual data sets to create a single data model or format (e.g., reformatted data sets), and the reformatted data sets Can be populated in the database 123 at. Event information from the ACR systems stored in the database 123 may further include ACR data recorded from information that records user viewing behavior, interests, and specific viewing history of a specific media program.

In some implementations, to normalize individual data sets from ACR systems 124 and 126, content manager 122 can clean or filter data within the data sets. For example, some data sets may include fields or data that are not related to the content manager 122. In this example, content manager 122 cleans or filters irrelevant data (eg, data can be removed or ignored). In another example, some data sets contain incomplete or inaccurate data or instances of the data set, and content manager 122 cleans or filters such incomplete or inaccurate data or data sets. In other implementations, to normalize individual data sets from ACR systems 124 and 126, content manager 122 maps the fields of the data sets. For example, when the content manager 122 receives a first data set from the ACR system 124 and a second data set from the ACR system 126, among the data fields of the first data set and the second data set At least some may be common to both the first and second data sets. However, these common data fields may be located in different places of the first and second data sets. In this example, the content manager 122 maps different data fields of the first and second data sets to normalized fields, and has the same data fields at the same data field locations in the database 123.

In another example, to normalize individual data sets from ACR systems 124 and 126, content manager 122 obtains data from the data sets. For example, data from ACR systems 124 and/or 126 may not include all of the fields required to populate the data fields of the database. However, content manager 122 may use other fields of data sets from ACR systems 124 and 126 to obtain data for these data fields.

In some examples, the database 123 includes data fields such as a country field, a designed market area (DMA), and a county and/or city field, but the data sets from ACR systems 124 and 126 have a zone improvement (ZIP). plan) codes may be included. In this example, the content manager 122 uses ZIP codes to obtain data for fields in the database. In another example, the data set does not include geographic location information, but includes the Internet Protocol (IP) address of ACR systems 124 and 126. In this example, the content manager 122 obtains state, DMA, county, city, and ZIP code information using a geo-IP lookup service.

In another example, the database 123 includes statistical fields such as an age field, a gender field, a household income field, and the like. However, data sets from ACR systems 124 and 126 may not include statistical fields or statistical data. In this example, ACR systems 124 and 126 provide the IP addresses of client devices 118 and 120 to content manager 122. The content manager 122 may use IP addresses to determine statistical data to populate data fields of the database.

In another example, a field in a first data set from ACR system 124 includes a local time zone, such as a Mountain Daylight Time (MDT) zone, and a second data set from ACR system 126 May include information from another time zone such as a UTC (Coordinated Universal Time) zone. The database may store all data using UTC, and the content manager 122 may convert the local time to UTC before storing the data in the database 123.

In some implementations, the content manager 122 uses the normalized data to generate reports or data (viewing data) regarding user viewing behavior through different ACR technology vendors and smart TVs or other internet-connected video devices. . Content manager 122 and media devices 115 may include communication interfaces for communicating information, such as overlay content 212 and recorded ACR data, between media content 115 and content manager 122. I can.

In some examples, the communication interface communicates information using a cellular network and/or a wireless network. In one example, the communications network is a 3rd Generation Partnership Project (3 GPP) Release 8, 9, 10, 11 or 12, long term evolution (LTE) or Institute of Electronics and Electrical Engineers (IEEE) 802.16p, 802.16n, 802.16m. -It is a cellular network that can be 2011, 802.16h-2010, 802.16j-2009, 802.16-2009 In another example, the communication network is a wireless network (e.g., a wireless network that can conform to the IEEE® standard (e.g., IEEE 802.11-2012, IEEE 802.1 lac, or IEEE 802.1 lad standard) developed by the Institute of Electrical and Electronics Engineers, Inc. , A network using Wi-Fi® technology developed by the Wi-Fi Alliance). In another example, the communication network is a Bluetooth® connection developed by the Bluetooth Special Interest Group (SIG) such as Bluetooth v1.0, Bluetooth v2.0, Bluetooth v3.0 or Bluetooth v4.0. In another embodiment, the communication network is Zigbee® developed by ZigBee Alliance such as IEEE 802.15.4-2003 (Zigbee 2003), IEEE 802.15.4-2006 (Zigbee 2006), IEEE 802.15.4-2007 (Zigbee Pro). It can be a connection.

In some implementations, content manager 122 also allows media devices 115 to replace portions of local content feed 103 received from OTA broadcaster 108 or MVPD 110 with overlay content 212. Instruct. Also, in some examples, the content manager 122 instructs the media devices 115 to overlay or superimpose the overlay content 212 over portions of the local content feed 103. The content manager 122 may collect ACR information across a plurality of ACR systems 124 and 126 and transmit the overlay content 212 to different client devices 118 and 120, where the client devices 118 And 120) may be from different device manufacturers.

Content manager 122 may also establish communication connections with other devices 116 that are generally classified as media device 115. In some examples, the other device 116 communicates with the client devices 118 or 120 to provide an additional screen (eg, a second screen) for displaying the overlay content 212. For example, the client devices 118 and 120 receive the local content feed 103 from the OTA broadcaster 108 or the MVPD 110 and display the local content feed 103 to the user. Other devices 116 may also transmit ACR event information to ACR systems 124 and 126 when an ACR event occurs, as discussed in the previous paragraphs. When the content manager 122 receives the ACR event information, the content manager 122 may transmit the overlay content 212 to other devices 116.

In some implementations, the client devices 118 and 120 continue to display the local content feed 103 and the other devices 116 display the overlay content 212. In another example, both client devices 118 and 120 and other devices 116 display overlay content 212. In another example, client devices 118 and 120 and other devices 116 display a portion of the overlay content 212 and a portion of the local content feed 103. Client devices 118 and 120 and other devices 116 may display different local content feed 103 and/or overlay content 212.

The client devices 118 and 120 and/or other devices 116 may display the overlay content 212 at the time the overlay content 212 is received. In some examples, client devices 118 and 120 and/or other devices 116 delay the display of overlay content 212 for a threshold time. The threshold time may be a predefined period of time, or the time at which the content manager 122 causes the client devices 118 and 120 and/or other devices 116 to delay the display of the overlay content 212. You can also choose.

2 illustrates a content manager 222 for providing overlay content 212 to a media device 115 such as client devices 218 and/or 220 in accordance with some implementations. The content provider 202 (e.g., a television broadcaster) may stream media content M to the media device 115 via the network 219, which streams the media content M's media device. It may be intercepted by content manager 222 prior to or concurrently with streaming to 115. The content manager 222 also communicates with the ad server (or “ad” server) 230 to send, for example, an ad call to the ad server 230, so that the subject of media content M as will be described in more detail And/or request an advertisement provided with (or as an overlay on) media content (M) for targeting the user's interests. The advertisement server 230 provides advertisements or other overlay content 212 to the content manager 222 for later delivery to the media devices 115 or provides the content to the media device for delivery as an overlay 212 or alternative advertisements. It may be a third party or an external server that can be provided directly to (115).

The content manager 222 may include an ACR engine 204, a lookup server 206, an overlay determination engine 210, an overlay database 211 storing the overlay content 212, and an advertisement targeter 214. . The content provider 202 may upload media content (M) to the ACR engine 204 through the network 219.

The ACR engine 204 may fingerprint the media content (M). In some examples, the ACR engine 204 generates fingerprints 208a-n by fingerprinting every frame in the feed, every other frame in the feed, a sequence of frames, and so on. For example, the ACR engine 204 performs discrete cosine transform (DCT) of the frame and designates a subset of the resulting coefficients (e.g., low frequency coefficients) as the fingerprint 208 for the frame of the feed. A fingerprint 208 is created. Additionally or alternatively, the ACR engine 204 may generate (or identify) a target block of fingerprints 208a-n corresponding to an ordered sequence of frames of content streamed to the media device 115. In addition, the lookup server 206 may find a matching source block of frame fingerprints 208a-n stored in the fingerprint database 207 for outgoing media programs (eg, outgoing content) with known identities. have.

In another or related implementation, the ACR engine 204 also determines which event has occurred (e.g., frame sequence query fingerprint 208a and frame fingerprints of the original content stored in the ACR system 124 or 126). Analyze the ACR event information for positive matching between (208a-n). If there is a positive match, the ACR engine 204 transmits a positive matching indicator including a media content identifier (ID) identifying the content in which the positive match occurs to the requesting media device 115. The media device 115 may transmit an overlay request requesting the media content overlay 212 to the overlay determination engine 210. In some examples, the overlay request includes a media content ID. In other examples, the overlay request includes overlay information or overlay parameters.

With further reference to FIG. 2, the ACR engine 204 queries the television program (e.g., scheduled for an identified channel) and a location within the television program corresponding to the ACR event received from the ACR system 124 or 126. And, the fingerprints 208a-n that can be determined may be transmitted to the lookup server 206. Each fingerprint 208 of a segment of the feed may be associated with a time stamp. The time stamp belongs to individual frames of a segment of the feed when received by the ACR engine 204. The time stamp can be the frame number in the feed from any starting point. The lookup server 206 stores the fingerprints 208a-n in association with each of the time stamps (e.g., in the fingerprint database 207), and the media content (M) of the feed that the user is viewing. ) Assists the advertisement targeter 214 and the overlay determination engine 210 in timing and content targeting.

In some implementations, the ACR engine 204 interacts with the ACR client 215 on various media devices 115. The ACR client 215 is locally matched with the fingerprints 208a-n to check whether the user has changed the channel to watch another television program, and report the channel change to the content manager 222. I can. Thus, matching of fingerprints 208a-n may occur locally at media device 115 in some cases.

In addition, the ACR client 215 includes a user fingerprint, for example in the form of query fingerprints 208a, including target blocks, requesting confirmation of the television program or channel being watched on the media device 115 The information may be transmitted to the lookup server 206 periodically, continuously or semi-continuously. The lookup server 206 may determine when there is a match between the query fingerprint(s) 208a (or target blocks) and the plurality of frame fingerprints 208a-n, which ) May be stored as source blocks of the fingerprint 208a-n across the network 219 from the lookup server in. The query fingerprint 208a may be an ordered sequence of frames, each of which is an individual Can be matched with things. If there is a positive match, the lookup server 206 transmits a positive matching indicator to the ACR client 215. In response to the positive matching indicator, the ACR client 215 sends an overlay 212 request to the overlay determination engine 210 requesting the media content overlay 212.

In some examples, the overlay request includes a media content identifier (ID). In further examples, the overlay request includes overlay information or overlay parameters. For example, the overlay determination engine 210 identifies the targeted overlay content 212 using the content ID, overlay information, and/or overlay parameters. In another example, the overlay determination engine 210 may use the content ID, overlay information, and/or overlay parameters to identify the overlay format. The overlay determination engine 210 may compare the content ID, overlay information, and/or overlay parameters with the overlay database 211 to identify the targeted overlay content 212 and the overlay format. The overlay database may be updated periodically or continuously with new overlay content 212 and overlay format by a content provider or advisor (eg, ad server 230). The overlay content 212 populates an overlay format (eg, an overlay template, etc.) before or after being delivered to the overlay location of the streamed media content M of the channel's television program.

The advertisement targeter 214 tracks and analyzes advertisements delivered to the media devices 115 by the overlay determination engine and user interactions with and behaviors with other overlay content 212. The advertisement targeter 214 may also receive and integrate user profile information with analysis of user behavior for each media device to determine primary interests for the user. This information and data collected by a user or group of users can be extended to preferred viewing times and general viewing habits in relation to television programs and commonly viewed channels and times. The ad targeter 214 then tells the overlay decision engine 210, for example in the form of parameters, that the overlay decision engine 210 does the best for each user for the maximum return on investment of the format and campaign budget When deciding which overlay content 212 to deliver when it's done, it can notify you of a variety of main interests and viewing habits that can be used.

When the overlay determination engine 210 identifies the targeted overlay content 212 with the aid of the advertisement targeter 214, the overlay determination engine returns the targeted overlay content 212 to the media device 115. In some examples, the overlay determination engine 210 transmits the targeted overlay content 212 directly to the media device 115, for example via a wireless communication network. In other examples, the overlay determination engine 210 transmits the targeted overlay content 212 to the media device 115 through a universal resource locator (URL). When the plurality of targeted overlay contents 212 match the content ID, overlay information and/or overlay parameters, the overlay determination engine 210 generates a targeted content overlay that satisfies the largest number of parameters or other information. Choose. Additionally or alternatively, when the plurality of targeted overlay contents 212 match the content ID, overlay information, and other overlay parameters, the overlay determination engine 210 satisfies the parameters and other information. 212) is selected at random. In other examples, when the plurality of targeted overlay contents 212 match the content ID, overlay information, and overlay parameters, the overlay determination engine 210 matches the content ID, overlay information, and/or overlay parameters. Select a predetermined overlay content 212. The overlay content 212 may be populated with dynamic content (eg, content that can be updated or refreshed at periodic intervals). Dynamic content can be stored in a local database or an external system.

The ACR client 215 of the media device 115 may overlap the overlay content 212 on the content feed 103 when the ACR fingerprint information matches the user fingerprint information. In one example, the media device 115 overlays the overlay content 212 over the content feed 103 in a hypertext markup language (HTML) browser. In another example, media device 115 overlays overlay content 212 over content feed 103 from an OTA broadcaster or cable broadcaster. When the overlay content 212 is placed on the content feed 103, the overlay content 212 may be displayed to the user through the display of the media device 115. In one example, overlay content 212 includes one or more call-to-action options that can be displayed to a user. In this example, the user interacts with the overlay content 212 using an input device (eg, a TV remote control, keyboard, smart phone, or tablet) to generate feedback information. The ACR client 215 may transmit the feedback information to the advertisement targeter 214. Another individual, such as an adviser, may access the feedback information and analyze the feedback information to determine desired information, such as user interest in overlay content 212.

The ACR client 215 may monitor the content feed 103 to determine when the overlay content 212 and the content feed 103 matching stops and/or the threshold time expires. In one example, when the overlay content 212 and content feed 103 matching stops or the threshold time expires, the media device stops superimposing the overlay content 212 for display on the media device 115.

3 is a system diagram of an exemplary ACR content manager 322, such as the content managers 122 and 222 shown in FIGS. It is used to control. The content manager 322 may include an ACR engine 204, a lookup server 206, a recorded ACR information database 123, and a channel schedule database 330. The ACR engine 204 receives content frames 302 of media content (M) to be fingerprinted. The ACR engine 204 may also include a fingerprinter 305, a fingerprint sequence matcher 325, and a database 327 in which frame fingerprints 306a-n are stored. Content provider 202 generates multimedia content M that is streamed to media devices 115, including client devices 218 and/or 220 (FIG. 2).

The content manager 322 may be implemented as a computing device such as a server, or a distributed group of computing devices, and includes a lookup server 206. In alternative implementations, the content manager 322 and the lookup server 206 are combined into a single server device.

In some implementations, the fingerprinter 305 detects or selects a number of content frames 302 from the multimedia content M as the fingerprint 306. In one embodiment, multiple content frames 302 are ordered sequentially (eg, as a target block), thus including a sequential time stamp from start to end of fingerprint 306. In one example, the content is audio data, video data, or both. In this example, the video content is raw video frames.

For example, when the fingerprinter 305 receives the content frames 302, the fingerprinter 305 processes the content frames 302 such as raw video and/or audio frames to perform the fingerprint 306 Decide how to generate ). In one example, the frames are individually fingerprinted. In another example, frames are fingerprinted as collections or sequences. The fingerprinter 305 may determine when to fingerprint frames individually or sequentially based on the ACR algorithm that the fingerprinter 305 executes while fingerprinting, examples of which will be discussed. Also, the fingerprinter 305 may fingerprint the content frames 302 differently for different broadcasters or users. In this example, fingerprinter 305 includes different ACR fingerprinting algorithms for different ACR vendors. In one example, different ACR fingerprinting algorithms are predetermined and stored in the memory of the ACR engine 204.

In another example, different ACR fingerprinting algorithms are provided by third party ACR vendors. If different ACR fingerprinting algorithms are provided by such vendors, the fingerprinter 305 incorporates different ACR fingerprinting algorithms. In one example, ACR fingerprinting uses RAW video within the YUV 4:2:2 color space and at high resolution or other levels of resolution. When the video content is received from the local provider 106 or other content provider 202, the fingerprinter 305 converts the video content to YUV 4:2:0 color space and transmits it to the media device 115. The resolution is scaled down to the threshold resolution level for encoding by the broadcaster or distributor before it becomes available.

In some implementations, the fingerprinter 305 includes or communicates with the fingerprint sequence matcher 325. As described in more detail below, the fingerprint sequence matcher 325 converts a sequence of fingerprints 306a-n to the original video content from which a predetermined set of individual frame fingerprints 306a-n are generated. Match it.

When the fingerprinter 305 fingerprints the content frames 302, the fingerprinter 305 stores the fingerprints 306a-n (including channel information, time code, and fingerprint information) in an overlay database ( 211) and/or the lookup server 206. The lookup server 206 retrieves the fingerprints 306a-n and related information from the overlay database 211. The lookup server 206 is also in communication or connection with the overlay determination engine 210 and ad targeter 214 to transmit the overlay 212 and topic matching information to the overlay determination engine 210 and ad targeter 214. The advertisement targeter 214 is used to target users on the client device 218 or 220 according to the context.

In some examples, different ACR fingerprinting algorithms are used in the same content to provide different fingerprint information to lookup servers of different ACR vendors. An advantage of fingerprinting the same content (eg, content frames) 302 differently may be to provide contextually-relevant advertising and interactive content to different viewers of media consuming devices. In further examples, the content frames 302 include media content (M) from different feeds. In this example, different ACR fingerprinting algorithms are used for the content of different feeds of content frames 302 to provide different fingerprinting information to lookup servers of different ACR vendors.

Different fingerprinting information can be uploaded to lookup servers of different ACR vendors, respectively. Different ACR vendors can be integrated into viewing devices manufactured by different contract equipment manufacturers (CEMs). For example, Toshiba TV can use Samba® ACR fingerprinting and Samsung® TV can use Enswer® ACR fingerprinting. An advantage of the fingerprinter 305, which includes ACR fingerprinting algorithms for different ACR vendors, is that it can fingerprint content provided to viewers through different ACR vendors regardless of the manufacturer of the media consuming device. In one example, ACR fingerprinting information is used for digital advertisement replacement (DAR). In another example, ACR fingerprinting information is used for advertisement or content augmentation and data collection. The overlay determination engine 210 and advertisement targeter 214 (FIG. 2) may use the fingerprinting information to match the encoded content with contextually related advertisements, information, and/or interactive content. Matched content and/or advertisements may be provided to media devices 115 to stream a display thereon. In another example, information about the matching event is transmitted to the broadcast cloud for analysis of content matching.

The fingerprinter 305 may perform upstream ACR fingerprinting of broadcast distribution in the system. For example, fingerprinting takes place in a broadcast chain in which broadcast feeds can be sent for encoding/uploading. When a single broadcast feed is used, the number of devices and/or applications that must be purchased, installed, monitored and maintained for ACR fingerprinting and encoding/uploading may be reduced. Capital costs (CAPEX) and/or operating costs (OPEX) can be reduced, for example, reduction in system infrastructure (rack space, power and Ethernet connectivity). Also, when a single broadcast feed is used, the number of broadcast feeds generated from the broadcaster's distribution amplifier can be reduced.

As discussed, the fingerprinter 305 can generate individual fingerprints 306a-n from the multimedia content M, e.g. in a path displayed on one of the media devices 115. , Broadcast server, head end, switch and/or set-top box. The fingerprints 306a-n may include one frame or multiple frames. These frames may be taken sequentially with chronological time stamps, or may be taken at regular intervals, such as every other one (or every third frame), for example with still corresponding time stamps.

The fingerprint sequence matcher 325 matches the frames to frame fingerprints 306a-n (stored in the database 327) of the original video content from which the corresponding video frames represented by these fingerprints originate. In order to be able to process a set or sequence of these individual frames (as a query fingerprint). The frame fingerprints 306a-n may be a single frame, each of which includes a corresponding time slot (or some kind of index, such as a frame number or an amount of time from the start of a media program). If a match is found, the media program, channel or channel change that the user is watching on the media device 115, time slot of the schedule according to the start and end time of the program, commercial time slot, and information of the matching media program or television channel And so on.

In order to have confidence in the matching result, the fingerprint sequence matcher 325 can take advantage of the fact that the sequence of the fingerprints 306a-n is arranged in chronological order, and thus the matching fingerprints 306a-n Not only belong to the same video, but are also similar in chronological order. The fingerprint sequence matcher 325 may also use these temporal properties of the frame sequence in the fingerprint to detect how (fast, slow or reverse) the matching fingerprint sequence is played back. The algorithm of the ACR fingerprint sequence matcher 325 can be used for specific playback scenarios such as, for example, a normal rate at a full frame rate, a normal rate at a 1/2 frame rate, and a normal rate at 1/3 frame rate. It can be implemented to detect.

In some examples, the lookup server 206 is in response to the fingerprinter 305 finding one or more matching frame fingerprints 306a-n in the database 327, the channel streamed to the media device 115. To identify. The lookup server 206 may then search the channel schedule database 330 for current scheduling information for the corresponding channel, and accordingly, determine a media program to be streamed. The content manager 322 may record the viewer's viewing history of a program on the media device 115 in the recorded ACR information database 123. When the viewer turns off the media device 115, changes the channel, or stops streaming to the media device before the media program ends, the content manager 322 stores the recorded ACR information database 123, The source of the media program (eg, from a specific broadcaster or broadcaster device) and the location of the media program at which the media program was stopped may be recorded.

In further implementations, when the media device 115 returns to the channel where the media program was previously interrupted, the media device 115 sends one or more messages about it to the content manager 322. The content manager 322 may check the viewing history of the media device in the recorded ACR information database 123 and then determine that the media program has been previously stopped. In addition, the content manager 322 may communicate in a response message to the media device 115 that the media program has previously been interrupted, and provide the source of the television broadcast and the location within the media program where it was interrupted. In some examples, the media device 115 may be accompanied by a prompt such as “Would you like to resume viewing this media program?” and a selectable indicator 213 that allows the viewer to agree or decline (e.g., via a remote control operation). The overlay 212 is delivered to the display of the media device. If the viewer responds negatively, the media device 115 may remove the overlay 212. If the viewer responds positively, the media device 115 can start streaming the media program from the source at the recorded location for the point in the media program where it was stopped.

In some implementations, content manager 322 (or generally ACR system 124 or 126) delivers overlay 212 to the display of media device 115. The overlay 212 may provide selectable options (or indicators) to provide control options related to a control operation such as play, pause, fast forward or rewind of the live media feed. In an alternative implementation, a remote controller for a media device (such as a TV) includes inputs that provide these same (or similar) control options upon selection. Upon receiving an option selection on the overlay 212 (or a corresponding input on the remote controller), the media device 115 provides a selection signal to the ACR client 215 indicative of the selection of the control option. This selection can be, for example, an input to play, pause, fast forward or rewind a live media feed. The ACR client 215 may perform a control operation on a media program streamed from a live media feed corresponding to the selected input or option.

When the location of the streaming is changed or paused, the ACR client is prompted to select one of the options of the overlay 212 (or remote controller) (via access to the ACR data of the media device stored in the database 123). When streaming resumes, the media program can indicate where to start playing. The ACR client 215 may store or buffer this location for use when starting to stream a media program, for example upon receipt of a selection signal indicating a user's playback selection. As the ACR client tracks the automatic content recognition data, the ACR client 215 can track the location where the user of the media device has moved into the live media stream. In some cases, the live media stream is an ACR server, ACR client, or ACR server and ACR client to facilitate movement of a live media feed streamed to the media device to a location indicated by user manipulation of control options. Is buffered for a period of time in a combination of

In various implementations, ACR client 215 makes control options available at overlay 212 or from input of a remote controller. Regarding overlay injection further, if the pause option is selected, other options (pause, RWD and FF buttons) may be displayed for selection. The currently selected option can be grayed out, or it can be highlighted that the option is currently running as a control task.

In some implementations, the content manager 322 is the overlay decision engine 210 for delivery of the overlay 212 targeting interaction with the lookup server 206 and for access to the recorded ACR information database 123. ) And the overlay database 211 (Fig. 2). Resumption of streaming (e.g., from pause, end, rewind or fast forward) can be done from the television broadcaster, or from the rest of the buffered versions of the media program stored in the content manager 322 Hypertext Transfer Protocol (HTTP) live streaming. (HLS) It may be to start playing the stream.

4 depicts an exemplary flow diagram of an automatic content recognition (ACR) method 400 that matches a sequence of frames in an input (or query) fingerprint 306a to identify a corresponding television program. Method 400 may include data processing hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (e.g., instructions executed by a processing device), firmware, or a combination thereof. May be performed at least in part by processing logic that may Method 400 may be performed by processing the logic of content manager 322, which may include a separate lookup server 206. Method 400 is also performed, in part, by a client device, such as client device 218 or 220, or a server system, such as ACR system 124 or 126 of FIG. 1 or ACR system 224 or 226 of FIG. Can be. Alternatively, the method may be performed by various types of user devices, portable devices, televisions, projectors, or other processing devices within other media devices.

Referring to FIG. 4, the method 400 may begin with processing logic for receiving media content M from a content feed 103 at a content (or media) device 410. The method 400 continues with logic to perform fingerprinting on the media content M, followed by an input (or query) fingerprint 306a including a sequence of frames and a corresponding time-based index (e.g., a corresponding time stamp). Generate (420). The method 400 continues with logic to match a plurality of frame fingerprints 306a-n from the original media content M and a query fingerprint 306a according to the time-based index, streaming the current media program. Identifying the active channel (430). Method 400 may continue with processing logic that identifies the media program from scheduling data for the channel.

5 shows an exemplary flow diagram of ACR's method 500 that detects interruption of a media program and provides an option to continue viewing the media program when the media program returns to a previously streamed channel. Method 500 may include data processing hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (e.g., instructions executed by a processing device), firmware, or a combination thereof. It can be done at least in part by processing the logic that can be. Method 500 may be performed by processing the logic of content manager 322, which may include a separate lookup server 206. Method 500 is also in part by a client device, such as client device 218 or 220, or by a server system such as ACR system 124 or 126 of FIG. 1 or ACR system 224 or 226 of FIG. Can be done. Alternatively, method 500 may be performed by various types of user devices, portable devices, televisions, projectors, or other processing devices within other media devices.

Referring to FIG. 5, the method 500 may begin with processing logic detecting a change or other termination of a channel for viewing a media program (510). The method 500 continues 520 with processing logic that records the channel, location and source of the media program at the end of viewing in the recorded ACR data, for example in the recorded ACR information database 123. Method 500 continues 530 with processing logic to detect that the media device has returned to the channel for viewing. This detection may be performed by receiving a message from a media device with an indication of a channel change or an indication that the media device has turned on that particular channel. The method 500 continues 540 with processing logic that further determines whether the interrupted media program is located in the recorded ACR information database 123. If the result is negative, the method 500 may begin again at block 510.

If the interrupted media program is located in the database 123 (determined at block 540), the method 500 continues (550) with processing logic that transmits the identity of the media program to the media device. The method 500 continues 560 with processing logic that causes the media device to display an overlay requesting whether the user wishes to resume viewing the media program. Method 500 continues 570 with processing logic that receives input through the media device and determines whether to resume viewing the media program. If no input is received (or if a negative response is received), method 500 may continue with processing logic to remove overlay 212 and proceed with alternative instructions from media device 580. If an affirmative response is received, the method 500 may continue with processing logic to start playing an HTTP live stream (HLS) or other type of television broadcast stream of the media program from the location where the media program previously ended ( 590). The media program may be streamed from the original television broadcaster or may be streamed from a buffered version of the media program stored in the content manager 322 or other ACR system.

6 shows ACR's method 600 of providing options on a media device to control the timing of streaming a live media feed (e.g., via a playback control option having a playback mode such as fast forward, rewind, pause, etc.) ) Is an exemplary flow chart. Method 600 may include hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (e.g., instructions executed by a processing device), firmware, or a combination thereof. It can be performed at least in part by processing logic. Method 600 may be performed by processing the logic of content manager 322, which may include a separate lookup server 206. The method 600 may also be by a client device, such as an ACR client 215 on the client device 218 or 220, or in part by the ACR system 124 or 126 of FIG. 1 or the ACR system 224 or 226 of FIG. 2. ). Alternatively, method 600 is performed by various types of user devices, portable devices, televisions, projectors, or other processing devices within other media devices.

6, method 600 begins with processing logic to display an overlay 212 on a media device 115 streaming a live media feed, where the overlay 212 includes control options (e.g., , Indicator, input, button, etc.) (610). Alternatively, method 600 begins 615 with processing logic that activates inputs on a remote controller of media device 115 to provide control options. Each control option may be configured to control the timing of streaming the live media feed (e.g., via playback mode) and may not be related to the source of the live media feed (e.g. Not the controller of the cable provider that connects to the set-top box). In various implementations, the options may include inputs or instructions for various playback modes to play, pause, rewind (RWD) or fast forward (FF) a media program streamed within a live media feed. Other actions may be envisioned, such as jumping to a specific section, chapter, or episode of the media program. The media program may be determined as described with reference to FIG. 4.

With further reference to FIG. 6, method 600 continues with processing logic to detect selection of control option 620. The method 600 continues 630 with processing logic that uses the ACR data to determine (and store) the location of the media program upon detection, eg, where the media program was paused (630). Method 600 continues 640 with processing logic that executes a control operation associated with the selected control option to control the timing of streaming the media program, e.g., to pause, play, fast forward or rewind (640). . If the action is, for example, to fast forward, rewind, or jump to another section, method 600 tracks the location within the media program (or the destination of the jump action) where the user stops rewinding or fast forward in the media program and Continue with processing logic to determine (645). The method 600 continues 650 with processing logic that detects the selection of the playback option 650. The method 600 continues 660 with processing logic to start playback of the media program from the stored location or from the location where the user stopped rewinding or fast forwarding the media program.

7 depicts an exemplary schematic diagram of a machine in an exemplary form of a computer system 700 on which a set of instructions may be executed that causes the machine to perform one or more of the methods discussed herein. In alternative implementations, the machine is connected (eg, connected to a network) to a LAN, intranet, extranet, or other machines on the Internet. The machine may operate as a server or client device in a client-server network environment, or as a peer machine in a peer-to-peer (or distributed) network environment. Machines specify personal computers (PCs), tablet PCs, set-top boxes (STBs), personal digital assistants (PDAs), mobile phones, smart phones, web devices, servers, network routers, switches or bridges, or actions to be performed by the machine. It may be a machine capable of executing a set of instructions (sequential or otherwise). Further, although only a single machine is shown, the term "machine" also refers to any machines that individually or jointly execute a set of instructions (or multiple sets) to perform one or more methods discussed herein. It should be considered to contain a set.

The computer system 700 may be the ACR system 124 or 126 of FIG. 1, the ACR system 224 or 226 of FIGS. 2 and 3, or the content manager 122 of FIG. 1, the content manager 222 of FIG. 2, or It may correspond to the content manager 322 of FIG. 3. Computer system 700 may correspond to any media device 115 such as client device 118 or 120 of FIG. 1. Computer system 700 may correspond to at least a portion of a cloud-based computer system.

The computer system 700 includes a processing unit 702, a main memory 704 (e.g., read-only memory (ROM), a flash memory, dynamic random access memory (DRAM)) (e.g., synchronous DRAM (SDRAM)), or DRAM (RDRAM), etc.), static memory 706 (eg, flash memory, static random access memory (SRAM), etc.), and a data storage device 718 in communication with each other via a bus 730.

The processing unit 702 represents one or more general purpose processing units, such as a microprocessor, a central processing unit, or the like. More specifically, the processing unit is a complex instruction set computing (CISC) microprocessor, a reduced instruction set computer (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, or a processor implementing another instruction set, or It may be a processor that implements a combination. The processing unit 702 may also be one or more special purpose processing units such as an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), a network processor, and the like. In some implementations, processing device 702 includes one or more processing cores. The processing device 702 may execute instructions 726 of mirroring logic to perform the operations discussed herein.

Computer system 700 may further include a network interface device 708 communicatively coupled to network 720. The computer system 700 also includes a video display unit 710 (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)), an alphanumeric input device 712 (e.g., a keyboard), a cursor control device ( 714) (eg, a mouse), a signal generating device 716 (eg, a speaker), or other peripheral devices. Further, the computer system 700 may include a graphics processing unit 722, a video processing unit 728 and an audio processing unit 732. In some implementations, computer system 700 is a chipset (not shown) that refers to a group of integrated circuits or chips designed to operate with processing device 702 and control communication between processing device 702 and external devices. Not included). For example, the chipset connects the processing unit 702 to a high-speed device such as main memory 704 and a graphics controller, and the processing unit 702 to a low-speed peripheral bus of a peripheral device such as a USB, PCI, or ISA bus. Is a set of chips on the motherboard.

The data storage device 718 can include a computer-readable storage medium 725 storing instructions 726 that implement one or more of the methods of functions described herein. Instructions 726 may also reside completely or at least partially within main memory 704 and/or processing unit 702 while being executed by computer system 700; Main memory 704 and processing unit 702 also constitute a computer-readable storage medium.

Computer-readable storage medium 725 may also be used to store instructions 726 using logic and/or software libraries, including logic and/or how to invoke the application. Although computer-readable storage medium 725 is shown to be a single medium in an exemplary implementation, the term "computer-readable storage medium" refers to a single medium or multiple media (e.g., central or Distributed databases, and/or associated caches and servers). The term "computer-readable storage medium" also includes any medium capable of storing, encoding or carrying a set of instructions 726 executed by a machine and causing the machine to perform one or more of the methods of the present invention. Is considered to be. The term "computer-readable storage medium" thus includes, but is not limited to, solid-state memory, optical media, and magnetic media. The following example relates to additional implementations.

While the present invention has been described with respect to a limited number of implementations, those skilled in the art will recognize numerous modifications and variations therefrom. It is intended that the appended claims cover all such modifications and variations that fall within the true spirit and scope of the present invention.

In the description herein, in order to provide a thorough understanding of the present invention, specific types of processors and system configurations, specific hardware structures, specific architecture and microarchitecture details, specific register configurations, specific instruction types, specific A number of specific details have been described, such as examples of system components, specific measurements/heights, specific processor pipeline stages and operations, and the like. However, it will be apparent to one of ordinary skill in the art that these specific details need not be used to practice the present invention. In other instances, in order to avoid unnecessarily obscuring the present invention, specific and alternative processor architectures, specific logic circuits/code for the described algorithms, specific firmware code, specific interconnect operation, specific logic configuration. Specific manufacturing techniques and materials, specific compiler implementations, specific representations of algorithms in code, specific power down and gating techniques/logic and other specific operating details of the computer system have not been described in detail.

Embodiments are described with reference to secure memory repartitioning in certain integrated circuits, such as in computing platforms or microprocessors. Embodiments may also be applicable to other types of integrated circuits and programmable logic devices. For example, the disclosed embodiments are not limited to desktop computer systems or portable computers, such as Intel® Ultrabooks™ computers. And it can also be used in other devices, such as handheld devices, tablets, other thin notebooks, systems on a chip (SOC) devices, and embedded applications. Some examples of handheld devices include cellular phones, internet protocol devices, digital cameras, personal digital assistants (PDAs), and handheld PCs. Embedded applications typically include microcontrollers, digital signal processors (DSPs), system on a chip (SOC), network computers (NetPC), set-top boxes, network hubs, wide area network (WAN) switches, or hereinafter. And any other system capable of performing the taught functions and operations. It is described that the system can be any kind of computer or embedded system. The disclosed embodiments are particularly low-cost devices, such as wearable devices (e.g., watches), electronic implants, sensory and control infrastructure devices, controllers, supervisory control and data acquisition (SCADA) systems, and the like. Can be used for fields. Moreover, the apparatuses, methods, and systems described herein are not limited to physical computing devices, but may also relate to software optimizations for energy conservation and efficiency. As will soon become apparent from the following description, embodiments of the methods, devices, and systems described herein (with reference to any of hardware, firmware, software, or combinations thereof) are subject to performance considerations. It is important for a'green technology' future that balances with.

Although embodiments are described herein with reference to a processor, other embodiments are applicable to other types of integrated circuits and logic devices. Similar techniques and teachings of embodiments of the present invention may be applied to other types of circuits or semiconductor devices that may benefit from higher pipeline throughput and improved performance. The teachings of embodiments of the present invention are applicable to any processor or machine that performs data manipulations. However, the present invention is not limited to processors or machines that perform 512-bit, 256-bit, 128-bit, 64-bit, 32-bit, or 16-bit data operations, and any processor on which manipulation or management of data is performed, and It can be applied to the machine. In addition, the description herein provides examples, and the accompanying drawings show various examples for purposes of illustration. However, since these examples are only intended to provide examples of embodiments of the present invention rather than to provide an exhaustive list of all possible implementations of the embodiments of the present invention, these examples are to be interpreted in a limiting sense. It shouldn't be.

Other embodiments are data or instructions stored on a machine-readable, tangible medium that, when executed by a machine, causes the machine to perform functions according to at least one embodiment of the present invention. Can be achieved by In one embodiment, functions associated with embodiments of the present invention are implemented in machine executable instructions. Instructions may be used to cause a general purpose or special purpose processor programmed with instructions to perform the steps of the present invention. Embodiments of the invention may include a machine or computer readable medium storing instructions that can be used to program a computer (or other electronic devices) to perform one or more operations according to embodiments of the invention. It may be provided as a computer program product or software. Alternatively, the operations of embodiments of the present invention may be performed by specific hardware components including fixed function logic to perform the operations, or by any combination of programmed computer components and fixed function hardware components. .

Instructions used to program logic to perform embodiments of the present invention may be stored in memory in the system, such as DRAM, cache, flash memory, or other storage. In addition, the instructions may be distributed over a network or through other computer-readable media. Accordingly, the machine-readable medium includes floppy diskettes, optical disks, compact disc (CD-ROM), and magneto-optical disks, read-only memory (ROM), random access memory (RAM), EPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), magnetic or optical cards, flash memory, or electric, optical, acoustic or other types of radio signals (e.g., carriers, infrared Storing information in a form readable by a machine (e.g., a computer), such as, but not limited to, a tangible machine-readable storage used to transmit information over the Internet via signals, digital signals, etc., or It can include any mechanism for transmitting. Accordingly, computer-readable media includes any type of tangible machine-readable medium suitable for storing or transmitting electronic instructions or information in a form readable by a machine (eg, a computer).

Design can go through a variety of stages, from fabrication through simulation to fabrication. Data representing the design can be represented in a number of ways. First, as useful in simulations, hardware can be represented using a hardware description language or another functional description language. In addition, a circuit level model with logic and/or transistor gates can be created at some stages of the design process. In addition, most designs reach the data level representing the physical placement of various devices in the hardware model. When conventional semiconductor manufacturing techniques are used, the data representing the hardware model may be data specifying the presence or absence of various features on different mask layers for the masks used to produce the integrated circuit. have. In any representation of the design, the data may be stored in any form of machine-readable medium. Magnetic or optical storage, such as a memory or disk, may be a machine-readable medium that stores information transmitted via optical or electrical waves that have been modulated or otherwise generated to transmit such information. When an electrical carrier indicating or containing a code or design is transmitted, a new copy is made as long as copying, buffering, or retransmission of the electrical signal is performed. Thus, a communications provider or network provider may at least temporarily store an article, such as carrier-encoded information, on a tangible machine-readable medium that implements the techniques of embodiments of the present invention.

Module as used herein refers to any combination of hardware, software, and/or firmware. As an example, a module includes hardware, such as a microcontroller, associated with a non-transitory medium storing code configured to be executed by the microcontroller. Thus, reference to a module, in one embodiment, refers to hardware specifically configured to recognize and/or execute code to be held on a non-transitory medium. Furthermore, in another embodiment, the use of a module refers to a non-transitory medium containing code specifically configured to be executed by a microcontroller to perform predetermined operations. And, as can be inferred, in another embodiment, the term module may refer to a combination of a microcontroller and a non-transitory medium (in this example). Often, module boundaries that are illustrated separately are typically different and possibly overlap. For example, the first module and the second module may share hardware, software, firmware, or a combination thereof, perhaps while holding some independent hardware, software, or firmware. In one embodiment, the use of the term logic includes hardware such as transistors, registers, or other hardware such as programmable logic devices.

The use of the phrase'configured to', in one embodiment, refers to arranging, assembling, manufacturing, selling proposals, importing and/or designing a device, hardware, logic, or element to perform a specified or determined task. . In this example, a non-operating device or element thereof, when designed, combined and/or interconnected to perform a specified task, is still'configured' to perform the specified task. As a purely illustrative example, a logic gate may provide 0 or 1 during operation. However, a logic gate'configured' to provide an enable signal to the clock does not include all of the potential logic gates that can provide 1 or 0. Instead, the logic gate is one that is coupled in some way to enable the clock with a 1 or 0 output during operation. Note again that the use of the term'configured to' does not require action and instead focuses on the latent state of the device, hardware, and/or element, where in the latent state The device, hardware, and/or element is designed to perform a specific task when the device, hardware, and/or element is operating.

In addition, the use of the phrases'to','can', and/or'operable to', in one embodiment, means that a device, logic, hardware, and/or element is a device, logic, Refers to that hardware, and/or elements are designed to be used in a specified manner. It should be noted that, as described above, the use of'to','can', and/or "operable to", in one embodiment, the potential of devices, logic, hardware, and/or elements. Refers to a state, where a device, logic, hardware, and/or element is not operating but is designed to enable the device to be used in a specified manner.

Values, as used herein, include any known representation of a number, state, logical state, or binary logical state. Often, the use of logic levels, logical values, or logical values also refers to ones and zeros, which simply represent binary logical states. For example, 1 refers to a high logic level, and 0 refers to a low logic level. In one embodiment, a storage cell, such as a transistor or flash cell, may hold a single logical value or multiple logical values. However, other representations of values in computer systems have been used. For example, the decimal number 10 can also be represented by the binary value 1010 and the hexadecimal character A. Thus, a value includes any representation of information that can be held in a computer system.

Moreover, states can be represented by values or parts of values. As an example, a first value, such as logic 1, may represent a default or initial state, while a second value, such as logic 0, may represent a non-default state. Additionally, the terms reset and set refer to a default and updated value or state, respectively, in one embodiment. For example, the default value maybe contains a high logical value, i.e. reset, while the updated value maybe contains a low logical value, i.e. set. It should be noted that any combination of values may be used to represent any number of states.

Embodiments of the methods, hardware, software, firmware or code described above may be implemented through instructions or code stored on a machine-accessible, machine-readable, computer-accessible, or computer-readable medium executable by a processing element. I can. Non-transitory machine-accessible/readable media includes any mechanism for presenting (ie, storing and/or transmitting) information in a form readable by a machine, such as a computer or electronic system. For example, the non-transitory machine-accessible medium may include random-access memory (RAM) such as static RAM (SRAM) or dynamic RAM (DRAM); ROM; Magnetic or optical storage media; Flash memory devices; Electrical storage devices; Optical storage devices; Acoustic storage devices; Other types of storage devices, etc. for holding information received from transient (propagating) signals (e.g., carriers, infrared signals, digital signals), which must be distinguished from non-transitory media that can receive information therefrom. Includes.

Instructions used to program logic to perform embodiments of the present invention may be stored in memory in the system, such as DRAM, cache, flash memory, or other storage. In addition, the instructions may be distributed over a network or through other computer-readable media. Accordingly, the machine-readable medium includes floppy diskettes, optical disks, compact disc (CD-ROM), and magneto-optical disks, read-only memory (ROM), random access memory (RAM), EPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), magnetic or optical cards, flash memory, or electric, optical, acoustic or other types of radio signals (e.g., carriers, infrared Storing information in a form readable by a machine (e.g., a computer), such as-but not limited to-a tangible machine-readable storage used to transmit information over the Internet via signals, digital signals, etc. Or may include any mechanism for transmitting. Accordingly, computer-readable media includes any type of tangible machine-readable medium suitable for storing or transmitting electronic instructions or information in a form readable by a machine (eg, a computer).

Reference throughout this specification to “some embodiments” or “an embodiment” indicates that a particular feature, structure, or characteristic described in connection with that embodiment is included in at least one embodiment of the present invention. it means. Thus, not all phrases such as "in some embodiments" or "in an embodiment" appearing in various places throughout this specification necessarily all refer to the same embodiment. In addition, a particular feature, structure, or characteristic may be combined in any suitable manner in one or more embodiments.

In the foregoing specification, a detailed description has been given with reference to specific exemplary embodiments. However, it will be apparent that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention as set forth in the appended claims. Accordingly, the specification and drawings are to be regarded as illustrative and not restrictive. Furthermore, although the above-described use of embodiments and other illustrative language does not necessarily refer to the same embodiment or the same example, different and separate embodiments may of course also refer to the same embodiment.

Some portions of the detailed description are presented as algorithms and symbolic representations of operations on data bits within a computer memory. These algorithmic descriptions and representations are the means used by those skilled in the data processing field to most effectively convey the content of their research to others skilled in the art. An algorithm, here and generally, is thought to be a sequence of self-consistent actions that lead to the desired result. Operations are those that require physical manipulations of physical quantities. While not necessarily, these quantities usually take the form of electrical or magnetic signals that can be stored, transmitted, combined, compared, and otherwise manipulated. In principle, it has proven convenient at times to refer to these signals as bits, values, elements, symbols, letters, terms, numbers, etc. for reasons of normal usage. The blocks described herein may be hardware, software, firmware, or a combination thereof.

However, it should be borne in mind that both of these and similar terms are only convenient names that are associated with and applied to the appropriate physical quantities. Unless specifically stated otherwise, as will be apparent from the above discussion, throughout this description, "define", "receive", "decision", "issue", "link", "associate", "acquisition", " Discussions using terms such as "authentication", "prohibition", "execution", "request", "forward", etc. describe data expressed in physical (electronic) quantities within the registers and memories of the computing system. It will be appreciated that it refers to the operations and processes of a computing system or similar electronic computing device that manipulates and transforms into other data that is similarly represented as physical quantities within the storage, transfer or display devices of such information or registers or other such information.

The words “example” or “exemplary” are used herein to mean serving as an example, instance, or illustration. Any aspect or design described herein as “example” or “exemplary” is not necessarily to be construed as better or advantageous over other aspects or designs. Rather, the use of the words “example” or “exemplary” is intended to present concepts in a concrete manner. As used in this application, the term “or” is intended to mean inclusive “or” rather than exclusive “or”. That is, unless otherwise stated or clear from context, "X includes A or B" is intended to mean any of the natural inclusive permutations. That is, X includes A; X comprises B; Or when X includes both A and B, “X includes A or B” is satisfied under any of the foregoing cases. In addition, the terms "a" and "any" as used in this application and in the appended claims, generally mean "one or more" unless otherwise specified or clear from the context as relating to the singular form. Should be interpreted as. Moreover, the use of the terms “an embodiment” or “an embodiment” or “implementation” or “an implementation” throughout this specification is not intended to mean the same embodiment or implementation, unless otherwise stated. Does not. In addition, terms such as "first", "second", "third", "fourth", etc., as used herein, are intended as labels to distinguish different elements, and must be in accordance with their numerical designation. It may not have an ordinal meaning.

Claims (20)

As a method,
Receiving, at data processing hardware of the media device, a streaming live media feed including media content;
Displaying, by the data processing hardware of the media device, an overlay on the media content of the streaming live media feed, the overlay comprising control options for controlling playback of the streaming live media feed, the control Options include pause, play, fast forward and rewind -;
Detecting, by the data processing hardware of the media device, a first selection of a first control option among the control options of the overlay, the first selection being to fast forward or rewind the streaming live media feed, Further in response to detecting the first selection, executing, by the data processing hardware of the media device, the first selected control option;
Subsequently, by the data processing hardware of the media device, detecting a second selection of a second control option of the control options of the overlay, the second selection to fast forward or rewind the streaming live media feed. Stopping and resuming playback of the streaming live media feed, further in response to detecting the second selection, executing, by the data processing hardware of the media device, the second selected control option; And
Identifying, by the data processing hardware of the media device, the content of the streaming live media feed at a location in the streaming live media feed where the playback is resumed using fingerprint-based automatic content recognition data-the playback resumes Identifying the content of the streaming live media feed at the location within the streamed live media feed being selected based on the identified content of the streaming live media feed for which playback has resumed. Make it possible to overlay the targeted overlay content-
Containing, the method. The method of claim 1,
Overlaying, by the data processing hardware of the media device, on the streaming live media feed, a targeted overlay content selected based on the identified content of the streaming live media feed for which playback has resumed. , Way. The method of claim 2,
And transmitting, by the media device, an overlay request requesting the targeted overlay content to an overlay determination engine. The method of claim 2,
Wherein the targeted overlay content is contextually related to the identified content of the streaming live media feed at a location within the streaming live media feed where the playback has resumed. The method of claim 4,
Based on a user profile, determining that the targeted overlay content is contextually relevant to the identified content at the location in the streaming live media feed where the playback has resumed. The method of claim 2,
Wherein the overlay comprises a hypertext markup language (HTML) browser overlay. The method of claim 1,
Buffering, by the data processing hardware of the media device, the content of the streaming live media feed for at least a predetermined time, the time being a duration between the first selection and the second selection input. Having, the way. The method of claim 1,
The step of identifying, by the data processing hardware of the media device, the content of the streaming live media feed at the location in the streaming live media feed where the playback is resumed using fingerprint-based automatic content recognition data,
By the data processing hardware of the media device, (i) query fingerprint data representing sequential frames of the contents of the streaming live media feed in the media device and (ii) frame fingerprint data representing the streaming live media feed. Comparing them; And
Detecting, by the data processing hardware of the media device, at least one fingerprint match based on the comparison
Containing, the method. The method of claim 8,
And receiving, at the data processing hardware of the media device, the frame fingerprint data representing the streaming live media feed. As a media device,
Data processing hardware; And
And a memory hardware in communication with the data processing hardware,
The memory hardware stores instructions that, when executed on the data processing hardware, cause the media device to perform operations, the operations comprising:
Receiving a streaming live media feed containing media content,
Displaying an overlay on the media content of the streaming live media feed-the overlay includes control options for controlling playback of the streaming live media feed, the control options being pause, play, fast forward and rewind Including -,
Detecting a first selection of a first one of the control options of the overlay, the first selection being to fast forward or rewind the streaming live media feed, and in response to detecting the first selection , Executing the first selected control option,
Subsequently, detecting a second selection of a second control option of the control options of the overlay-the second selection stops fast forward or rewind of the streaming live media feed and resumes playback of the streaming live media feed -, further in response to detecting the second selection, executing the second selected control option, and
Identifying the content of the streaming live media feed at a location in the streaming live media feed where the playback is resumed using fingerprint-based automatic content recognition data-at the location in the streaming live media feed where playback is resumed. Identifying the content of the streaming live media feed makes it possible to overlay, on the streaming live media feed, a targeted overlay content selected based on the identified content of the streaming live media feed resumed playing-
Including a media device. The method of claim 10,
The above operations are:
And overlaying, on the streaming live media feed, targeted overlay content selected based on the identified content of the streaming live media feed for which playback has resumed. The method of claim 11,
The above operations are:
And transmitting an overlay request for requesting the targeted overlay content to an overlay determination engine. The method of claim 11,
The targeted overlay content is contextually related to the identified content of the streaming live media feed at a location within the streaming live media feed where the playback has resumed. The method of claim 13,
The above operations are:
Further comprising determining, based on a user profile, that the targeted overlay content is contextually related to the identified content at the location in the streaming live media feed at which the playback has resumed. The method of claim 11,
The media device, wherein the overlay comprises a hypertext markup language (HTML) browser overlay. The method of claim 10,
The operations further include buffering the content of the streaming live media feed for at least a predetermined time, the time having a duration between the first selection and the second selection input. The method of claim 10,
The operation of identifying the content of the streaming live media feed at the location in the streaming live media feed where the playback is resumed using fingerprint-based automatic content recognition data,
(I) comparing, by the media device, query fingerprint data representing sequential frames of the content of the streaming live media feed with (ii) frame fingerprint data representing the streaming live media feed; And
Detecting at least one fingerprint matching based on the comparison
Including a media device. The method of claim 17,
The above operations are:
And receiving the frame fingerprint data representing the streaming live media feed. A non-transitory machine-readable medium storing instructions executable by data processing hardware of the media device for causing a media device to perform operations, the operations comprising:
Receiving a streaming live media feed including media content;
Displaying an overlay on the media content of the streaming live media feed-the overlay includes control options for controlling playback of the streaming live media feed, the control options being pause, play, fast forward and rewind Including -;
Detecting a first selection of a first of the control options of the overlay, the first selection being to fast forward or rewind the streaming live media feed, and in response to detecting the first selection And executing the first selected control option;
Subsequently, detecting a second selection of a second control option of the control options of the overlay-the second selection stops fast forward or rewind of the streaming live media feed and resumes playback of the streaming live media feed Further in response to detecting the second selection, executing the second selected control option; And
Identifying the content of the streaming live media feed at a location in the streaming live media feed where the playback is resumed using fingerprint-based automatic content recognition data-at the location in the streaming live media feed where playback is resumed Identifying the content of the streaming live media feed makes it possible to overlay, on the streaming live media feed, a targeted overlay content selected based on the identified content of the streaming live media feed resumed playing-
Containing, a non-transitory machine-readable medium. The method of claim 19,
The above operations are:
And overlying, on the streaming live media feed, targeted overlay content selected based on the identified content of the streaming live media feed for which playback has resumed.

Images