CN103733629A - Methods and apparatus to measure exposure to streaming media - Google Patents

Methods and apparatus to measure exposure to streaming media Download PDF

Info

Publication number
CN103733629A
CN103733629A CN201280032740.2A CN201280032740A CN103733629A CN 103733629 A CN103733629 A CN 103733629A CN 201280032740 A CN201280032740 A CN 201280032740A CN 103733629 A CN103733629 A CN 103733629A
Authority
CN
China
Prior art keywords
media
metadata
stream
transport stream
timing text
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201280032740.2A
Other languages
Chinese (zh)
Inventor
J·贝斯汉尼克
A·博斯沃思
阿伦·拉马斯瓦米
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nielsen Co US LLC
Original Assignee
Nielsen Co US LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/341,661 external-priority patent/US9515904B2/en
Priority claimed from US13/455,961 external-priority patent/US20130290508A1/en
Application filed by Nielsen Co US LLC filed Critical Nielsen Co US LLC
Publication of CN103733629A publication Critical patent/CN103733629A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/37Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying segments of broadcast information, e.g. scenes or extracting programme ID
    • H04H60/372Programme
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/68Systems specially adapted for using specific information, e.g. geographical or meteorological information
    • H04H60/73Systems specially adapted for using specific information, e.g. geographical or meteorological information using meta-information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2347Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving video stream encryption
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2407Monitoring of transmitted content, e.g. distribution time, number of downloads
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/26613Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel for generating or managing keys in general
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4405Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video stream decryption
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H2201/00Aspects of broadcast communication
    • H04H2201/50Aspects of broadcast communication characterised by the use of watermarks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H2201/00Aspects of broadcast communication
    • H04H2201/90Aspects of broadcast communication characterised by the use of signatures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234309Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Databases & Information Systems (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

Methods and apparatus to measure exposure to streaming media are described. An example method includes extracting metering data from media obtained from a media provider. Metadata identifying the media based on the extracted metering data is generated. The media is transcoded into a transport stream, the transport stream having a streaming format. The metadata is embedded in a timed text track accompanying the transport stream.

Description

Measure the method and apparatus of Streaming Media exposure rate
Technical field
The disclosure relates generally to measurement media exposure, and more specifically, relates to the method and apparatus of measuring Streaming Media exposure rate
Background technology
Stream (streaming) can be delivered to such as desktop computer, laptop computer, flat computer, personal digital assistant media, and numerous media such as smart phone present in device and in these devices and present.The pith of media (for example, content and/or advertisement) is presented in these devices by stream.
Accompanying drawing explanation
Fig. 1 is for measuring the figure of the example system of Streaming Media exposure rate.
Fig. 2 is the block diagram of the example implementation of the media monitor in Fig. 1.
Fig. 3 means exemplary HTML (HTML) code of the webpage that can be shown by exemplary client end device.
Fig. 4 is the exemplary timing text railway code exemplified with the exemplary timing text track that represents to be used by the exemplary media monitor of Fig. 2.
Fig. 5 means the flow chart of the example machine readable of the exemplary services provider that can be performed to realize Fig. 1.
Fig. 6 means the flow chart of the example machine readable of the exemplary media monitor that can be performed to realize Fig. 1 and/or Fig. 2.
Fig. 7 is the block diagram of exemplary realization of exemplary HLS stream that can be sent to the exemplary media monitor of Fig. 2.
Fig. 8 be can execution graph 5 and/or the example machine readable of Fig. 6 to realize the block diagram of the exemplary process applicator platform of exemplary services provider in Fig. 1 and/or the exemplary media monitor in Fig. 1 and/or Fig. 2.
Embodiment
Illustrative methods disclosed herein, equipment, system and goods (article of manufacture) can be for measuring the exposure rate of Streaming Media.Some such illustrative methods, equipment and/or goods are measured this exposure rate based on media element data, user consensus data and/or media apparatus type.These examples disclosed herein can be for for example monitoring, such as individual, computer, flat computer (
Figure BPA0000184824400000021
), the transmission of the Streaming Media that receives of mancarried device, mobile phone, internet equipment and/or other customer set up place that can play the device of media.Additionally or alternatively, exemplary realizations more disclosed herein can be for monitoring the playback of the media of local storage in media apparatus.The media element data that exemplary monitoring process collection disclosed herein is associated with the media that present by media apparatus, and these metadata are associated with the user's of media apparatus demographic information.Like this, the media element data based on collecting generate detailed exposure rate measurement with associated user's demographics.
Use mobile device (for example, smart phone, flat computer, MP3 player etc.) to watch media increasing gradually in recent years.At first, the application (for example app) that service provider creates customization is to play its media.But along with the more eurypalynous mobile device with different software requirement, version and compatibility etc. comes into the market, service provider starts display stream medium in the browser of mobile device.Therefore, many users watch Streaming Media by the browser of their mobile device.In view of access medium by this way becomes more and more general, how understand user carries out alternately (for example, understand what media is presented, how media are presented etc.) and provides valuable information to service provider, advertiser, content supplier, manufacturer and/or other entity with Streaming Media.
Here in the example of explanation, from media provider (for example, such as satellite provider, cable television provider, tangible media provider (, the digital video disk of mailing (DVD) service etc.) receiving media.Media be provided as from service provider spread be passed to one or more at client terminal device to present at described client terminal device.In this example, media are provided as transport stream.In some instances, from transport stream, extract the measurement data with the first form.In some such examples, described transport stream is corresponding to moving images expert group (MPEG) 2 transport stream that send according to HTML (Hypertext Markup Language) (HTTP) live TV stream (HLS) agreement.Yet, this transport stream can be additionally or alternatively corresponding to any other form of past, present or future, for example, MPEG4, HTTP security protocol (HTTPS), file transfer protocol (FTP) (FTP), Secure File Transfer Protocol (SFTP) and/or send according to these forms.
Audio watermarking technique is for identifying the technology of media of the media content etc. of media content such as television broadcasting, radio broadcasting, download, streaming medium content, packing in advance.Existing audio watermarking technique is by for example, carrying out identification medium having enough the Audiocode (, watermark) embedding such as identification information in hiding other audio frequency of signal level of watermark and/or video component.As used herein, word " code " or " watermark " are used interchangeably, and be defined as representing can for identification medium or such as tuning (for example, group character header) other object and insert or be embedded into for example, identifier in the audio or video of media (, program or advertisement).
From based on comprising and/or to be embedded in the media surveillance technology of code in the media that are monitored and/or watermark different, the media surveillance technology based on fingerprint or signature conventionally generates media by one or more inherent characteristics of the media that are monitored and produces fully unique agency in Looking Out Time interval.Such agency is called as signature, and can adopt string number value, waveform etc. to represent the form such as the media signal of audio frequency and/or vision signal, forms the media that are being monitored and presents.Good signature is conventionally and can repeats now processing identical media, but be at other that process other media, is unique now.Therefore, word " fingerprint " and " signature " are used interchangeably, and are defined as representing the agency for identification medium from one or more inherent characteristic generation of media.
Media based on signature monitor and (are for example usually directed to determine, generate and/or collect) by the media signal of the media apparatus output being monitored (for example represent, audio signal and/or vision signal) signature represent and the signature being monitored and for example, one or more reference signature corresponding to known (, with reference to) media resource compared.Can assess various standards of comparison such as cross correlation value, Hamming distance to determine whether the signature being monitored mates with specific reference signature.When mating between the signature of having found to be monitored and one of them reference signature, can the serve as reasons specific reference medium source that represents with the reference signal of the signatures match being monitored of the media identification being monitored is corresponding.Because collected the attribute of identifier such as media, presentative time, broadcasting channel etc. for reference signature, these attributes and the media that are monitored (signature being monitored mate with reference signature be monitored media) can be associated after therefore.
In some instances, the metadata being embedded in media is the first form (for example, watermark, signature, code etc.).In some instances, the measurement data that has the first form comprises the audio frequency watermark in the audio-frequency unit that is embedded into media.Additionally or alternatively, the measurement data with the first form can comprise the video of the video section that is embedded into media (for example image) watermark.Many client terminal devices can not be used the metadata of the first form, and/or in some cases, do not have enough disposal abilities of the metadata of identification the first form.Like this, here, in the example of explanation, service provider identifies watermark, and is the second readable form of client terminal device by metadata conversion.The metadata of the second form can be corresponding to the metadata of for example text formatting, such as for being included in the text formatting of timing text track (the timed text track) file of transmission associated with Streaming Media.
Timing text track is and web page interlinkage, the document that sends and/or embed described webpage together with described webpage and/or file that media are shown.Timing text track for example defined, in the correspondence position being associated with media demonstration or the time of time showing text (, closed caption (closed captioning), captions, annotation, advertisement, metadata etc.).For example, timing text track can stipulate that phrase " this is to obtain Patent right invention " should present the 00:01:12 demonstration after starting at media, display unit (such as TV etc.) should utilize closed caption option., in the example of explanation, be here display media mark timing text track in webpage.The example web page of exemplary approach has been shown in Fig. 3, and in this exemplary approach, timing text track can be associated with media.In the example of explanation, require timing text track to be independent of the webpage of the meta-attribute of the timing text track label based in webpage.Like this, in the example of Fig. 3, timing text track is connected to webpage, but is not all incorporated in wherein.Yet in some instances, timing text track is included in webpage.
Timing text track document comprises and starts prompting, finish prompting and point out relevant data to these.Start prompting and finish the time that prompting has defined the event that triggering is associated with time text track in related media.In some instances, timing text track is for causing the captions that define in the data that are associated with described prompting and/or the demonstration of caption data.When arrival starts to point out, show captions and/or caption data.When arriving end prompting, from display, eliminate captions and/or caption data.Fig. 4 shows the timing text track file of example.
In some disclosed examples, Streaming Media is used HTTP live TV stream (HLS) to send to client terminal device via HTML version 5 (HTML5) webpage.Yet, can be additionally or alternatively use any other past, at present and/or media streaming is sent to the method for client terminal device, for example, HTTP safety (HTTPS) agreement.Additionally or alternatively, can be additionally or alternatively use in the past, now and/or any other homepages language in the future.HTML version 5 (HTML5) allow that meta-data pack is contained in timing text track and/or allow by metadata with such as Media Stream etc., associate.In some disclosed examples, client terminal device shows the media that receive via HLS with browser.Additionally or alternatively, in some disclosed examples, client terminal device is used media renderers (for example, browser plug-in, application, framework, application programming interfaces (API) etc.) to show the media that receive via HLS.
Here, in some examples of explanation, client terminal device is to service provider's requested webpage.Here in some examples of explanation, web page definition by by the independent timing text track document of request of client terminal device.In some instances, timing text track document is provided by service provider.Yet in other example, timing text track document is provided by other entity beyond service provider, for example, the hub facility of audience measurement entity etc.In some instances, timing text track document is comprised in webpage, makes not need additional request access timing text track document.
In the example of explanation, by the metadata of recovering to transmit, monitor media exposure rate metric in timing text track below.In some instances, via DOM Document Object Model (DOM) object, recover metadata.DOM is for showing the object of HTML (HTML) form interactional cross-platform and do not rely on the instrument of language with these objects.Yet, can be additionally or alternatively use in the past, at present and/or any other form in the future, language, agreement etc., for example HTML5.DOM provides the internal representation of the webpage presenting.Via the access of Javascript for example DOM, make it possible to the object that access defines within comprising the webpage of timing text track for example.
Although can be additionally or alternatively use in the past, now and/or other metadata format of in the future any, in some instances, metadata be stored in timing text track with ID3 tag format.In some instances, for example the media renderer of QuickTime player (for example, media plug-in unit) is sent DOM event, and the prompting for example being triggered by the prompting defining in timing text track changes event.Here, in the example of explanation, DOM event is caught via JavaScript.Yet, can be additionally or alternatively use in the past, now and/or any other script in the future, language, instruction set etc.By catching DOM event, can extract via DOM the metadata (for example, ID3 label data) of timing text rail event.Once extract metadata, metadata for example can combine and send to hub facility to analyze and/or to pool together with the data of collecting from other device with the out of Memory such as with the associated cookie data of device, timestamp etc.
Illustrative methods disclosed herein, device, system and goods at client terminal device place to streaming media (for example relate to, stream audio and/or stream video) associated metadata (for example, be stored in metadata in ID3 label, the extend markup language based on metadata (XML) and/or with the past, now and/or the metadata of any other form in the future) extract or collect.In some instances, one or more in metadata sign type, artist, title of song, album name, transfer station/server site etc.In such example, can collect the data of height micronize (for example, very detailed).Yet, in the past, grading is main binds with specific program or broadcasting station, and illustrative methods disclosed herein, device, system and/or goods except or alternatively for example, for specific program (, broadcast, TV etc.), advertisement, content supplier, broadcaster and/or station, produce that grading is outer can also produce grading for type, artist, song, special edition/CD, specific transmission/server site etc.
In some instances, media change event that can be based on detecting in media player (for example, media present event, such as the variation defining in timing text track, beginning event, End Event, skip events etc.) trigger the collection of metadata.Media change event typically causes the change (for example, the change of the change of type, artistical change, title etc.) by the information of the metadata sign of extracting, and therefore trigger data collection effectively.In some instances, media change event when media are played, detected.In the example of explanation, when exist with the timing text track association of Streaming Media change time media change event (for example, when timing text rail event being detected etc.) detected.In some instances, the time of the metadata of collecting based on being collected and be coupled with timestamp.
Illustrative methods disclosed herein, equipment, system and the goods identifier based on associated with client terminal device (for example, Internet Protocol (IP) address, cookie, device identification etc.) gather the demographic information who is associated with the user of client terminal device.Then, media element data that can be based on corresponding with identifier and user consensus data generate media exposure information with at least one exposure rate tolerance and/or the demographics scope tolerance (demographic reach metrics) in indication school, artist, album name, dispatching station/server site etc.
In some instances, expectation connects consensus data and monitor message.In order to address this problem, audience measurement entity is set up and is agreed to provide demographic information agreement to be subject to the user's of Streaming Media activity monitoring group.A people provides the details about identity and consensus data (for example, sex, race, income, home address, occupation etc.) to audience measurement entity when adding this group.Audience measurement entity arranges identifier presenting on device, makes audience measurement entity can when group member has reported the access to Streaming Media, identify group member.Especially, for each group member provides media watch-dog, media monitor is reported the access to Streaming Media to the hub facility of audience measurement entity.In some instances, media watch-dog for example, is reported the access of convection current media when (, flow transmission) occurs in access.In some instances, media watch-dog buffer memory (for example, high speed storing, buffering etc.) is to the access of Streaming Media and send the access of buffer memory to hub facility.In example, media watch-dog sends identifier (for example, with cookie form) together with access.
Illustrative methods disclosed herein, equipment, system and goods also can for example, for generating the report of the media exposure rate metric on one or more dissimilar client terminal device of indication (, personal computer, mancarried device, mobile phone, flat computer etc.).For example, the metadata that audience measurement entity can the Streaming Media based on from client terminal device and/or similar device extracts generates media exposure tolerance.Then, based on media exposure, generating report indicates the exposure rate of the medium type (for example, the type of media (school)) that uses dissimilar client terminal device to measure.Therefore, for example, report at the client terminal device of certain type (is for example pointed out, mobile device, flat computer etc.) on the popularity of watching competitive sports can with client terminal device (for example, TV, personal computer etc.) in other type on watch the popularity of competitive sports to compare.
Additionally or alternatively, can compare the popularity of the different media on dissimilar device.These dissimilar media can be such as news, film, TV programme, on-demand media, media based on internet, game, stream game (streaming game) etc.Can between the device of any type and/or quantity, carry out this comparison, described device for example comprise cell phone, smart phone, special portable formula multimedia playback reproducer,
Figure BPA0000184824400000061
device, dull and stereotyped calculation element are (for example,
Figure BPA0000184824400000062
deng), SD (SD) television set, high definition (HD) television set, 3 dimension (3D) television sets, stationary computer, portable computer, internet radio equipment etc.Also can analyze media and/or the device of any other type and/or quantity.Described report can also for example, by media exposure rate metric and the corresponding consensus data's segmentation (, age bracket, sex, race etc.) of user with client terminal device.Additionally or alternatively, described report can be by artist, school, song between media exposure rate metric and of selecting from one or more consensus data's segmentation, one or more age bracket, one or more sex and/or other user characteristics or each a plurality of user characteristicses, and the tolerance of the popularity of title etc. is associated.
In some instances, described media exposure rate metric for determining consensus data's scope, the Streaming Media grading of Streaming Media, the participation index of Streaming Media, broadcast medium, the user affinity associated with Streaming Media and/or measure with Streaming Media and/or associated other audience measurement of local medium.In some instances, media exposure rate metric is to use the spectators' of different device type of access identical media the spectators of percentage to share tolerance.For example, first spectators' percentage can be to use smart phone contact news media, and second spectators' percentage is to contact identical news media by flat computer.
Fig. 1 is the block diagram of the example system 100 of the measurement Streaming Media exposure rate set up according to instruction of the present disclosure.The media for presenting on exemplary client end device 160 that provided via exemplary network 150 by exemplary media provider 110 are provided example system 100 in Fig. 1.The system of Fig. 1 comprises the exemplary hub facility 170 of exemplary services provider 120, exemplary media monitor 165 and audience measurement entity.In Fig. 1, illustrative example discloses the example of exemplary realization of the service provider 120, can be additionally or alternatively use other exemplary realization of provider 120, such as in co-pending U.S. Patent Application Serial Number 13/341, in 646, disclosed exemplary realization, is incorporated herein by reference in its entirety.
The media provider 110 of the example shown in Fig. 1 is corresponding to any or more media provider of the media that can be provided for presenting at client terminal device 160 places.The media that provided by media provider 110 can provide the media of any type, such as audio frequency, video, multimedia etc.In addition, media can for example, corresponding to the media of the media of live (, broadcast), Streaming Media, storage, on-demand content etc.
Service provider 120 in Fig. 1 in the illustrative example for example webpage (for example, hyperlink, embedding media etc.) of the link by comprising the media that media provider 110 provides provides media services to client terminal device 160.In the example illustrating, before media are sent to client terminal device 160, service provider 120 revises the media that media provider 110 provides.In the example illustrating, service provider 120 comprises exemplary media identifier 125, exemplary transcoder 130, exemplary meta-data embedded device 135 and exemplary media transmitter 140.
Media identification device 125 in example shown in Fig. 1, by realizing such as the logical circuit of carrying out the processor of instruction, still can additionally or alternatively be realized by application-specific integrated circuit (ASIC) (ASIC), programmable logic device (PLD) and/or field programmable logic device (FPLD), analog circuit and/or other circuit.Media identification device 125 in Fig. 1 extracts measurement data (for example, signature, watermark etc.) from obtaining from the media of media provider 110.For example, media identification device 125 for example can be realized function that SDK (SDK) provides, (to extract one or more audio frequency watermark, one or more video, image) watermark etc., these watermarks are embedded in the audio frequency and/or video of the media that obtain from media provider 110.(for example, media can comprise the voice data of pulse code modulation (PCM) voice data or other type, unpressed video/image data etc.)
The exemplary media identifier 125 of Fig. 1 (is for example determined, derivation, decoding, conversion etc.) in media, embed, watermark associated with media or that send together with media comprises or the measurement data that identifies (for example, media identification information, source identification information etc.), and media identification device 125 is converted to this measurement data for example, for (being included in ID3 label and/or other data type, text, binary system etc.) in text and/or binary format, using and insert in the timing text track be associated with Streaming Media as metadata.
The exemplary transcoder 130 illustrating in example of Fig. 1 is realized by the logical circuit of the processor such as execution instruction, but can additionally or alternatively by analog circuit, ASIC, DSP and/or other circuit, be realized.In some instances, transcoder 130 and media identification device 125 can be realized by same entity handles device.In this example, transcoder 130 is used suitable arbitrarily technology by the media transcoding receiving and/or is treated to the form (for example, stream format) that is suitable for stream.For example, the transcoder 130 in this example is carried out transcoding to use via HLS agreement according to MPEG4 audio/video compression method to media.
Metadata embedded device 135 in the example of Fig. 1, by realizing such as the logical circuit of carrying out the processor of instruction, still can additionally or alternatively be realized by analog circuit, ASIC, DSP, FPGA and/or other circuit.In some instances, transcoder 130, media identification device 125 and metadata embedded device 135 can be used same entity handles device to realize.
In this example, metadata embedded device 135 embeds the determined metadata of media identification device 125 in timing text track.In this example, timing text track is video web page text track (WebVTT) form.But, can be additionally or alternatively use such as any other of timing text markup language (TTML) form go over, present and following form.In some examples, for example such as when showing advertisement via product placement, while showing independence advertisement, while there is particular event in media (for example, when the contestant on TV game program answers a question), when the film broadcasting returns from advertisement, metadata embedded device 135 inserts in timing text track document the ID3 tag metadata corresponding with measuring metadata with the particular event in identification medium.Additionally or alternatively, metadata embedded device 135 can by such as by metadata encoding for will be associated with media the M3U8 of (for example, be included in media, append to media, prior to media transmission etc.) or other data file and metadata is embedded in independent metadata document.
Medium dispenser 140 in the example of Fig. 1, by realizing such as the logical circuit of carrying out the processor of instruction, still can additionally or alternatively be realized by analog circuit, ASIC, DSP, FPGA and/or other circuit.In some instances, transcoder 130, media identification device 125, metadata embedded device 135 and medium dispenser 140 can be used same entity handles device to realize.
Medium dispenser 140 adopts any suitable technology to select media and/or media streaming is arrived to request unit (such as client terminal device 160).For example, the media that the medium dispenser in this example 140 is selected to pass through 125 identifications of media identification device, process transcoder 130 transcodings and embedded metadata by metadata embedded device 135.What medium dispenser 140 was then used HLS or other stream protocol by network 150 is transferred to client terminal device 160 by media with the form of stream.
In some instances, no matter whether from client terminal device 160, receive request (for example, before receiving request), media identification device 125, transcoder 130 and/or metadata embedded device 130 are all ready to the media of flow transmission.In these examples, off-the-shelf media are for example stored in, in service provider 120 data storage (, flash memory, magnetizing mediums, optical medium etc.).In these examples, when receiving request from client terminal device 160, medium dispenser 140 is ready to transport stream so that these off-the-shelf media are sent to client terminal device 160 with the form flowing.In other example, media identification device 125, transcoder 130 and/or metadata embedded device 130 are prepared media to carry out flow transmission in response to the request receiving from client terminal device 160.
Network 150 in this example is internets.Additionally or alternatively, can use any other network that service provider 120 and client terminal device can be linked communicatedly, for example, private network, local area network (LAN) (LAN), Virtual Private Network (VPN) etc.Network 150 can comprise an any amount public or private network of the procotol of using any type.
Client terminal device 160 in the example of Fig. 1 is calculation elements, and this calculation element can present the Streaming Media that medium dispenser 140 provides via network 150.Client terminal device 160 can be for example flat computer, desktop computer, laptop computer, mobile computing device, television set, smart phone, mobile phone,
Figure BPA0000184824400000091
's
Figure BPA0000184824400000092
Figure BPA0000184824400000093
iPhone,
Figure BPA0000184824400000094
iPod, Android tMcalculation element,
Figure BPA0000184824400000095
's calculation element etc.In this example, client terminal device 160 comprises media monitor 165.In this example, media monitor 165 for example, is realized by the media player (, browser, local application etc.) that presents the Streaming Media that medium dispenser 140 provides.For example, media monitor 165 can additionally or alternatively be embodied as
Figure BPA0000184824400000101
(for example, being provided as SWF file),, can be implemented as HTML (HTML) version 5 (HTML5), can be implemented as
Figure BPA0000184824400000102
's
Figure BPA0000184824400000103
can realize according to the media framework of increasing income (OSMF), can realize according to device or the media player application program interface (API) of operating system provider, can be at the media player framework of device or operating system provider (for example,
Figure BPA0000184824400000104
's the MPMoviePlayer software of system) realization such as, or the mode of the combination in any of above method realizes.In example, media monitor 165 reports to hub facility 170 by measurement data.Although only exemplified with single client terminal device 160, can use the media of any amount and/or type to present device.
Hub facility 170 in example be audience measurement entity (for example, the LLC of Nielson company (US)), and for example comprise, for receive the interface of the metrical information (, metadata) reporting from the media monitor 165 of client terminal device 160 via network 150.In example, hub facility 170 comprises for receiving the HTTP interface of the HTTP request that comprises metrical information.HTTP request is sent out, and it has metrical information in payload.Described request can not be intended to actual recovery content, but is used as transmitting the carrier of metrical information.Hub facility 170 has the software (for example, finger daemon (daemon)) for extract metrical information from the payload of described request.Additionally or alternatively, can use any other method that receives metrical information, for example, such as HTTP security protocol (HTTPS), file transfer protocol (FTP) (FTP), Secure File Transfer Protocol (SFTP), HTTP and/HTTPS GET request, HTTP and/or HTTPS POST request etc.In example, the metrical information of the extraction receiving from a plurality of different clients devices is stored and analyzed to hub facility 170.For example, hub facility 170 can arrange and/or divide into groups (for example, whole measurement data of Jiang Yu specific medium provider 110 associations are divided into one group) according to 110 pairs of metrical informations of media provider.Additionally or alternatively, can carry out any other processing to metrical information.In some examples, hub facility 170 increases timestamp to metadata when receiving.Adding timestamp (time that for example, recording events occurs) makes it possible to identify exactly the time that the media that are presented and/or media are presented and/or the media that are presented and/or the media time being presented and the user who presents device is associated exactly.
Fig. 2 is the block diagram of exemplary realization of the media monitor 165 of Fig. 1.Media monitor 165 in the illustrative example of Fig. 2 comprises exemplary media renderer 210, exemplary event monitor 220, exemplary meta-data restorer 230, exemplary meta-data transducer 240 and example transmitter 250.
The exemplary media renderer 210 of Fig. 2 is realized by the processor of carrying out instruction, but can additionally or alternatively by analog circuit, ASIC, DSP, FPGA and/or other circuit, be realized.In example, media renderer 210 with
Figure BPA0000184824400000106
application programming interfaces (API) carry out alternately, with via client terminal device 160 display medias.Although used in example
Figure BPA0000184824400000111
aPI, additionally or alternatively, can use any other media to present framework.For example, exemplary media renderer 210 can be with
Figure BPA0000184824400000112
media present framework to carry out alternately.In example, media renderer 210 reads timing text track file.Exemplary timing text track file has been shown in Fig. 4.In the moment of some timed events limiting, by media renderer 210, trigger prompting event in timing text track.At for example media, present the preset time starting latter two seconds, can trigger timed events, in some instances, call exemplary event monitor 220.In example, media renderer 210 does not show the data that are included in timing text track.Yet in some instances, 210 demonstrations of media renderer are included in the data in timing text track.
Exemplary event monitor 220 in the example of Fig. 2, by realizing such as the logical circuit of carrying out the processor of instruction, still can additionally or alternatively be realized by analog circuit, ASIC, DSP, FPGA and/or other circuit.In some instances, media renderer 210 and event sniffer 220 can be realized by same entity handles device.In example, exemplary event monitor 220 is connected with JavaScript function, so that can receive and/or monitor event notice.Although use JavaScript to monitor event notice in this example, also can monitor event notice with any other script, language, instruction set and/or framework, such as ActiveX, Microsoft Sliverlight etc.
Metadata restorer 230 in the example of Fig. 2 is realized by the logical circuit of carrying out the processor of instruction, but can additionally or alternatively by analog circuit, ASIC, DSP, FPGA and/or other circuit, be realized.In some instances, media renderer 210, event sniffer 220 and metadata restorer 230 can be realized by same entity handles device.In example, the event notice that metadata restorer 230 detects according to event sniffer 220 and recover metadata from media renderer 210.In this example, metadata restorer 230 is by utilizing JavaScript to check that DOM Document Object Model (DOM) object being associated with the timing text track of media renderer 210 recovers metadata.DOM to as if media renderer 210 while reading timing text track file in the expression of the timing text track of media renderer 210 interior establishments.Although recover DOM object with JavaScript in this example, can use such as any other script, language, instruction set and/or framework such as ActiveX, Microsoft Silverlight etc. and recover DOM object.
The exemplary meta-data transducer 240 of Fig. 2, by realizing such as the logical circuit of carrying out the processor of instruction, still can additionally or alternatively be realized by analog circuit, ASIC, DSP, FPGA and/or other circuit.In some instances, media renderer 210, time monitor 220, metadata restorer 230 and metadata conversion device 240 can be realized by same entity handles device.In example, the metadata conversion that metadata conversion device 240 recovers metadata restorer 230 is for being transferred to the metadata format of the conversion of hub facility 170.The operations such as for example, metadata conversion device 240 can be encrypted metadata and/or part metadata, deciphers, compresses, modification are for example to reduce the amount of the data that will send to hub facility 170.In example, metadata conversion device 240 increased timestamp before metadata about transformation in metadata.Adding timestamp (time that for example, recording events occurs) makes it possible to identify exactly the time that the media that are presented and/or media are presented and/or the media that are presented and/or the media time being presented and the user who presents device is associated exactly.
Transmitter 250 in the example of Fig. 2 is realized by the logical circuit of carrying out the processor of instruction, but can additionally or alternatively by analog circuit, ASIC, DSP, FPGA and/or other circuit, be realized.In some instances, media renderer 210, time monitor 220, metadata restorer 230, metadata conversion device 240 and transmitter 250 can be realized by same entity handles device.In example, transmitter 250 for example sends to hub facility 170 via internet by the metadata after conversion.In this example, although the metadata of conversion is sent substantially in real time, in some instances, before sending to hub facility 170, the metadata of conversion is stored, high-speed cache and/or buffering.Equally, in example, although additionally or alternatively the metadata of conversion is sent to hub facility 170, in some instances, metadata additionally or is alternatively sent to different destinations, such as the display of for example media monitor 165 and/or client terminal device 160.Alternatively or additionally, transmitter 250 can send the identifier of media monitor and/or client terminal device 160, so that hub facility 170 can be associated metadata with data such as group member, group member group, demographics.In this example, hub facility 170 is associated with audience measurement companies, but sends irrelevant with the media to client terminal device.In some instances, hub facility 170 Applicative time stamp when the metadata of the conversion receiving.
Exemplary HTML (HTML) instruction 300 of the webpage that Fig. 3 carries out when representing can the exemplary media monitor 165 in Fig. 2 to be included in the client device 160 in Fig. 1.In this example, exemplary video label 310 is realized the exemplary media renderer 210 of Fig. 2.In this example, media renderer 210 is realized to have the source of media of global resources designator (URI), the frame with specified altitude assignment and width and identifier.In this example, exemplary video label 310 comprises the text track road instruction 315 of the timing text track file that indication is associated with the video of exemplary video label 310.It is " track_file.vtt " that the source of associated text track has been indicated in the text track road instruction 315 of this example.Yet, additionally or alternatively, can use any other file.In this example, comprise a text track road instruction 315.Yet, in some instances, can comprise text track road instruction additional and/or alternative.For example, text track additional or alternative can comprise the metadata (metadata for example, existing with different-format, the metadata existing with different language, for the metadata of special services provider customization etc.) of closed caption, different editions etc.
Exemplary " addeventlistener " function 320 being included in the HTML code 300 of Fig. 3 has been realized the event sniffer 220 in Fig. 2.In this example, for example, by (stipulating predetermined element, be identified as having the component identifier of id ' track '), regulation event type (for example, " cuechange " etc.) and regulation should carry out " TrackChangeFunction " function and carry out load events monitor 220 when event being detected.In this example, the event type detecting is " cuechange ", and " cuechange " is the event being triggered by media renderer 210.Yet, additionally or alternatively, also can use the event of any other type, for example, the event type associated from different media renderers, with the associated event type of the different triggerings of media renderer 210, with the event type of the program association that (" QT ") is different etc.
The illustrative instructions group function 330 being included in the exemplary HTML code 300 of Fig. 3 recovers the metadata being associated with the html object of triggering " TrackChangeFunction () ".In this example, when by media renderer 210 displaying video label 310, will carry out trigger event according to the event defining in the timing text track file by text track road instruction 315 signs.In " track " object of indicating in this example,, recover metadata from the getElementById function in instruction 320.In this example, for example, by the metadata store (, high-speed cache, buffering etc.) of recovering in local variable " myCues ".
In this example, the metadata of recovery is ID3 form.Yet in some instances, the metadata of recovery can be in the past, now and/or other form of in the future any, for example Java Script Object Notation (JSON).In some instances, metadata is stored as cryptographic Hash.In some instances, the HTML code 300 of Fig. 3 also comprises for take the function that the metadata conversion of the first form storage is the second form.
In this example, the square frame 350 in the exemplary HTML coding 300 of Fig. 3 sends to text filed 351 (being defined as " demonstration " in example) by the metadata after conversion.In some instances, frame 350 is modified to additionally or alternatively the metadata after conversion is sent to hub facility 170.In some instances, metadata sends (frame 350) with ID3 form.Additionally or alternatively, in some instances, except metadata or as the substituting of metadata, frame 350 sends other information, for example, user totem information, client-side information, timestamp, identifier etc.
Fig. 4 is exemplified with exemplary timing text railway code 400, and timing text railway code 400 represents the exemplary timing text track that can be used by the exemplary media monitor of Fig. 2.In described example, timing text code 400 is WebVTT forms, as indicated in format identifier 415.Yet timing text code 400 can be in the past, now and/or other form of in the future any, such as timing text markup language (TTML) form etc.The timing text code 400 of Fig. 4 comprises the first timed events 410.The first timed events 410 comprises time started 411 and end time 412.The first timed events 410 comprises the metadata 420 formaing according to ID3 form.Particularly, metadata 420 comprises contentid part, and contentid partly comprises identification information 425.In this example, the media that identification information 425 signs are presenting via associated Media Stream.
Fig. 4 is exemplified with the development of the time of associated media.For example, Fig. 4 shows time A450, time B460, time C470 and time D 480.In this example, in the first period after time A450 and before time B460, play the first fragment of TV programme.In the second period after time B460 and before time C470, broadcast advertisement.In the 3rd period after time C470 and before time D 480, play the second fragment of TV programme.
Timing text railway code 400 is described and is changed event by presenting associated the prompting triggering with media.In this example, by first 410 the first periods of sign of timed events.The first fragment of the identification information 425 sign TV programme of the metadata 420 of the first timed events 410.In this example, the first timed events 410 is triggered after played one second at media.It is because in some instances that the first timed events 410 is triggered after played one second at media, load events monitor function 320 not yet in played first second of media.In some instances, use the time started of alternative, for example zero second (for example, not postponing), five seconds, ten seconds, one minute etc.
In this example, the second period is by the second timed events 440 definition.The second timed events 440 starts for one second after the first period completed.Yet, can be additionally or alternatively use any time delay At All Other Times.The second timed events 440 comprises the metadata that is identified at the advertisement of playing in the second period.
In this example, the 3rd period is by the 3rd timed events 445 definition.The 3rd timed events 445 starts for one second after the second timed events 440 completes.Yet, can be additionally or alternatively use any time delay At All Other Times.The 3rd timed events 445 comprises the metadata of the second fragment that identifies TV programme.In this example, the metadata of the second fragment of sign TV programme is different from the metadata of the first fragment that identifies TV programme.Yet in some instances, the metadata of the second fragment of sign TV programme is identical with the metadata of the first fragment of sign TV programme.
In this example, prompting change event is triggered in the beginning of for example, each event in timed events (, the first timed events 410, the second timed events 440, the 3rd timed events 445 etc.).Like this, when media, by timing text track, defined when being presented in (comprising the beginning that media present) different period before media, timed events 410,440,445 occurs.In this example, the timing text track period is divided into the fragment corresponding with the media that are presented (for example, the first timed events is associated with the first fragment of TV programme, and the second timed events 440 is associated with advertisement etc.) with corresponding timed events.
In some instances, timing text rail event is divided into the fragment (for example, five seconds, ten seconds, a minute etc.) of regular length, and is associated with the media that present in the fragment of each regular length.Timing text track is divided into a plurality of fragments and is conducive to be convenient to accurately gather media monitor data, this is due to the more data point that has gathered the different time during presentation medium presents.When using together with timestamp, (for example use small fragment, 30 seconds, one minute etc.) be conducive to detect such as skipping, stop, other media alternative events of time-out, broadcast event, this is because the expected duration between the prompting of timing text track can being changed compare with the actual duration between timing text track prompting change.In some instances, timing text track is not divided into discrete fragment, but comprises the individual chip that the whole media of covering present.
Although in Fig. 1 and/or Fig. 2 exemplified with realize service provider 120 in Fig. 1 and/or Fig. 1 and/exemplary method of exemplary media monitor 165 in Fig. 2, each element in Fig. 1 and/or Fig. 2, processing and/or device also can combine according to alternate manner, divide, reset, omit, cancel and/or realize.In addition, exemplary media identifier 125 in Fig. 1, exemplary transcoder 130, exemplary meta-data embedded device 135, exemplary media renderer 210 in exemplary media transmitter 140 and/or more generally exemplary services provider 120 and/or Fig. 1 and/or Fig. 2, exemplary event monitor 220, exemplary meta-data restorer 230, exemplary meta-data transducer 240, example transmitter 250 and/or more generally exemplary media monitor 165 can pass through hardware, software, firmware and/or hardware, the combination in any of software and/or firmware realizes.Therefore, for example, exemplary media identifier 125 in Fig. 1, exemplary transcoder 130, example meta data embedded device 135, exemplary media renderer 210 in example media transmitter 140 and/or more generally exemplary services provider 120 and/or Fig. 1 and/or Fig. 2, exemplary event monitor 220, exemplary meta-data restorer 230, exemplary meta-data transducer 240, any in example transmitter 250 and/or more generally exemplary media monitor 165 can be by one or more circuit, programmable processor, application-specific integrated circuit (ASIC) (ASIC), programmable logic device (PLD) and/or field programmable logic device (FPLD) etc. are realized.When any device of this patent or system claim are understood to contain pure software and/or firmware and realize, exemplary media identifier 125, exemplary transcoder 130, exemplary meta-data embedded device 135, exemplary media transmitter 140, exemplary media renderer 210, exemplary event monitor 220, example meta data restorer 230, at least one in exemplary meta-data transducer 240 and/or example transmitter 250 is clearly defined as comprises that tangible computer-readable medium is (such as internal memory, DVD, CD, Blu-ray Disc etc.) come storing software and/or firmware.In addition, except shown in Fig. 1 and/or Fig. 2 or replace the element shown in Fig. 1 and/or Fig. 2, process and/or device, exemplary media identifier 125 in Fig. 1, exemplary transcoder 130, exemplary meta-data embedded device 135, exemplary media renderer 210 in example media transmitter 140 and/or more generally exemplary services provider 120 and/or Fig. 1 and/or Fig. 2, exemplary event monitor 220, exemplary meta-data restorer 230, exemplary meta-data transducer 240, example transmitter 250 and/or more generally exemplary media monitor 165 can comprise one or more element, process and/or device, and/or can comprise over an illustrated element, any or all in processing and installing.
In Fig. 5 and/or Fig. 6, illustrated the service provider 120 that realizes in Fig. 1 and/or the media monitor 165 in Fig. 1 and/or Fig. 2 example machine readable represent flow chart.In these examples, machine readable instructions comprises by the program of carrying out such as the logical circuit that contacts the processor 812 shown in the exemplary process applicator platform 800 that Fig. 8 discusses below.Program can be included in and such as computer-readable medium (for example be stored in, CD-ROM, floppy disk, hard disk drive, digital versatile disc (DVD), Blu-ray disc or the memory associated with processor 812) the software of tangible computer-readable medium in, but the part of whole program and/or program can alternatively be carried out by the device beyond processor 812, and/or is included in firmware or specialized hardware.In addition, although with reference to illustrative flow chart description in Fig. 5 and/or Fig. 6 example procedure, can alternatively use the exemplary services provider 120 that realizes in Fig. 1 and/or a lot of other methods of the exemplary media monitor 165 in Fig. 1 and/or Fig. 2.For example, the execution order of square frame can be changed, and/or the square frame of some descriptions can be changed, delete or combine.
As described in the text, the instruction that exemplary process in Fig. 5 and/or Fig. 6 can be used coding (for example, computer-readable instruction) realize, these instructions such as computer-readable medium (are for example stored in, hard disk drive, flash memory, read-only memory (ROM), CD (CD), digital versatile disc (DVD), high-speed cache, random access memory (RAM)) in tangible computer-readable medium and/or other storage medium, in these media, the time that information can be stored random length (for example, can store for a long time, interim storage, short time storage, adhoc buffer and/or described information is carried out to high-speed cache).As used in this article, term " tangible computer-readable medium " can clearly be defined as the signal that comprises any type computer readable storage medium storing program for executing but do not comprise propagation.Additionally or alternatively, the instruction that exemplary process in Fig. 5 and/or Fig. 6 can be used coding (for example, computer-readable instruction) realize, these instructions are stored in non-instantaneous computer-readable medium, such as hard disk drive, flash memory, read-only memory, CD, Digital video disc, high-speed cache, random access memory and/or other storage medium, in these media, the time that information can be stored random length (for example, can store for a long time, interim storage, short time storage, adhoc buffer and/or described information is carried out to high-speed cache).As used in this article, term " non-instantaneous computer-readable medium " can clearly be defined as the computer-readable memory that comprises any type but the signal that does not comprise propagation.As used in this article, while being used as transition word (transition term) in the preamble of phrase " at least " in claim, its scope is open, as term " comprise " represented implication also open.Therefore, in preamble, use the claim of transition word " at least " can comprise except clear and enumerate the element those elements in the claims.
Fig. 5 is the flow chart of example machine readable 500 that can carry out to realize the exemplary services provider 120 of Fig. 1.The media that the execution of the example machine readable 500 of Fig. 5 receives media provider 110 from service provider 120 media identification device 125 (frame 510).In this example, for example, in broadcast (on-the-spot broadcasting), receive described media.Yet media store and/or be cached in media identification device 125 in some instances.
Media identification device 125 in this example is then identified media (frame 520).Media identification device 125 for example, is identified media by extract measurement data (, signature, watermark, code etc.) from media.Measurement data based on extracting, media identification device 125 generator data (frame 530).In example, metadata generates with ID3 form.But, can be additionally or alternatively use any other metadata format.In addition,, in example, the measurement data of metadata based on extracting generates.Yet in some instances, metadata can be by being used some measurement data that extract or all measurement data inquiry external sources extracting to generate.
Then, transcoder 130 transcodings (frame 540) of the serviced provider 120 of media.In example, media are transcoded into can be via the MPEG2 transport stream of HTTP live TV stream (HLS) transmission.Particularly, service provider 120 metadata embedded device 135 is embedded into metadata (frame 550) in the timing text track being associated with HLS stream.In this example, metadata is embedded in HLS and flows in outside timing text track.Yet in some instances, metadata is embedded in media itself as for example closed caption.For example, timing text orbit information can be coded in MPEG2 transport stream as triggering according to the mode identical with external definition text track the closed caption data of timed events.In this example, the metadata being embedded in timing text track is identified at the different media that different time is presented.
Then, the medium dispenser 140 of the serviced provider 120 of media sends (frame 560).In example, media are utilized HTTP live TV stream (HLS) and send.But, can additionally or alternatively with any other form and/or agreement, send (for example, broadcast, clean culture, multicast etc.) media.
Fig. 6 mean can be performed to realize Fig. 1 and/flow chart of the example machine readable 600 of exemplary media monitor 165 in Fig. 2.The realization of the example machine readable 600 of Fig. 6 for example, starts from the instantiation (, being loaded by client terminal device 160) of media monitor 165.Then, the media renderer 210 of media monitor 165 starts to present media (frame 610) by the demonstration object for example loading for presenting via client terminal device 160.In example, show liking
Figure BPA0000184824400000171
object.Yet, can be additionally or alternatively use the demonstration object of any other type.When presenting media, media renderer 210 is recovered the timing text track file of relevant to media (for example, being associated with the object showing) of sign.
The event sniffer 220 of media monitor 165 starts event to monitor (frame 620).In this example, event sniffer 220 is monitored the JavaScript event being triggered by media renderer 210.In this example, JavaScript event is timing text track prompting change event.Yet in some instances, event sniffer 220 is monitored any other event, for example, for example, for example, such as media change event, user interactions event (, when user clicks an object), presented event (, the page loads) etc.If event sniffer 220 does not detect event, event sniffer 220 continues event to monitor, until media monitor 165 is closed.Different from captions and/or advertisement display system, the media monitor 165 in this example does not show information when timing text track prompting change event being detected.For example, captions and/or ad system can show captions and/or advertisement to user based on timing text track prompting change event and/or based on whether enabled captions and/or advertisement in media watch-dog 165 during media show.On the contrary, no matter whether in media watch-dog 165, enable captions and/or advertisement, to user, do not shown the data that are associated with timing text track prompting change event.
If event sniffer 220 detects event, the metadata restorer 230 of media monitor 165 recovers metadata (frame 630) from representing the DOM object of timing text track.Particularly, in example, event sniffer 220 passes to metadata restorer 230 by event object.Metadata restorer 230 checks that this event object is to recover metadata.For example, yet in some instances, event sniffer 220 transmits the identifier of object (, the demonstration object of media renderer 210), this identifier indication metadata restorer 230 will recover the object of metadata.In example, the form of metadata is ID3 label.Yet, additionally or alternatively, metadata can be used any other form.
Then the form (frame 640) that the transmitter 250 that, the metadata conversion device 240 of media monitor 165 is media monitor 165 by metadata conversion uses.In example, metadata is converted to text formatting from binary data format.In some instances, metadata is resolved to identify the part (for example, field, section etc.) of for example, concern in metadata (, school, artist, song title, album name, dispatching station/server site etc.).In some instances, metadata conversion device 240 is embedded into the identifier that presents the identifier of device and/or present the user of device in metadata.The identifier that presents the user of device and/or present device is included hub facility 170 can be associated the media that are presented with the user who presents device and/or present device.In example, metadata conversion device 240 before metadata is sent to hub facility 170 in metadata joining day stamp.Add timestamp (for example, the time that recording events occurs) and make it possible to identify exactly the time that the media that are presented and/or this media present, and/or the time that the media that are presented and/or this media present is associated with the user who presents device.
In some instances, metadata before being sent by transmitter for example, without conversion (, metadata sends with the form being recovered by metadata restorer 230).In such example, hub facility 170 such as by by metadata conversion, be different form, the analytical element data concern part in identification metadata etc. by metadata conversion centered by the form that uses of facility.The identifier that object that presented media are presented with identification medium is convenient in the conversion of 170 pairs of metadata of hub facility is associated.In some instances, hub facility 170 is stamped timestamp by metadata when receiving metadata.Add timestamp and make it possible to identify exactly the time that the media that are presented and/or this media present, and/or the time that the media that are presented and/or this media present is associated with the user who presents device.
Then, transmitter 250 sends to hub facility 170 (frame 650) by metadata.In example, adopt HTTPPost request to send metadata.Yet, additionally or alternatively, can use any other method that sends data and/or metadata.For example, can use file transfer protocol (FTP) (FTP), HTTP Get request, asynchronous JavaScript and extend markup language (XML) (AJAX) etc. to send metadata.In some instances, metadata is not sent to hub facility 170.The demonstration object that for example metadata can send to client terminal device 160 is to show to user.In example, by real time, (for example, the form to flow) sends to hub facility 170 to metadata.For example, yet in some instances, before being sent to hub facility 170, metadata can be stored (, high-speed cache or buffering etc.) a period of time.
Fig. 7 is the block diagram of the exemplary realization of the exemplary HLS stream 700 that shows of exemplary media monitor that can be in Fig. 2.In the example of Fig. 7, HLS stream 700 comprises inventory 710 and three transport stream.Yet, can be additionally or alternatively use the transport stream of any other quantity and/or type.In example, the exemplary HTML instruction 300 of Fig. 3 comprises the instruction of Additional Cargo List 710.In example, the exemplary HTML instruction 300 of Fig. 3 comprises the instruction of the timing text track 400 that loads Fig. 4.In example, inventory 710 is to client terminal device, to describe the .m3u8 file of available transport stream.Yet, can be additionally or alternatively use in the past, now and/or any other file format in the future.In some instances, can omit inventory 710, and media monitor 165 can directly use transport stream.In example, client terminal device for example, recovers inventory 710 in response to showing the instruction of HLS element (, video elementary).For example, the frame in Fig. 3 310 comprises that client terminal device should present the instruction that is stored in the HLS element being identified by inventory 710 that " movie.mp4 " locate.
HLS is a kind of self adaptation form, that is to say, although a lot of device has recovered identical inventory 710, according to one or more factor, can show different transport stream.For example, (for example there are different available bandwidths, high-speed Internet connection, low speed the Internet connection etc.) and/or the device of different display capabilities (for example, such as cellular small-size screen, such as the medium size screen of flat board and/or notebook, such as the large scale screen of TV etc.) can select to be applicable to the transport stream of its demonstration and/or bandwidth ability.In some instances, the cell phone that has the small screen and a limited bandwidth is used the transport stream of low resolution.Alternatively, in some instances, there is the television set that large-screen is connected with high-speed Internet and use high-resolution transport stream.For example, when the performance change of device (, this device connects while transforming to low speed the Internet connection from high-speed Internet), this device can be switched to different transport stream.
In the example of Fig. 7, show high-resolution transport stream 720, intermediate resolution transport stream 730 and low resolution transport stream 740.In this example, each transport stream 720,730 and/or 740 is representing a part (for example, 5 seconds, 10 seconds, 30 seconds, 1 minute etc.) for related media.Correspondingly, high-resolution transport stream 720 is corresponding to the first of media, and the second high-resolution transport stream 721 is corresponding to the second portion of media, and third high resolution transport stream 722 is corresponding to the third part of media.In addition, intermediate resolution transport stream 730 is corresponding to the first of media, and the second intermediate resolution transport stream 731 is corresponding to the second portion of media, and the 3rd intermediate resolution transport stream 732 is corresponding to the third part of media.In addition, low resolution transport stream 740 is corresponding to the first of media, and the second low resolution transport stream 741 is corresponding to the second portion of media, and the 3rd low resolution transport stream 742 is corresponding to the third part of media.Although show three transport stream for every kind of resolution in the example of Fig. 7, additionally or alternatively, can use an any amount transport stream of an any amount corresponding part that represents media.
In example, each transport stream 720,721,722,730,731,732,740,741 and/or 742 comprises video flowing 750,751,752, audio stream 755,757,752 and metadata streams 760,761,762.According to the resolution of the transport stream associated with video flowing, video flowing 750,751 and/or 752 comprises the video associated with the media of different resolution.Audio stream 755,756 and/or 757 comprises the audio frequency relevant to media.Metadata streams 760,761 and/or 762 comprises metadata, such as timing text orbital data, to link, closed caption data and/or the ID3 label associated with media of timing text orbital data.In some instances, owing to may sending to media monitor 165 as timing text track 400 for measuring the information of Streaming Media exposure rate, therefore can not comprise metadata streams 760,761 and/or 762.In some instances, metadata streams 760,761 and/or 762 comprises the information (for example, closed caption information etc.) not being included in timing text track 400.
Fig. 8 be can execution graph 5 and/or Fig. 6 in example machine readable to realize the block diagram of the exemplary process applicator platform 800 of exemplary services provider 120 in Fig. 1 and/or the exemplary media monitor 165 in Fig. 1 and/or Fig. 2.For example, exemplary process applicator platform 800 can be the calculation element of server, personal computer, mobile phone (for example, cell phone), flat computer, personal digital assistant (PDA), internet application, DVD player, CD Player, digital camera, Blu-ray player, game host, individual video camera, Set Top Box and/or other type.
The system 800 of current example comprises processor 812.For example, processor 812 can be realized from the type of any expectation or the microprocessor of manufacturer or controller by one or more.
Processor 812 comprises local storage 813 (for example, high-speed cache), and by bus 818 with comprise that the main storage of volatile memory 814 and nonvolatile memory 816 communicates.Volatile memory 814 can be deposited by Synchronous Dynamic Random Access Memory (SDRAM), dynamic random access memory (DRAM), RAMBUS dynamic random access memory the random access memory device realization of (RDRAM) and/or other any type.Nonvolatile memory 816 can be realized by the storage arrangement of flash memory and/or any other desired type.By storage control, control the access to main storage 814,816.
Computer 800 also comprises interface circuit 820, and this interface circuit 820 can be realized by the interface standard of any type, such as Ethernet interface, USB (USB) and/or PCI fast interface.
One or more input equipments 822 are connected with interface circuit 820.Input equipment 822 allows user that data and order are input to processor 812.For example, input equipment can be realized by keyboard, mouse, touch-screen, track pad, trace ball, isopoint and/or sound recognition system.
One or more of output equipments 824 are also connected with interface circuit 820.For example, output equipment 824 can for example, be realized by display unit (, liquid crystal display, cathode-ray tube display (CRT), printer and/or loud speaker).Therefore, interface circuit 820 generally includes image-driven card.
Interface circuit 820 (for example also comprises communicator, medium dispenser 140, transmitter 250), such as modulator-demodulator or network interface unit, for example, so that pass through network 826 (, Ethernet connection, digital subscriber line (DSL), telephone wire, coaxial cable, cell phone system etc.), carry out exchanges data with outer computer.
Computer 800 also comprises that one or each a plurality of high-capacity storages 828 are with storing software and data.The example of this class high-capacity storage 828 comprises floppy disk, hard disk drive, CD drive and digital versatile disc (DVD) driver.
The instruction 832 of the coding in Fig. 5 and/or Fig. 6 can be stored in high-capacity storage 828, in volatile memory 814, in nonvolatile memory 816, in local storage 813 and/or in removable memory medium (such as CD or DVD).
Although this paper describes specific illustrative methods, device and goods, therefore the coverage of this patent can not be restricted.On the contrary, this patent covers all methods, device and goods that clearly fall into the claim protection range of this patent.

Claims (40)

1. a method of measuring Streaming Media exposure rate, the method comprises:
From the media that obtain from media provider, extract measurement data;
Measurement data based on extracting, the metadata of media described in generating identification;
By described media transcoding, be transport stream, described transport stream has stream format; And
Described metadata is embedded in the timing text track of following described transport stream.
2. method according to claim 1, the method also comprises described transport stream and described timing text track is sent to request unit.
3. method according to claim 2, wherein, in response to the request of described request device, obtains described media from described media provider.
4. method according to claim 1, wherein, the described media that obtain from described media provider are live media.
5. method according to claim 1, wherein, the described media that obtain from described media provider are media of storage.
6. method according to claim 1, wherein, described stream format is HTML (Hypertext Markup Language) (HTTP) live TV stream (HLS) form.
7. method according to claim 1, wherein, described measurement data comprises the data that are coded in the watermark sending with described media.
8. method according to claim 7, wherein, described watermark is audio frequency watermark.
9. method according to claim 7, wherein, described watermark is video watermark.
10. method according to claim 1, wherein, described metadata is formatted as ID3 label.
11. 1 kinds of equipment of measuring Streaming Media exposure rate, this equipment comprises:
Media identification device, its measurement data based on extracting from media and the metadata of media described in generating identification;
Transcoder, it is transport stream by described media transcoding; And
Metadata embedded device, it embeds described metadata in the timing text track associated with described transport stream.
12. equipment according to claim 11, this equipment also comprises for sending the medium dispenser of described transport stream and described timing text track.
13. equipment according to claim 11, wherein, described transport stream is formatted as stream format.
14. equipment according to claim 13, wherein, described stream format is HTML (Hypertext Markup Language) (HTTP) live TV stream (HLS) form.
15. equipment according to claim 11, wherein, described metadata is formatted as ID3 label.
16. 1 kinds of machinable mediums, this machinable medium comprises instruction, described instruction makes machine at least when being performed:
From the media that obtain from media provider, extract measurement data;
Measurement data based on extracting, the metadata of media described in generating identification;
It by described media transcoding, is the transport stream with the form of stream; And
Described metadata is embedded in the timing text track of following described transport stream.
17. machine readable medias according to claim 16, this machine readable media is also included in while being performed and makes described machine described transport stream and described timing text track be sent to the instruction of request unit.
18. machine readable medias according to claim 17, wherein, in response to the request of described request device, obtain described media from described media provider.
19. machine readable medias according to claim 16, wherein, the described media that obtain from described media provider are live media.
20. machine readable medias according to claim 16, wherein, the media that obtain from described media provider are media of storage.
21. machine readable medias according to claim 16, wherein, described stream format is HTML (Hypertext Markup Language) (HTTP) live TV stream (HLS) form.
22. machine readable medias according to claim 16, wherein, described measurement data comprises the data that are coded in the watermark sending with described media.
23. machine readable medias according to claim 22, wherein, described watermark is audio frequency watermark.
24. machine readable medias according to claim 22, wherein, described watermark is video watermark.
25. machine readable medias according to claim 16, wherein, described metadata is formatted as ID3 label.
26. 1 kinds of methods of measuring Streaming Media exposure rate, the method comprises:
With processor, detect the timing text rail event being associated with the media that receive via Media Stream presenting device place;
In response to described timing text rail event, check for presenting DOM Document Object Model (DOM) object of the application of described media, to recover to embed the metadata in described timing text track; And
At least one in described metadata or the data based on described metadata outputed to media and measure server.
27. methods according to claim 26, the method also comprises processes described metadata to form media exposure rate metric.
28. methods according to claim 27, the method also comprise by user or described in present device identifier send to media measurement system.
29. methods according to claim 28, wherein, described in present device described identifier be embedded in described media exposure rate metric.
30. methods according to claim 26, wherein, described metadata is stored with JavaScript object tag (JSON) form.
31. methods according to claim 26, wherein, described metadata receives with ID3 form.
32. methods according to claim 26, wherein, described Media Stream is formatted as HTML (Hypertext Markup Language) (HTTP) live TV stream (HLS) form.
33. methods according to claim 26, the method is also included at least one in described metadata or the data based on described metadata adds timestamp.
34. 1 kinds of machinable mediums, this machinable medium comprises instruction, described instruction makes machine at least when being performed:
Detect the timing text rail event be associated with the media that receive via Media Stream presenting device;
In response to described timing text rail event being detected, check for presenting DOM Document Object Model (DOM) object of the application of described media, with the metadata of recovering to carry in described Media Stream; And
At least one in described metadata or the data based on described metadata sent to media measurement system.
35. machinable mediums according to claim 34, this machinable medium also comprises for the treatment of described metadata to form the instruction of media exposure rate metric.
36. machinable mediums according to claim 34, this machinable medium also comprises for the described identifier that presents the user of device being sent to the instruction of described media measurement system.
37. machinable mediums according to claim 36, wherein, described in present device identifier be embedded in described media exposure rate metric.
38. machinable mediums according to claim 34, wherein, described metadata receives with ID3 form.
39. machinable mediums according to claim 34, wherein, described Media Stream is formatted as HTML (Hypertext Markup Language) (HTTP) live TV stream (HLS) form.
40. machinable mediums according to claim 34, this machinable medium also comprise for make described machine described metadata or based on described metadata according at least one on add the instruction of timestamp.
CN201280032740.2A 2011-06-21 2012-06-21 Methods and apparatus to measure exposure to streaming media Pending CN103733629A (en)

Applications Claiming Priority (11)

Application Number Priority Date Filing Date Title
US201161499520P 2011-06-21 2011-06-21
US61/499,520 2011-06-21
US201161568631P 2011-12-08 2011-12-08
US61/568,631 2011-12-08
US13/341,646 2011-12-30
US13/341,661 US9515904B2 (en) 2011-06-21 2011-12-30 Monitoring streaming media content
US13/341,661 2011-12-30
US13/341,646 US9210208B2 (en) 2011-06-21 2011-12-30 Monitoring streaming media content
US13/455,961 US20130290508A1 (en) 2012-04-25 2012-04-25 Methods and apparatus to measure exposure to streaming media
US13/455,961 2012-04-25
PCT/US2012/043546 WO2012177874A2 (en) 2011-06-21 2012-06-21 Methods and apparatus to measure exposure to streaming media

Publications (1)

Publication Number Publication Date
CN103733629A true CN103733629A (en) 2014-04-16

Family

ID=47423204

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201280032740.2A Pending CN103733629A (en) 2011-06-21 2012-06-21 Methods and apparatus to measure exposure to streaming media

Country Status (5)

Country Link
EP (1) EP2756684A4 (en)
CN (1) CN103733629A (en)
AU (1) AU2012272876B2 (en)
MX (1) MX2014000281A (en)
WO (1) WO2012177874A2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105100869A (en) * 2015-07-13 2015-11-25 腾讯科技(深圳)有限公司 Bullet curtain displaying method and device
CN105306964A (en) * 2015-10-23 2016-02-03 北京理工大学 Quick recovery system and quick recovery method for video stream transcoding fault
CN106790380A (en) * 2016-11-21 2017-05-31 广州华多网络科技有限公司 Data reporting method and device

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2003234420A1 (en) 2002-12-27 2004-07-29 Nielsen Media Research, Inc. Methods and apparatus for transcoding metadata
US9380356B2 (en) 2011-04-12 2016-06-28 The Nielsen Company (Us), Llc Methods and apparatus to generate a tag for media content
US9209978B2 (en) 2012-05-15 2015-12-08 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US9210208B2 (en) 2011-06-21 2015-12-08 The Nielsen Company (Us), Llc Monitoring streaming media content
US8538333B2 (en) * 2011-12-16 2013-09-17 Arbitron Inc. Media exposure linking utilizing bluetooth signal characteristics
US9282366B2 (en) 2012-08-13 2016-03-08 The Nielsen Company (Us), Llc Methods and apparatus to communicate audience measurement information
US9313544B2 (en) 2013-02-14 2016-04-12 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US9332035B2 (en) * 2013-10-10 2016-05-03 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
JP2017514345A (en) 2014-03-13 2017-06-01 ベランス・コーポレイション Interactive content acquisition using embedded code
US10504200B2 (en) 2014-03-13 2019-12-10 Verance Corporation Metadata acquisition using embedded watermarks
US9699499B2 (en) 2014-04-30 2017-07-04 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
WO2016028936A1 (en) 2014-08-20 2016-02-25 Verance Corporation Watermark detection using a multiplicity of predicted patterns
US9986288B2 (en) * 2014-08-21 2018-05-29 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US20160094600A1 (en) 2014-09-30 2016-03-31 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US9942602B2 (en) 2014-11-25 2018-04-10 Verance Corporation Watermark detection and metadata delivery associated with a primary content
EP3225034A4 (en) 2014-11-25 2018-05-02 Verance Corporation Enhanced metadata and content delivery using watermarks
WO2016100916A1 (en) * 2014-12-18 2016-06-23 Verance Corporation Service signaling recovery for multimedia content using embedded watermarks
US9762965B2 (en) 2015-05-29 2017-09-12 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US20180376173A1 (en) * 2015-07-16 2018-12-27 Sony Corporation Transmission device, transmission method, reception device, and reception method
US11722741B2 (en) 2021-02-08 2023-08-08 Verance Corporation System and method for tracking content timeline in the presence of playback rate changes

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6006227A (en) * 1996-06-28 1999-12-21 Yale University Document stream operating system
US7738550B2 (en) * 2000-03-13 2010-06-15 Sony Corporation Method and apparatus for generating compact transcoding hints metadata
US20040003394A1 (en) * 2002-07-01 2004-01-01 Arun Ramaswamy System for automatically matching video with ratings information
US20040073941A1 (en) * 2002-09-30 2004-04-15 Ludvig Edward A. Systems and methods for dynamic conversion of web content to an interactive walled garden program
AU2003234420A1 (en) * 2002-12-27 2004-07-29 Nielsen Media Research, Inc. Methods and apparatus for transcoding metadata
US7383229B2 (en) * 2003-03-12 2008-06-03 Yahoo! Inc. Access control and metering system for streaming media
US7962547B2 (en) * 2009-01-08 2011-06-14 International Business Machines Corporation Method for server-side logging of client browser state through markup language

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105100869A (en) * 2015-07-13 2015-11-25 腾讯科技(深圳)有限公司 Bullet curtain displaying method and device
WO2017008551A1 (en) * 2015-07-13 2017-01-19 腾讯科技(深圳)有限公司 Bullet screen display method and apparatus
CN105306964A (en) * 2015-10-23 2016-02-03 北京理工大学 Quick recovery system and quick recovery method for video stream transcoding fault
CN105306964B (en) * 2015-10-23 2018-05-08 北京理工大学 A kind of video stream transcoding failure quick recovery system and restoration methods
CN106790380A (en) * 2016-11-21 2017-05-31 广州华多网络科技有限公司 Data reporting method and device

Also Published As

Publication number Publication date
EP2756684A2 (en) 2014-07-23
AU2012272876B2 (en) 2016-06-16
EP2756684A4 (en) 2015-06-24
WO2012177874A3 (en) 2013-02-28
AU2012272876A1 (en) 2013-05-02
MX2014000281A (en) 2014-04-30
WO2012177874A2 (en) 2012-12-27

Similar Documents

Publication Publication Date Title
CN103733629A (en) Methods and apparatus to measure exposure to streaming media
US11968413B2 (en) Methods and apparatus to measure exposure to streaming media
US12010380B2 (en) Methods and apparatus to measure exposure to streaming media
CN103733630A (en) Methods and apparatus to measure exposure to streaming media
US9313544B2 (en) Methods and apparatus to measure exposure to streaming media
US20130291001A1 (en) Methods and apparatus to measure exposure to streaming media
US20130268623A1 (en) Methods and apparatus to measure exposure to streaming media
CN103748825B (en) The method and apparatus measuring Streaming Media exposure rate
AU2014331927A1 (en) Methods and apparatus to measure exposure to streaming media
AU2012272872B8 (en) Methods and apparatus to measure exposure to streaming media

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1195836

Country of ref document: HK

WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20140416

REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1195836

Country of ref document: HK