Connect public, paid and private patent data with Google Patents Public Datasets

Mobile media, devices, and signaling

Download PDF

Info

Publication number
US20100226526A1
US20100226526A1 US12650306 US65030609A US2010226526A1 US 20100226526 A1 US20100226526 A1 US 20100226526A1 US 12650306 US12650306 US 12650306 US 65030609 A US65030609 A US 65030609A US 2010226526 A1 US2010226526 A1 US 2010226526A1
Authority
US
Grant status
Application
Patent type
Prior art keywords
device
watermark
media
content
mobile
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12650306
Inventor
Sierra K. Modro
Ravi K. Sharma
Brian T. MacIntosh
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Digimarc Corp
Original Assignee
Digimarc Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • G06T1/0021Image watermarking
    • G06T1/005Robust watermarking, e.g. average attack or collusion attack resistant
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00577Recognising objects characterised by unique random properties, i.e. objects having a physically unclonable function [PUF], e.g. authenticating objects based on their unclonable texture
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • G06T1/0021Image watermarking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device
    • H04N1/32101Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32144Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
    • H04N1/32149Methods relating to embedding, encoding, decoding, detection or retrieval operations
    • H04N1/32309Methods relating to embedding, encoding, decoding, detection or retrieval operations in colour image data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device
    • H04N1/32101Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32144Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
    • H04N1/32149Methods relating to embedding, encoding, decoding, detection or retrieval operations
    • H04N1/3232Robust embedding or watermarking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225Television cameras ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/232Devices for controlling television cameras, e.g. remote control; Control of cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in, e.g. mobile phones, computers or vehicles
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/278Subtitling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/7904Processing of colour television signals in connection with recording using intermediate digital signal processing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/87Regeneration of colour television signals
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2201/00General purpose image data processing
    • G06T2201/005Image watermarking
    • G06T2201/0065Extraction of an embedded watermark; Reliable detection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/0077Types of the still picture apparatus
    • H04N2201/0089Image display device

Abstract

Consumer uses of mobile devices and electronic media are changing. Mobile devices include increased computational capabilities, mobile broadband access, better integrated sensors, and higher resolution screens. These enhanced features are driving increased consumption of media such as images, maps, e-books, audio, video, and games. As users become more accustomed to using mobile devices for media, opportunities arise for new digital watermarking usage models. For example, transient media, like images being displayed on screens, can be watermarked to provide a link between mobile devices, extending the reach of digital watermarking. Digital fingerprinting can also be employed. Applications based on these emerging usage models can provide richer user experiences and drive increased media consumption. A great variety of other features and arrangements are also detailed.

Description

    RELATED APPLICATION DATA
  • [0001]
    This application claims priority benefit to provisional application 61/142,127 filed Dec. 31, 2008.
  • TECHNICAL FIELD
  • [0002]
    The present technology relates to portable devices, such as PDAs, smart phones, etc., and use of such devices in conjunction with audio and visual media.
  • BACKGROUND AND SUMMARY
  • [0003]
    Although digital watermarking has been commercially available for several years, relatively few applications have directly targeted consumers. Traditional applications of digital watermarking such as copy prevention, copyright communication, and broadcast monitoring, involve embedding the watermark at the point of media creation or distribution and detecting the watermark either on a tethered system or a dedicated device. While these usages have utility for consumers, they are primarily of interest to content creators and media distributors.
  • [0004]
    Modes of digital media consumption are changing, fueled by the emergence of advanced computational and communications capabilities in mobile devices. Electronic media is increasingly being consumed on mobile devices. Consequently, distribution and delivery of media to mobile devices is becoming more relevant. This creates opportunities for new and emerging usage models based on digital watermarking. These usage models are enabled by the ability of digital watermarks to survive digital-to-analog-to-digital (D-A-D) transformations. In these usage models, the digital watermark serves as a link between media being played or displayed, and online content pertinent to that media.
  • [0005]
    The new usage models create new opportunities for use of digital watermarking by combining watermarking with the capabilities of mobile devices, including mobile phones, Mobile Internet Devices (MIDs), and Ultra-Mobile PCs (UMPCs). For example, transient media such as images or video displayed on a screen (e.g. LCD panel) can be watermarked and then detected using a mobile device. Applications based on these usage models can provide richer user experiences and intuitive interfaces by allowing interaction with the media itself. These applications can enable easier distribution and delivery of media on to mobile devices and drive further media consumption.
  • [0006]
    Usage models linking media content to the Internet using watermarking [1] [2] and content-based identification technologies [4] have been proposed earlier. Watermarking usually imparts a content-independent identity to the media, whereas content-based identification technologies (such as digital fingerprinting, media recognition) derive an identity from the content itself. The proliferation of capable mobile devices and mobile media usage has made such models more viable and compelling. This has resulted in emerging applications based on these models. Watermarking offers benefits that can expand the applicability of some of the usage models and enables new ones.
  • [0007]
    The foregoing are just a few of the features of the technology detailed below.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • [0008]
    FIG. 1 shows elements employed in exemplary applications of the present technology.
  • [0009]
    FIG. 2 shows a flowchart of one particular process employing aspects of the present technology.
  • [0010]
    FIG. 3 shows a flowchart of another process employing aspects of the present technology.
  • [0011]
    FIG. 4 shows a block diagram of an apparatus employing aspects of the present technology.
  • DETAILED DESCRIPTION
  • [0012]
    Until recently, mobile devices have had restricted capabilities—limited processing power coupled with low amounts of available memory. These devices frequently had fixed focal length cameras with no macro capability, assuming they had a camera at all. The availability of mobile broadband access was limited to major metro areas only and was cost-prohibitive for average consumers.
  • [0013]
    However, the technological landscape has been changing over the last few years and the vision looking forward is much more attractive. Chip manufacturers are designing silicon specifically for ultra-low power draw while providing enhanced performance over older generations. This is improving battery life and allowing for sleeker industrial designs due to less need for bulky thermal solutions. Additionally, many new devices include improved camera capabilities, with more and more devices opting to include video recording as well.
  • [0014]
    These smaller devices are more attractive to consumers and easier to carry around regularly. As a result, consumers are using the enhanced capabilities to increase media consumption and mobile Internet access. The emergence of higher speed mobile broadband, including WiMAX and LTE (4G), allow for higher throughput for high quality video streaming while mobile, enabling mobile television usage models. Consumers are also using ultra-portable devices for general purpose computing due to the convenience of “always on, always connected” features. Accessing media through online storefronts like iTunes and Amazon.com is increasing the demand for content optimized for smaller screens. As a result of these changes, demand for higher capability mobile devices is increasing. While the demand over the last two years has been growing stronger, projections show a continued increase in demand over the next five years. This should drive further mobile consumption of media. As users consume more content while mobile, opportunities emerge for improvements to user experiences through digital watermarking.
  • [0015]
    The infrastructure for software development for mobile devices has also advanced. It is now relatively easy to develop applications for mobile devices and to deliver software to devices over a mobile broadband connection. The combination of the iPhone SDK, the App Store, and the Apple iPhone is a prime example of integration of software development infrastructure, delivery and deployment.
  • [0016]
    In addition to the enhanced capabilities of the mobile devices themselves, large high resolution flat screen monitors are affordable and capable of displaying images at high quality. This allows reading watermarks directly from the screen. Flat screens are also proliferating through digital picture frames. Also, mobile devices themselves are tending towards larger and higher resolution screens.
  • Usage Models For Digital Watermarking
  • [0017]
    Digital watermarks can survive Digital-Analog-Digital transformations. Robust watermarks may even survive multiple such transformations. In the past, this ability of digital watermarks has been exploited to enable print-to-web [1] applications that connect printed material containing digital watermarks with the web. The advent of powerful computational capabilities in mobile devices, and the proliferation of media consumption on these devices, provide opportunities for new and emerging digital watermarking usage models in addition to the print-to-web model.
  • [0018]
    FIG. 1 illustrates some of the implementations. A mobile device, such as a microphone- and camera-equipped iPhone, samples content presented by various other devices. These other devices can include—without limitation, broadcast and cable television receivers, audio players, video players, electronic picture frames, games and gaming consoles, laptops, etc. (Although the depicted gaming device does not include a screen, many do.)
  • Linking to Digitally Displayed Content
  • [0019]
    Consumption of digital media usually involves displaying the content on a display screen (such as an LCD panel) in the case of text, images, video, and games, or playing it over-the-air in the case of audio. If digital media is watermarked before the point of consumption, the watermark can provide an identity to the media. This identity can enable linking to more information about the media simply by capturing a portion of the played or displayed media using the mobile device. The watermark thus provides opportunities for intuitive interactions with the media.
  • [0020]
    Imagine a watermarked photo displayed on a screen such as a digital picture frame. By pointing at the picture frame with the camera in a mobile device, enabled with watermark detection software, the watermark in the photo can be detected and identified. On identification, the mobile device can be linked to an online photo sharing service like Flickr or Picasa. The user may then download the image or a higher resolution copy, order prints, or browse through related albums or photos. The watermark facilitates an enriched and intuitive user experience—the user just points the mobile device at the screen to obtain related information from the Internet. Availability of a broadband connection, and sufficient computational throughput for watermark detection on the mobile device, are the enabling factors in this example.
  • [0021]
    Extensions of this model include watermarking media content such as electronic maps, e-books, web pages, or even banner ads on web pages. In fact, the model can be expanded to include any content displayed on either a part of the screen or the entire screen. The move towards larger sized screens with higher resolutions for mobile devices implies that this usage model can also be applied to link displayed media on one mobile device to another mobile device.
  • [0022]
    As use of software applications on mobile devices becomes commonplace, ease of finding the right applications gains importance. Efforts such as the iTunes AppStore have begun addressing this aspect. Now consider that the user interface for an application (or other graphic display presented by the application on the screen) is watermarked. (As is familiar to the artisan, slight variations can be made to essentially any graphic, including solid colors, backgrounds, text, etc., to effect digital watermarking.) The application can then be identified by pointing to it with another device. As friends or colleagues share experiences with new mobile applications, they can link directly to the location of the application in an application store. This kind of direct sharing simplifies the discovery of applications on mobile devices and complements the convenience provided by application stores.
  • [0023]
    A similar concept can be applied to games, e.g., by watermarking the texture maps or the user interface displayed on the screen. Different watermarks can be used to identify different levels within the games. In addition to enabling sharing, watermark detection can also be used to expose additional functionality, say in the form of interaction between devices and players, rewards, or hidden features.
  • [0024]
    In other embodiments, the audio output from such applications/games can be watermarked to serve the same purposes.
  • [0025]
    Such arrangements can also be implemented by use of image or audio fingerprints. A fingerprint derived from image or audio data that is captured from an application/game is matched in a database, which then provides a link to an online store from which the application/game can be downloaded and/or purchased.
  • Audio Playing Over-the-Air
  • [0026]
    As indicated, the usage models described above are also applicable to audio. Linking to music played over-the-air using watermarking techniques [2] as well as content-based identification techniques [4] such as fingerprinting has been previously proposed. However, watermarking can be used to extend the model to many situations involving audio, beyond just music—including broadcast television, radio, live podcasts, in a movie theater, or even subscription and paid content playing on another mobile device. For example, consider that a listener is tuned into a live discussion or news event on radio. The listener may like to obtain a podcast of this event for later listening. The listener activates the watermark detection application on the mobile device, which reads the payload, identifies the podcast and “bookmarks” it for later use Such usage models become more viable as computational capabilities of mobile devices support real-time watermark detection from the captured audio stream.
  • Video Displayed on a Screen
  • [0027]
    This usage model is based on detecting a watermark in a displayed video by capturing the video using the camera on a mobile device. The video can be displayed on an LCD screen, television, movie screen, or even on the screen of another mobile device. Following the themes described for images and audio, the detected watermark can identify the video and route the user to relevant information on the Internet.
  • [0028]
    For some videos like advertisements, identification of the video can trigger a download of the video over the broadband connection, replicating the video on the user's device. Such a response can further enable viral distribution of advertisements and teaser video. The video watermark can change dynamically along the duration of the video. This can enable different information to be relayed to the detecting mobile device at different points during the video.
  • [0029]
    This usage model can also be expanded using an amalgamation of some of the usage models described earlier. For example, the video can also be identified through the watermark in the audio accompanying the video or in the thumbnail image for the video.
  • Digital Signage
  • [0030]
    Digital signage refers to displays, banners or billboards that use flat panel screens such as LCDs to show customizable content including advertisements, information, and entertainment. Examples of such displays can already be seen at airports, shopping malls, and hotels. Adoption of digital signage is expected to increase rapidly given the advantages it provides—customizable content that can be changed easily and frequently to target specific audiences.
  • [0031]
    Watermarking can be used to enable the audience to connect to this content using their mobile devices. The connection can be provided by embedding the displayed media with a digital watermark. The entire display can be watermarked (i.e., the entire graphic shown on the LCD screen can be embedded), possibly in real time. This watermark can be read by pointing an enabled mobile device at the display. Reading the watermark can facilitate the desired connection to related information about the displayed content, leading to an interactive experience.
  • [0032]
    The transitory nature of the content displayed on digital signage and the desire to target the content at a location-specific audience makes it ideal for use with watermarking. For example, an advertisement from a national retailer playing over an airport display would want to connect to the local store for that retailer. This can be easily achieved by embedding a different watermark corresponding to each location specific version of the same advertisement.
  • Other Opportunities
  • [0033]
    The usage models described above provide opportunities for driving further innovation in digital watermarking technologies. The usual attributes of imperceptibility, speed and robustness remain crucial driving factors. The new usage models pose additional possibilities and challenges for each of these existing attributes and create new attributes that become relevant when detecting from screens and over-the-air.
  • Robustness and Imperceptibility
  • [0034]
    Many of the new usage models rely on the survivability of the watermark signal through D-A-D transformations. Surviving this cycle of transformations is more challenging than digital-to-digital transformations. For images, the watermark signal must be capable of recovering from geometric distortions. For detecting watermarks in over-the-air audio, multi-path interference and background noise issues must be addressed. For all media types, the watermark should be capable of surviving compression cycles (encoding and decoding). This is particularly important for video encoded at lower bit rates for transfer on slow speed networks. With the increasing proliferation of broadband access over mobile devices, this is likely to be less of an issue for consumer quality video in the future.
  • [0035]
    For these emerging usage models to gain broad acceptance, the watermark signal should be imperceptible. The model of detecting watermarks from display screens opens up new areas of innovation. For example, the watermark signal can be tailored towards screen display and detection. In addition, the resolution of the watermark can be altered for optimal detection by changing the size of the displayed image (or video) on screen by zooming in or out. Also, given that the color gamut on screen is larger than that for print, there can be opportunities for taking advantage of color for imperceptibility and robustness.
  • Ease of Use
  • [0036]
    Ideally, the model of pointing a mobile device to a watermarked source (screen image, audio, video, etc.) should work without any detailed instruction to the user. Instructions, if any, should be fairly intuitive, e.g. slowly move the mobile device closer to the marked media starting at arm's length. To support this intuitive interface, speed of watermark detection becomes important. Ideally, capture of the media as well as watermark detection should both take place in real-time. For detecting screen images, this means that the camera on the mobile device should capture and detect at a high frame-rate so that there is no perceived drop in frame-rate observed on the screen of the capturing device. Supporting this model requires optimized detectors, possibly taking advantage of some of the intrinsic capabilities of the mobile devices (multiple cores, graphics capabilities, signal processing primitives, etc.). Audiovisual feedback during the process of watermark detection can also improve ease of use. Such feedback can be used to guide the user to properly position the detecting device for optimal detection.
  • Transient Watermarks
  • [0037]
    A transient watermark is one which is embedded into the media just before the point of consumption. For instance, a watermark can be embedded into an image just before it is displayed on an LCD screen. Transient watermarks can be applied to media that has no prior watermark to enable linking such media to mobile devices. Embedding of transient watermarks often requires real-time embedding capabilities, particularly when dealing with media such as video. Alternatively, one can treat all graphics rendered on a digital display as a video stream and embed this stream. A novel embedding approach, in this case, is to use the device's graphics capabilities to embed the watermark signal in the rendered graphics.
  • [0038]
    As mentioned earlier, to support the emerging usage models, the watermark signal should be robust to survive D-A-D transformations. Increasingly, digital watermarks are introduced at media origination to support applications including copyright communication and broadcast monitoring, and measurement. Some of these applications are based exclusively in the digital domain. Consequently those watermarks may not be well suited for the emerging usage models. However, such watermark signals already provide the digital identity required for these usage models, which can be translated into a transient watermark at the time of media consumption. For instance, consider a video stream that already contains a watermark that cannot be detected from the displayed version of the video using a mobile device. A new transient watermark can be embedded in the video before display. The transient watermark can then be designed specifically to suit mobile detection from a display.
  • Ease of Embedding
  • [0039]
    For the new usage models to succeed, the embedding process should be automated and easily accommodated in existing workflows. The speed of the embedding operation is important in most cases, particularly for transient watermarks described above where real-time embedding may be desired.
  • [0040]
    One implementation for transient watermarks is to introduce the watermark in the form of an overlay that is layered on top of the existing video. In this case the watermark layer is analogous to a transparency placed above the displayed content. The advantage of this technique is that it circumvents the traditional route of embedding the watermark into the content. As a result, this operation can be performed rather quickly for real-time watermark insertion.
  • Detection Framework
  • [0041]
    For watermarking to provide an intuitive interface and user experience, a detection framework must be provided to encompass multiple watermarking technologies. This framework should be capable of determining the appropriate watermark detection engine to employ for the media being acquired by the detector, with minimum intervention from the user.
  • [0042]
    Ideally, the user should not have to select the appropriate detector for linking to specific captured content. For instance, the detection framework should ideally be able to determine the appropriate audio watermark detection engine based on whether the acquired content is audio from broadcast television or radio or a movie theater. Achieving this capability is aided by equipping the detection framework with contextual awareness (e.g., time of day), sensory data (e.g., proximity, lighting), and other added intelligence (e.g., location from GPS coordinates). The detection framework can also be arranged to perform a quick assessment of the type of watermark present before performing intensive detection operations using a specific detection engine. The signaling for these different content dissemination avenues may also be designed with the detection framework in mind to provide a common protocol for signaling the type of technology employed.
  • [0043]
    The detection framework can also encompass complementary content-based identification technologies such as fingerprinting.
  • [0044]
    One form of audio fingerprinting technology said to be suitable with ambient audio is disclosed in Google's patent application 20070124756. Another is disclosed in U.S. Pat. No. 7,359,889 and patent publication 20070143777 to Shazam, and in Wang, The Shazam Music Recognition Service, Communications of the ACM, Vo. 49, No. 8, August, 2006, pp. 44-48. Still other fingerprinting techniques are disclosed in Nielsen's patent publications 20080276265 and 20050232411. (Nielsen maintains a fingerprint database by which it can identify broadcast television by reference to audio fingerprints.)
  • [0045]
    The framework can provide the data sampling, pre-processing, filtering, and transformations that are common to the applicable identification technologies. An example of such processing is FFT decomposition for frequency analysis. The detection framework should be flexible to accommodate additional identification technologies or combination techniques based on two or more technologies.
  • [0046]
    FIG. 2 shows one embodiment of such technology. The process begins by establishing the location of the device, such as by GPS or other means. If the location information is in the form of latitude/longitude, it can be submitted to a web service to obtain descriptors relating to that place.
  • [0047]
    One such web service is Microsoft's MapPoint Web Service. This service offers a function, GetLocationInfo, that takes as input a latitude/longitude, and returns as output metadata relating to that location—such as a street address. This street address can then be submitted to a service, such as Google, to identify the building at that location.
  • [0048]
    Another geolocation service is Yahoo's GeoPlanet service, which returns a hierarchy of descriptors such as “Rockefeller Center,” “10024” (a zip code), “Midtown Manhattan,” “N.Y.,” “Manhattan,” “N.Y.,” and “United States,” when queried with the latitude/longitude of the Rockefeller Center. Another related service is GeoNames<dot>org. (It will be recognized that the “<dot>” convention, and omission of the usual http preamble, is used to prevent the reproduction of this text by the Patent Office from being indicated as a live hyperlink.) In addition to providing place names for a given latitude/longitude (at levels of neighborhood, city, state, country), and providing parent, child, and sibling information for geographic divisions, GeoNames also provides functions such as finding the nearest intersection, finding the nearest post office, finding the surface elevation, etc.
  • [0049]
    From the web look-up, the method determines whether the user is at a location corresponding to a movie theatre.
  • [0050]
    Meanwhile, or next, the device captures and digitizes ambient audio. If the location is determined to be a movie theatre, the device applies a watermark detector process corresponding to audio watermarks expected to be found in theatrical presentations of motion pictures (e.g., digital cinema watermarks). This process can include digitizing the captured audio at a particular sample rate optimized for detection of such watermarks, transforming the sampled audio to the frequency domain, such as by an FFT (with a number and spacing of bins particularly corresponding to the expected watermark). It can also include applying windowing and other filters as may be associated with detection of the digital cinema watermark. Finally, the form of analysis applied to extract the encoded payload from the processed data is the one appropriate for the expected watermark.
  • [0051]
    If the location does not correspond to a movie theatre, the device proceeds differently. It may try a series of different decoding operations, looking for one that yields valid output data. (Most watermarking protocols include error checking capabilities, so correct decoding can be confirmed. In fingerprinting, a “no-match” from the database can indicate that a different fingerprint algorithm/database should be tried.)
  • [0052]
    Perhaps the most likely watermark would be the one commonly found in radio broadcasts—inserted for Arbitron by radio broadcasters for audience measurements purposes. Another one may be the watermark commonly found in television broadcasts—inserted for Nielsen by television broadcasters. Still another one may be a watermark inserted by music distributors, such as Amazon, to identify certain electronically-delivered entertainment content. A series of such decoding regimes may be applied (with more probable processes applied first), until one yields valid output data.
  • [0053]
    The action taken by the portable device depends on the watermark decoded (or fingerprint found).
  • [0054]
    For example, the digital cinema watermark is a forensic mark that conveys tracking information, which is carried into subsequent legitimate or illegitimate copies of the content. Inserted immediately after the digital content is decrypted, the forensic watermark typically comprises a recurring 35 bit payload, indicating the theatre and screen being viewed (by a location code), together with the date and time (a timestamp). Further details are available from the Digital Cinema System Specification, published at the web site dcimovies<dot>com.
  • [0055]
    From the location and the time, the movie title can readily be determined, e.g., from online movie listings. (Or, an identifier corresponding to the movie title can be encoded in the watermark, and resolved by reference to a corresponding database.)
  • [0056]
    By knowing the movie title, the user's device can link to various related content, e.g., actor biographies, out-take reels, script text, etc. Knowledge of the location, and the presentation time, allows further customization of related content, e.g., happy hour promotions at a nearby brewpub, etc.
  • [0057]
    The device can also present a synchronized display of subtitle information (e.g., closed-captioning) corresponding to text spoken in the movie.
  • [0058]
    From the decoded location code and timestamp, the device consults public and/or private databases to identify the movie being screened. With a movie identifier, the device links to an online repository containing the movie script—or other source of subtitle data.
  • [0059]
    If the watermark contains a running timecode (indicating instantaneous position in the movie), the text from the repository can be presented to the user on the screen of the device—advancing in correspondence with the timecodes. However, the timestamps in current digital cinema watermarks do not allow for very accurate synchronization. So other ways of synchronization can be employed.
  • [0060]
    One alternative is to use features of the detected audio, e.g., audio landmarks or fingerprints, to identify the current location within the movie (by comparing against a database of known landmark features—each associated with a respective SMPTE timecode). The corresponding subtitle for that scene of the movie, or excerpt of dialog, can then be displayed. (The subtitles can be indexed by the SMPTE timecodes.) The fingerprint technologies detailed earlier can be used for this purpose.
  • [0061]
    Once the current location within the motion picture has been determined, the subtitle data can be advanced in real-time with essentially no further adjustment. However, to assure that unforeseen difficulties do not desynchronize the subtitling, audio landmark checks can be made periodically (e.g., once per minute) to assure that the movie presentation is advancing as expected.
  • [0062]
    Another way that display of subtitle data can be synchronized with the displayed motion picture is by image landmarks (video fingerprints)—detected using a camera portion of the portable device. (Various video fingerprints are known; one is detailed in Vobile's patent publication 20070253594.) As with audio landmarks, the video landmarks can be used to identify the current location in the motion picture, so that corresponding subtitling downloaded from the internet (or other source) can be presented on the screen of the user's portable device.
  • [0063]
    If there are several users of such portable devices within the movie auditorium, it is redundant for each of them to perform all of the processing and searching detailed above. Instead, information determined by one user can be shared with others.
  • [0064]
    The sharing can be accomplished by various known means, including ad hoc wireless networks, infrared networking, Bluetooth, WiFi, etc. The information shared can be the decoded watermark data, the SMPTE timecode for the present instant (determined by reference to content features, etc.), the current subtitle phrase(s), movie-related metadata obtained from the internet, etc.
  • [0065]
    In still other arrangements, the theatre owner can distribute some or all of this information to users in the auditorium. With its access to the digital version of the content—often including SMPTE timecodes and subtitling data—together with superior hardware and network infrastructure, the theatre owner can easily distribute timecodes, subtitles, and/or other information using the foregoing means. Moreover, with its control over the audio and imagery presented in the auditorium, the theatre operator can convey information to the consumers by other signaling means—such as by its own added audio or video watermark, infrared projection of data signals on the screen, etc.
  • [0066]
    The subtitle information can be presented on the user's portable device display by itself, or with other information (e.g., in a pane at the bottom of the screen, permitting other applications—such as MySpace, email, etc., to be displayed concurrently). The displayed font may be set by the user (allowing more or less information to be displayed by use of a smaller or larger font), or the subtitling may be delivered in pre-formatted image (video) form.
  • [0067]
    Oftentimes, subtitling in different languages is available. The user can select a language different than that spoken in the movie—if desired.
  • [0068]
    By the foregoing arrangements, it will be recognized that movie-goers can glance at their cell phones to review movie dialog they may have missed, e.g., due to hearing impairment, lack of language fluency, distraction, etc. Other information relating to the movie can similarly be presented.
  • [0069]
    The FIG. 2 arrangement particularly contemplated use of location data to determine, e.g., if the user is at a cinema. Similar principles can be expanded to other circumstances, as shown in FIG. 3.
  • [0070]
    In the FIG. 3 arrangement, the device collects a variety of clues that may be useful in identifying the type of watermark (or other signaling, e.g., audio fingerprinting) that may be useful in the user's present context. One clue is location, as before.
  • [0071]
    Others include features of ambient audio. The sounds impinging on the device microphone can be checked for frequency content and other characteristics. For example, analysis may show that the sounds are limited to a certain mid-frequency band—missing high frequencies and/or low frequencies. The sounds can be checked for dynamic range—indicating presence or absence of level compression. Another clue is generated by super-sampling the ambient audio, allowing the device to detect artifacts from a digital-to-analog conversion (at a lower clock rate). The captured sounds may also include background attributes, e.g., noise patterns that can be associated with certain environments. All these data can be used to infer information about the source of the impinging audio, and the types of signaling that may be relevant.
  • [0072]
    Other clues can comprise visual features. The color gamut of the subject captured by the device camera may have tell-tale qualities revealing something about the subject being imaged. For example, the color gamut captured from a natural scene will be different than the color gamut captured from the LCD screen of another electronic device. If the subject being imaged is an electronic display, it may have a screen refresh rate that causes visual artifacts (e.g., strobing) to appear in the captured imagery. The refresh rate of the subject can be inferred from the captured data. Similarly, moiré effects may be found in the captured imagery—indicating that the subject is a sampled (e.g., pixilated) image, with a certain orientation and resolution relative to the camera. Again, such parameters of the moiré patterning can be used to infer information about the imaged subject.
  • [0073]
    Other data can also be collected and evaluated for use as clues. Temperature can be sensed, and used to determine whether the user is in a climate controlled indoor environment, or outdoors. Ambient lighting (which may be from a direction different than the device camera is pointing) is another clue. So is the date and time. So is the loudness of captured audio, or the brightness of captured imagery. If the device has a polarizing filter that can be employed over the imaging sensor, this can give further data. Other data specific to the particular application can also be used.
  • [0074]
    The clue data collected by the user device is used to query a database. For different combinations of input data, the database serves to identify different signaling schemes that are most-likely to be encountered.
  • [0075]
    If the device reports a temperature of 70 degrees, in a dark environment, mid-afternoon on a summer day in Los Angeles, the database may respond suggesting that the device should first check for a digital cinema forensic watermark—as detailed above. (This determination may be made even without reference to location data particularly identifying a movie theatre.) If that fails, it may suggest trying to decode the Nielsen broadcast watermark. If that fails, it may suggest processing in accordance with the Shazam fingerprinting algorithm, and submitting the data to the Shazam database for identification. If that fails, it may suggest still other watermark decoding algorithms, etc.
  • [0076]
    If the device senses a highly band-limited audio spectrum, with limited dynamic range, it may infer it is sensing sound from a commercial advertisement (where band-limiting and multi-band dynamic range compression is commonly used). In this case it may suggest first looking for Arbitron watermark, followed by a Nielsen watermark, etc.
  • [0077]
    If the device reports that it is imaging a subject having a particular color gamut, and a particular moiré artifact, the database may respond suggesting that the device should first check for a watermark that is commonly encoded in video entertainment content downloaded from the iTunes store. (This suggestion may be based on the color-gamut indicating an LCD display, and the moiré pattern suggesting a small display.) If that fails, the device should next check for a watermark that Amazon encodes into video entertainment that its online store distributes. If that fails, the device should next check for a personal verification watermark encoded into facial images presented on cell phones for a proprietary e-money system. Etc., etc.
  • [0078]
    In some arrangements, the database may indicate that one or more different fingerprint calculations and matches should be attempted before watermark decoding is attempted.
  • [0079]
    The user device attempts the different operations indicated by the database. Desirably, it provides feedback to the database, indicating which operations were tried, which failed, and which succeeded. If one operation succeeded, but shortly thereafter the user continued to try alternate processing approaches suggested by the database, this can indicate that the successful operation was not the one desired by the user, and that a later type of processing (if successful) more accurately served the user's intent. Over time, the database learns what combinations of clues most reliably indicate what types of signaling, and how the user wishes these different types of signals to be handled (and the relevance to be given to each clue in such determination), so that future queries build on the experience of earlier queries. The system thus acts as a Bayesian inference engine—making one or more guesses (i.e., establishing various hypotheses), receiving feedback, and thereby making better guesses in the future.
  • [0080]
    By sensing different characteristics of captured stimuli (and/or analyzing the captured data to determine such characteristics), querying the database with this information, trying the operations suggested by the database, and continuously refining a model of the process, the system takes on an intuitive behavior—making educated judgments about what it should do in different circumstances.
  • [0081]
    The database may be shared among a community of users, so experiences of one user help improve the later experiences of other users. A shared, remote database can be accessed by each user, or a local copy of a central database can be obtained periodically, and updates can be periodically sent back to the central database.
  • [0082]
    FIG. 4 is a block diagram of a portable device of the sort that can be used in the just-described embodiment.
  • Benefits of Watermarking in Context of the New Usage Models Distribution/Deployment of Embedded Content
  • [0083]
    In the new usage models, the distribution of embedded content is in the digital domain. Consequently watermarked content for these usage models can be distributed relatively quickly and inexpensively. As an example, consider the case of digital signage. Watermarked media can be distributed to the digital displays through digital means. Alternatively, the watermarks can be embedded right at the point of display through the use of transient watermarks as described above. The cost of embedding is either incurred by the media distributor or indirectly by the media consumer (for transient watermarks).
  • Consumer Created Media
  • [0084]
    Watermarking provides a means to connect analog instances of consumer created media (or User Generated Content) to the Internet. Analog instances refer to displayed versions of the media in the case of images or video content, or over-the-air versions in the case of audio. Consumer created media includes photos, digital videos, podcasts, recordings, etc. Such content is usually dynamically created, transitory in nature (i.e., is of unknown longevity), and is enormous in volume. However, it is well-suited for watermarking where a unique payload can be embedded into the content to identify it. In comparison, the nature of this content makes it challenging for use with content-based identification technologies which require prior analysis of the content.
  • Live Content
  • [0085]
    Live content, whether produced commercially or by consumers, poses unique challenges for content identification technologies. This is particularly true for the usage models described above, where users may desire to link to appurtenances related to the live content as it is being viewed or heard. Lack of a time lag between content creation and consumption generally constrains the type of content identification techniques that can be employed in such scenarios. Content-based identification schemes require pre-analysis of the content before the back-end database can be populated. For live content, this raises the costs of solutions based on content-based identification. In comparison, watermarking is well-suited for such scenarios, since it does not require pre-analysis of the content before use in the system. The payload carried by the watermark is generally completely independent of the content. This allows the back-end database to be pre-populated with a payload (or payloads) specifically designated for the live content. Therefore, a solution based on watermarking can be implemented at relatively lower cost.
  • [0000]
    Push vs. Pull Model
  • [0086]
    Watermarking allows for placing the control of media enhancement in the hands of the media creator or owner. Individuals who create the content frequently may want to directly manage the media linking experience for users. This control lends itself to a push model where the media is watermarked by the creator or owner and pushed to the aggregator (or distributor). This approach also reduces the overhead for the aggregator. For example, media creators may embed watermarks in their photos that are uploaded to a photo-sharing site. The watermark can either be an ID provided by the site or can be a more descriptive payload that can link directly to enhanced experiences. When those watermarked photos are viewed on the site or in digital picture frames, the person viewing the image can point a mobile device at the photo, read the watermark, and then connect to the photo-sharing site. In this scenario, minimal intervention is required from the aggregator since it would just have to associate the ID with the photo.
  • [0087]
    In a pull model, the aggregator would have to pull the requisite information from the media to enable the connection. Consider implementing the photo-sharing example using content-based identification technology [3]. The photo-sharing site has to decide to include content-based information about the uploaded photo into its database. In this case, the onus for ensuring identification of the photo in later use rests solely with the identification service provider rather than the content owner.
  • [0088]
    For many media owners, the ability to control the enhancements to their images and video can be very important. For small content creators, watermarking the content themselves may be the most suitable option for creating links between the analog instances of their content and the Internet.
  • Measurement and Analysis
  • [0089]
    Watermarks provide the ability to determine the source of the content. Multiple distributors of the same content can easily be identified. For example, the same advertisement airing on two different channels can a carry different payload for each channel. Detection of the payload can identify the channel on which the ad is airing. This capability can be used for effective measurement and analysis of content consumption and content flow.
  • [0090]
    Such analysis can facilitate different models for monetization and placement. For instance, in the sharing examples provided in the usage models above, referrals can be rewarded. An app shared can result in a reward at the app store for the user whose screen the app was shared from.
  • Customized Responses
  • [0091]
    The ability of the watermark to carry different payloads for copies of the same content can enable customized responses on detection. Different renditions of the same media, say a version played on a mobile device versus a version played on a large high resolution display, can evoke different detection responses. On detection from the mobile version, the detecting user can be linked to the store for the mobile version. On detection from the high resolution version, the detecting user can be linked to a site for a high definition version (or physical disc).
  • [0092]
    The watermark payload can also encode different responses for different geographies, for the same content. Part or all of the response on detection can be encoded in the payload itself, allowing for the possibility of making the system independent of the back end processing if so desired. This functionality would require sufficient watermark payload capacity for encoding the response in the payload.
  • Aesthetic and Physical Constraints
  • [0093]
    Aesthetic considerations can limit the type of identification technology used. Overt symbologies such as bar codes are not applicable in situations where there is a premium on the aesthetic quality of the media. Since watermarks can be embedded imperceptibly, they do not alter the aesthetic qualities of the underlying media.
  • [0094]
    Sometimes the size of the displayed media places a constraint on the type of identification technology used. Again, technologies such as bar codes occupy additional real estate and may not be applicable in situations where media is consumed on small form factor devices (e.g. image or video displayed on a mobile screen). Watermarks do not occupy any additional real estate beyond that required for the media itself.
  • Challenges in Market Adoption
  • [0095]
    The proliferation of media consumption on mobile devices and the enabling factors make the usage models described above viable. However, several challenges hinder the adoption of applications based on these models.
  • Availability of Watermarked Media
  • [0096]
    One of the biggest challenges in adoption is the availability of watermarked media. A substantial amount of media must be embedded with digital watermarks for any of the usage models described above to be widely adopted. Often, the ability to enable a broad range of mobile devices with watermark detectors is also dependent on broad availability of watermarked media. Conversely, media owners are unlikely to introduce watermarks in their content without the availability of enabled devices. This creates a “Catch-22,” due to the co-dependency of the watermarked media and watermark detectors. One solution to this issue is to begin with applications where the content is already watermarked, e.g., broadcast television content, and then to expand into other media types. Another solution is based on the use of transient watermarks, where the media content need not be watermarked at its source. Instead, the transient media can be watermarked as it is consumed (displayed or played). With this concept, applications can be deployed faster, since existing content can be watermarked just before consumption.
  • Availability of Enabled Devices
  • [0097]
    As mentioned above, availability of devices enabled with digital watermarking (and/or fingerprinting) applications is needed. Historically, achieving broad deployment of watermarking applications across a wide range of mobile devices has been challenging due to the large variation in device capabilities. However, the percentage of new devices that are technically capable of reading watermarks is increasing rapidly as technology advances. A short-term solution is to focus on just a few of the most capable mobile devices to enable rapid deployment. This strategy can result in compelling applications that take advantage of specific capabilities of the targeted devices. These applications can then serve as device differentiators that enable intuitive interfaces and spur broader adoption of the new and emerging usage models. As more mobile devices are launched, applications which differentiate devices with similar features will drive sales and product preference.
  • [0098]
    As technology continues to advance, it is expected that the majority of mobile devices will be technically capable of reading digital watermarks. At that point, the landscape shifts again to a stronger focus on software as a standalone product. The capable devices can be enabled to read watermarks by the device owner through installation of aftermarket available software that meets the device owner's needs.
  • Competing and Complementary Technologies
  • [0099]
    Competing technologies that can be employed instead of digital watermarking include overt symbologies (e.g. barcodes) and protocols for inter-device communication (e.g. Bluetooth). Although these technologies are readily available, they are not as easy and intuitive for users as the usage models described above. Overt symbols occupy real estate on screen and may not always be practical on smaller form factor displays. Bluetooth, while generally available, requires specific setup and pairing of devices for communication.
  • [0100]
    Complementary technologies include content-based identification and retrieval technologies (e.g. digital fingerprinting) which can be used in conjunction with digital watermarking to provide effective applications that take advantage of the merits of both technologies. For example, digital fingerprinting can be effective for legacy media that does not contain a watermark, whereas digital watermarking can be used effectively when multiple identities must be imparted to the same media. A combination approach consisting of the use of watermarking and content-based identification techniques can provide a more effective end-solution.
  • Viable Business Models
  • [0101]
    Ultimately, success in the market will be defined by the existence of viable business models. While it is premature to foretell what form successful business models will eventually take, it is prudent to contemplate avenues for monetization. The click-through model described above, where watermark detection re-routes the user to a pertinent destination on the Internet, can naturally lead to opportunities for monetization. As mobile media and devices continue to proliferate and become widely used, digital watermarking can open new revenue streams for media aggregators and device manufacturers looking to differentiate their products.
  • CONCLUSION
  • [0102]
    It will be recognized that technology detailed above allows a portable device to serve as a media “forager”—employing its microphone and/or camera (and/or other sensors) to capture information about the user's environment, and then respond in desired ways.
  • [0103]
    The present assignee has published a great deal of information about related systems and technologies in the patent literature—a body of work with which the artisan is presumed to be familiar. Included are U.S. Pat. Nos. 6,122,403, 6,590,996, 6,947,571, and published patent application 20070156726.
  • [0104]
    Nielsen's watermark is understood to follow the teachings of its U.S. Pat. Nos. 7,006,555 and 6,968,564. Arbitron's watermark is understood to follow teachings of its U.S. Pat. Nos. 5,450,490, 5,764,763, 6,871,180, 6,862,355, and 6,845,360.
  • [0105]
    While the arrangements detailed above focused on watermark-based approaches, the same or similar functionality can often be realized with fingerprint-based approaches.
  • [0106]
    Although disclosed as complete systems, subcombinations of the detailed arrangements are also separately contemplated.
  • [0107]
    While this specification has detailed particular ordering of acts, and particular combinations of elements, in the illustrative embodiments, it will be recognized that other contemplated methods may re-order acts (possibly omitting some and adding others), and other contemplated combinations may omit some elements and add others, etc.
  • [0108]
    The design of cell phones and other devices referenced in this disclosure is familiar to the artisan. In general terms, each includes one or more processors, one or more memories (e.g. RAM), storage (e.g., a disk or flash memory), a user interface (which may include, e.g., a keypad, a TFT LCD or OLED display screen, touch or other gesture sensors, a camera or other optical sensor, a microphone, etc., together with software instructions for providing a graphical user interface), and an interface for communicating with other devices (which may be wireless, as noted above, and/or wired, such as through an Ethernet local area network, a T-1 internet connection, etc).
  • [0109]
    The functionality detailed above can be implemented by dedicated hardware, or by processors executing software instructions read from a memory or storage, or by combinations thereof. References to “processors” can refer to functionality, rather than any particular form of implementation. Processors can be dedicated hardware, or software-controlled programmable hardware. Moreover, several such processors can be implemented by a single programmable processor, performing multiple functions.
  • [0110]
    Software instructions for implementing the detailed functionality can be readily authored by artisans, from the descriptions provided herein.
  • [0111]
    Typically, each device includes operating system software that provides interfaces to hardware devices and general purpose functions, and also includes application software which can be selectively invoked to perform particular tasks desired by a user. Known browser software, communications software, and media processing software can be adapted for uses detailed herein. Software is commonly stored as instructions in one or more data structures conveyed by tangible media, such as discs, memory cards, ROM, etc. Some embodiments may be implemented as embedded systems—a special purpose computer system in which the operating system software and the application software is indistinguishable to the user (e.g., as is commonly the case in basic cell phones). The functionality detailed in this specification can be implemented in operating system software, application software and/or as embedded system software.
  • [0112]
    Different of the functionality can be implemented on different devices. For example, in a system in which a cell phone communicates with a remote server, different tasks can be performed exclusively by one device or the other, or execution can be distributed between the devices. Extracting watermark or fingerprint data from captured media content is but one example of such a task. Thus, it should be understood that description of an operation as being performed by a device is not limiting but exemplary; performance of the operation by another device, or shared between devices, is also contemplated.
  • [0113]
    To provide a comprehensive disclosure without unduly lengthening this specification, applicants incorporate by reference the documents and patent disclosures referenced herein. (Such documents are incorporated in their entireties, even if cited above in connection with specific of their teachings.)
  • [0114]
    The particular combinations of elements and features in the above-detailed embodiments are exemplary only; the interchanging and substitution of these teachings with other teachings in this and the incorporated-by-reference documents are also expressly contemplated and intended.
  • REFERENCES
  • [0000]
    • [1] Alattar, A., “Smart Images Using Digimarc's Watermarking Technology”, SPIE's 21th Symposium on Electronic Imaging, vol. 3971, pp. 264-273 (2000).
    • [2] Kalker, T, and Haitsma J., “Robust Identification of Audio Using Watermarking and Fingerprinting”, Multimedia Security Handbook, CRC Press, pp. 261-281 (2005).
    • [3] Jürgen Herre, “Content-Based Identification (Fingerprinting)”, Digital Rights Management, Lecture Notes in Computer Science, pp. 93-100, Springer Berlin/Heidelberg, (2003).
    • [4] A. Wang, “An industrial-strength audio search algorithm”, Proceedings ISMIR 2003, pp. 7-13, 2003.
    • [5] ABI Research, “Analyst Insider”, Jun. 2, 2008.

Claims (13)

1. A portable device comprising a processor, a memory, an input sensor for capturing data, and an output device, the memory including instructions by which the processor can decode digital watermarks in the captured data according to plural different steganographic decoding schemes, the input sensor being selected from the group consisting of a microphone and an image sensor, the device further including a location sensor portion, wherein an output from the location sensor portion is coupled to the processor and is used in deciding which of the plural different steganographic decoding schemes to apply to the captured data.
2. A portable device comprising a processor, a memory, an input sensor for capturing data, and an output device, the memory including instructions by which the processor can process the captured data to derive plural-bit data therefrom according to plural different digital watermarking and/or content fingerprinting schemes, the input sensor being selected from the group consisting of a microphone and an image sensor, the memory further including instructions causing the processor to analyze captured data for clues, and based on such clues determine which of said plural different schemes to apply to the captured data.
3. A method practiced in a movie auditorium, comprising the acts:
capturing audio or image data from a movie presentation, using a portable device;
by reference to the captured data, identifying a particular temporal location within a movie;
accessing information in a subtitle repository from the portable device, said accessing making reference to the identified temporal location; and
presenting subtitle information on a display screen of said portable device, in synchrony with the movie presentation.
4. The method 3 that further includes, by reference to the captured data, identifying the movie.
5. The method 4 that includes using a processor in the portable device to decode plural-bit data steganographically encoded in the captured data, and identifying the movie by reference to this decoded data.
6. The method 3 that includes identifying the particular temporal location by reference to audio or visual landmarks within the movie.
7. A method comprising the acts:
using an image sensor in a portable device, capturing image data from a picture presented by an electronic picture display;
processing the captured image data to identify the picture;
linking the portable device to an online photo sharing service associated with the identified picture; and
downloading to the portable device, from the photo sharing service, a higher resolution of the picture than originally captured.
8. A computer storage medium on which is stored application software, the application software causing a user interface to be presented on a display screen of a first device when the software is executed by a processor of the first device, the user interface including a digitally watermarked graphic, wherein data conveyed by the digitally watermarked graphic causes a second device to link to an online store from which another copy of that application software can be downloaded to that second device, when the second device captures an image of the user interface presented on the display screen of the first device.
9. A method comprising the acts:
using an image sensor in a first device to capture image data corresponding to a user interface screen presented by an application programming running on a second device;
processing the captured image data to derive an identifier;
by reference to the derived identifier, identifying an online store from which the application program running on the second device can be obtained; and
linking from the first device to said online store, and installing the application program on the first device.
10. The method 9 wherein the processing comprises processing the captured image data to derive fingerprint information therefrom.
11. The method 9 wherein the processing comprises processing the captured image data to decode steganographically encoded digital watermark data therefrom.
12. A method comprising the acts:
sending video data for display from a remote source to a display device, the sent video data being encoded with a first type of watermark;
decoding the first type of watermark from the sent video data to extract plural bits of payload data therefrom;
encoding the video data with a second type of watermark, the second type of watermark conveying plural of the bits of payload data extracted from the first type of watermark; and
presenting the video data with the encoded second type of watermark on the display device;
wherein the second type of watermark is more robust to digital-to-analog-to-digital conversion than the first type of watermark.
13. The method 12 wherein the decoding of the first type of watermark and the encoding of the second type of watermark is performed at the display device.
US12650306 2008-12-31 2009-12-30 Mobile media, devices, and signaling Abandoned US20100226526A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US14212708 true 2008-12-31 2008-12-31
US12650306 US20100226526A1 (en) 2008-12-31 2009-12-30 Mobile media, devices, and signaling

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US12650306 US20100226526A1 (en) 2008-12-31 2009-12-30 Mobile media, devices, and signaling
US14463180 US9552617B2 (en) 2008-12-31 2014-08-19 Mobile media, devices, and signaling

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14463180 Division US9552617B2 (en) 2008-12-31 2014-08-19 Mobile media, devices, and signaling

Publications (1)

Publication Number Publication Date
US20100226526A1 true true US20100226526A1 (en) 2010-09-09

Family

ID=42678286

Family Applications (2)

Application Number Title Priority Date Filing Date
US12650306 Abandoned US20100226526A1 (en) 2008-12-31 2009-12-30 Mobile media, devices, and signaling
US14463180 Active 2030-01-17 US9552617B2 (en) 2008-12-31 2014-08-19 Mobile media, devices, and signaling

Family Applications After (1)

Application Number Title Priority Date Filing Date
US14463180 Active 2030-01-17 US9552617B2 (en) 2008-12-31 2014-08-19 Mobile media, devices, and signaling

Country Status (1)

Country Link
US (2) US20100226526A1 (en)

Cited By (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100222088A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods and apparatus for receiving information by a mobile device
US20100223120A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods, and devices for administering consumer reward programs through the use of tones sent to mobile devices
US20100222041A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, Methods, and Apparatus for Providing Promotion Information to a Mobile Device
US20100223145A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods and apparatus for facilitating transactions using a mobile device
US20100222037A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, Methods, and Apparatus for Providing Terms and Conditions and Program Enrollment Information to a Mobile Device
US20100222026A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, Methods, and Apparatus for Receiving Promotion Information by a Mobile Device
US20100223138A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods and apparatus for marketing by communicating tones to a mobile device
US20100223346A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods, and devices for processing feedback information received from mobile devices responding to tone transmissions
US20100222087A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods and apparatus for communicating information to a mobile device in a broadcast signal
US20100222043A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods, and devices for prompting mobile device users for feedback information using tone transmissions
US20100222038A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods, and devices for communicating supplemental information to mobile devices
US20100222072A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods and apparatus for providing information to a mobile device
US20100222100A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods and apparatus for facilitating communication between mobile devices
CN101986764A (en) * 2010-10-20 2011-03-16 新疆智翔科技有限公司 Internet of things-based multi-source data connection system
US20110098056A1 (en) * 2009-10-28 2011-04-28 Rhoads Geoffrey B Intuitive computing methods and systems
US20110158469A1 (en) * 2009-12-29 2011-06-30 Mastykarz Justin P Methods and apparatus for management of field operations, projects and/or collected samples
US20120095749A1 (en) * 2010-10-14 2012-04-19 Antonio Capretta Multi-functional audio distribution system and method for movie theaters and other public and private venues
US20120140978A1 (en) * 2010-12-02 2012-06-07 Samsung Electronics Co., Ltd. Image processing apparatus and control method thereof
US20120185887A1 (en) * 2009-03-20 2012-07-19 Echostar Technologies L.L.C. Systems and methods for memorializing a viewers viewing experience with captured viewer images
US20120198339A1 (en) * 2011-01-28 2012-08-02 Hunter Williams Audio-Based Application Architecture
US20130044084A1 (en) * 2011-08-18 2013-02-21 Apple Inc. Securing protected content during video playback
US20130050230A1 (en) * 2011-08-23 2013-02-28 Samsung Electronics Co., Ltd Display method and apparatus in portable terminal
WO2013030855A1 (en) * 2011-06-21 2013-03-07 Smart Reporter S.R.L. Method for communication, audio/video recording, storing of digital material, for example journalistic material
US20130083208A1 (en) * 2011-09-30 2013-04-04 Research In Motion Limited Associating a work with a biometric indication of the identity of an author
US20130097630A1 (en) * 2011-10-14 2013-04-18 Tony F. Rodriguez Arrangements employing content identification and/or distribution identification data
WO2013056436A1 (en) 2011-10-19 2013-04-25 Thomson Licensing System and method for automatic content program discovery
US8433306B2 (en) 2009-02-05 2013-04-30 Digimarc Corporation Second screens and widgets
US8491384B2 (en) 2011-04-30 2013-07-23 Samsung Electronics Co., Ltd. Multi-user discovery
US8666528B2 (en) 2009-05-01 2014-03-04 The Nielsen Company (Us), Llc Methods, apparatus and articles of manufacture to provide secondary content in association with primary broadcast media content
US8826389B2 (en) 2012-05-09 2014-09-02 International Business Machines Corporation Multi-media identity management system
US20150015784A1 (en) * 2013-07-12 2015-01-15 Echostar Technologies L.L.C. Context-sensitive information presentation
US8943514B2 (en) 2011-04-30 2015-01-27 Samsung Electronics Co., Ltd. Middle partners
US20150043891A1 (en) * 2013-08-09 2015-02-12 Thomson Licensing Second screen device and system
US8959016B2 (en) 2002-09-27 2015-02-17 The Nielsen Company (Us), Llc Activating functions in processing devices using start codes embedded in audio
EP2758956A4 (en) * 2011-09-23 2015-05-06 Digimarc Corp Context-based smartphone sensor logic
US20150131846A1 (en) * 2006-02-24 2015-05-14 Digimarc Corporation Geographic-based signal detection
EP2899987A1 (en) * 2014-01-22 2015-07-29 Thomson Licensing Synchronising a reproduction of audio or audio and video content
CN104898731A (en) * 2015-04-03 2015-09-09 新疆智翔科技有限公司 Outdoor connection terminal based on Internet of things
US20150331938A1 (en) * 2014-05-16 2015-11-19 Alphonso Inc. Apparatus and method for determining co-location of services
US9197421B2 (en) 2012-05-15 2015-11-24 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US9210208B2 (en) 2011-06-21 2015-12-08 The Nielsen Company (Us), Llc Monitoring streaming media content
US9282366B2 (en) 2012-08-13 2016-03-08 The Nielsen Company (Us), Llc Methods and apparatus to communicate audience measurement information
US20160073099A1 (en) * 2013-11-15 2016-03-10 Beijing Zhigu Rui Tuo Tech Co., Ltd User information extraction method and user information extraction apparatus
US20160073002A1 (en) * 2013-11-15 2016-03-10 Beijing Zhigu Rui Tuo Tech Co., Ltd User information acquisition method and user information acquisition apparatus
US9286912B2 (en) 2012-09-26 2016-03-15 The Nielsen Company (Us), Llc Methods and apparatus for identifying media
US9313544B2 (en) 2013-02-14 2016-04-12 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US9354778B2 (en) 2013-12-06 2016-05-31 Digimarc Corporation Smartphone-based methods and systems
US9380356B2 (en) 2011-04-12 2016-06-28 The Nielsen Company (Us), Llc Methods and apparatus to generate a tag for media content
US9484046B2 (en) 2010-11-04 2016-11-01 Digimarc Corporation Smartphone-based methods and systems
US9525918B2 (en) * 2014-06-25 2016-12-20 Rovi Guides, Inc. Systems and methods for automatically setting up user preferences for enabling subtitles
US9538251B2 (en) 2014-06-25 2017-01-03 Rovi Guides, Inc. Systems and methods for automatically enabling subtitles based on user activity
US20170004364A1 (en) * 2007-06-18 2017-01-05 Synergy Sports Technology. LLC Systems and methods for generating bookmark video fingerprints
US9609034B2 (en) 2002-12-27 2017-03-28 The Nielsen Company (Us), Llc Methods and apparatus for transcoding metadata
US9615140B1 (en) 2010-05-27 2017-04-04 Edward Malinowski Method and device for delivery of subtitle synchronized with a media stream
US9667365B2 (en) 2008-10-24 2017-05-30 The Nielsen Company (Us), Llc Methods and apparatus to perform audio watermarking and watermark detection and extraction
US9699499B2 (en) 2014-04-30 2017-07-04 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US9711153B2 (en) 2002-09-27 2017-07-18 The Nielsen Company (Us), Llc Activating functions in processing devices using encoded audio and detecting audio signatures
US9762965B2 (en) 2015-05-29 2017-09-12 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US9813751B2 (en) 2011-09-01 2017-11-07 Gracenote, Inc. Media source identification
US9830950B2 (en) 2010-11-04 2017-11-28 Digimarc Corporation Smartphone-based methods and systems
US9877015B2 (en) * 2013-11-15 2018-01-23 Beijing Zhigu Rui Tuo Tech Co., Ltd. User information extraction method and user information extraction apparatus

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6122403A (en) * 1995-07-27 2000-09-19 Digimarc Corporation Computer system linked by using information in data objects
US6522769B1 (en) * 1999-05-19 2003-02-18 Digimarc Corporation Reconfiguring a watermark detector
US6947571B1 (en) * 1999-05-19 2005-09-20 Digimarc Corporation Cell phones with optical capabilities, and related applications
US20060062426A1 (en) * 2000-12-18 2006-03-23 Levy Kenneth L Rights management systems and methods using digital watermarking
US7024016B2 (en) * 1996-05-16 2006-04-04 Digimarc Corporation Digital watermarking apparatus and methods
US20070067808A1 (en) * 2005-09-19 2007-03-22 Dacosta Behram Portable video programs
US20070124756A1 (en) * 2005-11-29 2007-05-31 Google Inc. Detecting Repeating Content in Broadcast Media
US7263203B2 (en) * 1995-05-08 2007-08-28 Digimarc Corporation Digital watermarks
US7716604B2 (en) * 2005-04-19 2010-05-11 Hitachi, Ltd. Apparatus with thumbnail display
US7726604B1 (en) * 2004-11-24 2010-06-01 West Virginia University Aerial sensor pod deployment system
US7734489B2 (en) * 2000-04-27 2010-06-08 Oracle International Corporation Method and apparatus for facilitating management of information technology investment
US8056113B2 (en) * 2009-02-05 2011-11-08 Sony Corporation Mobile consumer electronic applications on internet video platform
US8095796B2 (en) * 1999-05-19 2012-01-10 Digimarc Corporation Content identifiers
US8578404B2 (en) * 2011-06-30 2013-11-05 The Nielsen Company (Us), Llc Program telecast monitoring using watermarks

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3002471B2 (en) 1988-08-19 2000-01-24 株式会社日立製作所 Program distribution device
US6505160B1 (en) 1995-07-27 2003-01-07 Digimarc Corporation Connected audio and other media objects
US6611607B1 (en) 1993-11-18 2003-08-26 Digimarc Corporation Integrating digital watermarks in multimedia content
US5596705A (en) 1995-03-20 1997-01-21 International Business Machines Corporation System and method for linking and presenting movies with their underlying source information
US5774664A (en) 1996-03-08 1998-06-30 Actv, Inc. Enhanced video programming system and method for incorporating and displaying retrieved integrated internet information segments
US6240555B1 (en) 1996-03-29 2001-05-29 Microsoft Corporation Interactive entertainment system for presenting supplemental interactive content together with continuous video programs
KR100213188B1 (en) * 1996-10-05 1999-08-02 윤종용 Apparatus and method for user authentication
US5931908A (en) 1996-12-23 1999-08-03 The Walt Disney Corporation Visual object present within live programming as an actionable event for user selection of alternate programming wherein the actionable event is selected by human operator at a head end for distributed data and programming
US6637032B1 (en) 1997-01-06 2003-10-21 Microsoft Corporation System and method for synchronizing enhancing content with a video program using closed captioning
US6209028B1 (en) 1997-03-21 2001-03-27 Walker Digital, Llc System and method for supplying supplemental audio information for broadcast television programs
US7197156B1 (en) 1998-09-25 2007-03-27 Digimarc Corporation Method and apparatus for embedding auxiliary information within original data
US8091025B2 (en) 2000-03-24 2012-01-03 Digimarc Corporation Systems and methods for processing content objects
US6614844B1 (en) 2000-11-14 2003-09-02 Sony Corporation Method for watermarking a video display based on viewing mode
US6722569B2 (en) * 2001-07-13 2004-04-20 Welch Allyn Data Collection, Inc. Optical reader having a color imager
US6965674B2 (en) * 2002-05-21 2005-11-15 Wavelink Corporation System and method for providing WLAN security through synchronized update and rotation of WEP keys
US7360096B2 (en) * 2002-11-20 2008-04-15 Microsoft Corporation Securely processing client credentials used for Web-based access to resources
US7809953B2 (en) * 2002-12-09 2010-10-05 Research In Motion Limited System and method of secure authentication information distribution
US6983882B2 (en) * 2003-03-31 2006-01-10 Kepler, Ltd. Personal biometric authentication and authorization device
US7580562B2 (en) * 2004-09-21 2009-08-25 Seiko Epson Corporation Image processing method, image processing device, and image processing program
EP1932339A1 (en) 2005-09-08 2008-06-18 Thomson Licensing Digital cinema projector watermarking system and method
US20090259564A1 (en) * 2008-03-27 2009-10-15 Thomas Pike Barkerding Method, system, and storage device for an online content marketplace and exchange
US8520979B2 (en) * 2008-08-19 2013-08-27 Digimarc Corporation Methods and systems for content processing
US9197736B2 (en) * 2009-12-31 2015-11-24 Digimarc Corporation Intuitive computing methods and systems
US8660355B2 (en) * 2010-03-19 2014-02-25 Digimarc Corporation Methods and systems for determining image processing operations relevant to particular imagery

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7263203B2 (en) * 1995-05-08 2007-08-28 Digimarc Corporation Digital watermarks
US6122403A (en) * 1995-07-27 2000-09-19 Digimarc Corporation Computer system linked by using information in data objects
US7024016B2 (en) * 1996-05-16 2006-04-04 Digimarc Corporation Digital watermarking apparatus and methods
US6947571B1 (en) * 1999-05-19 2005-09-20 Digimarc Corporation Cell phones with optical capabilities, and related applications
US8095796B2 (en) * 1999-05-19 2012-01-10 Digimarc Corporation Content identifiers
US6522769B1 (en) * 1999-05-19 2003-02-18 Digimarc Corporation Reconfiguring a watermark detector
US7734489B2 (en) * 2000-04-27 2010-06-08 Oracle International Corporation Method and apparatus for facilitating management of information technology investment
US20060062426A1 (en) * 2000-12-18 2006-03-23 Levy Kenneth L Rights management systems and methods using digital watermarking
US20080140433A1 (en) * 2001-04-20 2008-06-12 Levy Kenneth L Rights Management Systems and Methods Using Content Identifiers
US8607354B2 (en) * 2001-04-20 2013-12-10 Digimarc Corporation Deriving multiple fingerprints from audio or video content
US7726604B1 (en) * 2004-11-24 2010-06-01 West Virginia University Aerial sensor pod deployment system
US7716604B2 (en) * 2005-04-19 2010-05-11 Hitachi, Ltd. Apparatus with thumbnail display
US20070067808A1 (en) * 2005-09-19 2007-03-22 Dacosta Behram Portable video programs
US20070124756A1 (en) * 2005-11-29 2007-05-31 Google Inc. Detecting Repeating Content in Broadcast Media
US8056113B2 (en) * 2009-02-05 2011-11-08 Sony Corporation Mobile consumer electronic applications on internet video platform
US8578404B2 (en) * 2011-06-30 2013-11-05 The Nielsen Company (Us), Llc Program telecast monitoring using watermarks

Cited By (96)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8959016B2 (en) 2002-09-27 2015-02-17 The Nielsen Company (Us), Llc Activating functions in processing devices using start codes embedded in audio
US9711153B2 (en) 2002-09-27 2017-07-18 The Nielsen Company (Us), Llc Activating functions in processing devices using encoded audio and detecting audio signatures
US9609034B2 (en) 2002-12-27 2017-03-28 The Nielsen Company (Us), Llc Methods and apparatus for transcoding metadata
US20150131846A1 (en) * 2006-02-24 2015-05-14 Digimarc Corporation Geographic-based signal detection
US9648199B2 (en) * 2006-02-24 2017-05-09 Digimarc Corporation Geographic-based signal detection
US20170004364A1 (en) * 2007-06-18 2017-01-05 Synergy Sports Technology. LLC Systems and methods for generating bookmark video fingerprints
US9754170B2 (en) * 2007-06-18 2017-09-05 Synergy Sports Technology, Llc Systems and methods for generating bookmark video fingerprints
US9667365B2 (en) 2008-10-24 2017-05-30 The Nielsen Company (Us), Llc Methods and apparatus to perform audio watermarking and watermark detection and extraction
US8433306B2 (en) 2009-02-05 2013-04-30 Digimarc Corporation Second screens and widgets
US20100222043A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods, and devices for prompting mobile device users for feedback information using tone transmissions
US20100222038A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods, and devices for communicating supplemental information to mobile devices
US20100222072A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods and apparatus for providing information to a mobile device
US20100222100A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods and apparatus for facilitating communication between mobile devices
US20100222087A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods and apparatus for communicating information to a mobile device in a broadcast signal
US20100223346A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods, and devices for processing feedback information received from mobile devices responding to tone transmissions
US20100223138A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods and apparatus for marketing by communicating tones to a mobile device
US20100222026A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, Methods, and Apparatus for Receiving Promotion Information by a Mobile Device
US8606638B2 (en) 2009-03-02 2013-12-10 First Data Corporation Systems, methods and apparatus for facilitating transactions using a mobile device
US20100222037A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, Methods, and Apparatus for Providing Terms and Conditions and Program Enrollment Information to a Mobile Device
US20100223120A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods, and devices for administering consumer reward programs through the use of tones sent to mobile devices
US20100223145A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods and apparatus for facilitating transactions using a mobile device
US9077800B2 (en) 2009-03-02 2015-07-07 First Data Corporation Systems, methods, and devices for processing feedback information received from mobile devices responding to tone transmissions
US8725121B2 (en) 2009-03-02 2014-05-13 First Data Corporation Systems, methods, and devices for prompting mobile device users for feedback information using tone transmissions
US20100222041A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, Methods, and Apparatus for Providing Promotion Information to a Mobile Device
US8577345B2 (en) 2009-03-02 2013-11-05 First Data Corporation Systems, methods, and apparatus for providing promotion information to a mobile device
US8577346B2 (en) 2009-03-02 2013-11-05 First Data Corporation Systems, methods, and apparatus for receiving promotion information by a mobile device
US20100222088A1 (en) * 2009-03-02 2010-09-02 First Data Corporation Systems, methods and apparatus for receiving information by a mobile device
US20120185887A1 (en) * 2009-03-20 2012-07-19 Echostar Technologies L.L.C. Systems and methods for memorializing a viewers viewing experience with captured viewer images
US8286202B2 (en) * 2009-03-20 2012-10-09 Echostar Technologies L.L.C. Systems and methods for memorializing a viewers viewing experience with captured viewer images
US8914820B2 (en) 2009-03-20 2014-12-16 Echostar Technologies L.L.C. Systems and methods for memorializing a viewers viewing experience with captured viewer images
US8666528B2 (en) 2009-05-01 2014-03-04 The Nielsen Company (Us), Llc Methods, apparatus and articles of manufacture to provide secondary content in association with primary broadcast media content
US9609107B2 (en) 2009-10-28 2017-03-28 Digimarc Corporation Intuitive computing methods and systems
US9444924B2 (en) 2009-10-28 2016-09-13 Digimarc Corporation Intuitive computing methods and systems
US20110098056A1 (en) * 2009-10-28 2011-04-28 Rhoads Geoffrey B Intuitive computing methods and systems
US8977293B2 (en) 2009-10-28 2015-03-10 Digimarc Corporation Intuitive computing methods and systems
US8886222B1 (en) 2009-10-28 2014-11-11 Digimarc Corporation Intuitive computing methods and systems
US8121618B2 (en) 2009-10-28 2012-02-21 Digimarc Corporation Intuitive computing methods and systems
US20110158469A1 (en) * 2009-12-29 2011-06-30 Mastykarz Justin P Methods and apparatus for management of field operations, projects and/or collected samples
US9615140B1 (en) 2010-05-27 2017-04-04 Edward Malinowski Method and device for delivery of subtitle synchronized with a media stream
US20120095749A1 (en) * 2010-10-14 2012-04-19 Antonio Capretta Multi-functional audio distribution system and method for movie theaters and other public and private venues
CN101986764A (en) * 2010-10-20 2011-03-16 新疆智翔科技有限公司 Internet of things-based multi-source data connection system
US9484046B2 (en) 2010-11-04 2016-11-01 Digimarc Corporation Smartphone-based methods and systems
US9830950B2 (en) 2010-11-04 2017-11-28 Digimarc Corporation Smartphone-based methods and systems
US20120140978A1 (en) * 2010-12-02 2012-06-07 Samsung Electronics Co., Ltd. Image processing apparatus and control method thereof
US20120198339A1 (en) * 2011-01-28 2012-08-02 Hunter Williams Audio-Based Application Architecture
US9595258B2 (en) 2011-04-04 2017-03-14 Digimarc Corporation Context-based smartphone sensor logic
US9681204B2 (en) 2011-04-12 2017-06-13 The Nielsen Company (Us), Llc Methods and apparatus to validate a tag for media
US9380356B2 (en) 2011-04-12 2016-06-28 The Nielsen Company (Us), Llc Methods and apparatus to generate a tag for media content
US8943514B2 (en) 2011-04-30 2015-01-27 Samsung Electronics Co., Ltd. Middle partners
US8491384B2 (en) 2011-04-30 2013-07-23 Samsung Electronics Co., Ltd. Multi-user discovery
US9210208B2 (en) 2011-06-21 2015-12-08 The Nielsen Company (Us), Llc Monitoring streaming media content
US9838281B2 (en) 2011-06-21 2017-12-05 The Nielsen Company (Us), Llc Monitoring streaming media content
US9515904B2 (en) 2011-06-21 2016-12-06 The Nielsen Company (Us), Llc Monitoring streaming media content
WO2013030855A1 (en) * 2011-06-21 2013-03-07 Smart Reporter S.R.L. Method for communication, audio/video recording, storing of digital material, for example journalistic material
US9767840B2 (en) * 2011-08-18 2017-09-19 Apple Inc. Securing protected content during video playback
US20130044084A1 (en) * 2011-08-18 2013-02-21 Apple Inc. Securing protected content during video playback
US20130050230A1 (en) * 2011-08-23 2013-02-28 Samsung Electronics Co., Ltd Display method and apparatus in portable terminal
US9813751B2 (en) 2011-09-01 2017-11-07 Gracenote, Inc. Media source identification
US9196028B2 (en) 2011-09-23 2015-11-24 Digimarc Corporation Context-based smartphone sensor logic
EP2758956A4 (en) * 2011-09-23 2015-05-06 Digimarc Corp Context-based smartphone sensor logic
US9013581B2 (en) * 2011-09-30 2015-04-21 Blackberry Limited Associating a work with a biometric indication of the identity of an author
US20130083208A1 (en) * 2011-09-30 2013-04-04 Research In Motion Limited Associating a work with a biometric indication of the identity of an author
US20130097630A1 (en) * 2011-10-14 2013-04-18 Tony F. Rodriguez Arrangements employing content identification and/or distribution identification data
US9402099B2 (en) * 2011-10-14 2016-07-26 Digimarc Corporation Arrangements employing content identification and/or distribution identification data
WO2013056436A1 (en) 2011-10-19 2013-04-25 Thomson Licensing System and method for automatic content program discovery
EP2769300A4 (en) * 2011-10-19 2015-05-20 Thomson Licensing System and method for automatic content program discovery
US9197946B2 (en) 2011-10-19 2015-11-24 Thomson Licensing System and method for automatic content program discovery
US8826389B2 (en) 2012-05-09 2014-09-02 International Business Machines Corporation Multi-media identity management system
US9209978B2 (en) 2012-05-15 2015-12-08 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US9197421B2 (en) 2012-05-15 2015-11-24 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US9282366B2 (en) 2012-08-13 2016-03-08 The Nielsen Company (Us), Llc Methods and apparatus to communicate audience measurement information
US9286912B2 (en) 2012-09-26 2016-03-15 The Nielsen Company (Us), Llc Methods and apparatus for identifying media
US9357261B2 (en) 2013-02-14 2016-05-31 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US9313544B2 (en) 2013-02-14 2016-04-12 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US20150015784A1 (en) * 2013-07-12 2015-01-15 Echostar Technologies L.L.C. Context-sensitive information presentation
US9872000B2 (en) * 2013-08-09 2018-01-16 Thomson Licensing Second screen device and system
US20150043891A1 (en) * 2013-08-09 2015-02-12 Thomson Licensing Second screen device and system
US20160073002A1 (en) * 2013-11-15 2016-03-10 Beijing Zhigu Rui Tuo Tech Co., Ltd User information acquisition method and user information acquisition apparatus
US9838588B2 (en) * 2013-11-15 2017-12-05 Beijing Zhigu Rui Tuo Tech Co., Ltd. User information acquisition method and user information acquisition apparatus
US20160073099A1 (en) * 2013-11-15 2016-03-10 Beijing Zhigu Rui Tuo Tech Co., Ltd User information extraction method and user information extraction apparatus
US9877015B2 (en) * 2013-11-15 2018-01-23 Beijing Zhigu Rui Tuo Tech Co., Ltd. User information extraction method and user information extraction apparatus
US9354778B2 (en) 2013-12-06 2016-05-31 Digimarc Corporation Smartphone-based methods and systems
EP2899987A1 (en) * 2014-01-22 2015-07-29 Thomson Licensing Synchronising a reproduction of audio or audio and video content
US9699499B2 (en) 2014-04-30 2017-07-04 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US9698924B2 (en) * 2014-05-16 2017-07-04 Alphonso Inc. Efficient apparatus and method for audio signature generation using recognition history
US20160336025A1 (en) * 2014-05-16 2016-11-17 Alphonso Inc. Efficient apparatus and method for audio signature generation using recognition history
US9641980B2 (en) 2014-05-16 2017-05-02 Alphonso Inc. Apparatus and method for determining co-location of services using a device that generates an audio signal
US9520142B2 (en) 2014-05-16 2016-12-13 Alphonso Inc. Efficient apparatus and method for audio signature generation using recognition history
US9590755B2 (en) 2014-05-16 2017-03-07 Alphonso Inc. Efficient apparatus and method for audio signature generation using audio threshold
US20150331938A1 (en) * 2014-05-16 2015-11-19 Alphonso Inc. Apparatus and method for determining co-location of services
US9584236B2 (en) 2014-05-16 2017-02-28 Alphonso Inc. Efficient apparatus and method for audio signature generation using motion
US9583121B2 (en) * 2014-05-16 2017-02-28 Alphonso Inc. Apparatus and method for determining co-location of services
US9525918B2 (en) * 2014-06-25 2016-12-20 Rovi Guides, Inc. Systems and methods for automatically setting up user preferences for enabling subtitles
US9538251B2 (en) 2014-06-25 2017-01-03 Rovi Guides, Inc. Systems and methods for automatically enabling subtitles based on user activity
CN104898731A (en) * 2015-04-03 2015-09-09 新疆智翔科技有限公司 Outdoor connection terminal based on Internet of things
US9762965B2 (en) 2015-05-29 2017-09-12 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media

Also Published As

Publication number Publication date Type
US20150043890A1 (en) 2015-02-12 application
US9552617B2 (en) 2017-01-24 grant

Similar Documents

Publication Publication Date Title
US7650010B2 (en) Connected video and audio
US20110311095A1 (en) Content fingerprinting
US6411725B1 (en) Watermark enabled video objects
US20110289114A1 (en) System and method for auto content recognition
US20120072420A1 (en) Content capture device and methods for automatically tagging content
US20110246495A1 (en) Media fingerprinting for social networking
US20100158391A1 (en) Identification and transfer of a media object segment from one communications network to another
US20140074855A1 (en) Multimedia content tags
US20030065665A1 (en) Device, method and recording medium for information distribution
US7593576B2 (en) Systems and methods of managing audio and other media
US20080028223A1 (en) Visual Content-Based Internet Search Methods and Sub-Combinations
US20080140573A1 (en) Connected Audio and Other Media Objects
US20090158318A1 (en) Media Methods and Systems
US20100222102A1 (en) Second Screens and Widgets
US20120120296A1 (en) Methods and Systems for Dynamically Presenting Enhanced Content During a Presentation of a Media Content Instance
US7711564B2 (en) Connected audio and other media objects
US20100191728A1 (en) Method, System Computer Program, and Apparatus for Augmenting Media Based on Proximity Detection
US20020001395A1 (en) Authenticating metadata and embedding metadata in watermarks of media signals
US8831279B2 (en) Smartphone-based methods and systems
US20110247042A1 (en) Media fingerprinting for content determination and retrieval
US20070250716A1 (en) Fingerprinting of Media Signals
US20120134548A1 (en) Smartphone-Based Methods and Systems
US20120208592A1 (en) Smartphone-Based Methods and Systems
US20120284012A1 (en) Smartphone-Based Methods and Systems
US7505605B2 (en) Portable devices and methods employing digital watermarking

Legal Events

Date Code Title Description
AS Assignment

Owner name: DIGIMARC CORPORATION (AN OREGON CORPORATION), OREG

Free format text: MERGER;ASSIGNOR:DIGIMARC CORPORATION (A DELAWARE CORPORATION);REEL/FRAME:024369/0582

Effective date: 20100430

AS Assignment

Owner name: DIGIMARC CORPORATION, OREGON

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MODRO, SIERRA K.;SHARMA, RAVI K.;MACINTOSH, BRIAN T.;REEL/FRAME:024449/0756

Effective date: 20100526