US20110066944A1 - Multifunction Multimedia Device - Google Patents

Multifunction Multimedia Device Download PDF

Info

Publication number
US20110066944A1
US20110066944A1 US12/631,762 US63176209A US2011066944A1 US 20110066944 A1 US20110066944 A1 US 20110066944A1 US 63176209 A US63176209 A US 63176209A US 2011066944 A1 US2011066944 A1 US 2011066944A1
Authority
US
United States
Prior art keywords
media content
user
media
audio input
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/631,762
Inventor
James M. Barton
Brian Lanier
Amir H. Gharaat
James Cheng
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Adeia Media Solutions Inc
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to US12/631,762 priority Critical patent/US20110066944A1/en
Assigned to TIVO INC. reassignment TIVO INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LANIER, BRIAN, CHENG, JAMES, BARTON, JAMES M., GHARAAT, AMIR H.
Priority to EP17211239.3A priority patent/EP3346377A1/en
Priority to AU2010291945A priority patent/AU2010291945A1/en
Priority to SG2012017034A priority patent/SG179091A1/en
Priority to JP2012528995A priority patent/JP2013504947A/en
Priority to PCT/US2010/048811 priority patent/WO2011032167A1/en
Priority to CN201080051626.5A priority patent/CN102696233B/en
Priority to EP17211241.9A priority patent/EP3349436A1/en
Priority to CA2773323A priority patent/CA2773323A1/en
Priority to EP10816287.6A priority patent/EP2478700A4/en
Priority to EP17211240.1A priority patent/EP3346700A1/en
Priority to EP17211237.7A priority patent/EP3346701A1/en
Priority to EP17211238.5A priority patent/EP3346715B1/en
Publication of US20110066944A1 publication Critical patent/US20110066944A1/en
Priority to HK12112854.6A priority patent/HK1172178A1/en
Priority to JP2014165383A priority patent/JP6124357B2/en
Assigned to MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT reassignment MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: TIVO SOLUTIONS INC.
Assigned to TIVO SOLUTIONS INC. reassignment TIVO SOLUTIONS INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: TIVO INC.
Priority to HK19100302.2A priority patent/HK1257940A1/en
Priority to HK19100305.9A priority patent/HK1257943A1/en
Priority to HK19100303.1A priority patent/HK1257941A1/en
Priority to HK19100304.0A priority patent/HK1257942A1/en
Priority to HK19100301.3A priority patent/HK1257939A1/en
Assigned to TIVO SOLUTIONS INC. reassignment TIVO SOLUTIONS INC. RELEASE OF SECURITY INTEREST IN PATENT RIGHTS Assignors: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0277Online advertisement
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/41Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0242Determining effectiveness of advertisements
    • G06Q30/0244Optimization
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0251Targeted advertisements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0251Targeted advertisements
    • G06Q30/0255Targeted advertisements based on user history
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0251Targeted advertisements
    • G06Q30/0269Targeted advertisements based on user profile or attribute
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/04Billing or invoicing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0631Item recommendations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/01Social networking
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/32Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
    • G11B27/322Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier used signal is digitally coded
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42201Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/441Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
    • H04N21/4415Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/835Generation of protective data, e.g. certificates
    • H04N21/8358Generation of protective data, e.g. certificates involving watermark
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/78Television signal recording using magnetic recording
    • H04N5/782Television signal recording using magnetic recording on tape
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/42Systems providing special services or facilities to subscribers
    • H04M3/487Arrangements for providing information services, e.g. recorded voice services or time announcements
    • H04M3/493Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
    • H04M3/4938Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals comprising a voice browser which renders and interprets, e.g. VoiceXML

Definitions

  • the present invention relates to a multifunction multimedia device.
  • Multimedia content streams may be received by a multimedia player for display to a user. Furthermore, general information about multimedia content may be received by the multimedia player for display to the user.
  • the multimedia content is generally presented in a fixed non-editable format. The user is able to jump to particular points in the media content via scene selections created by the producer. Accordingly, the watching of the media content is generally passive and the user interaction is minimal.
  • FIG. 1A is a block diagram illustrating an example system in accordance with an embodiment
  • FIG. 1B is a block diagram illustrating an example media device in accordance with an embodiment
  • FIG. 2 illustrates a flow diagram for presenting additional content in accordance with an embodiment.
  • FIG. 3 illustrates a flow diagram for determining a position in the playing of media content in accordance with an embodiment.
  • FIG. 4 illustrates a flow diagram for detecting the playing of an advertisement in accordance with an embodiment.
  • FIG. 5 illustrates a flow diagram for deriving a fingerprint from media content in accordance with an embodiment.
  • FIG. 6 shows an exemplary architecture for the collection and storage of fingerprints derived from media devices.
  • FIG. 7 illustrates a flow diagram for presenting messages in accordance with an embodiment.
  • FIG. 8 illustrates a flow diagram for interpreting voice commands in accordance with an embodiment
  • FIG. 9 illustrates a flow diagram for correlating annotations with media content in accordance with an embodiment
  • FIG. 10 shows an exemplary system for configuring an environment in accordance with one or more embodiments.
  • FIG. 11 shows a block diagram that illustrates a system upon which an embodiment of the invention may be implemented.
  • media content is received and presented to a user.
  • a fingerprint derived from the media content is then used to query a server to identify the media content. Based on the media content identified based on the fingerprint, additional content is obtained and presented to the user.
  • the additional content may include an advertisement (e.g., for a product, service, or other media content), which is selected based on the identified media content.
  • an advertisement e.g., for a product, service, or other media content
  • a fingerprint is derived dynamically from the media content subsequent to receiving a command to present the media content. In an embodiment, the fingerprint is derived dynamically from the media content subsequent to receiving a command to present additional content associated with the media content being presented.
  • a face is detected in the media content based on the fingerprint derived from the media content.
  • a name of a person associated with the face is determined and presented in the additional content. Detecting the face and/or determining the name of the person associated with the face may be dynamically performed in response to receiving a user command.
  • features e.g., objects, structures, landscapes, locations, etc.
  • the features may be identified and the identification may be presented.
  • the features may be identified and/or the identification presented in response to a user command.
  • fingerprints may be dynamically derived concurrently with playing the media content. A position in the playing of the media content may then be determined based on the fingerprints.
  • additional content may be presented based on the position in the playing of the media content.
  • the additional content based on the position in the playing of the media content may be presented in response to a user command.
  • playing of the media content may be synchronized over multiple devices based on the position in the playing of the media content.
  • synchronization over multiple devices may be performed by starting the playing of media content on multiple devices at the same time, seeking to an arbitrary position of the media content on a device or delaying the playing of media content on a device.
  • a command to fast-forward, rewind, pause, stop, seek, or play on one device may be performed on all synchronized devices.
  • a determination may be made that advertisements are being played based on the position in the playing of the media content.
  • the advertisement may be skipped over or fast-forwarded through based on the position in the playing of the media content.
  • a notification may be provided that the advertisement was played or the speed at which the advertisement was played.
  • the advertisement may be selected based on the position in the playing of the media content.
  • the playing of an advertisement may be detected by determining that one or more fingerprints of the media content being played are associated with an advertisement portion of the media content.
  • an advertisement may be detected by identifying the persons associated with the faces in the advertisement portion of the media content and determining that the identified persons are not actors listed for the media content.
  • the advertisement may be enhanced with additional content pertaining to the product or service being advertised.
  • the advertisement may be automatically fast-forwarded, muted, or replaced with an alternate advertisement.
  • only a non-advertisement portion of the media content may be recorded by skipping over the detected advertisement portion of the media content.
  • a command is received to record particular media content on a first device associated with a first user and the particular media content is scheduled for recording on the first device.
  • a notification is provided to a second device associated with a second user of the scheduling of the recording of the particular media content on the first device.
  • the second device may then schedule recording of the particular media content.
  • the second device may schedule the recording of the particular media content without receiving a user command or subsequent to receiving a user confirmation to record the particular media content in response to the notification.
  • a command may be received from the second user by the second device to record all media content that is scheduled for recording on first device, any one of a plurality of specified devices, or a device associated with any of a plurality of specified users.
  • the scheduled recording of a particular media content on multiple devices may be detected.
  • a notification may be provided to at least one of the multiple devices that the particular media content is scheduled for recording on the multiple devices.
  • the particular media content may then be synchronously displayed on the multiple devices.
  • a time may be selected by one of the devices to synchronously play the particular media content on the multiple devices based on a user availability calendar accessible through each of the devices.
  • a time may also be suggested to receive a user confirmation for the suggested time.
  • a command to record or play a particular media content on a device associated with a user may be received. Responsive to the command, the particular media content may be recorded or played and information may be published in association with the user indicating that the user is recording or playing the particular media content. The information may be automatically published to a web service for further action, such as display on a web page. Responsive to the command, information associated with the particular media content may be obtained and presented to the user. In an embodiment, a group (e.g., on a social networking website) may be automatically created for users associated with devices playing or recording the particular media content.
  • a media device meeting an idleness criteria may be detected.
  • media content may be sent to the media device.
  • the media device may be configured to receive a particular content stream or streams accessible via the internet comprising the media content.
  • the media device may derive a fingerprint from the media content and send the fingerprint to a fingerprint database, along with additional data pertaining to the media (such as title, synopsis, closed caption text, etc).
  • Detecting that a media device meets an idleness criteria may involve receiving a signal from the media device, the media device completing a duration of time without receiving a user command at the media device, or determining that the media content has resource availability for deriving a fingerprint.
  • a message is received concurrently with playing audio/video (AV) content.
  • the message is interpreted based on message preferences associated with a user and the user is presented with the message based on the message preferences.
  • one or more messages may be filtered out based on message preferences.
  • presenting messages includes overlaying information associated with the message on one or more video frames of the AV content being played to the user. Presenting the message may include playing audio information associated with the message. In an embodiment, AV content is paused or muted when messages are presented.
  • messages are submitted by another user as audio input, textual input or graphical input.
  • Audio input may include a voice associated with the sender of the message, the receiver of the message, a particular fictional character, or non-fictional character, or a combination thereof.
  • the messages may be played exclusively to the recipient of the message.
  • a message may be presented during a time period specified by a message preference.
  • a message may be held until a commercial break during the playing of the AV content and presented during the commercial break.
  • a message maybe received from a message service associated with a social networking website.
  • a user-defined alert condition is received from a user.
  • AV content is played concurrently with monitoring for occurrence of the user-defined alert condition and occurrence of the user-defined alert condition is detected.
  • An alert may be presented in response to detecting occurrence of the user-defined alert condition.
  • detecting the alert condition includes determining that media content determined to be of interest to a user is being available on a content stream. In an embodiment, detecting the alert condition includes determines that media content associated with user requested information is available on a content stream. Detecting the alert condition may include receiving a notification indicating occurrence of the alert condition. In an embodiment, detecting occurrence of an alert condition may include obtaining information using optical character recognition (OCT) and detecting occurrence of the alert condition based on the information.
  • OCT optical character recognition
  • a voice command is received from a user and the user is identified based on voice command.
  • the voice command is then interpreted based on preferences associated with the identified user to determine an action out of a plurality of actions. The action is then performed.
  • a number of applicable users for the voice command is determined.
  • the number of applicable users may be determined by recognizing users based on voice input.
  • the action based on user preferences may include configuring a multimedia device or an environment, presenting messages, making a purchase, or performing another suitable action.
  • an action may be presented for user confirmation prior to performing the action or checked to ensure that the user permission to execute the action.
  • the voice command may be interpreted based on the language in which the voice command was received.
  • an annotation(s) is received from a user.
  • the annotation is stored in associated with the media content.
  • the annotation may include audio input, textual input, and/or graphical input.
  • the media content is played a second time concurrently with audio input received from the user. Playing the media content the second time may involve playing only a video portion of the media content with the audio input received from the user.
  • multiple versions of annotations may be received during different playbacks of the media content and each annotation may be stored in association with the media content.
  • the annotations may be provided in languages different than the original language of the audio portion of the media content.
  • Annotations may be provided with instructions associated with intended playback.
  • Annotations may include automatically generated audio based on information obtained using optical character recognition.
  • annotations may be analyzed to derive annotation patterns associated with media content.
  • Annotations may be elicited from a user and may include reviews of media content.
  • user profiles may be generated based on annotations.
  • Annotations may mark intervals or particular points in the playing of media content, which may be used as bookmarks to resume playing of the media content. Intervals marked by annotations may be skipped during a subsequent playing of the media content or used to create a play sequence.
  • Embodiments of the invention also include any system that includes the means for performing the method steps described herein.
  • Embodiments of the invention also include a computer readable medium with instructions, which when executed, cause the method steps described herein to be performed.
  • FIG. 1 shows a media device A ( 100 ), a media source ( 110 ), a media device N ( 120 ), a fingerprint server ( 130 ), a network device ( 140 ), and a web server ( 150 ).
  • a media device A 100
  • a media source 110
  • a media device N 120
  • a fingerprint server 130
  • a network device 140
  • a web server 150
  • the media source ( 110 ) generally represents any content source from which the media device A ( 100 ) can receive media content.
  • the media source ( 110 ) may be a broadcaster (includes a broadcasting company/service) that streams media content to media device A ( 100 ).
  • the media source ( 110 ) may be a media content server from which the media device A ( 100 ) downloads the media content.
  • the media source ( 100 ) may be an audio and/or video player from which the media device A ( 100 ) receives the media content being played.
  • the media source ( 100 ) may be a computer readable storage or input medium (e.g., physical memory, a compact disc, or digital video disc) which the media device A ( 100 ) reads to obtain the media content.
  • the terms streaming, broadcasting, or downloading to a device may be used interchangeably herein and should not be construed as limiting to one particular method of the device obtaining data.
  • the media device A ( 100 ) may receive data by streaming, broadcasting, downloading, etc. from a broadcast service, a web server, another media device, or any suitable system with data or content that may accessible by the media device.
  • Different sources may be mentioned as different examples presented below. An example describing a specific source should not be construed as limited to that source.
  • the fingerprint server ( 130 ) generally represents any server that stores fingerprints derived from media content.
  • the fingerprint server ( 130 ) may be accessed by the media device A ( 100 ) to download and/or upload fingerprints derived from media content.
  • the fingerprint server ( 130 ) may be managed by a content source (e.g., a broadcast service, a web service, or any other source of content) for storing a database of fingerprints derived from media content.
  • the content source may select media content to be fingerprinted.
  • the media device A ( 100 ) may derive the fingerprint from selected media content and provide the fingerprint to the fingerprint server ( 130 ).
  • the fingerprint server ( 130 ) may serve as a database for identifying media content or metadata associated with media content based on the fingerprint derived from that media content.
  • at least a portion of the fingerprint server ( 130 ) is implemented on one or more media devices. The media devices may be updated continuously, periodically, or according to another suitable schedule when the fingerprint server ( 130 ) is updated.
  • the network device ( 140 ) generally represents any component that is a part of the media device A ( 100 ) or a separate device altogether that includes functionality to communicate over a network (e.g., internet, intranet, world wide web, etc.).
  • the network device ( 140 ) may be a computer communicatively coupled with the media device A ( 100 ) or a network card in the media device A ( 100 ).
  • the network device ( 140 ) may include functionality to publish information associated with the media device A ( 100 ) (e.g., media content scheduled for recording on the media device A ( 100 ), media content recorded on the media device A ( 100 ), media content being played on the media device A ( 100 ), media content previously played on the media device A ( 100 ), media content displayed on the media device A ( 100 ), user preferences/statistics collected by the media device A ( 100 ), user settings on the media device A ( 100 ), etc.).
  • the network device ( 140 ) may post the information on a website, provide the information in an electronic message or text message, print the information on a network printer, or publish the information in any other suitable manner.
  • the network device ( 140 ) may include functionality to directly provide the information to another media device(s) (e.g., media device N ( 120 )).
  • the network device ( 140 ) may include functionality to obtain information from a network.
  • the network device ( 140 ) may perform a search for metadata or any other additional data associated with media content and provide the search results to the media device A ( 100 ).
  • Another example may involve the network device ( 140 ) obtaining information associated with media content scheduled, recorded, and/or played on media device N ( 120 ).
  • media device A ( 100 ) (or media device N ( 120 )) generally represents any media device comprising a processor and configured to present media content.
  • the media device A ( 100 ) may refer to a single device or any combination of devices (e.g., a receiver and a television set) that may be configured to present media content.
  • Examples of the media device A ( 100 ) include one or more of: receivers, digital video recorders, digital video players, televisions, monitors, Blu-ray players, audio content players, video content players, digital picture frames, hand-held mobile devices, computers, printers, etc.
  • the media device A ( 100 ) may present media content by playing the media content (e.g., audio and/or visual media content), displaying the media content (e.g., still images), printing the media content (e.g., coupons), electronically transmitting the media content (e.g., electronic mail), publishing the media content (e.g., on a website), or by any other suitable means.
  • media device A ( 100 ) may be a management device which communicates with one or more other media devices in a system.
  • the media device A ( 100 ) may receive commands from media device (e.g., a DVD player, a remote, a joystick, etc.) and communicate the command to another media device (e.g., a monitor, a receiver, etc.).
  • the media device A ( 100 ) may represent any apparatus with one or more subsystems configured to perform the functions described herein.
  • the media device A ( 100 ) may include functionality to derive fingerprints from media content.
  • the media device A ( 100 ) may derive a fingerprint from media content recorded on associated memory or stored in any other accessible location (e.g., an external hard drive, a DVD, etc.).
  • the media device A ( 100 ) may also derive a fingerprint from media content available on a content stream.
  • Media content that is available on a content stream includes any media content that is accessible by the media device A ( 100 ).
  • content available on a content stream may include content being broadcasted by a broadcast service, content available for download from a web server, peer device, or another system, or content that is otherwise accessible by the media device A ( 100 ).
  • the media device A ( 100 ) may include functionality to obtain media content being displayed and dynamically derive fingerprints from the media content being displayed or media content stored on the media device.
  • the media device A ( 100 ) may include the processing and storage capabilities to decompress media content (e.g., video frames), modify and/or edit media content, and compress media content.
  • the media device A ( 100 ) may include functionality to mimic another media device(s) (e.g., media device N ( 120 )) by recording, or playing the same media content as another media device.
  • the media device A ( 100 ) may include functionality to receive notifications of media content being recorded on media device N ( 120 ) and obtain the same media content from a content source. The media device A may automatically record the media content or provide the notification to a user and record the media content in response to a user command.
  • FIG. 1B illustrates an example block diagram of a media device in accordance with one or more embodiments.
  • the media device ( 100 ) may include multiple components such as a memory system ( 155 ), a disk ( 160 ), a central processing unit (CPU) ( 165 ), a display sub-system ( 170 ), an audio/video input ( 175 ), a tuner ( 180 ), a network module ( 190 ), peripherals unit ( 195 ), text/audio convertor ( 167 ), and/or other components necessary to perform the functionality described herein.
  • a memory system 155
  • a disk 160
  • CPU central processing unit
  • 170 a display sub-system
  • 175 an audio/video input
  • tuner 180
  • a network module 190
  • peripherals unit 195
  • text/audio convertor 167
  • the audio/video input ( 175 ) may correspond to any component that includes functionality to receive audio and/or video input (e.g., HDMI 176 , DVI 177 , Analog 178 ) from an external source.
  • the audio/video input ( 175 ) may be a DisplayPort or a high definition multimedia interface (HDMI) that can receive input from different devices.
  • the audio/video input ( 175 ) may receive input from a set-top box, a Blu-ray disc player, a personal computer, a video game console, an audio/video receiver, a compact disk player, an enhanced versatile disc player, a high definition optical disc, a holographic versatile disc, a laser disc, mini disc, a disc film, a RAM disc, a vinyl disc, a floppy disk, a hard drive disk, etc.
  • the media device ( 100 ) may include multiple audio/video inputs ( 175 ).
  • the tuner ( 180 ) generally represents any input component that can receive a content stream (e.g., through cable, satellite, internet, network, or terrestrial antenna).
  • the tuner ( 180 ) may allow one or more received frequencies while filtering out others (e.g., by using electronic resonance).
  • a television tuner may convert an RF television transmission into audio and video signals which can be further processed to produce sound and/or an image.
  • a network module ( 190 ) generally represents any input component that can receive information over a network (e.g., internet, intranet, world wide web, etc.). Examples of a network module ( 190 ) include a network card, network adapter, network interface controller (NIC), network interface card, Local Area Network adapter, Ethernet network card, and/or any other component that can receive information over a network.
  • the network module ( 190 ) may also be used to directly connect with another device (e.g., a media device, a computer, a secondary storage device, etc.).
  • input may be received by the media device ( 100 ) from any communicatively coupled device through wired and/or wireless communication segments.
  • Input received by the media device ( 100 ) may be stored to the memory system ( 155 ) or disk ( 160 ).
  • the memory system ( 155 ) may include one or more different types of physical memory to store data.
  • one or more memory buffers e.g., an HD frame buffer
  • HD high definition
  • the memory system ( 155 ) may also store frames in a compressed form (e.g., MPEG2, MPEG4, or any other suitable format), where the frames are then uncompressed into the frame buffer for modification, fingerprinting, replacement, and/or display.
  • the memory system ( 155 ) may include FLASH memory, DRAM memory, EEPROM, traditional rotating disk drives, etc.
  • the disk ( 160 ) generally represents secondary storage accessible by the media device ( 100 ).
  • central processing unit ( 165 ) may include functionality to perform the functions described herein using any input received by the media device ( 100 ).
  • the central processing unit ( 165 ) may be used to dynamically derive fingerprints from media content frames stored in the memory system ( 155 ).
  • the central processing unit ( 165 ) may be configured to mark or identify media content or portions of media content based on tags, hash values, fingerprints, time stamp, or other suitable information associated with the media content.
  • the central processing unit ( 165 ) may be used to modify media content (e.g., scale a video frame), analyze media content, decompress media content, compress media content, etc.
  • a video frame (e.g., an HD video frame) stored in a frame buffer may be modified dynamically by the central processing unit ( 165 ) to overlay additional content (e.g., information about the frame, program info, a chat message, system message, web content, pictures, an electronic programming guide, or any other suitable content) on top of the video frame, manipulate the video frame (e.g., stretching, rotation, shrinking, etc.), or replace the video frame in real time.
  • additional content e.g., information about the frame, program info, a chat message, system message, web content, pictures, an electronic programming guide, or any other suitable content
  • manipulate the video frame e.g., stretching, rotation, shrinking, etc.
  • an electronic programming guide, advertisement information that is dynamically selected, media content information, or any other text/graphics may be written onto a video frame stored in a frame buffer to superimpose the additional content on top of the stored video frame.
  • the central processing unit ( 165 ) may be used for processing communication with any of the input and/or output devices associated with the media device ( 100 ). For example, a video frame which is dynamically modified in real time may subsequently be transmitted for display.
  • the central processing unit ( 165 ) may be used to communicate with other media devices to perform functions related to synchronization, or publication of data.
  • the text/audio convertor ( 167 ) generally represents any software and/or hardware for converting text to audio and/or for converting audio to text.
  • the text/audio convertor may include functionality to convert text corresponding to closed captioned data to an audio file.
  • the audio file may be based on a computerized voice, or may be trained for using the voice of a user, a fictional or non-fictional character, etc.
  • the automatically generated voice used for a particular message may be the voice of a user generating the message.
  • the text/audio convertor may include functionality to switch languages when converting from voice to text or from text to voice. For example, audio input in French may be converted to a text message in English.
  • the peripherals unit ( 195 ) generally represents input and/or output for any peripherals that are communicatively coupled with the media device ( 100 ) (e.g., via USB, External Serial Advanced Technology Attachment (eSATA), Parallel ATA, Serial ATA, Bluetooth, infrared, etc.).
  • peripherals may include remote control devices, USB drives, a keyboard, a mouse, a microphone, and voice recognition devices that can be used to operate the media device ( 100 ).
  • multiple microphones may be used to detect sound, identify user location, etc.
  • a microphone may be a part of a media device ( 100 ) or other device (e.g., a remote control) that is communicatively coupled with the media device ( 100 ).
  • the media device ( 100 ) may include functionality to identify media content being played (e.g., a particular program, or a position in a particular program) when audio input is received (e.g., via a microphone) from a user.
  • the display sub-system ( 170 ) generally represents any software and/or device that includes functionality to output (e.g., Video Out to Display 171 ) and/or actually display one or more images.
  • Examples of display devices include a kiosk, a hand held device, a computer screen, a monitor, a television, etc.
  • the display devices may use different types of screens such as a liquid crystal display, cathode ray tube, a projector, a plasma screen, etc.
  • the output from the media device ( 100 ) may be specially for formatted for the type of display device being used, the size of the display device, resolution (e.g., 720i, 720p, 1080i, 1080p, or other suitable resolution), etc.
  • FIG. 2 illustrates a flow diagram for presenting additional content in accordance with an embodiment.
  • One or more of the steps described below may be omitted, repeated, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIG. 2 should not be construed as limiting the scope of the invention.
  • a command is received to present media content in accordance with an embodiment (Step 202 ).
  • the received command may be entered by a user via a keyboard or remote control.
  • the command may be a selection in the electronic programming guide (EPG) by a user for the recording and/or playing of the media content.
  • the command may a channel selection entered by a user.
  • the command may be a request to display a slide show of pictures.
  • the command may be to play an audio file.
  • the command may be a request to play a movie (e.g., a command for a blu-ray player).
  • receiving the command to present media content may include a user entering the title of media content in a search field on a user interface.
  • media content is presented (Step 204 ). Presenting the media content may include playing audio and/or visual media content (e.g., video content), displaying or printing images, etc. Presenting the media content may also involve overlaying the media content over other media content also being presented.
  • a fingerprint is derived from the media content (Step 206 ).
  • An example of deriving a fingerprint from media content includes projecting intensity values of one or more video frames onto a set of projection vectors and obtaining a set of projected values. A fingerprint bit may then be computed based on each of the projected values and concatenated to compute the fingerprint for the media content. Another example may include applying a mathematical function to a spectrogram of an audio file. Other fingerprint derivation techniques may also be used to derive a fingerprint from media content in accordance with one or more embodiments.
  • the fingerprint is derived from media content dynamically as the media content is being played. For example, media content being received from a content source may concurrently be played and fingerprinted.
  • the fingerprint may be derived for media content recognition, e.g., identifying the particular program, movie, etc.
  • Media streams containing 3-Dimensional video may also be fingerprinted.
  • fingerprinting 3-Dimensional video may involve selecting fingerprint portions of the 3-Dimensional video. For example, near objects (e.g., objects that appear closer when watching the 3-Dimensional video) in the 3-Dimensional video stream may be selected for fingerprinting in order to recognize a face or structure.
  • the near objects may be selected based on a field of depth tag associated with objects or by the relative size of objects compared to other objects.
  • a command to present additional content associated with the media content being presented is received (Step 208 ).
  • a command may be received to identify generic additional content (e.g., any feature in the media content). For example, information of the media content being played such as the plot synopsis of a movie, the actors in a movie, the year the movie was made, a time duration associated with the particular media content, a director or producer of the movie, a genre of the movie, etc.
  • specific information may be requested. For example, a command requesting the geographic location in the world of the current scene being played. Another example may involve a command requesting an identification of the people in a current scene being displayed.
  • Another example may involve a request for the year and model of a car in a scene of the movie.
  • Another example may involve a request to save or publish information about the content, including a timestamp, offset from beginning, and other contextual data, for later use or reference.
  • the specific information requests may include identification of places, objects, or people in a scene of the media content.
  • the additional content requested by the user may not be available when the command for the additional content is received. Accordingly, the additional information is dynamically identified (Step 210 ), after receiving the command, based on a fingerprint of the media content.
  • the fingerprint derived from the media content may be used to query a web server and receive identification of the object, place, or person in a scene that matches the fingerprint. The fingerprint may also be used to identify the media content being played to obtain the metadata already associated with the media content.
  • a fingerprint may be dynamically derived from the media content after receiving the command to present additional information.
  • the additional content is presented (Step 212 ).
  • Presenting the additional content may include overlaying the additional content on top of the media content being presented to the user.
  • Presenting the additional content may also include overlaying the additional content on portions of the frame displaced by scaling, cropping, or otherwise altering the original content.
  • uncompressed HD frame(s) may be loaded into a frame buffer and the additional data may be written into the same frame buffer, thereby overlaying original frame information with the additional data.
  • the additional information may be related to the media content being played, EPG display data, channel indicator in a banner display format as described in U.S. Pat. No. 6,642,939, owned by the applicant and incorporated herein by reference, program synopsis, etc.
  • a geographical location of the scene may be displayed on the screen concurrently with the scene.
  • a field may display the names of current actors in a scene at any given time.
  • a visual indication linking the name of an object, place, person, etc. with the object, place, person on screen may be displayed. For example, a line between a car in the scene and identifying information about the car.
  • the additional content may also provide links to advertisers, businesses, etc. about a displayed image.
  • additional information about a car displayed on the screen may include identifying information about the car, a name of a car dealership that sells the car, a link to a car dealership that sells the car, pricing information associated with the car, safety information associated with the car, or any other information directly or tangentially related to the identified car.
  • Another example may involve presenting information about content available on a content stream (e.g., received from a broadcast service or received from a web server).
  • the content itself may be overlaid on the frame, or a link with a description may be overlaid on the frame, where the link can be selected through user input.
  • the additional content may be presented as closed caption data.
  • subtitles in a user-selected language may be overlaid on top of the content, such as a movie or TV show.
  • the subtitles may be derived by various methods including download from an existing database of subtitle files, or real-time computational translation of closed captioning text from the original content.
  • Another example may involve synchronized overlay of lyrics on top of a music video or concert performance. The system may perform this operation for several frames or until the user instructs it to remove the overlay. At that point, the system may discontinue writing the additional information into the frame buffer.
  • audio content may replace or overlay the audio from the original content.
  • One example may involve replacing the audio stream of a national broadcast of a national football game with the audio stream of the local radio announcer.
  • One example may involve a real-time mix of the audio from the original media with additional audio, such as actor's commentary on a scene. This example may involve alteration of the original and additional audio, such as amplification.
  • FIG. 3 illustrates a flow diagram for determining a position in the playing of media content in accordance with an embodiment.
  • One or more of the steps described below may be omitted, repeated, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIG. 3 should not be construed as limiting the scope of the invention.
  • Step 302 a command is received to present media content (Step 302 ) and the media content is presented (Step 304 ) in accordance with an embodiment.
  • Step 302 and Step 304 are essentially the same as Step 202 and Step 204 described above.
  • a fingerprint is derived from the media content being played (Step 306 ) to determine the position in the playing of the media content on a first device (Step 308 ).
  • the media device may display the media content and derive fingerprints from the specific frames being displayed.
  • the media device may also derive fingerprints from every nth frame, from iframes, or based on any other frame selection mechanism.
  • a content fingerprint derived from one or more frames may then be compared to a database of fingerprints to identify a database fingerprint that matches the frame fingerprint.
  • the database of fingerprints may be locally implemented on the media device itself or on a server communicatively coupled with the media device.
  • the match between the content fingerprint and the database fingerprint may be an exact match or the two fingerprints may meet a similarity threshold (e.g., at least a threshold number of signature bits in the fingerprint match).
  • a similarity threshold e.g., at least a threshold number of signature bits in the fingerprint match.
  • a second device may be synchronized with the first device by playing the same media content on the second device concurrently, in accordance with one or more embodiments. (Step 310 ). Once a position of the playing of the media content is determined for the first device, the playing of the media content on the second device may be started at that position. If the media content is already being played on the second device, the playing of the media content on the second device may be stopped and restarted at that position. Alternatively, the playing of the media content on the second device may be fast forwarded or rewound to that position.
  • the viewing of a live broadcast or stored program may be synchronized using a buffer incorporated in media devices.
  • the content received in the content stream may be stored on multiple devices as they are received. Thereafter, the devices may communicate to synchronously initiate the playing of the media content, the pausing of media content, the fast forwarding of media content, and the rewinding of media content.
  • a large buffer that can store the entire media content may be used in an embodiment.
  • a smaller buffer can be used and video frames may be deleted as they are displayed and replaced with new video frames received in a content stream.
  • Synchronized playing of a live broadcast or stored program may involve playing a particular frame stored in a memory buffer at a particular time to obtain frame level synchronization.
  • two devices may exchange information that indicates at which second a particular frame stored in memory is to be played and a rate at which future frames are to played. Accordingly, based on the same start time, the frames may be displayed on different media devices at the exact same time or approximately the same time. Furthermore, additional frame/time combinations may be determined to ensure that the synchronization is maintained. When media devices are being used in different time zones, the times may be adjusted to account for the time difference. For example, Greenwich Mean Time (GMT) may be used across all media devices for synchronized playing of media content.
  • GTT Greenwich Mean Time
  • the synchronization may be maintained.
  • any play-function e.g., stop, fast-forward, rewind, play, pause, etc.
  • Step 312 any play-function (e.g., stop, fast-forward, rewind, play, pause, etc.) received on one device may be performed on both devices (Step 312 ).
  • the playing of an advertisement may be detected based on the position in the playing of the media content (Step 314 ).
  • media content available on a content stream may include a television show and advertisements interspersed at various times during the television show.
  • the composition information of the media content may indicate that the television show is played for twenty-five minutes, followed by five minutes of advertisements, followed by another twenty-five minutes of the television show and followed again by another five minutes of advertisements. Accordingly, if the position of the playing of the media content is determined to be twenty minutes from the start, the television show is being played. However, if the position of the playing of the media content is determined to be twenty-seven minutes from the start, an advertisement is being played.
  • the playing of an advertisement may be detected without determining the position in the playing of the media content. For example, if the media content includes a television show and advertisements interspersed between the television show, advertisements may be detected based on the fingerprints derived from the media content currently being played. The fingerprints derived from the media content currently being played may be compared to the fingerprints derived only from the television show or fingerprints derived only from the advertisement. Based on the comparison, the media content concurrently being played may be determined to be a portion of the television show or a portion of the advertisement.
  • the playing of an advertisement may be detected based on the elements present in the media content. For example, based on the fingerprints derived from the media content being played, faces of actors within the media content may be recognized. The names of the actors may then be compared with the names of actors that are listed as actors in the television show. If the actors detected in the media content being played match the actors listed as actors in the television show, then the television show is being played. Alternatively, if the actors detected in the media content being played do not match the actors listed as actors in the television show, then an advertisement is being played.
  • a time window may be used for detection of known actors in a television show, where at least one actor listed as an actor in the television show must be detected within the time window to conclude that the television show is being played.
  • advertisements may be auto fast-forwarded. For example, as soon as the playing of an advertisement is detected, an automatic fast-forwarding function may be applied to the playing of the media content until the playing of the advertisement is completed (e.g., when playing of a television program is detected again based on a fingerprint). Similarly, advertisements may also be auto-muted, where an un-muting function is selected in response to detecting the completion of the advertisement.
  • an advertisement may automatically be skipped over for the recording.
  • the non-advertisement portions e.g., movie portions
  • the advertisement portions of the media content may be skipped for the recording.
  • alternate advertisements may be displayed.
  • detected advertisement portions of the content stream may be replaced with alternate advertisements.
  • a media device at a sports bar may be programmed to display drink specials instead of the advertisements received in a content stream.
  • advertisements from local vendors which are stored in memory or streamed from a server, may be displayed instead of advertisements received in the content stream.
  • the advertisements may be selected based on the media content. For example, if during the playing of a sporting event, advertisements directed toward men may be selected.
  • the advertisement may be augmented with additional content related to the advertisement.
  • detected advertisement portions of the content stream may be scaled, cropped, or otherwise altered, and the displaced empty space can be programmatically populated by additional content.
  • additional content For example, an advertisement for a movie opening in theaters soon can be augmented with show times at theaters in a 15-mile vicinity of the device.
  • the user may also be presented with one or more interactive functions related to the additional content, such as the option to store information about the advertised movie, including the selected local theater and show time, to be used in future presentation, reference, ticket purchase, or other related activity.
  • the advertisement may be augmented with games, quizzes, polls, video, and audio related to the advertisement.
  • the advertisement may be augmented with information about actions taken by the user's social network connections related to the advertisement.
  • an advertisement for a digital camera may be augmented by photos of the user's friends taken with the same digital camera.
  • an advertisement for a movie recently released on DVD may be augmented with friends' ratings and reviews of that movie.
  • the advertisement may be augmented with additional content not related to the advertisement.
  • detected advertisement portions of the content stream may be scaled, cropped, or otherwise altered, and the displaced empty space can be programmatically populated by additional content.
  • the user may direct the system to use portions of the display during advertisements to display personalized content.
  • the personalized content may include the latest scores and statistics from the user's favorite sports teams.
  • the content may include all or some of the user's latest received messages, such as email, SMS, instant messages, social network notifications, and voice mails.
  • the user may be presented with information about additional content related to the content interrupted by the advertisement.
  • the user may be presented with the chance to take his turn in a previously started game.
  • the user may also be presented with one or more interactive functions related to the additional content, such as the option to store information about the content to be used in future presentation, reference, or other related activity.
  • the user may choose to respond to an SMS, email, voice mail, or instant message using a keyboard or microphone.
  • a notification of the playing of an advertisement by a media device may be provided to an interested party (e.g., a vendor or broadcaster).
  • an interested party e.g., a vendor or broadcaster.
  • a vendor advertisement is played on a media device
  • a content source may be informed that the vendor advertisement was in fact played.
  • the content source may be informed that the vendor advertisement was fast forwarded through.
  • This information may be provided to the vendor in order for the vendor to determine the effectiveness of the advertisement. Additional information including whether the advertisement was played as a part of a previously stored recording or played directly upon receiving from the content source may be provided to an interested party.
  • cumulative statistics of a user may also be gathered based on advertisement detection. For example, particular types of advertisements or media content viewed by a user may be documented to determine user interests. These user interests may be provided to a vendor, stored on a server, published on an interactive webpage associated with the user, or otherwise presented. Anonymous information of a plurality of users may be collected to create reports based on user viewing or input.
  • U.S. patent application Ser. No. 10/189,989 owned by the Applicant and incorporated herein by reference, describes such approaches.
  • FIG. 4 illustrates a flow diagram for detecting the playing of an advertisement in accordance with an embodiment.
  • One or more of the steps described below may be omitted, repeated, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIG. 4 should not be construed as limiting the scope of the invention.
  • a command is received to view or record media content on a first device associated with a first user (Step 402 ).
  • the command to view or record media content may be received by a selection in an electronic programming guide (EPG).
  • the command may be for a single recording of media content (e.g., a movie, a sports event, or a particular television show) or a series recording of media content (e.g., multiple episodes of a television show).
  • a command may be received to play a media content file that is locally stored on memory (e.g., a DVD player may receive a command to play a DVD, a digital video recorder may receive a command to play a stored recording).
  • a single media device may receive all such commands and instruct the other devices (e.g., a DVD player, a blu-ray player) accordingly.
  • the viewing or recording of media content on the first device is published in accordance with an embodiment (Step 404 ).
  • Publishing the viewing or recording of media content may be user specific.
  • the viewing or recording of media content may be posted on a webpage (e.g., a user webpage on a networking website such as MySpace®, or Facebook®) (MySpace® is a registered trademark of MySpace, Inc., Beverly Hills, Calif. and Facebook® is a registered trademark of Facebook, Inc., Palo Alto, Calif.) associated with a user
  • a posting on a group page e.g., a webpage designated for a group
  • may be emailed to other users may be provided in a text message, or may be published in any other manner.
  • all the viewing or recording by a user may be automatically emailed to a list of other users that have chosen to receive messages from the user (e.g., using Twitter®, Twitter® is a registered trademark of Twitter, Inc., San Francisco, Calif.).
  • Publishing the viewing or recording of media content may also include a fee associated with the media content. For example, if the user selects a pay per view movie, the cost of the movie may also be published.
  • publishing the viewing or recording of media content may involve publishing the name of a user (or username associated with the user) on a publication associated with the media content.
  • all the users that have viewed a particular media content may be published on a single web page associated with a social networking website. Any users that have responded (e.g., “like”, “thumbs up”, “share”, etc.) to a posting related to the particular media content, which indicates the user has viewed the particular media content, may be published on the single web page.
  • the media content is recorded on the first device and a second device associated with a second user (Step 506 ).
  • the first device may notify the second device of the scheduled recording of media content and the second device may auto-record the media content.
  • the second device may prompt a second user for recording of the media content.
  • the second device may then record the media content subsequent to receiving a user command to record the media content.
  • the recording of the media content on the second device may be subsequent to the publication (e.g., on a website) of recording on the first device, as described above.
  • a second user may select a link on a website associated with the publication of recording the media content on the first device, to record the media content on the second device associated with the second user.
  • a media device may be configured to mimic another media device by recording all programs recorded by the other media device.
  • the recording of the same media content on multiple devices may be detected in accordance with an embodiment (Step 408 ).
  • different users within a user group may each schedule the recording of the same media content on their respective media devices.
  • the scheduled recordings of each media device associated with the users within the group may be collected and compared (e.g., by a server, a service, or one of the media devices) to detect any overlapping scheduled recordings.
  • the already recorded media content on a media device may be compared to the already recorded media content on another media content or to scheduled recordings on another media content.
  • a media device may be configured to automatically schedule recordings of any media content that is scheduled for recording by another specified media device. Accordingly, a media device may be configured to mimic another media device identified by a device identification number. The media device may also be configured to mimic any device associated with a specified user. For example, a first user may determine that a second user has a great selection of new shows or programs based on the postings of the second user on a social networking website. The first user may then choose to mimic the television watching habits of the second user by submitting a mimicking request with the identification number of the media device associated with the second user or a name of the second user. Alternatively, the first user may indicate the preference on the social networking website. The social networking website may then communicate the identification of the first user and the second user to a content source, which configures the media device associated with the first user to record the same shows as recorded by the media device associated with the second user.
  • each media device may be configured to access a database of media device recording schedules (e.g., on a server, provided by a third party service, etc.).
  • a user may access this database using their own media device and mimic the recordings of another media device that is referenced by the name or identification of a specific user.
  • a user may select specific shows that are also recorded by another user.
  • the user may be able to access other recording related statistics to select shows for viewing or recording.
  • a media device recording database may indicate the most popular shows based on future scheduled recordings, based on recordings already completed, or based on a number of users that watched the shows as they were made available on the content stream.
  • a time for playing the media content concurrently on multiple devices may be scheduled in accordance with an embodiment (Step 410 ).
  • the time for playing the media content may be selected automatically or may be selected based on user input from one or more users. For example, all users associated with media devices that are scheduled for recording (or have already recorded) particular media content may be notified of the overlapping selection and one user may select the time for concurrent viewing of the media content by all the users using their respective media devices.
  • each media device may access a user availability calendar to determine the available viewing times for a respective user. Thereafter, a synchronous viewing of a show may be scheduled in the calendar such that all the users (or most of the users) are available.
  • the viewers/recorders of the same media content may be automatically enrolled into a group associated with the media content in accordance with an embodiment (Step 412 ).
  • all the viewers and/or recorders of a specific movie may be automatically enrolled into a social networking group associated with the movie, in response to each recording/viewing the movie.
  • the auto-enrollment group may be used by users as a forum to discuss the media content, find other users with similar viewing preferences, schedule a viewing time for similar recordings, or for any other suitable purpose.
  • a discussion forum may be initiated for two or more users associated with multiple devices that are synchronously playing media content.
  • the discussion forum may be initiated by the media device inviting a user to join an instant messaging chat (e.g., Yahoo!® Instant Messaging, Google® Chat, AIM®, Twitter®, etc.)
  • Yahoo!® is a registered trademark of Yahoo!, Inc., Sunnyvale, Calif.
  • Google® is a registered trademark of Google, Inc., Mountain View, Calif.
  • AIM® is a registered trademark of AOL LLC, Dulles, Va.
  • video chat e.g., Skype®, Skype® is a registered trademark of Skype Limited Corp., Dublin, Ireland
  • the discussion forum may include two users or any number of users.
  • the discussion forum may be initiated for users that are already known to be connected. For example, the discussion forum may be initiated if users are friends on a social networking website. In an embodiment, the discussion forum may be created to introduce vendors to potential clients. For example, during the playing of a football game, an invitation may be presented to chat with a vendor of football game tickets.
  • the discussion forum may be implemented as a dating portal. For example, men and women in the same geographical area that are subscribed to a dating server, who are watching the same show may be invited to a chat by the media device. Another example involves an activity portal. For example, a media device may be configured to invite viewers of a cooking channel show to cook together, or a media device may configured to invite viewers of a travel channel show to travel to a featured destination together.
  • a media device may be configured to communicate, as described above, with any other computing device (e.g., another media device or a personal computer).
  • FIG. 5 illustrates a flow diagram for deriving a fingerprint from media content in accordance with an embodiment.
  • One or more of the steps described below may be omitted, repeated, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIG. 5 should not be construed as limiting the scope of the invention.
  • a media device is monitored to determine that the media device meets an idleness criteria (Step 502 ).
  • An idleness criteria may be based on non-use of a media device or component, or a usage percentage (e.g., a percentage related to available bandwidth of the total bandwidth or a percentage related to available processing power of the total processing power).
  • the media device may be self monitored or monitored by a server. Monitoring the media device for the idleness criteria may involve detecting completion of a period of time without receiving a user command. Monitoring the media device for the idleness criteria may involve detecting availability of resources needed to receive media content and/or derive a fingerprint from the media content. Monitoring the media device may include separately monitoring different components of a media device.
  • the tuner may be idle. Based on this information, a determination may be made that the tuner meets an idleness criteria. Accordingly, different components of the media device may be associated with separate idleness criteria. In another example, components necessary for deriving a fingerprint from media content may meet an idleness criteria.
  • the media device receives media content from a content source for the purpose of deriving a fingerprint from the media content (Step 504 ).
  • the media device may receive media content in response to alerting a content source that the media device (or components within the media device) meet an idleness criteria.
  • the content source may automatically detect whether a media device meets an idleness criteria. For example, the content source may determine that the media device has not requested to view any particular media content (e.g., broadcast content, web content, etc.). Therefore, the tuner most likely has bandwidth to download media content.
  • media devices may include the functionality to receive multiple content streams. In this embodiment, the content source may determine how many content streams are being received by the media device. Based on the known configuration and/or functionality of the media device, the content source may determine the tuner's available bandwidth for receiving additional media content. Once the idleness criteria is met, the content source may download a particular media content for the media device to generate a fingerprint.
  • the content source may build a database of fingerprints for media content by dividing out the media content to be broadcasted among multiple media devices that meet the idleness criteria. For example, if five thousand devices meet the idleness criteria and two thousand unique media content files are to be fingerprinted, the content source might transmit four unique media content files to each of the five thousand media devices for generating respective fingerprints from the media devices.
  • the content source may send each unique media content file to two or more media devices in case there is an error with the fingerprint derived from media device, or if the media device is interrupted while deriving the fingerprint.
  • the content source may also direct a media device to fingerprint content which has already been downloaded to the media device (e.g., based on user command).
  • a user may resume utilizing the media device and thereby prevent or stop the media device from deriving a fingerprint.
  • the content source may prompt the user to request permission for using the media device when an idleness criteria is met before downloading media content onto the media device.
  • the content source may also offer incentives such as credits to watch pay-per-view movies if the user allows the content source to use the media device to perform and/or execute particular functions (e.g., deriving fingerprints).
  • a fingerprint is derived from media content by the media device (Step 506 ). Any technique may be used to derive a fingerprint from media content.
  • One example is to derive a fingerprint from a video frame based on the intensity values of pixels within the video frame.
  • a function e.g., that is downloaded onto the media device
  • a signature bit e.g., ‘0’ or ‘1’
  • a similar technique may be used for audio fingerprinting by applying the method to spectrograms created from audio data.
  • the fingerprint may be derived by the media device based on specific instructions from the content source. For example, fingerprints may be derived from all video frames of a particular media content file. Alternatively, the fingerprint may be derived for every nth frame or every iFrame received by the media device. In an embodiment, specific frames to be fingerprinted may be tagged. Tagging techniques are described in application Ser. No. 09/665,921, application Ser. No. 11/473,990, and application Ser. No. 11/473,543, all of which are owned by the Applicant, and herein incorporated by reference. Once a media device receives a frame that is tagged, the media device may then decompress the frame, analyze the frame, and derive a fingerprint from the frame. The video frame fingerprints may be categorized by the media device according to the media content (e.g., by media content name, episode number, etc.).
  • the media device may derive fingerprints for media content that is being watched by a user. For example, a user may select a particular show on an electronic programming guide displayed by a media device. The media device may then request the content stream, from the content source, that includes the particular show. As an optional step, the source may indicate whether a fingerprint is needed for the particular show requested by the media device. The indication may be a flag in the data received by the media device. If the particular show needs to be fingerprinted as indicated by the flag, the media device may decompress the corresponding video frames, load the decompressed video frames into memory and analyze the video frames to derive a fingerprint from the video frames. In an embodiment, the user may change the channel mid-way through the playing of the media content being fingerprinted.
  • the tuner may be forced to receive a different content stream.
  • the media device may have derived fingerprints for only a portion of the media content.
  • the media device may generate metadata indicating the start position and end position in the playing of the media content for which the fingerprint has been derived.
  • the media device may then upload the fingerprint derived from the media content (or from a portion of the media content) to a fingerprint server in accordance with an embodiment (Step 508 ).
  • a fingerprint database may be built by multiple media devices each uploading fingerprints for media content. Fingerprints received for only a portion of the media content may be combined with other fingerprints from the same media content to generate a complete fingerprint. For example, if one media device generates and uploads fingerprints for video frames in the first half of a program and a second media device generates and uploads fingerprints for a second half of the same program, then the two fingerprints received from the two devices may be combined to obtain fingerprints for all the video frames of the program.
  • the fingerprint management engine ( 604 ) generally represents any hardware and/or software that may be configured to obtain fingerprints derived by media devices (e.g., media device A ( 606 ), media device B ( 608 ), media device C ( 610 ), media device N ( 620 ), etc.).
  • the fingerprint management engine ( 600 ) may be implemented by a content source or other system/service that includes functionality to obtain fingerprints derived by the media devices.
  • the fingerprint management engine ( 604 ) may obtain fingerprints for media content already received by the media device (e.g., in response to user selection of the media content or content stream which includes the media content).
  • the fingerprint management engine ( 604 ) may transmit media content to a media device specifically for the purpose of deriving a fingerprint.
  • the fingerprint management engine ( 604 ) may transmit media content to a media device for fingerprinting in response to detecting that the media device is idle.
  • the fingerprint management engine ( 604 ) maintains a fingerprint database ( 602 ) for storing and querying fingerprints derived by the media devices.
  • FIG. 7 illustrates a flow diagram for presenting messages in accordance with an embodiment.
  • One or more of the steps described below may be omitted, repeated, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIG. 7 should not be construed as limiting the scope of the invention.
  • message preferences associated with a user are received (Step 702 ).
  • Message preferences generally represent any preferences associated with message content, message timing, message filtering, message priority, message presentation, or any other characteristics associated with messages.
  • message preferences may indicate that messages are to be presented as soon as they are received or held until a particular time (e.g., when commercials are being displayed).
  • Message preferences may indicate different preferences based on a message source or a message recipient. For example, messages from a particular website, Really Simply Syndication (RSS) feed, or a particular user may be classified as high priority messages to be presented first or to be presented as soon as they are received. Low priority messages may be held for a particular time.
  • RSS Really Simply Syndication
  • Message preferences may indicate whether messages are to be presented as received, converted to text, converted to audio, presented in a particular manner/format/style, etc.
  • Message preferences may be associated with automated actions, where receiving particular messages results in automatically performing specified actions.
  • One or more preferences e.g., message preferences), viewing history, and/or other information associated with a user make up a user profile.
  • message preferences may include a user-defined alert condition.
  • the alert condition may include receiving an email, voicemail, text message, instant message, twitter tweet, etc. that meets a particular condition.
  • An alert condition may include a specific user action performed by a specified list of users.
  • an alert condition may a particular user posting a hiking activity invite on a webpage.
  • the alert condition may be based on particular keywords in a communication, a subject matter associated with a communication, etc. For example, if the word “emergency” or “urgent” is found in the communication, the alert condition may be met.
  • the alert condition may be related to security (e.g., a house alarm or car alarm being set off).
  • the alert condition may be related to kitchen equipment.
  • the alert condition may be linked to an oven timer going off.
  • the alert condition may include a change in status of a user specified entity.
  • the alert condition may be related to when a user on a social networking website changes status from “in a relationship” to “single”.
  • An alert condition may include the availability of a particular media content, in a content stream, selected based on a user profile.
  • the user profile may include a viewing history, an actor name, a media content genre, a language associated with the media content. If media content that matches any part of the user profile, the alert condition may be met and an alert may be presented in response.
  • message preferences may be received as direct input from a user, determined based on user files, obtained from the internet (e.g., from a web page or other file associated with a user, by querying a database, etc.).
  • the message preferences may be obtained by monitoring the usage patterns on a media device. For example, if usage patterns indicate that a user checks messages immediately upon receiving notifications of a message, the message preferences may indicate that messages are to be displayed or played immediately.
  • Message preferences for a user may also be sender based. For example, the sender of a message may indicate the delivery method and/or delivery preferences. Message preferences may also be randomly (e.g., user input), periodically, or continuously be modified.
  • a command to play media content is received (Step 704 ).
  • the received command may be submitted by a user via a keyboard, remote control, a mouse, joystick, a microphone or any other suitable input device.
  • the command may be a selection in the electronic programming guide (EPG) by a user for the playing of the media content.
  • the command may be a channel selection entered by a user.
  • the command may be a request to display a slide show of pictures.
  • the command may be to play an audio file.
  • the command may be a request to play a movie (e.g., a command for a blu-ray player).
  • receiving the command to present media content may include a user entering the title of media content in a search field on a user interface.
  • the command to play media content may be a user selection of particular media content that is stored in memory.
  • the media content is played (Step 706 ).
  • the media content may be played in response to the command or without receiving a command.
  • a user may turn on a media device which is automatically configured to receive a content stream on the last selected channel or a default channel.
  • the media device may automatically select media content for playing based on user preferences or responsive to playing or recording of the media content on another media device.
  • a message may be received while playing media content (Step 708 ).
  • the message may be received from a local or remote source over a network (e.g., internet, intranet, broadcast service, etc.).
  • a message may be received from a web service through an internet connection.
  • friend messages or status changes associated with a social networking website may be received from a web service.
  • the web service may be configured to provide all messages associated with a social networking website or a filtered selection of messages associated with particular preferences.
  • Another example, may include a Really Simply Syndication (RSS) feed that may be received from a web service associated with news, sports, entertainment, weather, stocks, or any other suitable category.
  • the message may be received from a content source related to services provided by the content source. For example, the message may indicate the availability of car purchasing service, or the availability of a particular car for sale.
  • the message may be a direct message to a user or group of users (e.g., voicemail, text message, email, etc.).
  • the message may be received in a form different than the originating form.
  • a text message may be received as an audio file, or the text message may be converted to an audio file by the media device after receipt of the text message.
  • an audio file may be received as a text message or converted to a text message.
  • symbols, abbreviations, images, etc. may be used to represent messages.
  • a message received in one language may be translated to a different language.
  • the receiving the message may include detecting the occurrence of a user-defined alert condition. For example, all messages may be monitored and compared to user-defined alert conditions.
  • EPG data, an RSS feed, a webpage, an event log, displayed information obtained using OCR or any other source of information may be monitored for occurrence of the alert condition. If any of the messages received match an alert condition, the occurrence of the alert condition may be identified. An alert may be then be immediately presented indicating occurrence of the alert condition. The message indicating occurrence of the alert condition may be interpreted based on user preferences.
  • presenting the message may include presenting the message in a visual format and/or playing the message in an audio format.
  • a message may be presented by loading a media content frame into a frame buffer and overlaying message content in the frame buffer to overwrite a portion of the media content frame. The content of the frame buffer may then be presented on a display screen.
  • different buffers may be used for media content and for message content, where content for the display screen is obtained from both buffers.
  • presenting a message may include displaying message information and concurrently playing an audio file with the message information.
  • the message information displayed on the screen and played in the audio file may be the same or different.
  • the display screen may display the face of a person associated with the message or announcing the message, while the audio file may include the actual message.
  • playing an audio message may include muting or lowering the volume associated with the media content be played.
  • FIG. 8 illustrates a flow diagram for interpreting a voice command in accordance with an embodiment.
  • One or more of the steps described below may be omitted, repeated, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIG. 8 should not be construed as limiting the scope of the invention.
  • one or more users present near a multimedia device are identified (Step 802 ).
  • One or more users may be identified based on voice input received by the multimedia device or an input device (e.g., a microphone, a remote) associated with the multimedia device.
  • the multimedia device (or an associated input device) may be configured to periodically sample detectable voice input and compare the voice input to data representing user voices to identify known users.
  • the data representing user voices may be generated based on a voice training exercise performed by users for the multimedia device to receive voice samples associated with a user.
  • Users may be identified during an active or passive mode. For example, users may be identified when a user command is received to recognize users or users may be identified automatically without a specific user command.
  • voice identification is used as an example, other means for recognizing users may also be used.
  • user names may be entered via an input device (e.g., keyboard, mouse, remote, joystick, etc.). Users may be identified based on metadata associated with the household. Users may be identified using fingerprint detection on the media device or fingerprint detection on another communicatively coupled device (e.g., a remote).
  • a voice command is received from a user (Step 804 ).
  • a voice command may be received by a user first indicating that a voice command is to be given. For example, a user may say a keyword such as “command” or enter input on a device such as a remote indicating that the user is going to submit a voice command.
  • a voice command may be received by continuously processing all voice input and comparing the voice input to known commands to determine if a voice command was submitted. For example, voice input in the last n seconds from the current time may be continuously submitted for analysis to determine if a voice command was received in the last n seconds.
  • different portions of the voice command may be received from different users.
  • a command “record” may be received from a first user and various titles of programs/shows may be received from multiple users. Examples of other commands include “order pizza”, “tweet this game is amazing”, “wall post who wants to come watch the emmys”, etc.
  • a voice command is used in this example, any type of input (e.g., using a mouse, a keyboard, a joystick) may be accepted.
  • the command may be interpreted based on preferences (e.g., in a user profile) associated with one or more identified users (Step 806 ) to determine an action to be performed (Step 808 ).
  • Interpreting a command may involve determining whether the command is applicable to one user (e.g., the user giving the command) or multiple users (e.g., including multiple users identified in Step 802 ).
  • a particular command word may be indicative of a single user command or a multiple user command.
  • tweet commands may be interpreted by default as a command applicable to a single user, e.g., the user submitting the command.
  • the command may be interpreted based on the user's preferences/settings.
  • the action to be performed is to generate a tweet for the user's twitter account including the words “this game is amazing”.
  • Another example of a command applicable to a single user includes “wall post who wants to come watch the emmys”.
  • the command by a user may be recognized as a Facebook wall post and the message “who wants to come watch the emmys” may be posted on the user's Facebook profile.
  • the multimedia device may be configured to associate certain types of commands with multiple user commands. For example, orders for food may be associated with all the identified users. A command “order pizza” may be interpreted as an order for pizza with toppings matching the preferences of all the identified users.
  • a command “buy tickets” may be interpreted as an order to purchase tickets for all the identified users for a football game currently being advertised on television.
  • a command may be intentionally vague for complete interpretation based on the identified users.
  • the command “play recorded show” may result in evaluating each recorded show on a media device to determine how many identified users prefer the recorded show based on user preferences. Thereafter, the recorded show that matches the preferences of the largest number of identified users is selected for playing.
  • command interpretations may be confirmed with a user before execution. For example, when ordering pizza, the pizza toppings selected based on user preferences may be presented for confirmation. Another example involving confirmation of commands may involve any orders requiring money or a threshold amount of money.
  • a command may be interpreted based on permissions associated with a user and the command may be performed only if the user giving the command has the permission to give the command. For example, a recording and/or playing of a rated R movie may be restricted to users over the age of seventeen. A profile may be setup for each user including the age of the user. If an identified user over the age of seventeen gives the command to record/play an R rated movie, the command is executed. However, if a user under the age of seventeen gives the command to record/play the R rated movie, the command is denied.
  • a command may be interpreted based on the religious and/or political beliefs of a user. For example, an election coverage program sponsored by the democratic party may be recorded if a democratic user submits a command to record election coverage and an election coverage program sponsored by the republican party may be recorded if a republican user submits the command.
  • a language used to submit a command may be used to interpret the command. For example, if a command to record a show is submitted in French, the French subtitles may be selected out of a set of available subtitle streams and recorded with the show. In another example, if multiple audio streams are available in different languages, the audio stream selected may be based on the language of the command.
  • FIG. 9 illustrates a flow diagram for correlating annotations with media content in accordance with an embodiment.
  • One or more of the steps described below may be omitted, repeated, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIG. 9 should not be construed as limiting the scope of the invention.
  • annotations e.g., audio, textual, graphical, etc.
  • embodiments of the invention are applicable to any type of annotation.
  • media content is played (Step 902 ).
  • the media content may include both audio and video content, or the media content may include video content alone.
  • audio input received from a user may be recorded (Step 904 ).
  • the audio input received from a user may be general reactions to the media content.
  • the audio input may include laughter, excitement (e.g., gasps, “wow”, etc.), commentary, criticisms, praises, or any other reaction to the media content.
  • the commentary may include audio input intended for a subsequent playing of the media content. For example, in a documentary film about tourist destinations, a user may submit voice input which includes stories or memories associated with the particular tourist destination being featured.
  • a band may provide song lyrics during a particular portion of the media content for recording in association with that portion of the media content.
  • a user may provide commentary, plot synopsis, character lines, or any other information about the media content in an alternate language during the playing of the media content in the original language.
  • Different versions of audio input e.g., by the same user or by different users
  • the audio input may be provided with instructions for intended playback information.
  • the playback information may indicate that the submitted audio is to replace the original audio entirely, or played in concurrently with the original audio.
  • the audio input may be automatically generated by a text-to-speech translator which generates speech based on text associated with the media content.
  • speech in an alternate language may be generated based on the closed caption text in the alternate language.
  • optical character recognition may be used to identify building names, letters, team names, etc. displayed on a screen and converted to audio for visually impaired audiences, or for audiences that cannot read the information (e.g., due to language barriers or age).
  • audio input may be received concurrently with playing a particular portion of the media content and stored in association with that particular portion of the media content.
  • the media content is subsequently played with the audio input received during a previous playing of the media content (Step 906 ).
  • Playing the additional audio input received during the previous playing of the media content may include completely replacing the original audio stream or playing concurrently with the original audio stream.
  • the additional audio input may be a feature that can be turned on or off during the playing of the corresponding media content.
  • multiple versions of additional audio input may be offered, where a user selects the particular additional audio input for playing during playing of the media content. For example, an online community may be established for submitting and downloading commentary to be played with different movies. Different users with different media devices may record audio input in association with a particular movie (or other content) and thereafter upload the audio input for association with that movie.
  • the purchaser may be able to select a commentary (e.g., audio input) by another user to be downloaded/played with the movie. If a purchaser finds the commentary by a particular user very, the purchaser may set the particular user as a default commentator and download all commentaries by the particular user when downloading a movie (or other media content).
  • a commentary e.g., audio input
  • audio input is used an example of annotations of media content
  • any type of annotations may be used in accordance with embodiments of the invention.
  • text may be entered or images may be submitted by one or more users.
  • all or part of an annotation or collection of annotations may be processed or analyzed to derive new content.
  • a collection of annotations associated with the same media content may be compared to identify annotations patterns.
  • a collection of annotations can be analyzed to determine the most annotated point within media content. Accordingly, a scene or actor which resulted in the greatest amount of user excitement (or other emotion) may be identified via annotations during a scene.
  • user content included in a collection of annotations such as text or voice notes can be analyzed to determine collective user sentiment (e.g., the funniest scene in a movie, or the funniest movie released in 2009).
  • any annotations may be elicited before, during, or after presenting media content by a personal media device associated with a user.
  • Eliciting annotations may be based on selections by an administrator, content producer, content director, etc. For example, a user may be prompted by a media device for a review (e.g., vote, rating, criticism, praise, etc.) at the conclusion of each performance within a presentation of a talent contest within media content in the content stream that was received by the media device and displayed by the media device.
  • a review e.g., vote, rating, criticism, praise, etc.
  • elicited annotations may be associated with the media content as a whole rather than a specific point within the media content such as when the audio input was submitted.
  • the annotations of one or more users may then be processed (e.g., to count votes, scores, etc.) for the media content.
  • the audio input may be elicited from a user by a media device to build a user profile. For example, reactions to different media content may be elicited from a user. Based on the reactions, a user profile may be automatically created which may include users interests, likes, dislikes, values, political views etc. The automatically created profile may used for a dating service, a social networking website, etc. The automatically generated profile may be published on a webpage (e.g., of a social networking website).
  • the system can elicit user annotations to identify information associated with media content. For example, annotations may be elicited for identification of a face which although detected, cannot be identified automatically.
  • a system may also be configured to elicit annotations from a parent, after media content has been played, indicating whether the media content is appropriate for children.
  • annotations may be used by a user to mark a location in the playing of media content.
  • a user may submit audio input or textual input during the playing of media content that includes a particular keyword such as “mark”, “note”, “record”, etc. that instructs the system to mark a current location in the playing of the media content.
  • the system may automatically mark a particular location based on user reaction. For example, user input above a certain frequency or a certain decibel level may indicate that the user is excited. This excitement point may be stored automatically.
  • the marked points may include start points and/or end points. For example, periods of high user activity which may correlate to exciting portions of a sports game may be marked by start and end points.
  • a parent may mark start and end points of media content that are not appropriate for children and thus, the marked portion may be skipped during playback unless a password is provided.
  • a user may mark a section in a home video that was eventful.
  • an annotation may be stored in association with the point.
  • the annotation may embody a reference to the original content, a time, or frame offset from the start of the original content, and the UTC when the user marked the point.
  • audio input may used as an example, input may be submitted by pressing a key on a remote, clicking on a mouse, entering a command on a keyword, or using any other input method.
  • marking (or identifying) a particular point in media content may involve marking a media frame.
  • media frames may be marked using tags, as described in Applicant owned patent application Ser. No. 09/665,921 filed on Sep. 20, 2000, which is hereby incorporated by reference.
  • Another example may involve marking a media frame using hash values, as described in Applicant owned patent application Ser. No. 11/473,543 filed on Jun. 22, 2006, which is hereby incorporated by reference.
  • marking a particular point in the media content may involve deriving a fingerprint from one or more frames in the media content and using the fingerprint to recognize the particular point in the media content.
  • a particular point may be marked by storing a time interval from a starting point in the playing of the media content.
  • a user marked location may be selected by the user at a later time.
  • the user may be able to scan through different user marked locations during the playing of the media content by pressing next or scan.
  • An image from each of the marked points may be presented to the user, where the user can select a particular image and start/resume the playing of the media content from the corresponding user marked point.
  • User annotations may be used to dynamically segment media content into different parts. User annotations may also be used to filter out certain portions (e.g., periods of no annotations/excitement) of media content and play the remaining portions of the media content in a subsequent playing of the media content.
  • all or part of an annotation may be published (e.g., referenced or presented on a web site or web service).
  • all or part of an annotation may be automatically presented to a user on another system.
  • a user can request the system to send all or parts of annotations to an email or SMS address.
  • a user can request the system automatically add a movie to an online shopping cart or queue when another user (e.g., a movie critic or friend) positively annotates the movie.
  • annotations of media content may be sold by a user in an online community for the sale or trade of media content annotations.
  • annotations (e.g., media content with embedded annotations) may be directed sent from one media device to another media device (e.g., through email, intranet, internet, or any other available method of communication).
  • the system can derive annotation content for media content from the closed-captioning portion of the media content.
  • the system can produce an annotation that includes a proper name recognized by a natural language processing system and/or a semantic analysis system, and then associate the annotation with the video content where the proper name appears in closed caption.
  • the system can produce an annotation indicating the start of a commercial break when the phrase “we'll be back after these words” or a similar phrase is recognized in the closed captioning.
  • Another example includes a system producing an annotation associated with a region of media content that contains explicit closed caption language. The system may then provide an option to automatically mute the audio portion of the media content associated with the explicit closed caption language.
  • the system can generate audio input utilizing optical character recognition systems.
  • the system can produce an annotation that includes the title of a movie being advertised.
  • the annotation may display the movie title (e.g., at the bottom of a screen) as soon as the title of the movie is identified or at the end of a movie trailer.
  • the system can produce an audio annotation that includes the names of cast members from video content corresponding to credits.
  • Another example may involve the system producing an annotation indicating a change in score during a sports game by analyzing OCR-derived data inside the ticker regions of a sporting event broadcast.
  • the system may detect a user is navigating an electronic programming guide (EPG) by recognizing a collection of show and movie titles from the OCR. The system may then produce a visual annotation on the EPG recommending the highest-rated show listed in the EPG.
  • the annotation may also include other contextual information that can be used to further optimize recommendations. For example, the annotation may be based on content recently viewed by the user, which can be used to recommend content from the EPG in the same genre or starring the same actors.
  • the system can derive annotation content utilizing speech-to-text systems.
  • the system can produce a transcript of the dialogue in media content to be used in a future presentation when audio is muted or when requested by the hearing impaired.
  • the derived transcript can be processed by a separate system that monitors presence of topics or persons of interest and then automatically produces annotations associated with topics or persons of interest.
  • FIG. 10 shows an exemplary system for configuring an environment in accordance with one or more embodiments.
  • the environment configuration engine ( 1015 ) generally represents any software and/or hardware that may be configured to determine environment configurations ( 1025 ).
  • the environment configuration engine ( 1015 ) may be implemented within the media device, shown in FIG. 1B or may be implemented as a separate component.
  • the environment configuration engine ( 1015 ) may identify one or more users (e.g., user A ( 1005 ), user N ( 1010 ), etc.) that are within close proximity of the environment configuration engine ( 1015 ) and identify user preferences ( 1020 ) associated with the identified users.
  • the users may be identified based on voice recognition or based on other input identifying the users.
  • the environment configuration engine may configure a user interface, an audio system configuration, a room lighting, a game console, a music playlist, a seating configuration, or any other suitable environmental configurations ( 1025 ). For example, if five friends are identified, which are associated with a group user preference, a channel streaming a sports game may be automatically selected and surround sound may be selected for the audio stream(s) associated with the sports game. Another example may involve identifying a couple, and automatically initiating the playing of a romantic comedy.
  • the techniques described herein are implemented by one or more special-purpose computing devices.
  • the special-purpose computing devices may be hard-wired to perform the techniques, or may include digital electronic devices such as one or more application-specific integrated circuits (ASICs) or field programmable gate arrays (FPGAs) that are persistently programmed to perform the techniques, or may include one or more general purpose hardware processors programmed to perform the techniques pursuant to program instructions in firmware, memory, other storage, or a combination.
  • ASICs application-specific integrated circuits
  • FPGAs field programmable gate arrays
  • Such special-purpose computing devices may also combine custom hard-wired logic, ASICs, or FPGAs with custom programming to accomplish the techniques.
  • the special-purpose computing devices may be desktop computer systems, portable computer systems, handheld devices, networking devices or any other device that incorporates hard-wired and/or program logic to implement the techniques.
  • FIG. 11 is a block diagram that illustrates a System 1100 upon which an embodiment of the invention may be implemented.
  • System 1100 includes a bus 1102 or other communication mechanism for communicating information, and a hardware processor 1104 coupled with bus 1102 for processing information.
  • Hardware processor 1104 may be, for example, a general purpose microprocessor.
  • System 1100 also includes a main memory 1106 , such as a random access memory (RAM) or other dynamic storage device, coupled to bus 1102 for storing information and instructions to be executed by processor 1104 .
  • Main memory 1106 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 1104 .
  • Such instructions when stored in storage media accessible to processor 1104 , render System 1100 into a special-purpose machine that is customized to perform the operations specified in the instructions.
  • System 1100 further includes a read only memory (ROM) 1108 or other static storage device coupled to bus 1102 for storing static information and instructions for processor 1104 .
  • ROM read only memory
  • a storage device 1110 such as a magnetic disk or optical disk, is provided and coupled to bus 1102 for storing information and instructions.
  • System 1100 may be coupled via bus 1102 to a display 1112 , such as a cathode ray tube (CRT), for displaying information to a computer user.
  • a display 1112 such as a cathode ray tube (CRT)
  • An input device 1114 is coupled to bus 1102 for communicating information and command selections to processor 1104 .
  • cursor control 11111 is Another type of user input device
  • cursor control 11111 such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 1104 and for controlling cursor movement on display 1112 .
  • This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane.
  • System 1100 may implement the techniques described herein using customized hard-wired logic, one or more ASICs or FPGAs, firmware and/or program logic which in combination with the System causes or programs System 1100 to be a special-purpose machine. According to one embodiment, the techniques herein are performed by System 1100 in response to processor 1104 executing one or more sequences of one or more instructions contained in main memory 1106 . Such instructions may be read into main memory 1106 from another storage medium, such as storage device 1110 . Execution of the sequences of instructions contained in main memory 1106 causes processor 1104 to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions.
  • Non-volatile media includes, for example, optical or magnetic disks, such as storage device 1110 .
  • Volatile media includes dynamic memory, such as main memory 1106 .
  • Common forms of storage media include, for example, a floppy disk, a flexible disk, hard disk, solid state drive, magnetic tape, or any other magnetic data storage medium, a CD-ROM, any other optical data storage medium, any physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, NVRAM, any other memory chip or cartridge.
  • Storage media is distinct from but may be used in conjunction with transmission media.
  • Transmission media participates in transferring information between storage media.
  • transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprise bus 1102 .
  • transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications.
  • Various forms of media may be involved in carrying one or more sequences of one or more instructions to processor 1104 for execution.
  • the instructions may initially be carried on a magnetic disk or solid state drive of a remote computer.
  • the remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem.
  • a modem local to System 1100 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal.
  • An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on bus 1102 .
  • Bus 1102 carries the data to main memory 1106 , from which processor 1104 retrieves and executes the instructions.
  • the instructions received by main memory 1106 may optionally be stored on storage device 1110 either before or after execution by processor 1104 .
  • System 1100 also includes a communication interface 1118 coupled to bus 1102 .
  • Communication interface 1118 provides a two-way data communication coupling to a network link 1120 that is connected to a local network 1122 .
  • communication interface 1118 may be an integrated services digital network (ISDN) card, cable modem, satellite modem, or a modem to provide a data communication connection to a corresponding type of telephone line.
  • ISDN integrated services digital network
  • communication interface 1118 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN.
  • LAN local area network
  • Wireless links may also be implemented.
  • communication interface 1118 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.
  • Network link 1120 typically provides data communication through one or more networks to other data devices.
  • network link 1120 may provide a connection through local network 1122 to a host computer 1124 or to data equipment operated by an Internet Service Provider (ISP) 11211 .
  • ISP 11211 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the “Internet” 1128 .
  • Internet 1128 uses electrical, electromagnetic or optical signals that carry digital data streams.
  • the signals through the various networks and the signals on network link 1120 and through communication interface 1118 which carry the digital data to and from System 1100 , are example forms of transmission media.
  • System 1100 can send messages and receive data, including program code, through the network(s), network link 1120 and communication interface 1118 .
  • a server 1130 might transmit a requested code for an application program through Internet 1128 , ISP 11211 , local network 1122 and communication interface 1118 .
  • the received code may be executed by processor 1104 as it is received, and/or stored in storage device 1110 , or other non-volatile storage for later execution.
  • an apparatus is a combination of one or more hardware and/or software components described herein.
  • a subsystem for performing a step is a combination of one or more hardware and/or software components that may be configured to perform the step.

Abstract

A method for interpreting messages, user-defined alert conditions, voice commands and performing an action in response is described. A method for annotating media content is described. A method for presenting additional content associated with media content identified based on a fingerprint is described. A method for identifying that an advertisement portion of media content is being played based on a fingerprint derived from the media content is described. A method of one media device recording particular media content automatically in response to another media device recording the particular media content is described. A method of concurrently playing media content on multiple devices is described. A method of publishing information associated with recording of media content is described. A method of deriving fingerprints by media devices that meet an idleness criteria is described. A method of loading, modifying, and displaying a high definition frame from a frame buffer is described. A method of recording or playing media content identified based on fingerprints is described.

Description

    PRIORITY INFORMATION
  • The present invention claims priority under 35 U.S.C. 119(e) of provisional application No. 61/242,277 filed on Sep. 14, 2009.
  • FIELD OF THE INVENTION
  • The present invention relates to a multifunction multimedia device.
  • BACKGROUND
  • The approaches described in this section are approaches that could be pursued, but not necessarily approaches that have been previously conceived or pursued. Therefore, unless otherwise indicated, it should not be assumed that any of the approaches described in this section qualify as prior art merely by virtue of their inclusion in this section.
  • Multimedia content streams may be received by a multimedia player for display to a user. Furthermore, general information about multimedia content may be received by the multimedia player for display to the user. The multimedia content is generally presented in a fixed non-editable format. The user is able to jump to particular points in the media content via scene selections created by the producer. Accordingly, the watching of the media content is generally passive and the user interaction is minimal.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which like reference numerals refer to similar elements and in which:
  • FIG. 1A is a block diagram illustrating an example system in accordance with an embodiment;
  • FIG. 1B is a block diagram illustrating an example media device in accordance with an embodiment;
  • FIG. 2 illustrates a flow diagram for presenting additional content in accordance with an embodiment.
  • FIG. 3 illustrates a flow diagram for determining a position in the playing of media content in accordance with an embodiment.
  • FIG. 4 illustrates a flow diagram for detecting the playing of an advertisement in accordance with an embodiment.
  • FIG. 5 illustrates a flow diagram for deriving a fingerprint from media content in accordance with an embodiment.
  • FIG. 6 shows an exemplary architecture for the collection and storage of fingerprints derived from media devices.
  • FIG. 7 illustrates a flow diagram for presenting messages in accordance with an embodiment.
  • FIG. 8 illustrates a flow diagram for interpreting voice commands in accordance with an embodiment;
  • FIG. 9 illustrates a flow diagram for correlating annotations with media content in accordance with an embodiment;
  • FIG. 10 shows an exemplary system for configuring an environment in accordance with one or more embodiments.
  • FIG. 11 shows a block diagram that illustrates a system upon which an embodiment of the invention may be implemented.
  • DETAILED DESCRIPTION
  • In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, that the present invention may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring the present invention.
  • Several features are described hereafter that can each be used independently of one another or with any combination of the other features. However, any individual feature might not address any of the problems discussed above or might only address one of the problems discussed above. Some of the problems discussed above might not be fully addressed by any of the features described herein. Although headings are provided, information related to a particular heading, but not found in the section having that heading, may also be found elsewhere in the specification.
  • Example features are described according to the following outline:
      • 1.0 FUNCTIONAL OVERVIEW
      • 2.0 SYSTEM ARCHITECTURE
      • 3.0 PRESENTING ADDITIONAL CONTENT BASED ON MEDIA CONTENT FINGERPRINTS
      • 4.0 DETERMINING A PLAYING POSITION BASED ON MEDIA CONTENT FINGERPRINTS
      • 5.0 PUBLISHING RECORDING OR VIEWING INFORMATION
      • 6.0 DERIVING A FINGERPRINT FROM MEDIA CONTENT
      • 7.0 PRESENTING UPDATES
      • 8.0 INTERPRETING COMMANDS
      • 9.0 CORRELATING INPUT WITH MEDIA CONTENT
      • 10.0 ELICITING ANNOTATIONS BY A PERSONAL MEDIA DEVICE
      • 11.0 MARKING MEDIA CONTENT
      • 12.0 PUBLICATION OF MEDIA CONTENT ANNOTATIONS
      • 13.0 AUTOMATICALLY GENERATED ANNOTATIONS
      • 14.0 ENVIRONMENT CONFIGURATION
      • 15.0 HARDWARE OVERVIEW
      • 16.0 EXTENSIONS AND ALTERNATIVES
    1.0 Functional Overview
  • In an embodiment, media content is received and presented to a user. A fingerprint derived from the media content is then used to query a server to identify the media content. Based on the media content identified based on the fingerprint, additional content is obtained and presented to the user.
  • In an embodiment, the additional content may include an advertisement (e.g., for a product, service, or other media content), which is selected based on the identified media content.
  • In an embodiment, a fingerprint is derived dynamically from the media content subsequent to receiving a command to present the media content. In an embodiment, the fingerprint is derived dynamically from the media content subsequent to receiving a command to present additional content associated with the media content being presented.
  • In an embodiment, a face is detected in the media content based on the fingerprint derived from the media content. A name of a person associated with the face is determined and presented in the additional content. Detecting the face and/or determining the name of the person associated with the face may be dynamically performed in response to receiving a user command.
  • In an embodiment, features (e.g., objects, structures, landscapes, locations, etc.) in media content frames may be detected based on the fingerprint derived from the media content. The features may be identified and the identification may be presented. The features may be identified and/or the identification presented in response to a user command.
  • In an embodiment, fingerprints may be dynamically derived concurrently with playing the media content. A position in the playing of the media content may then be determined based on the fingerprints.
  • In an embodiment, additional content may be presented based on the position in the playing of the media content. In an embodiment, the additional content based on the position in the playing of the media content may be presented in response to a user command.
  • In an embodiment, playing of the media content may be synchronized over multiple devices based on the position in the playing of the media content. In an embodiment, synchronization over multiple devices may be performed by starting the playing of media content on multiple devices at the same time, seeking to an arbitrary position of the media content on a device or delaying the playing of media content on a device. During synchronized playing of the media content on multiple devices, a command to fast-forward, rewind, pause, stop, seek, or play on one device may be performed on all synchronized devices. In an embodiment, a determination may be made that advertisements are being played based on the position in the playing of the media content. The advertisement may be skipped over or fast-forwarded through based on the position in the playing of the media content. In an embodiment, a notification may be provided that the advertisement was played or the speed at which the advertisement was played. In an embodiment, the advertisement may be selected based on the position in the playing of the media content.
  • In an embodiment, the playing of an advertisement may be detected by determining that one or more fingerprints of the media content being played are associated with an advertisement portion of the media content. In an embodiment, an advertisement may be detected by identifying the persons associated with the faces in the advertisement portion of the media content and determining that the identified persons are not actors listed for the media content. In an embodiment, the advertisement may be enhanced with additional content pertaining to the product or service being advertised. In an embodiment, the advertisement may be automatically fast-forwarded, muted, or replaced with an alternate advertisement. In an embodiment, only a non-advertisement portion of the media content may be recorded by skipping over the detected advertisement portion of the media content.
  • In an embodiment, a command is received to record particular media content on a first device associated with a first user and the particular media content is scheduled for recording on the first device. A notification is provided to a second device associated with a second user of the scheduling of the recording of the particular media content on the first device. The second device may then schedule recording of the particular media content. The second device may schedule the recording of the particular media content without receiving a user command or subsequent to receiving a user confirmation to record the particular media content in response to the notification.
  • In an embodiment, a command may be received from the second user by the second device to record all media content that is scheduled for recording on first device, any one of a plurality of specified devices, or a device associated with any of a plurality of specified users.
  • In an embodiment, the scheduled recording of a particular media content on multiple devices may be detected. In response to detecting that the particular media content is scheduled for recording on multiple devices, a notification may be provided to at least one of the multiple devices that the particular media content is scheduled for recording on the multiple devices. The particular media content may then be synchronously displayed on the multiple devices. A time may be selected by one of the devices to synchronously play the particular media content on the multiple devices based on a user availability calendar accessible through each of the devices. A time may also be suggested to receive a user confirmation for the suggested time.
  • In an embodiment, a command to record or play a particular media content on a device associated with a user may be received. Responsive to the command, the particular media content may be recorded or played and information may be published in association with the user indicating that the user is recording or playing the particular media content. The information may be automatically published to a web service for further action, such as display on a web page. Responsive to the command, information associated with the particular media content may be obtained and presented to the user. In an embodiment, a group (e.g., on a social networking website) may be automatically created for users associated with devices playing or recording the particular media content.
  • In an embodiment, a media device meeting an idleness criteria may be detected. In response to detecting an idleness criteria, media content may be sent to the media device. The media device may be configured to receive a particular content stream or streams accessible via the internet comprising the media content. The media device may derive a fingerprint from the media content and send the fingerprint to a fingerprint database, along with additional data pertaining to the media (such as title, synopsis, closed caption text, etc). Detecting that a media device meets an idleness criteria may involve receiving a signal from the media device, the media device completing a duration of time without receiving a user command at the media device, or determining that the media content has resource availability for deriving a fingerprint.
  • In an embodiment, concurrently with playing audio/video (AV) content, a message is received. The message is interpreted based on message preferences associated with a user and the user is presented with the message based on the message preferences. In an embodiment, one or more messages may be filtered out based on message preferences.
  • In an embodiment, presenting messages includes overlaying information associated with the message on one or more video frames of the AV content being played to the user. Presenting the message may include playing audio information associated with the message. In an embodiment, AV content is paused or muted when messages are presented.
  • In an embodiment, messages are submitted by another user as audio input, textual input or graphical input. Audio input may include a voice associated with the sender of the message, the receiver of the message, a particular fictional character, or non-fictional character, or a combination thereof. The messages may be played exclusively to the recipient of the message.
  • In an embodiment, a message may be presented during a time period specified by a message preference. A message may be held until a commercial break during the playing of the AV content and presented during the commercial break. In an embodiment, a message maybe received from a message service associated with a social networking website.
  • In an embodiment, a user-defined alert condition is received from a user. AV content is played concurrently with monitoring for occurrence of the user-defined alert condition and occurrence of the user-defined alert condition is detected. An alert may be presented in response to detecting occurrence of the user-defined alert condition.
  • In an embodiment, detecting the alert condition includes determining that media content determined to be of interest to a user is being available on a content stream. In an embodiment, detecting the alert condition includes determines that media content associated with user requested information is available on a content stream. Detecting the alert condition may include receiving a notification indicating occurrence of the alert condition. In an embodiment, detecting occurrence of an alert condition may include obtaining information using optical character recognition (OCT) and detecting occurrence of the alert condition based on the information.
  • In an embodiment, a voice command is received from a user and the user is identified based on voice command. The voice command is then interpreted based on preferences associated with the identified user to determine an action out of a plurality of actions. The action is then performed.
  • In an embodiment, a number of applicable users for the voice command is determined. The number of applicable users may be determined by recognizing users based on voice input.
  • In an embodiment, the action based on user preferences may include configuring a multimedia device or an environment, presenting messages, making a purchase, or performing another suitable action. In an embodiment, an action may be presented for user confirmation prior to performing the action or checked to ensure that the user permission to execute the action. In an embodiment, the voice command may be interpreted based on the language in which the voice command was received.
  • In an embodiment, concurrently with playing media content on a multimedia device, an annotation(s) is received from a user. The annotation is stored in associated with the media content. In an embodiment, the annotation may include audio input, textual input, and/or graphical input. In an embodiment, the media content is played a second time concurrently with audio input received from the user. Playing the media content the second time may involve playing only a video portion of the media content with the audio input received from the user.
  • In an embodiment, multiple versions of annotations may be received during different playbacks of the media content and each annotation may be stored in association with the media content. The annotations may be provided in languages different than the original language of the audio portion of the media content. Annotations may be provided with instructions associated with intended playback. Annotations may include automatically generated audio based on information obtained using optical character recognition. In an embodiment, annotations may be analyzed to derive annotation patterns associated with media content. Annotations may be elicited from a user and may include reviews of media content. In an embodiment, user profiles may be generated based on annotations. Annotations may mark intervals or particular points in the playing of media content, which may be used as bookmarks to resume playing of the media content. Intervals marked by annotations may be skipped during a subsequent playing of the media content or used to create a play sequence.
  • Although specific components are recited herein as performing the method steps, in other embodiments agents or mechanisms acting on behalf of the specified components may perform the method steps. Further, although some aspects of the invention are discussed with respect to components on a system, the invention may be implemented with components distributed over multiple systems. Embodiments of the invention also include any system that includes the means for performing the method steps described herein. Embodiments of the invention also include a computer readable medium with instructions, which when executed, cause the method steps described herein to be performed.
  • 2.0 System Architecture
  • Although a specific computer architecture is described herein, other embodiments of the invention are applicable to any architecture that can be used to perform the functions described herein.
  • FIG. 1 shows a media device A (100), a media source (110), a media device N (120), a fingerprint server (130), a network device (140), and a web server (150). Each of these components are presented to clarify the functionalities described herein and may not be necessary to implement the invention. Furthermore, components not shown in FIG. 1 may also be used to perform the functionalities described herein. Functionalities described as performed by one component may instead be performed by another component.
  • In an embodiment, the media source (110) generally represents any content source from which the media device A (100) can receive media content. The media source (110) may be a broadcaster (includes a broadcasting company/service) that streams media content to media device A (100). The media source (110) may be a media content server from which the media device A (100) downloads the media content. The media source (100) may be an audio and/or video player from which the media device A (100) receives the media content being played. The media source (100) may be a computer readable storage or input medium (e.g., physical memory, a compact disc, or digital video disc) which the media device A (100) reads to obtain the media content. The terms streaming, broadcasting, or downloading to a device may be used interchangeably herein and should not be construed as limiting to one particular method of the device obtaining data. The media device A (100) may receive data by streaming, broadcasting, downloading, etc. from a broadcast service, a web server, another media device, or any suitable system with data or content that may accessible by the media device. Different sources may be mentioned as different examples presented below. An example describing a specific source should not be construed as limited to that source.
  • In an embodiment, the fingerprint server (130) generally represents any server that stores fingerprints derived from media content. The fingerprint server (130) may be accessed by the media device A (100) to download and/or upload fingerprints derived from media content. The fingerprint server (130) may be managed by a content source (e.g., a broadcast service, a web service, or any other source of content) for storing a database of fingerprints derived from media content. The content source may select media content to be fingerprinted. The media device A (100) may derive the fingerprint from selected media content and provide the fingerprint to the fingerprint server (130). In an embodiment, the fingerprint server (130) may serve as a database for identifying media content or metadata associated with media content based on the fingerprint derived from that media content. In an embodiment, at least a portion of the fingerprint server (130) is implemented on one or more media devices. The media devices may be updated continuously, periodically, or according to another suitable schedule when the fingerprint server (130) is updated.
  • In an embodiment, the network device (140) generally represents any component that is a part of the media device A (100) or a separate device altogether that includes functionality to communicate over a network (e.g., internet, intranet, world wide web, etc.). For example, the network device (140) may be a computer communicatively coupled with the media device A (100) or a network card in the media device A (100). The network device (140) may include functionality to publish information associated with the media device A (100) (e.g., media content scheduled for recording on the media device A (100), media content recorded on the media device A (100), media content being played on the media device A (100), media content previously played on the media device A (100), media content displayed on the media device A (100), user preferences/statistics collected by the media device A (100), user settings on the media device A (100), etc.). The network device (140) may post the information on a website, provide the information in an electronic message or text message, print the information on a network printer, or publish the information in any other suitable manner. The network device (140) may include functionality to directly provide the information to another media device(s) (e.g., media device N (120)). The network device (140) may include functionality to obtain information from a network. For example, the network device (140) may perform a search for metadata or any other additional data associated with media content and provide the search results to the media device A (100). Another example may involve the network device (140) obtaining information associated with media content scheduled, recorded, and/or played on media device N (120).
  • In an embodiment media device A (100) (or media device N (120)) generally represents any media device comprising a processor and configured to present media content. The media device A (100) may refer to a single device or any combination of devices (e.g., a receiver and a television set) that may be configured to present media content. Examples of the media device A (100) include one or more of: receivers, digital video recorders, digital video players, televisions, monitors, Blu-ray players, audio content players, video content players, digital picture frames, hand-held mobile devices, computers, printers, etc. The media device A (100) may present media content by playing the media content (e.g., audio and/or visual media content), displaying the media content (e.g., still images), printing the media content (e.g., coupons), electronically transmitting the media content (e.g., electronic mail), publishing the media content (e.g., on a website), or by any other suitable means. In an embodiment, media device A (100) may be a management device which communicates with one or more other media devices in a system. For example, the media device A (100) may receive commands from media device (e.g., a DVD player, a remote, a joystick, etc.) and communicate the command to another media device (e.g., a monitor, a receiver, etc.). In an embodiment, the media device A (100) may represent any apparatus with one or more subsystems configured to perform the functions described herein.
  • In an embodiment, the media device A (100) may include functionality to derive fingerprints from media content. For example, the media device A (100) may derive a fingerprint from media content recorded on associated memory or stored in any other accessible location (e.g., an external hard drive, a DVD, etc.). The media device A (100) may also derive a fingerprint from media content available on a content stream. Media content that is available on a content stream includes any media content that is accessible by the media device A (100). For example, content available on a content stream may include content being broadcasted by a broadcast service, content available for download from a web server, peer device, or another system, or content that is otherwise accessible by the media device A (100). In an embodiment, the media device A (100) may include functionality to obtain media content being displayed and dynamically derive fingerprints from the media content being displayed or media content stored on the media device. In an embodiment, the media device A (100) may include the processing and storage capabilities to decompress media content (e.g., video frames), modify and/or edit media content, and compress media content.
  • In an embodiment, the media device A (100) may include functionality to mimic another media device(s) (e.g., media device N (120)) by recording, or playing the same media content as another media device. For example, the media device A (100) may include functionality to receive notifications of media content being recorded on media device N (120) and obtain the same media content from a content source. The media device A may automatically record the media content or provide the notification to a user and record the media content in response to a user command.
  • FIG. 1B illustrates an example block diagram of a media device in accordance with one or more embodiments. As shown in FIG. 1B, the media device (100) may include multiple components such as a memory system (155), a disk (160), a central processing unit (CPU) (165), a display sub-system (170), an audio/video input (175), a tuner (180), a network module (190), peripherals unit (195), text/audio convertor (167), and/or other components necessary to perform the functionality described herein.
  • In an embodiment, the audio/video input (175) may correspond to any component that includes functionality to receive audio and/or video input (e.g., HDMI 176, DVI 177, Analog 178) from an external source. For example, the audio/video input (175) may be a DisplayPort or a high definition multimedia interface (HDMI) that can receive input from different devices. The audio/video input (175) may receive input from a set-top box, a Blu-ray disc player, a personal computer, a video game console, an audio/video receiver, a compact disk player, an enhanced versatile disc player, a high definition optical disc, a holographic versatile disc, a laser disc, mini disc, a disc film, a RAM disc, a vinyl disc, a floppy disk, a hard drive disk, etc. The media device (100) may include multiple audio/video inputs (175).
  • In an embodiment, the tuner (180) generally represents any input component that can receive a content stream (e.g., through cable, satellite, internet, network, or terrestrial antenna). The tuner (180) may allow one or more received frequencies while filtering out others (e.g., by using electronic resonance). A television tuner may convert an RF television transmission into audio and video signals which can be further processed to produce sound and/or an image.
  • In an embodiment, input may also be received from a network module (190). A network module (190) generally represents any input component that can receive information over a network (e.g., internet, intranet, world wide web, etc.). Examples of a network module (190) include a network card, network adapter, network interface controller (NIC), network interface card, Local Area Network adapter, Ethernet network card, and/or any other component that can receive information over a network. The network module (190) may also be used to directly connect with another device (e.g., a media device, a computer, a secondary storage device, etc.).
  • In an embodiment, input may be received by the media device (100) from any communicatively coupled device through wired and/or wireless communication segments. Input received by the media device (100) may be stored to the memory system (155) or disk (160). The memory system (155) may include one or more different types of physical memory to store data. For example, one or more memory buffers (e.g., an HD frame buffer) in the memory system (155) may include storage capacity to load one or more uncompressed high definition (HD) video frames for editing and/or fingerprinting. The memory system (155) may also store frames in a compressed form (e.g., MPEG2, MPEG4, or any other suitable format), where the frames are then uncompressed into the frame buffer for modification, fingerprinting, replacement, and/or display. The memory system (155) may include FLASH memory, DRAM memory, EEPROM, traditional rotating disk drives, etc. The disk (160) generally represents secondary storage accessible by the media device (100).
  • In an embodiment, central processing unit (165) may include functionality to perform the functions described herein using any input received by the media device (100). For example, the central processing unit (165) may be used to dynamically derive fingerprints from media content frames stored in the memory system (155). The central processing unit (165) may be configured to mark or identify media content or portions of media content based on tags, hash values, fingerprints, time stamp, or other suitable information associated with the media content. The central processing unit (165) may be used to modify media content (e.g., scale a video frame), analyze media content, decompress media content, compress media content, etc. A video frame (e.g., an HD video frame) stored in a frame buffer may be modified dynamically by the central processing unit (165) to overlay additional content (e.g., information about the frame, program info, a chat message, system message, web content, pictures, an electronic programming guide, or any other suitable content) on top of the video frame, manipulate the video frame (e.g., stretching, rotation, shrinking, etc.), or replace the video frame in real time. Accordingly, an electronic programming guide, advertisement information that is dynamically selected, media content information, or any other text/graphics may be written onto a video frame stored in a frame buffer to superimpose the additional content on top of the stored video frame. The central processing unit (165) may be used for processing communication with any of the input and/or output devices associated with the media device (100). For example, a video frame which is dynamically modified in real time may subsequently be transmitted for display. The central processing unit (165) may be used to communicate with other media devices to perform functions related to synchronization, or publication of data.
  • In an embodiment, the text/audio convertor (167) generally represents any software and/or hardware for converting text to audio and/or for converting audio to text. For example, the text/audio convertor may include functionality to convert text corresponding to closed captioned data to an audio file. The audio file may be based on a computerized voice, or may be trained for using the voice of a user, a fictional or non-fictional character, etc. In an embodiment, the automatically generated voice used for a particular message may be the voice of a user generating the message. The text/audio convertor may include functionality to switch languages when converting from voice to text or from text to voice. For example, audio input in French may be converted to a text message in English.
  • In an embodiment, the peripherals unit (195) generally represents input and/or output for any peripherals that are communicatively coupled with the media device (100) (e.g., via USB, External Serial Advanced Technology Attachment (eSATA), Parallel ATA, Serial ATA, Bluetooth, infrared, etc.). Examples of peripherals may include remote control devices, USB drives, a keyboard, a mouse, a microphone, and voice recognition devices that can be used to operate the media device (100). In an embodiment, multiple microphones may be used to detect sound, identify user location, etc. In an embodiment, a microphone may be a part of a media device (100) or other device (e.g., a remote control) that is communicatively coupled with the media device (100). In an embodiment, the media device (100) may include functionality to identify media content being played (e.g., a particular program, or a position in a particular program) when audio input is received (e.g., via a microphone) from a user.
  • In an embodiment, the display sub-system (170) generally represents any software and/or device that includes functionality to output (e.g., Video Out to Display 171) and/or actually display one or more images. Examples of display devices include a kiosk, a hand held device, a computer screen, a monitor, a television, etc. The display devices may use different types of screens such as a liquid crystal display, cathode ray tube, a projector, a plasma screen, etc. The output from the media device (100) may be specially for formatted for the type of display device being used, the size of the display device, resolution (e.g., 720i, 720p, 1080i, 1080p, or other suitable resolution), etc.
  • 3.0 Presenting Additional Content Based on Media Content Fingerprints
  • FIG. 2 illustrates a flow diagram for presenting additional content in accordance with an embodiment. One or more of the steps described below may be omitted, repeated, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIG. 2 should not be construed as limiting the scope of the invention.
  • Initially, a command is received to present media content in accordance with an embodiment (Step 202). The received command may be entered by a user via a keyboard or remote control. The command may be a selection in the electronic programming guide (EPG) by a user for the recording and/or playing of the media content. The command may a channel selection entered by a user. The command may be a request to display a slide show of pictures. The command may be to play an audio file. The command may be a request to play a movie (e.g., a command for a blu-ray player). In an embodiment, receiving the command to present media content may include a user entering the title of media content in a search field on a user interface. In an embodiment, media content is presented (Step 204). Presenting the media content may include playing audio and/or visual media content (e.g., video content), displaying or printing images, etc. Presenting the media content may also involve overlaying the media content over other media content also being presented.
  • In an embodiment, a fingerprint is derived from the media content (Step 206). An example of deriving a fingerprint from media content includes projecting intensity values of one or more video frames onto a set of projection vectors and obtaining a set of projected values. A fingerprint bit may then be computed based on each of the projected values and concatenated to compute the fingerprint for the media content. Another example may include applying a mathematical function to a spectrogram of an audio file. Other fingerprint derivation techniques may also be used to derive a fingerprint from media content in accordance with one or more embodiments. In an embodiment, the fingerprint is derived from media content dynamically as the media content is being played. For example, media content being received from a content source may concurrently be played and fingerprinted. The fingerprint may be derived for media content recognition, e.g., identifying the particular program, movie, etc. Media streams containing 3-Dimensional video may also be fingerprinted. In an embodiment, fingerprinting 3-Dimensional video may involve selecting fingerprint portions of the 3-Dimensional video. For example, near objects (e.g., objects that appear closer when watching the 3-Dimensional video) in the 3-Dimensional video stream may be selected for fingerprinting in order to recognize a face or structure. The near objects may be selected based on a field of depth tag associated with objects or by the relative size of objects compared to other objects.
  • In an embodiment, a command to present additional content associated with the media content being presented, is received (Step 208). A command may be received to identify generic additional content (e.g., any feature in the media content). For example, information of the media content being played such as the plot synopsis of a movie, the actors in a movie, the year the movie was made, a time duration associated with the particular media content, a director or producer of the movie, a genre of the movie, etc. In an embodiment, specific information may be requested. For example, a command requesting the geographic location in the world of the current scene being played. Another example may involve a command requesting an identification of the people in a current scene being displayed. Another example may involve a request for the year and model of a car in a scene of the movie. Another example may involve a request to save or publish information about the content, including a timestamp, offset from beginning, and other contextual data, for later use or reference. Accordingly, the specific information requests may include identification of places, objects, or people in a scene of the media content.
  • The additional content requested by the user may not be available when the command for the additional content is received. Accordingly, the additional information is dynamically identified (Step 210), after receiving the command, based on a fingerprint of the media content. For example, the fingerprint derived from the media content may be used to query a web server and receive identification of the object, place, or person in a scene that matches the fingerprint. The fingerprint may also be used to identify the media content being played to obtain the metadata already associated with the media content. In an embodiment, a fingerprint may be dynamically derived from the media content after receiving the command to present additional information.
  • In an embodiment, the additional content is presented (Step 212). Presenting the additional content may include overlaying the additional content on top of the media content being presented to the user. Presenting the additional content may also include overlaying the additional content on portions of the frame displaced by scaling, cropping, or otherwise altering the original content. To overlay the additional content on top of the original or altered media content, uncompressed HD frame(s) may be loaded into a frame buffer and the additional data may be written into the same frame buffer, thereby overlaying original frame information with the additional data. The additional information may be related to the media content being played, EPG display data, channel indicator in a banner display format as described in U.S. Pat. No. 6,642,939, owned by the applicant and incorporated herein by reference, program synopsis, etc. For example, in a movie, a geographical location of the scene may be displayed on the screen concurrently with the scene. In another example, a field may display the names of current actors in a scene at any given time. A visual indication linking the name of an object, place, person, etc. with the object, place, person on screen may be displayed. For example, a line between a car in the scene and identifying information about the car. The additional content may also provide links to advertisers, businesses, etc. about a displayed image. For example, additional information about a car displayed on the screen may include identifying information about the car, a name of a car dealership that sells the car, a link to a car dealership that sells the car, pricing information associated with the car, safety information associated with the car, or any other information directly or tangentially related to the identified car. Another example may involve presenting information about content available on a content stream (e.g., received from a broadcast service or received from a web server). The content itself may be overlaid on the frame, or a link with a description may be overlaid on the frame, where the link can be selected through user input. The additional content may be presented as closed caption data. In another example, subtitles in a user-selected language may be overlaid on top of the content, such as a movie or TV show. The subtitles may be derived by various methods including download from an existing database of subtitle files, or real-time computational translation of closed captioning text from the original content. Another example may involve synchronized overlay of lyrics on top of a music video or concert performance. The system may perform this operation for several frames or until the user instructs it to remove the overlay. At that point, the system may discontinue writing the additional information into the frame buffer. In one embodiment, audio content may replace or overlay the audio from the original content. One example may involve replacing the audio stream of a national broadcast of a national football game with the audio stream of the local radio announcer. One example may involve a real-time mix of the audio from the original media with additional audio, such as actor's commentary on a scene. This example may involve alteration of the original and additional audio, such as amplification.
  • 4.0 Determining a Playing Position Based on Media Content Fingerprints
  • FIG. 3 illustrates a flow diagram for determining a position in the playing of media content in accordance with an embodiment. One or more of the steps described below may be omitted, repeated, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIG. 3 should not be construed as limiting the scope of the invention.
  • Initially, a command is received to present media content (Step 302) and the media content is presented (Step 304) in accordance with an embodiment. Step 302 and Step 304 are essentially the same as Step 202 and Step 204 described above.
  • In an embodiment, a fingerprint is derived from the media content being played (Step 306) to determine the position in the playing of the media content on a first device (Step 308). For example, as a media device receives media content in a content stream (or from any other source), the media device may display the media content and derive fingerprints from the specific frames being displayed. The media device may also derive fingerprints from every nth frame, from iframes, or based on any other frame selection mechanism. A content fingerprint derived from one or more frames may then be compared to a database of fingerprints to identify a database fingerprint that matches the frame fingerprint. The database of fingerprints may be locally implemented on the media device itself or on a server communicatively coupled with the media device. The match between the content fingerprint and the database fingerprint may be an exact match or the two fingerprints may meet a similarity threshold (e.g., at least a threshold number of signature bits in the fingerprint match). Once a match is identified in the database, metadata that is stored in association with the database fingerprint is obtained. The metadata may include a position in the media content. For example, the metadata may indicate that the fingerprint corresponds to the kth frame of n total frames in the media content. Based on this position information and/or the number of frames per second, a position in the playing of the media content may be determined. The metadata may also explicitly indicate the position. For example, the metadata may indicate that the fingerprint corresponds to a playing position at 35 minutes and 3 seconds from the start of the media content.
  • Based on the position in the playing of the media content on the first device, a second device may be synchronized with the first device by playing the same media content on the second device concurrently, in accordance with one or more embodiments. (Step 310). Once a position of the playing of the media content is determined for the first device, the playing of the media content on the second device may be started at that position. If the media content is already being played on the second device, the playing of the media content on the second device may be stopped and restarted at that position. Alternatively, the playing of the media content on the second device may be fast forwarded or rewound to that position.
  • In an embodiment, the viewing of a live broadcast or stored program may be synchronized using a buffer incorporated in media devices. For example, the content received in the content stream may be stored on multiple devices as they are received. Thereafter, the devices may communicate to synchronously initiate the playing of the media content, the pausing of media content, the fast forwarding of media content, and the rewinding of media content. A large buffer that can store the entire media content may be used in an embodiment. Alternatively, a smaller buffer can be used and video frames may be deleted as they are displayed and replaced with new video frames received in a content stream. Synchronized playing of a live broadcast or stored program may involve playing a particular frame stored in a memory buffer at a particular time to obtain frame level synchronization. For example, two devices may exchange information that indicates at which second a particular frame stored in memory is to be played and a rate at which future frames are to played. Accordingly, based on the same start time, the frames may be displayed on different media devices at the exact same time or approximately the same time. Furthermore, additional frame/time combinations may be determined to ensure that the synchronization is maintained. When media devices are being used in different time zones, the times may be adjusted to account for the time difference. For example, Greenwich Mean Time (GMT) may be used across all media devices for synchronized playing of media content.
  • In an embodiment, after synchronization of multiple devices playing the same media content, the synchronization may be maintained. In order to maintain synchronization any play-function (e.g., stop, fast-forward, rewind, play, pause, etc.) received on one device may be performed on both devices (Step 312).
  • In an embodiment, the playing of an advertisement may be detected based on the position in the playing of the media content (Step 314). For example, media content available on a content stream may include a television show and advertisements interspersed at various times during the television show. The composition information of the media content may indicate that the television show is played for twenty-five minutes, followed by five minutes of advertisements, followed by another twenty-five minutes of the television show and followed again by another five minutes of advertisements. Accordingly, if the position of the playing of the media content is determined to be twenty minutes from the start, the television show is being played. However, if the position of the playing of the media content is determined to be twenty-seven minutes from the start, an advertisement is being played.
  • In an embodiment, the playing of an advertisement may be detected without determining the position in the playing of the media content. For example, if the media content includes a television show and advertisements interspersed between the television show, advertisements may be detected based on the fingerprints derived from the media content currently being played. The fingerprints derived from the media content currently being played may be compared to the fingerprints derived only from the television show or fingerprints derived only from the advertisement. Based on the comparison, the media content concurrently being played may be determined to be a portion of the television show or a portion of the advertisement.
  • In an embodiment, the playing of an advertisement may be detected based on the elements present in the media content. For example, based on the fingerprints derived from the media content being played, faces of actors within the media content may be recognized. The names of the actors may then be compared with the names of actors that are listed as actors in the television show. If the actors detected in the media content being played match the actors listed as actors in the television show, then the television show is being played. Alternatively, if the actors detected in the media content being played do not match the actors listed as actors in the television show, then an advertisement is being played. In an embodiment, a time window may be used for detection of known actors in a television show, where at least one actor listed as an actor in the television show must be detected within the time window to conclude that the television show is being played.
  • In response to determining that an advertisement is being played, many different actions may be performed in accordance with one or more embodiments. In an embodiment, advertisements may be auto fast-forwarded. For example, as soon as the playing of an advertisement is detected, an automatic fast-forwarding function may be applied to the playing of the media content until the playing of the advertisement is completed (e.g., when playing of a television program is detected again based on a fingerprint). Similarly, advertisements may also be auto-muted, where an un-muting function is selected in response to detecting the completion of the advertisement.
  • In an embodiment, if the media content is being recorded, an advertisement may automatically be skipped over for the recording. For example, in the recording of a movie being received from a content source, the non-advertisement portions (e.g., movie portions) of the media content may be recorded while the advertisement portions of the media content may be skipped for the recording.
  • In an embodiment, alternate advertisements may be displayed. When receiving and displaying a content stream, detected advertisement portions of the content stream may be replaced with alternate advertisements. For example, a media device at a sports bar may be programmed to display drink specials instead of the advertisements received in a content stream. Alternatively, advertisements from local vendors, which are stored in memory or streamed from a server, may be displayed instead of advertisements received in the content stream. The advertisements may be selected based on the media content. For example, if during the playing of a sporting event, advertisements directed toward men may be selected.
  • In an embodiment, the advertisement may be augmented with additional content related to the advertisement. When receiving a content stream, detected advertisement portions of the content stream may be scaled, cropped, or otherwise altered, and the displaced empty space can be programmatically populated by additional content. For example, an advertisement for a movie opening in theaters soon can be augmented with show times at theaters in a 15-mile vicinity of the device. The user may also be presented with one or more interactive functions related to the additional content, such as the option to store information about the advertised movie, including the selected local theater and show time, to be used in future presentation, reference, ticket purchase, or other related activity. In another example, the advertisement may be augmented with games, quizzes, polls, video, and audio related to the advertisement. In an embodiment, the advertisement may be augmented with information about actions taken by the user's social network connections related to the advertisement. For example, an advertisement for a digital camera may be augmented by photos of the user's friends taken with the same digital camera. In another example, an advertisement for a movie recently released on DVD may be augmented with friends' ratings and reviews of that movie.
  • In an embodiment, the advertisement may be augmented with additional content not related to the advertisement. When receiving a content stream, detected advertisement portions of the content stream may be scaled, cropped, or otherwise altered, and the displaced empty space can be programmatically populated by additional content. In one embodiment, the user may direct the system to use portions of the display during advertisements to display personalized content. In one example, the personalized content may include the latest scores and statistics from the user's favorite sports teams. In another example, the content may include all or some of the user's latest received messages, such as email, SMS, instant messages, social network notifications, and voice mails. In another example, the user may be presented with information about additional content related to the content interrupted by the advertisement. In another example, the user may be presented with the chance to take his turn in a previously started game. In an embodiment, the user may also be presented with one or more interactive functions related to the additional content, such as the option to store information about the content to be used in future presentation, reference, or other related activity. In an example, the user may choose to respond to an SMS, email, voice mail, or instant message using a keyboard or microphone.
  • In an embodiment, a notification of the playing of an advertisement by a media device may be provided to an interested party (e.g., a vendor or broadcaster). For example, if a vendor advertisement is played on a media device, a content source may be informed that the vendor advertisement was in fact played. Furthermore, if a vendor advertisement was fast forwarded through, the content source may be informed that the vendor advertisement was fast forwarded through. This information may be provided to the vendor in order for the vendor to determine the effectiveness of the advertisement. Additional information including whether the advertisement was played as a part of a previously stored recording or played directly upon receiving from the content source may be provided to an interested party.
  • In an embodiment, cumulative statistics of a user may also be gathered based on advertisement detection. For example, particular types of advertisements or media content viewed by a user may be documented to determine user interests. These user interests may be provided to a vendor, stored on a server, published on an interactive webpage associated with the user, or otherwise presented. Anonymous information of a plurality of users may be collected to create reports based on user viewing or input. U.S. patent application Ser. No. 10/189,989, owned by the Applicant and incorporated herein by reference, describes such approaches.
  • 5.0 Publishing Recording or Viewing Information
  • FIG. 4 illustrates a flow diagram for detecting the playing of an advertisement in accordance with an embodiment. One or more of the steps described below may be omitted, repeated, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIG. 4 should not be construed as limiting the scope of the invention.
  • In an embodiment, a command is received to view or record media content on a first device associated with a first user (Step 402). The command to view or record media content may be received by a selection in an electronic programming guide (EPG). The command may be for a single recording of media content (e.g., a movie, a sports event, or a particular television show) or a series recording of media content (e.g., multiple episodes of a television show). A command may be received to play a media content file that is locally stored on memory (e.g., a DVD player may receive a command to play a DVD, a digital video recorder may receive a command to play a stored recording). In an embodiment, a single media device may receive all such commands and instruct the other devices (e.g., a DVD player, a blu-ray player) accordingly.
  • The viewing or recording of media content on the first device is published in accordance with an embodiment (Step 404). Publishing the viewing or recording of media content may be user specific. For example, the viewing or recording of media content may be posted on a webpage (e.g., a user webpage on a networking website such as MySpace®, or Facebook®) (MySpace® is a registered trademark of MySpace, Inc., Beverly Hills, Calif. and Facebook® is a registered trademark of Facebook, Inc., Palo Alto, Calif.) associated with a user, a posting on a group page (e.g., a webpage designated for a group) may be emailed to other users, may be provided in a text message, or may be published in any other manner. In an embodiment, all the viewing or recording by a user may be automatically emailed to a list of other users that have chosen to receive messages from the user (e.g., using Twitter®, Twitter® is a registered trademark of Twitter, Inc., San Francisco, Calif.). Publishing the viewing or recording of media content may also include a fee associated with the media content. For example, if the user selects a pay per view movie, the cost of the movie may also be published. In an embodiment, publishing the viewing or recording of media content may involve publishing the name of a user (or username associated with the user) on a publication associated with the media content. For example, all the users that have viewed a particular media content may be published on a single web page associated with a social networking website. Any users that have responded (e.g., “like”, “thumbs up”, “share”, etc.) to a posting related to the particular media content, which indicates the user has viewed the particular media content, may be published on the single web page.
  • In an embodiment, responsive to receiving a command to record media content on the first device associated with a first user, the media content is recorded on the first device and a second device associated with a second user (Step 506). For example, the first device may notify the second device of the scheduled recording of media content and the second device may auto-record the media content. In another example, in response to the notification from the first device, the second device may prompt a second user for recording of the media content. The second device may then record the media content subsequent to receiving a user command to record the media content. In an embodiment, the recording of the media content on the second device may be subsequent to the publication (e.g., on a website) of recording on the first device, as described above. For example, a second user may select a link on a website associated with the publication of recording the media content on the first device, to record the media content on the second device associated with the second user. In an embodiment, a media device may be configured to mimic another media device by recording all programs recorded by the other media device.
  • The recording of the same media content on multiple devices may be detected in accordance with an embodiment (Step 408). For example, different users within a user group may each schedule the recording of the same media content on their respective media devices. The scheduled recordings of each media device associated with the users within the group may be collected and compared (e.g., by a server, a service, or one of the media devices) to detect any overlapping scheduled recordings. In an embodiment, the already recorded media content on a media device may be compared to the already recorded media content on another media content or to scheduled recordings on another media content.
  • In an embodiment, a media device may be configured to automatically schedule recordings of any media content that is scheduled for recording by another specified media device. Accordingly, a media device may be configured to mimic another media device identified by a device identification number. The media device may also be configured to mimic any device associated with a specified user. For example, a first user may determine that a second user has a great selection of new shows or programs based on the postings of the second user on a social networking website. The first user may then choose to mimic the television watching habits of the second user by submitting a mimicking request with the identification number of the media device associated with the second user or a name of the second user. Alternatively, the first user may indicate the preference on the social networking website. The social networking website may then communicate the identification of the first user and the second user to a content source, which configures the media device associated with the first user to record the same shows as recorded by the media device associated with the second user.
  • In an embodiment, each media device may be configured to access a database of media device recording schedules (e.g., on a server, provided by a third party service, etc.). A user may access this database using their own media device and mimic the recordings of another media device that is referenced by the name or identification of a specific user. For example, a user may select specific shows that are also recorded by another user. In an embodiment, the user may be able to access other recording related statistics to select shows for viewing or recording. For example, a media device recording database may indicate the most popular shows based on future scheduled recordings, based on recordings already completed, or based on a number of users that watched the shows as they were made available on the content stream.
  • A time for playing the media content concurrently on multiple devices may be scheduled in accordance with an embodiment (Step 410). The time for playing the media content may be selected automatically or may be selected based on user input from one or more users. For example, all users associated with media devices that are scheduled for recording (or have already recorded) particular media content may be notified of the overlapping selection and one user may select the time for concurrent viewing of the media content by all the users using their respective media devices. In another example, each media device may access a user availability calendar to determine the available viewing times for a respective user. Thereafter, a synchronous viewing of a show may be scheduled in the calendar such that all the users (or most of the users) are available.
  • The viewers/recorders of the same media content may be automatically enrolled into a group associated with the media content in accordance with an embodiment (Step 412). For example, all the viewers and/or recorders of a specific movie may be automatically enrolled into a social networking group associated with the movie, in response to each recording/viewing the movie. The auto-enrollment group may be used by users as a forum to discuss the media content, find other users with similar viewing preferences, schedule a viewing time for similar recordings, or for any other suitable purpose. A discussion forum may be initiated for two or more users associated with multiple devices that are synchronously playing media content. The discussion forum may be initiated by the media device inviting a user to join an instant messaging chat (e.g., Yahoo!® Instant Messaging, Google® Chat, AIM®, Twitter®, etc.) (Yahoo!® is a registered trademark of Yahoo!, Inc., Sunnyvale, Calif.|Google® is a registered trademark of Google, Inc., Mountain View, Calif.|AIM® is a registered trademark of AOL LLC, Dulles, Va.|Twitter® is a registered trademark of Twitter, Inc., San Francisco, Calif.), video chat (e.g., Skype®, Skype® is a registered trademark of Skype Limited Corp., Dublin, Ireland), a website thread, or an electronic messaging (email) thread. The discussion forum may include two users or any number of users. The discussion forum may be initiated for users that are already known to be connected. For example, the discussion forum may be initiated if users are friends on a social networking website. In an embodiment, the discussion forum may be created to introduce vendors to potential clients. For example, during the playing of a football game, an invitation may be presented to chat with a vendor of football game tickets. In an embodiment, the discussion forum may be implemented as a dating portal. For example, men and women in the same geographical area that are subscribed to a dating server, who are watching the same show may be invited to a chat by the media device. Another example involves an activity portal. For example, a media device may be configured to invite viewers of a cooking channel show to cook together, or a media device may configured to invite viewers of a travel channel show to travel to a featured destination together. A media device may be configured to communicate, as described above, with any other computing device (e.g., another media device or a personal computer).
  • 6.0 Deriving a Fingerprint from Media Content
  • FIG. 5 illustrates a flow diagram for deriving a fingerprint from media content in accordance with an embodiment. One or more of the steps described below may be omitted, repeated, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIG. 5 should not be construed as limiting the scope of the invention.
  • In an embodiment, a media device is monitored to determine that the media device meets an idleness criteria (Step 502). An idleness criteria may be based on non-use of a media device or component, or a usage percentage (e.g., a percentage related to available bandwidth of the total bandwidth or a percentage related to available processing power of the total processing power). The media device may be self monitored or monitored by a server. Monitoring the media device for the idleness criteria may involve detecting completion of a period of time without receiving a user command. Monitoring the media device for the idleness criteria may involve detecting availability of resources needed to receive media content and/or derive a fingerprint from the media content. Monitoring the media device may include separately monitoring different components of a media device. For example, if a user is watching a stored recording on the media device and not recording any additional content being streamed to the media device, the tuner may be idle. Based on this information, a determination may be made that the tuner meets an idleness criteria. Accordingly, different components of the media device may be associated with separate idleness criteria. In another example, components necessary for deriving a fingerprint from media content may meet an idleness criteria.
  • In an embodiment, the media device receives media content from a content source for the purpose of deriving a fingerprint from the media content (Step 504). The media device may receive media content in response to alerting a content source that the media device (or components within the media device) meet an idleness criteria. In an embodiment, the content source may automatically detect whether a media device meets an idleness criteria. For example, the content source may determine that the media device has not requested to view any particular media content (e.g., broadcast content, web content, etc.). Therefore, the tuner most likely has bandwidth to download media content. In an embodiment, media devices may include the functionality to receive multiple content streams. In this embodiment, the content source may determine how many content streams are being received by the media device. Based on the known configuration and/or functionality of the media device, the content source may determine the tuner's available bandwidth for receiving additional media content. Once the idleness criteria is met, the content source may download a particular media content for the media device to generate a fingerprint.
  • In an embodiment, the content source may build a database of fingerprints for media content by dividing out the media content to be broadcasted among multiple media devices that meet the idleness criteria. For example, if five thousand devices meet the idleness criteria and two thousand unique media content files are to be fingerprinted, the content source might transmit four unique media content files to each of the five thousand media devices for generating respective fingerprints from the media devices. In an embodiment, the content source may send each unique media content file to two or more media devices in case there is an error with the fingerprint derived from media device, or if the media device is interrupted while deriving the fingerprint. The content source may also direct a media device to fingerprint content which has already been downloaded to the media device (e.g., based on user command). In an embodiment, a user may resume utilizing the media device and thereby prevent or stop the media device from deriving a fingerprint. In an embodiment, the content source may prompt the user to request permission for using the media device when an idleness criteria is met before downloading media content onto the media device. The content source may also offer incentives such as credits to watch pay-per-view movies if the user allows the content source to use the media device to perform and/or execute particular functions (e.g., deriving fingerprints).
  • In an embodiment, a fingerprint is derived from media content by the media device (Step 506). Any technique may be used to derive a fingerprint from media content. One example is to derive a fingerprint from a video frame based on the intensity values of pixels within the video frame. A function (e.g., that is downloaded onto the media device) may be applied to each of the intensity values and thereafter based on the result, a signature bit (e.g., ‘0’ or ‘1’) may be assigned for the that intensity value. A similar technique may be used for audio fingerprinting by applying the method to spectrograms created from audio data.
  • The fingerprint may be derived by the media device based on specific instructions from the content source. For example, fingerprints may be derived from all video frames of a particular media content file. Alternatively, the fingerprint may be derived for every nth frame or every iFrame received by the media device. In an embodiment, specific frames to be fingerprinted may be tagged. Tagging techniques are described in application Ser. No. 09/665,921, application Ser. No. 11/473,990, and application Ser. No. 11/473,543, all of which are owned by the Applicant, and herein incorporated by reference. Once a media device receives a frame that is tagged, the media device may then decompress the frame, analyze the frame, and derive a fingerprint from the frame. The video frame fingerprints may be categorized by the media device according to the media content (e.g., by media content name, episode number, etc.).
  • In an embodiment, the media device may derive fingerprints for media content that is being watched by a user. For example, a user may select a particular show on an electronic programming guide displayed by a media device. The media device may then request the content stream, from the content source, that includes the particular show. As an optional step, the source may indicate whether a fingerprint is needed for the particular show requested by the media device. The indication may be a flag in the data received by the media device. If the particular show needs to be fingerprinted as indicated by the flag, the media device may decompress the corresponding video frames, load the decompressed video frames into memory and analyze the video frames to derive a fingerprint from the video frames. In an embodiment, the user may change the channel mid-way through the playing of the media content being fingerprinted. As a result the tuner may be forced to receive a different content stream. In this case, the media device may have derived fingerprints for only a portion of the media content. The media device may generate metadata indicating the start position and end position in the playing of the media content for which the fingerprint has been derived.
  • In an embodiment, the media device may then upload the fingerprint derived from the media content (or from a portion of the media content) to a fingerprint server in accordance with an embodiment (Step 508). Thus, a fingerprint database may be built by multiple media devices each uploading fingerprints for media content. Fingerprints received for only a portion of the media content may be combined with other fingerprints from the same media content to generate a complete fingerprint. For example, if one media device generates and uploads fingerprints for video frames in the first half of a program and a second media device generates and uploads fingerprints for a second half of the same program, then the two fingerprints received from the two devices may be combined to obtain fingerprints for all the video frames of the program.
  • An exemplary architecture for the collection and storage of fingerprints derived from media devices, in accordance with one or more embodiments is shown in FIG. 6. The fingerprint management engine (604) generally represents any hardware and/or software that may be configured to obtain fingerprints derived by media devices (e.g., media device A (606), media device B (608), media device C (610), media device N (620), etc.). The fingerprint management engine (600) may be implemented by a content source or other system/service that includes functionality to obtain fingerprints derived by the media devices. The fingerprint management engine (604) may obtain fingerprints for media content already received by the media device (e.g., in response to user selection of the media content or content stream which includes the media content). The fingerprint management engine (604) may transmit media content to a media device specifically for the purpose of deriving a fingerprint. The fingerprint management engine (604) may transmit media content to a media device for fingerprinting in response to detecting that the media device is idle. In an embodiment, the fingerprint management engine (604) maintains a fingerprint database (602) for storing and querying fingerprints derived by the media devices.
  • 7.0 Presenting Messages
  • FIG. 7 illustrates a flow diagram for presenting messages in accordance with an embodiment. One or more of the steps described below may be omitted, repeated, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIG. 7 should not be construed as limiting the scope of the invention.
  • Initially, message preferences associated with a user are received (Step 702). Message preferences generally represent any preferences associated with message content, message timing, message filtering, message priority, message presentation, or any other characteristics associated with messages. For example, message preferences may indicate that messages are to be presented as soon as they are received or held until a particular time (e.g., when commercials are being displayed). Message preferences may indicate different preferences based on a message source or a message recipient. For example, messages from a particular website, Really Simply Syndication (RSS) feed, or a particular user may be classified as high priority messages to be presented first or to be presented as soon as they are received. Low priority messages may be held for a particular time. Message preferences may indicate whether messages are to be presented as received, converted to text, converted to audio, presented in a particular manner/format/style, etc. Message preferences may be associated with automated actions, where receiving particular messages results in automatically performing specified actions. One or more preferences (e.g., message preferences), viewing history, and/or other information associated with a user make up a user profile.
  • In an embodiment, message preferences may include a user-defined alert condition. For example, the alert condition may include receiving an email, voicemail, text message, instant message, twitter tweet, etc. that meets a particular condition. An alert condition may include a specific user action performed by a specified list of users. For example, an alert condition may a particular user posting a hiking activity invite on a webpage. The alert condition may be based on particular keywords in a communication, a subject matter associated with a communication, etc. For example, if the word “emergency” or “urgent” is found in the communication, the alert condition may be met. The alert condition may be related to security (e.g., a house alarm or car alarm being set off). The alert condition may be related to kitchen equipment. For example, the alert condition may be linked to an oven timer going off. The alert condition may include a change in status of a user specified entity. For example, the alert condition may be related to when a user on a social networking website changes status from “in a relationship” to “single”. An alert condition may include the availability of a particular media content, in a content stream, selected based on a user profile. For example, the user profile may include a viewing history, an actor name, a media content genre, a language associated with the media content. If media content that matches any part of the user profile, the alert condition may be met and an alert may be presented in response.
  • In an embodiment, message preferences may be received as direct input from a user, determined based on user files, obtained from the internet (e.g., from a web page or other file associated with a user, by querying a database, etc.). The message preferences may be obtained by monitoring the usage patterns on a media device. For example, if usage patterns indicate that a user checks messages immediately upon receiving notifications of a message, the message preferences may indicate that messages are to be displayed or played immediately. Message preferences for a user may also be sender based. For example, the sender of a message may indicate the delivery method and/or delivery preferences. Message preferences may also be randomly (e.g., user input), periodically, or continuously be modified.
  • In an embodiment, a command to play media content is received (Step 704). The received command may be submitted by a user via a keyboard, remote control, a mouse, joystick, a microphone or any other suitable input device. The command may be a selection in the electronic programming guide (EPG) by a user for the playing of the media content. The command may be a channel selection entered by a user. The command may be a request to display a slide show of pictures. The command may be to play an audio file. The command may be a request to play a movie (e.g., a command for a blu-ray player). In an embodiment, receiving the command to present media content may include a user entering the title of media content in a search field on a user interface. The command to play media content may be a user selection of particular media content that is stored in memory.
  • In an embodiment, the media content is played (Step 706). In an embodiment, the media content may be played in response to the command or without receiving a command. For example, a user may turn on a media device which is automatically configured to receive a content stream on the last selected channel or a default channel. In an embodiment, the media device may automatically select media content for playing based on user preferences or responsive to playing or recording of the media content on another media device.
  • In an embodiment, a message may be received while playing media content (Step 708). The message may be received from a local or remote source over a network (e.g., internet, intranet, broadcast service, etc.). A message may be received from a web service through an internet connection. For example, friend messages or status changes associated with a social networking website may be received from a web service. The web service may be configured to provide all messages associated with a social networking website or a filtered selection of messages associated with particular preferences. Another example, may include a Really Simply Syndication (RSS) feed that may be received from a web service associated with news, sports, entertainment, weather, stocks, or any other suitable category. In an embodiment, the message may be received from a content source related to services provided by the content source. For example, the message may indicate the availability of car purchasing service, or the availability of a particular car for sale.
  • The message may be a direct message to a user or group of users (e.g., voicemail, text message, email, etc.). The message may be received in a form different than the originating form. For example, a text message may be received as an audio file, or the text message may be converted to an audio file by the media device after receipt of the text message. Conversely, an audio file may be received as a text message or converted to a text message. In an embodiment, symbols, abbreviations, images, etc. may be used to represent messages. In an embodiment, a message received in one language may be translated to a different language.
  • In an embodiment, the receiving the message may include detecting the occurrence of a user-defined alert condition. For example, all messages may be monitored and compared to user-defined alert conditions. In an embodiment, EPG data, an RSS feed, a webpage, an event log, displayed information obtained using OCR or any other source of information may be monitored for occurrence of the alert condition. If any of the messages received match an alert condition, the occurrence of the alert condition may be identified. An alert may be then be immediately presented indicating occurrence of the alert condition. The message indicating occurrence of the alert condition may be interpreted based on user preferences.
  • A determination may be made whether to present the message immediately, present the message at a later time, or not present the message at all (Step 710). Based on the user preference, a received message may be presented (Step 717) immediately upon receiving, or held until a later time. A message may be presented during commercial breaks, when a user selects the messages for viewing, based on a specified schedule or at another suitable time. The messages may also be filtered out based on user preferences. For example, each received message may be compared to user defined alert conditions to determine if the message matches a user defined alert condition. Messages that match a user defined alert condition may be presented and messages that do not match the user defined alert conditions may be filtered out.
  • In an embodiment, presenting the message may include presenting the message in a visual format and/or playing the message in an audio format. For example, a message may be presented by loading a media content frame into a frame buffer and overlaying message content in the frame buffer to overwrite a portion of the media content frame. The content of the frame buffer may then be presented on a display screen. In another exemplary implementation, different buffers may be used for media content and for message content, where content for the display screen is obtained from both buffers. In an embodiment, presenting a message may include displaying message information and concurrently playing an audio file with the message information. The message information displayed on the screen and played in the audio file may be the same or different. For example, the display screen may display the face of a person associated with the message or announcing the message, while the audio file may include the actual message. In embodiment, playing an audio message may include muting or lowering the volume associated with the media content be played.
  • 8.0 Interpreting Commands
  • FIG. 8 illustrates a flow diagram for interpreting a voice command in accordance with an embodiment. One or more of the steps described below may be omitted, repeated, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIG. 8 should not be construed as limiting the scope of the invention.
  • Initially, one or more users present near a multimedia device are identified (Step 802). One or more users may be identified based on voice input received by the multimedia device or an input device (e.g., a microphone, a remote) associated with the multimedia device. For example, the multimedia device (or an associated input device) may be configured to periodically sample detectable voice input and compare the voice input to data representing user voices to identify known users. The data representing user voices may be generated based on a voice training exercise performed by users for the multimedia device to receive voice samples associated with a user. Users may be identified during an active or passive mode. For example, users may be identified when a user command is received to recognize users or users may be identified automatically without a specific user command. Although voice identification is used as an example, other means for recognizing users may also be used. For example, user names may be entered via an input device (e.g., keyboard, mouse, remote, joystick, etc.). Users may be identified based on metadata associated with the household. Users may be identified using fingerprint detection on the media device or fingerprint detection on another communicatively coupled device (e.g., a remote).
  • In an embodiment, a voice command is received from a user (Step 804). A voice command may be received by a user first indicating that a voice command is to be given. For example, a user may say a keyword such as “command” or enter input on a device such as a remote indicating that the user is going to submit a voice command. A voice command may be received by continuously processing all voice input and comparing the voice input to known commands to determine if a voice command was submitted. For example, voice input in the last n seconds from the current time may be continuously submitted for analysis to determine if a voice command was received in the last n seconds. In an embodiment, different portions of the voice command may be received from different users. For example, a command “record” may be received from a first user and various titles of programs/shows may be received from multiple users. Examples of other commands include “order pizza”, “tweet this game is amazing”, “wall post who wants to come watch the emmys”, etc. Although a voice command is used in this example, any type of input (e.g., using a mouse, a keyboard, a joystick) may be accepted.
  • The command may be interpreted based on preferences (e.g., in a user profile) associated with one or more identified users (Step 806) to determine an action to be performed (Step 808). Interpreting a command may involve determining whether the command is applicable to one user (e.g., the user giving the command) or multiple users (e.g., including multiple users identified in Step 802). A particular command word may be indicative of a single user command or a multiple user command. For example, tweet commands may be interpreted by default as a command applicable to a single user, e.g., the user submitting the command. Furthermore, the command may be interpreted based on the user's preferences/settings. If the user submitting the command “tweet this game is amazing” is associated with a twitter account, then the action to be performed is to generate a tweet for the user's twitter account including the words “this game is amazing”. Another example of a command applicable to a single user includes “wall post who wants to come watch the emmys”. In this case, the command by a user may be recognized as a Facebook wall post and the message “who wants to come watch the emmys” may be posted on the user's Facebook profile. The multimedia device may be configured to associate certain types of commands with multiple user commands. For example, orders for food may be associated with all the identified users. A command “order pizza” may be interpreted as an order for pizza with toppings matching the preferences of all the identified users. A command “buy tickets” may be interpreted as an order to purchase tickets for all the identified users for a football game currently being advertised on television. A command may be intentionally vague for complete interpretation based on the identified users. For example, the command “play recorded show” may result in evaluating each recorded show on a media device to determine how many identified users prefer the recorded show based on user preferences. Thereafter, the recorded show that matches the preferences of the largest number of identified users is selected for playing.
  • In an embodiment, all or a portion of command interpretations may be confirmed with a user before execution. For example, when ordering pizza, the pizza toppings selected based on user preferences may be presented for confirmation. Another example involving confirmation of commands may involve any orders requiring money or a threshold amount of money.
  • In an embodiment, a command may be interpreted based on permissions associated with a user and the command may be performed only if the user giving the command has the permission to give the command. For example, a recording and/or playing of a rated R movie may be restricted to users over the age of seventeen. A profile may be setup for each user including the age of the user. If an identified user over the age of seventeen gives the command to record/play an R rated movie, the command is executed. However, if a user under the age of seventeen gives the command to record/play the R rated movie, the command is denied. In an embodiment, a command may be interpreted based on the religious and/or political beliefs of a user. For example, an election coverage program sponsored by the democratic party may be recorded if a democratic user submits a command to record election coverage and an election coverage program sponsored by the republican party may be recorded if a republican user submits the command.
  • In an embodiment, a language used to submit a command may be used to interpret the command. For example, if a command to record a show is submitted in French, the French subtitles may be selected out of a set of available subtitle streams and recorded with the show. In another example, if multiple audio streams are available in different languages, the audio stream selected may be based on the language of the command.
  • 9.0 Correlating Input with Media Content
  • FIG. 9 illustrates a flow diagram for correlating annotations with media content in accordance with an embodiment. One or more of the steps described below may be omitted, repeated, and/or performed in a different order. Accordingly, the specific arrangement of steps shown in FIG. 9 should not be construed as limiting the scope of the invention. Furthermore, although specific types of annotations (e.g., audio, textual, graphical, etc.) may be discussed in the examples below, embodiments of the invention are applicable to any type of annotation.
  • In an embodiment, media content is played (Step 902). The media content may include both audio and video content, or the media content may include video content alone. Concurrently with playing of the media content, audio input received from a user may be recorded (Step 904). The audio input received from a user may be general reactions to the media content. For example, the audio input may include laughter, excitement (e.g., gasps, “wow”, etc.), commentary, criticisms, praises, or any other reaction to the media content. In an embodiment, the commentary may include audio input intended for a subsequent playing of the media content. For example, in a documentary film about tourist destinations, a user may submit voice input which includes stories or memories associated with the particular tourist destination being featured. In another example, a band may provide song lyrics during a particular portion of the media content for recording in association with that portion of the media content. In another embodiment, a user may provide commentary, plot synopsis, character lines, or any other information about the media content in an alternate language during the playing of the media content in the original language. Different versions of audio input (e.g., by the same user or by different users) may be recorded in association with particular media content. In an embodiment, the audio input may be provided with instructions for intended playback information. For example, the playback information may indicate that the submitted audio is to replace the original audio entirely, or played in concurrently with the original audio. In an embodiment, the audio input may be automatically generated by a text-to-speech translator which generates speech based on text associated with the media content. For example, speech in an alternate language may be generated based on the closed caption text in the alternate language. In an embodiment, optical character recognition may be used to identify building names, letters, team names, etc. displayed on a screen and converted to audio for visually impaired audiences, or for audiences that cannot read the information (e.g., due to language barriers or age). In an embodiment, audio input may be received concurrently with playing a particular portion of the media content and stored in association with that particular portion of the media content.
  • In an embodiment, the media content is subsequently played with the audio input received during a previous playing of the media content (Step 906). Playing the additional audio input received during the previous playing of the media content may include completely replacing the original audio stream or playing concurrently with the original audio stream. In an embodiment, the additional audio input may be a feature that can be turned on or off during the playing of the corresponding media content. In an embodiment, multiple versions of additional audio input may be offered, where a user selects the particular additional audio input for playing during playing of the media content. For example, an online community may be established for submitting and downloading commentary to be played with different movies. Different users with different media devices may record audio input in association with a particular movie (or other content) and thereafter upload the audio input for association with that movie. When a purchaser of the movie downloads the movie, the purchaser may be able to select a commentary (e.g., audio input) by another user to be downloaded/played with the movie. If a purchaser finds the commentary by a particular user hilarious, the purchaser may set the particular user as a default commentator and download all commentaries by the particular user when downloading a movie (or other media content).
  • Although audio input is used an example of annotations of media content, any type of annotations may be used in accordance with embodiments of the invention. For example, during the playing of media content, text may be entered or images may be submitted by one or more users. In an embodiment, all or part of an annotation or collection of annotations may be processed or analyzed to derive new content. In an embodiment, a collection of annotations associated with the same media content may be compared to identify annotations patterns. For example, a collection of annotations can be analyzed to determine the most annotated point within media content. Accordingly, a scene or actor which resulted in the greatest amount of user excitement (or other emotion) may be identified via annotations during a scene. In another example, user content included in a collection of annotations, such as text or voice notes can be analyzed to determine collective user sentiment (e.g., the funniest scene in a movie, or the funniest movie released in 2009).
  • 10.0 Eliciting Annotations by a Personal Media Device
  • In an embodiment, any annotations (including audio input, textual input, graphical input, etc.) may be elicited before, during, or after presenting media content by a personal media device associated with a user. Eliciting annotations may be based on selections by an administrator, content producer, content director, etc. For example, a user may be prompted by a media device for a review (e.g., vote, rating, criticism, praise, etc.) at the conclusion of each performance within a presentation of a talent contest within media content in the content stream that was received by the media device and displayed by the media device. In an embodiment, elicited annotations (or other annotations) may be associated with the media content as a whole rather than a specific point within the media content such as when the audio input was submitted. The annotations of one or more users may then be processed (e.g., to count votes, scores, etc.) for the media content.
  • In an embodiment, the audio input may be elicited from a user by a media device to build a user profile. For example, reactions to different media content may be elicited from a user. Based on the reactions, a user profile may be automatically created which may include users interests, likes, dislikes, values, political views etc. The automatically created profile may used for a dating service, a social networking website, etc. The automatically generated profile may be published on a webpage (e.g., of a social networking website).
  • In an embodiment, the system can elicit user annotations to identify information associated with media content. For example, annotations may be elicited for identification of a face which although detected, cannot be identified automatically. A system may also be configured to elicit annotations from a parent, after media content has been played, indicating whether the media content is appropriate for children.
  • 11.0 Marking Media Content
  • In an embodiment, annotations may be used by a user to mark a location in the playing of media content. For example, a user may submit audio input or textual input during the playing of media content that includes a particular keyword such as “mark”, “note”, “record”, etc. that instructs the system to mark a current location in the playing of the media content. The system may automatically mark a particular location based on user reaction. For example, user input above a certain frequency or a certain decibel level may indicate that the user is excited. This excitement point may be stored automatically. In an embodiment, the marked points may include start points and/or end points. For example, periods of high user activity which may correlate to exciting portions of a sports game may be marked by start and end points. A parent may mark start and end points of media content that are not appropriate for children and thus, the marked portion may be skipped during playback unless a password is provided. A user may mark a section in a home video that was eventful. As a result of the user marking the point or the automatic marking based on user reaction, an annotation may be stored in association with the point. The annotation may embody a reference to the original content, a time, or frame offset from the start of the original content, and the UTC when the user marked the point. Although audio input may used as an example, input may be submitted by pressing a key on a remote, clicking on a mouse, entering a command on a keyword, or using any other input method.
  • In an embodiment, marking (or identifying) a particular point in media content may involve marking a media frame. For example, media frames may be marked using tags, as described in Applicant owned patent application Ser. No. 09/665,921 filed on Sep. 20, 2000, which is hereby incorporated by reference. Another example may involve marking a media frame using hash values, as described in Applicant owned patent application Ser. No. 11/473,543 filed on Jun. 22, 2006, which is hereby incorporated by reference. In an embodiment, marking a particular point in the media content may involve deriving a fingerprint from one or more frames in the media content and using the fingerprint to recognize the particular point in the media content. In an embodiment, a particular point may be marked by storing a time interval from a starting point in the playing of the media content.
  • In an embodiment, a user marked location may be selected by the user at a later time. For example, the user may be able to scan through different user marked locations during the playing of the media content by pressing next or scan. An image from each of the marked points may be presented to the user, where the user can select a particular image and start/resume the playing of the media content from the corresponding user marked point. User annotations may be used to dynamically segment media content into different parts. User annotations may also be used to filter out certain portions (e.g., periods of no annotations/excitement) of media content and play the remaining portions of the media content in a subsequent playing of the media content.
  • 12.0 Publication of Media Content Annotations
  • In an embodiment, all or part of an annotation may be published (e.g., referenced or presented on a web site or web service). In an embodiment, all or part of an annotation may be automatically presented to a user on another system. In an example, a user can request the system to send all or parts of annotations to an email or SMS address. In another example, a user can request the system automatically add a movie to an online shopping cart or queue when another user (e.g., a movie critic or friend) positively annotates the movie. In an embodiment, annotations of media content may be sold by a user in an online community for the sale or trade of media content annotations. In an embodiment, annotations (e.g., media content with embedded annotations) may be directed sent from one media device to another media device (e.g., through email, intranet, internet, or any other available method of communication).
  • 13.0 Automatically Generated Annotations
  • In an embodiment, the system can derive annotation content for media content from the closed-captioning portion of the media content. In an example, the system can produce an annotation that includes a proper name recognized by a natural language processing system and/or a semantic analysis system, and then associate the annotation with the video content where the proper name appears in closed caption. In another example, the system can produce an annotation indicating the start of a commercial break when the phrase “we'll be back after these words” or a similar phrase is recognized in the closed captioning. Another example includes a system producing an annotation associated with a region of media content that contains explicit closed caption language. The system may then provide an option to automatically mute the audio portion of the media content associated with the explicit closed caption language.
  • In an embodiment, the system can generate audio input utilizing optical character recognition systems. In an example, the system can produce an annotation that includes the title of a movie being advertised. For example, the annotation may display the movie title (e.g., at the bottom of a screen) as soon as the title of the movie is identified or at the end of a movie trailer. In another example, the system can produce an audio annotation that includes the names of cast members from video content corresponding to credits. Another example may involve the system producing an annotation indicating a change in score during a sports game by analyzing OCR-derived data inside the ticker regions of a sporting event broadcast.
  • In an example, the system may detect a user is navigating an electronic programming guide (EPG) by recognizing a collection of show and movie titles from the OCR. The system may then produce a visual annotation on the EPG recommending the highest-rated show listed in the EPG. In an embodiment, the annotation may also include other contextual information that can be used to further optimize recommendations. For example, the annotation may be based on content recently viewed by the user, which can be used to recommend content from the EPG in the same genre or starring the same actors.
  • In an embodiment, the system can derive annotation content utilizing speech-to-text systems. For example, the system can produce a transcript of the dialogue in media content to be used in a future presentation when audio is muted or when requested by the hearing impaired. In an embodiment, the derived transcript can be processed by a separate system that monitors presence of topics or persons of interest and then automatically produces annotations associated with topics or persons of interest.
  • 14.0 Environment Configuration
  • FIG. 10 shows an exemplary system for configuring an environment in accordance with one or more embodiments. In an embodiment, the environment configuration engine (1015) generally represents any software and/or hardware that may be configured to determine environment configurations (1025). The environment configuration engine (1015) may be implemented within the media device, shown in FIG. 1B or may be implemented as a separate component. The environment configuration engine (1015) may identify one or more users (e.g., user A (1005), user N (1010), etc.) that are within close proximity of the environment configuration engine (1015) and identify user preferences (1020) associated with the identified users. The users may be identified based on voice recognition or based on other input identifying the users. Based on the user preferences (1020), the environment configuration engine may configure a user interface, an audio system configuration, a room lighting, a game console, a music playlist, a seating configuration, or any other suitable environmental configurations (1025). For example, if five friends are identified, which are associated with a group user preference, a channel streaming a sports game may be automatically selected and surround sound may be selected for the audio stream(s) associated with the sports game. Another example may involve identifying a couple, and automatically initiating the playing of a romantic comedy.
  • 15.0 Hardware Overview
  • According to one embodiment, the techniques described herein are implemented by one or more special-purpose computing devices. The special-purpose computing devices may be hard-wired to perform the techniques, or may include digital electronic devices such as one or more application-specific integrated circuits (ASICs) or field programmable gate arrays (FPGAs) that are persistently programmed to perform the techniques, or may include one or more general purpose hardware processors programmed to perform the techniques pursuant to program instructions in firmware, memory, other storage, or a combination. Such special-purpose computing devices may also combine custom hard-wired logic, ASICs, or FPGAs with custom programming to accomplish the techniques. The special-purpose computing devices may be desktop computer systems, portable computer systems, handheld devices, networking devices or any other device that incorporates hard-wired and/or program logic to implement the techniques.
  • For example, FIG. 11 is a block diagram that illustrates a System 1100 upon which an embodiment of the invention may be implemented. System 1100 includes a bus 1102 or other communication mechanism for communicating information, and a hardware processor 1104 coupled with bus 1102 for processing information. Hardware processor 1104 may be, for example, a general purpose microprocessor.
  • System 1100 also includes a main memory 1106, such as a random access memory (RAM) or other dynamic storage device, coupled to bus 1102 for storing information and instructions to be executed by processor 1104. Main memory 1106 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 1104. Such instructions, when stored in storage media accessible to processor 1104, render System 1100 into a special-purpose machine that is customized to perform the operations specified in the instructions.
  • System 1100 further includes a read only memory (ROM) 1108 or other static storage device coupled to bus 1102 for storing static information and instructions for processor 1104. A storage device 1110, such as a magnetic disk or optical disk, is provided and coupled to bus 1102 for storing information and instructions.
  • System 1100 may be coupled via bus 1102 to a display 1112, such as a cathode ray tube (CRT), for displaying information to a computer user. An input device 1114, including alphanumeric and other keys, is coupled to bus 1102 for communicating information and command selections to processor 1104. Another type of user input device is cursor control 11111, such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 1104 and for controlling cursor movement on display 1112. This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane.
  • System 1100 may implement the techniques described herein using customized hard-wired logic, one or more ASICs or FPGAs, firmware and/or program logic which in combination with the System causes or programs System 1100 to be a special-purpose machine. According to one embodiment, the techniques herein are performed by System 1100 in response to processor 1104 executing one or more sequences of one or more instructions contained in main memory 1106. Such instructions may be read into main memory 1106 from another storage medium, such as storage device 1110. Execution of the sequences of instructions contained in main memory 1106 causes processor 1104 to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions.
  • The term “storage media” as used herein refers to any media that store data and/or instructions that cause a machine to operation in a specific fashion. Such storage media may comprise non-volatile media and/or volatile media. Non-volatile media includes, for example, optical or magnetic disks, such as storage device 1110. Volatile media includes dynamic memory, such as main memory 1106. Common forms of storage media include, for example, a floppy disk, a flexible disk, hard disk, solid state drive, magnetic tape, or any other magnetic data storage medium, a CD-ROM, any other optical data storage medium, any physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, NVRAM, any other memory chip or cartridge.
  • Storage media is distinct from but may be used in conjunction with transmission media. Transmission media participates in transferring information between storage media. For example, transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprise bus 1102. Transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications.
  • Various forms of media may be involved in carrying one or more sequences of one or more instructions to processor 1104 for execution. For example, the instructions may initially be carried on a magnetic disk or solid state drive of a remote computer. The remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem. A modem local to System 1100 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal. An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on bus 1102. Bus 1102 carries the data to main memory 1106, from which processor 1104 retrieves and executes the instructions. The instructions received by main memory 1106 may optionally be stored on storage device 1110 either before or after execution by processor 1104.
  • System 1100 also includes a communication interface 1118 coupled to bus 1102. Communication interface 1118 provides a two-way data communication coupling to a network link 1120 that is connected to a local network 1122. For example, communication interface 1118 may be an integrated services digital network (ISDN) card, cable modem, satellite modem, or a modem to provide a data communication connection to a corresponding type of telephone line. As another example, communication interface 1118 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN. Wireless links may also be implemented. In any such implementation, communication interface 1118 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.
  • Network link 1120 typically provides data communication through one or more networks to other data devices. For example, network link 1120 may provide a connection through local network 1122 to a host computer 1124 or to data equipment operated by an Internet Service Provider (ISP) 11211. ISP 11211 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the “Internet” 1128. Local network 1122 and Internet 1128 both use electrical, electromagnetic or optical signals that carry digital data streams. The signals through the various networks and the signals on network link 1120 and through communication interface 1118, which carry the digital data to and from System 1100, are example forms of transmission media.
  • System 1100 can send messages and receive data, including program code, through the network(s), network link 1120 and communication interface 1118. In the Internet example, a server 1130 might transmit a requested code for an application program through Internet 1128, ISP 11211, local network 1122 and communication interface 1118.
  • The received code may be executed by processor 1104 as it is received, and/or stored in storage device 1110, or other non-volatile storage for later execution. In an embodiment, an apparatus is a combination of one or more hardware and/or software components described herein. In an embodiment, a subsystem for performing a step is a combination of one or more hardware and/or software components that may be configured to perform the step.
  • 16.0 Extensions and Alternatives
  • In the foregoing specification, embodiments of the invention have been described with reference to numerous specific details that may vary from implementation to implementation. Thus, the sole and exclusive indicator of what is the invention, and is intended by the applicants to be the invention, is the set of claims that issue from this application, in the specific form in which such claims issue, including any subsequent correction. Any definitions expressly set forth herein for terms contained in such claims shall govern the meaning of such terms as used in the claims. Hence, no limitation, element, property, feature, advantage or attribute that is not expressly recited in a claim should limit the scope of such claim in any way. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.

Claims (21)

1. A method comprising:
playing media content on a first multimedia device;
concurrently with playing a particular portion of the media content on the first multimedia device, receiving a first audio input from a first user;
storing the first audio input in association with the particular portion of the media content.
2. The method as recited in claim 1, further comprising:
playing the particular portion of the media content concurrently with playing the first audio input received from the user.
3. The method as recited in claim 1, further comprising:
playing the media content on a second multimedia device;
concurrently with playing the particular portion of the media content on the second multimedia device, receiving a second audio input from a second user;
storing the second audio input in association with the particular portion of the media content.
4. The method as recited in claim 3, further comprising:
the first media device uploading the first audio input to a web server;
the second media device uploading the second audio input to a web server;
a third media device selecting one of the first audio input or the second audio input for downloading with the media content;
the third media device downloading the media content with the first audio input or the second audio input.
5. The method as recited in claim 1, further comprising:
identifying text information associated with the media content based on optical character recognition by applied to the particular portion of the media content;
generating an audio file based on the text information;
storing the audio file in association with the particular portion of the media content.
6. The method as recited in claim 1, further comprising:
receiving a second audio input concurrently with playing the media content;
analyzing at least the first audio input and the second audio input to identify a pattern associated with the media content.
7. The method as recited in claim 1, further comprising generating a user profile for the first user based at least on the first audio input received from the first user.
8. A computer readable storage medium comprising a sequence of instructions, which when executed by one or more processors, cause performing steps comprising:
playing media content on a first multimedia device;
concurrently with playing a particular portion of the media content on the first multimedia device, receiving a first audio input from a first user;
storing the first audio input in association with the particular portion of the media content.
9. The computer readable storage medium as recited in claim 8, the steps further comprising:
playing the particular portion of the media content concurrently with playing the first audio input received from the user.
10. The computer readable storage medium as recited in claim 8, the steps further comprising:
playing the media content on a second multimedia device;
concurrently with playing the particular portion of the media content on the second multimedia device, receiving a second audio input from a second user;
storing the second audio input in association with the particular portion of the media content.
11. The computer readable storage medium as recited in claim 10, the steps further comprising:
the first media device uploading the first audio input to a web server;
the second media device uploading the second audio input to a web server;
a third media device selecting one of the first audio input or the second audio input for downloading with the media content;
the third media device downloading the media content with the first audio input or the second audio input.
12. The computer readable storage medium as recited in claim 8, the steps further comprising:
identifying text information associated with the media content based on optical character recognition by applied to the particular portion of the media content;
generating an audio file based on the text information;
storing the audio file in association with the particular portion of the media content.
13. The computer readable storage medium as recited in claim 8, the steps further comprising:
receiving a second audio input concurrently with playing the media content;
analyzing at least the first audio input and the second audio input to identify a pattern associated with the media content.
14. The computer readable storage medium as recited in claim 8, the steps further comprising generating a user profile for the first user based at least on the first audio input received from the first user.
15. An apparatus comprising:
one or more processors;
one or more subsystems configured for performing steps comprising:
playing media content on a first multimedia device;
concurrently with playing a particular portion of the media content on the first multimedia device, receiving a first audio input from a first user;
storing the first audio input in association with the particular portion of the media content.
16. The apparatus as recited in claim 15, the steps further comprising:
playing the particular portion of the media content concurrently with playing the first audio input received from the user.
17. The apparatus as recited in claim 15, the steps further comprising:
playing the media content on a second multimedia device;
concurrently with playing the particular portion of the media content on the second multimedia device, receiving a second audio input from a second user;
storing the second audio input in association with the particular portion of the media content.
18. The apparatus as recited in claim 10, the steps further comprising:
the first media device uploading the first audio input to a web server;
the second media device uploading the second audio input to a web server;
a third media device selecting one of the first audio input or the second audio input for downloading with the media content;
the third media device downloading the media content with the first audio input or the second audio input.
19. The apparatus as recited in claim 15, the steps further comprising:
identifying text information associated with the media content based on optical character recognition by applied to the particular portion of the media content;
generating an audio file based on the text information;
storing the audio file in association with the particular portion of the media content.
20. The apparatus as recited in claim 15, the steps further comprising:
receiving a second audio input concurrently with playing the media content;
analyzing at least the first audio input and the second audio input to identify a pattern associated with the media content.
21. The apparatus as recited in claim 15, the steps further comprising generating a user profile for the first user based at least on the first audio input received from the first user.
US12/631,762 2009-09-14 2009-12-04 Multifunction Multimedia Device Abandoned US20110066944A1 (en)

Priority Applications (20)

Application Number Priority Date Filing Date Title
US12/631,762 US20110066944A1 (en) 2009-09-14 2009-12-04 Multifunction Multimedia Device
EP17211238.5A EP3346715B1 (en) 2009-09-14 2010-09-14 Multifunction multimedia device
EP10816287.6A EP2478700A4 (en) 2009-09-14 2010-09-14 Multifunction multimedia device
EP17211237.7A EP3346701A1 (en) 2009-09-14 2010-09-14 Multifunction multimedia device
AU2010291945A AU2010291945A1 (en) 2009-09-14 2010-09-14 Multifunction multimedia device
SG2012017034A SG179091A1 (en) 2009-09-14 2010-09-14 Multifunction multimedia device
JP2012528995A JP2013504947A (en) 2009-09-14 2010-09-14 Multi-function multimedia device
PCT/US2010/048811 WO2011032167A1 (en) 2009-09-14 2010-09-14 Multifunction multimedia device
CN201080051626.5A CN102696233B (en) 2009-09-14 2010-09-14 Multifunction multimedia device
EP17211241.9A EP3349436A1 (en) 2009-09-14 2010-09-14 Multifunction multimedia device
CA2773323A CA2773323A1 (en) 2009-09-14 2010-09-14 Multifunction multimedia device
EP17211239.3A EP3346377A1 (en) 2009-09-14 2010-09-14 Multifunction multimedia device
EP17211240.1A EP3346700A1 (en) 2009-09-14 2010-09-14 Multifunction multimedia device
HK12112854.6A HK1172178A1 (en) 2009-09-14 2012-12-12 Multifunction multimedia device
JP2014165383A JP6124357B2 (en) 2009-09-14 2014-08-15 Automatic monitoring of media content availability
HK19100301.3A HK1257939A1 (en) 2009-09-14 2019-01-09 Multifunction multimedia device
HK19100302.2A HK1257940A1 (en) 2009-09-14 2019-01-09 Multifunction multimedia device
HK19100305.9A HK1257943A1 (en) 2009-09-14 2019-01-09 Multifunction multimedia device
HK19100303.1A HK1257941A1 (en) 2009-09-14 2019-01-09 Multifunction multimedia device
HK19100304.0A HK1257942A1 (en) 2009-09-14 2019-01-09 Multifunction multimedia device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US24227709P 2009-09-14 2009-09-14
US12/631,762 US20110066944A1 (en) 2009-09-14 2009-12-04 Multifunction Multimedia Device

Publications (1)

Publication Number Publication Date
US20110066944A1 true US20110066944A1 (en) 2011-03-17

Family

ID=43730081

Family Applications (17)

Application Number Title Priority Date Filing Date
US12/631,783 Active 2031-12-05 US8510769B2 (en) 2009-09-14 2009-12-04 Media content finger print system
US12/631,782 Active US9521453B2 (en) 2009-09-14 2009-12-04 Multifunction multimedia device
US12/631,781 Active 2031-10-03 US9264758B2 (en) 2009-09-14 2009-12-04 Method and an apparatus for detecting media content recordings
US12/631,765 Active US10097880B2 (en) 2009-09-14 2009-12-04 Multifunction multimedia device
US12/631,762 Abandoned US20110066944A1 (en) 2009-09-14 2009-12-04 Multifunction Multimedia Device
US12/631,740 Abandoned US20110066942A1 (en) 2009-09-14 2009-12-04 Multifunction Multimedia Device
US12/631,751 Abandoned US20110067066A1 (en) 2009-09-14 2009-12-04 Multifunction Multimedia Device
US12/631,770 Active 2032-05-31 US8704854B2 (en) 2009-09-14 2009-12-04 Multifunction multimedia device
US12/631,759 Active US8984626B2 (en) 2009-09-14 2009-12-04 Multifunction multimedia device
US12/631,775 Active 2031-06-26 US8417096B2 (en) 2009-09-14 2009-12-04 Method and an apparatus for determining a playing position based on media content fingerprints
US12/631,778 Active 2030-10-22 US9648380B2 (en) 2009-09-14 2009-12-04 Multimedia device recording notification system
US13/859,620 Active 2030-01-15 US9036979B2 (en) 2009-09-14 2013-04-09 Determining a position in media content based on a name information
US13/965,125 Active 2030-03-22 US9554176B2 (en) 2009-09-14 2013-08-12 Media content fingerprinting system
US14/259,145 Active 2030-02-02 US9369758B2 (en) 2009-09-14 2014-04-22 Multifunction multimedia device
US16/150,050 Active 2029-12-25 US10805670B2 (en) 2009-09-14 2018-10-02 Multifunction multimedia device
US17/020,151 Active US11653053B2 (en) 2009-09-14 2020-09-14 Multifunction multimedia device
US18/133,099 Pending US20230283837A1 (en) 2009-09-14 2023-04-11 Multifunction multimedia device

Family Applications Before (4)

Application Number Title Priority Date Filing Date
US12/631,783 Active 2031-12-05 US8510769B2 (en) 2009-09-14 2009-12-04 Media content finger print system
US12/631,782 Active US9521453B2 (en) 2009-09-14 2009-12-04 Multifunction multimedia device
US12/631,781 Active 2031-10-03 US9264758B2 (en) 2009-09-14 2009-12-04 Method and an apparatus for detecting media content recordings
US12/631,765 Active US10097880B2 (en) 2009-09-14 2009-12-04 Multifunction multimedia device

Family Applications After (12)

Application Number Title Priority Date Filing Date
US12/631,740 Abandoned US20110066942A1 (en) 2009-09-14 2009-12-04 Multifunction Multimedia Device
US12/631,751 Abandoned US20110067066A1 (en) 2009-09-14 2009-12-04 Multifunction Multimedia Device
US12/631,770 Active 2032-05-31 US8704854B2 (en) 2009-09-14 2009-12-04 Multifunction multimedia device
US12/631,759 Active US8984626B2 (en) 2009-09-14 2009-12-04 Multifunction multimedia device
US12/631,775 Active 2031-06-26 US8417096B2 (en) 2009-09-14 2009-12-04 Method and an apparatus for determining a playing position based on media content fingerprints
US12/631,778 Active 2030-10-22 US9648380B2 (en) 2009-09-14 2009-12-04 Multimedia device recording notification system
US13/859,620 Active 2030-01-15 US9036979B2 (en) 2009-09-14 2013-04-09 Determining a position in media content based on a name information
US13/965,125 Active 2030-03-22 US9554176B2 (en) 2009-09-14 2013-08-12 Media content fingerprinting system
US14/259,145 Active 2030-02-02 US9369758B2 (en) 2009-09-14 2014-04-22 Multifunction multimedia device
US16/150,050 Active 2029-12-25 US10805670B2 (en) 2009-09-14 2018-10-02 Multifunction multimedia device
US17/020,151 Active US11653053B2 (en) 2009-09-14 2020-09-14 Multifunction multimedia device
US18/133,099 Pending US20230283837A1 (en) 2009-09-14 2023-04-11 Multifunction multimedia device

Country Status (9)

Country Link
US (17) US8510769B2 (en)
EP (10) EP3361742A1 (en)
JP (4) JP2013504947A (en)
CN (4) CN102696233B (en)
AU (2) AU2010291945A1 (en)
CA (2) CA2773323A1 (en)
HK (6) HK1172178A1 (en)
SG (2) SG179092A1 (en)
WO (2) WO2011032167A1 (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110067066A1 (en) * 2009-09-14 2011-03-17 Barton James M Multifunction Multimedia Device
US20120284644A1 (en) * 2011-05-06 2012-11-08 David H. Sitrick Systems And Methodologies Comprising A Plurality Of Computing Appliances Having Input Apparatus And Display Apparatus And Logically Structured As A Main Team
US20120284642A1 (en) * 2011-05-06 2012-11-08 David H. Sitrick System And Methodology For Collaboration, With Selective Display Of User Input Annotations Among Member Computing Appliances Of A Group/Team
US20120284643A1 (en) * 2011-05-06 2012-11-08 David H. Sitrick System And Methodology For Collaboration in Groups With Split Screen Displays
US8806352B2 (en) 2011-05-06 2014-08-12 David H. Sitrick System for collaboration of a specific image and utilizing selected annotations while viewing and relative to providing a display presentation
US8875011B2 (en) 2011-05-06 2014-10-28 David H. Sitrick Systems and methodologies providing for collaboration among a plurality of users at a plurality of computing appliances
US8914735B2 (en) 2011-05-06 2014-12-16 David H. Sitrick Systems and methodologies providing collaboration and display among a plurality of users
US8918721B2 (en) 2011-05-06 2014-12-23 David H. Sitrick Systems and methodologies providing for collaboration by respective users of a plurality of computing appliances working concurrently on a common project having an associated display
US8918724B2 (en) 2011-05-06 2014-12-23 David H. Sitrick Systems and methodologies providing controlled voice and data communication among a plurality of computing appliances associated as team members of at least one respective team or of a plurality of teams and sub-teams within the teams
US8924859B2 (en) 2011-05-06 2014-12-30 David H. Sitrick Systems and methodologies supporting collaboration of users as members of a team, among a plurality of computing appliances
US8990677B2 (en) 2011-05-06 2015-03-24 David H. Sitrick System and methodology for collaboration utilizing combined display with evolving common shared underlying image
US9224129B2 (en) 2011-05-06 2015-12-29 David H. Sitrick System and methodology for multiple users concurrently working and viewing on a common project
US9330366B2 (en) 2011-05-06 2016-05-03 David H. Sitrick System and method for collaboration via team and role designation and control and management of annotations
US20170013376A1 (en) * 2011-07-14 2017-01-12 Vivint, Inc. Managing audio output through an intermediary
US9781377B2 (en) 2009-12-04 2017-10-03 Tivo Solutions Inc. Recording and playback system based on multimedia content fingerprints
US10402485B2 (en) 2011-05-06 2019-09-03 David H. Sitrick Systems and methodologies providing controlled collaboration among a plurality of users
US11611595B2 (en) 2011-05-06 2023-03-21 David H. Sitrick Systems and methodologies providing collaboration among a plurality of computing appliances, utilizing a plurality of areas of memory to store user input as associated with an associated computing appliance providing the input

Families Citing this family (298)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1490767B1 (en) 2001-04-05 2014-06-11 Audible Magic Corporation Copyright detection and protection system and method
US8972481B2 (en) 2001-07-20 2015-03-03 Audible Magic, Inc. Playlist generation method and apparatus
US9235557B2 (en) * 2005-10-26 2016-01-12 Cortica, Ltd. System and method thereof for dynamically associating a link to an information resource with a multimedia content displayed in a web-page
US11620327B2 (en) 2005-10-26 2023-04-04 Cortica Ltd System and method for determining a contextual insight and generating an interface with recommendations based thereon
US10607355B2 (en) 2005-10-26 2020-03-31 Cortica, Ltd. Method and system for determining the dimensions of an object shown in a multimedia content item
US10614626B2 (en) 2005-10-26 2020-04-07 Cortica Ltd. System and method for providing augmented reality challenges
US9477658B2 (en) 2005-10-26 2016-10-25 Cortica, Ltd. Systems and method for speech to speech translation using cores of a natural liquid architecture system
US10585934B2 (en) 2005-10-26 2020-03-10 Cortica Ltd. Method and system for populating a concept database with respect to user identifiers
US10380164B2 (en) 2005-10-26 2019-08-13 Cortica, Ltd. System and method for using on-image gestures and multimedia content elements as search queries
US11019161B2 (en) 2005-10-26 2021-05-25 Cortica, Ltd. System and method for profiling users interest based on multimedia content analysis
US9330189B2 (en) 2005-10-26 2016-05-03 Cortica, Ltd. System and method for capturing a multimedia content item by a mobile device and matching sequentially relevant content to the multimedia content item
US10635640B2 (en) 2005-10-26 2020-04-28 Cortica, Ltd. System and method for enriching a concept database
US11003706B2 (en) 2005-10-26 2021-05-11 Cortica Ltd System and methods for determining access permissions on personalized clusters of multimedia content elements
US9191626B2 (en) 2005-10-26 2015-11-17 Cortica, Ltd. System and methods thereof for visual analysis of an image on a web-page and matching an advertisement thereto
US10848590B2 (en) 2005-10-26 2020-11-24 Cortica Ltd System and method for determining a contextual insight and providing recommendations based thereon
US9256668B2 (en) 2005-10-26 2016-02-09 Cortica, Ltd. System and method of detecting common patterns within unstructured data elements retrieved from big data sources
US10387914B2 (en) 2005-10-26 2019-08-20 Cortica, Ltd. Method for identification of multimedia content elements and adding advertising content respective thereof
US9218606B2 (en) 2005-10-26 2015-12-22 Cortica, Ltd. System and method for brand monitoring and trend analysis based on deep-content-classification
US10776585B2 (en) 2005-10-26 2020-09-15 Cortica, Ltd. System and method for recognizing characters in multimedia content
US9286623B2 (en) 2005-10-26 2016-03-15 Cortica, Ltd. Method for determining an area within a multimedia content element over which an advertisement can be displayed
US9489431B2 (en) 2005-10-26 2016-11-08 Cortica, Ltd. System and method for distributed search-by-content
US11032017B2 (en) 2005-10-26 2021-06-08 Cortica, Ltd. System and method for identifying the context of multimedia content elements
US9953032B2 (en) 2005-10-26 2018-04-24 Cortica, Ltd. System and method for characterization of multimedia content signals using cores of a natural liquid architecture system
US9529984B2 (en) 2005-10-26 2016-12-27 Cortica, Ltd. System and method for verification of user identification based on multimedia content elements
US9646005B2 (en) 2005-10-26 2017-05-09 Cortica, Ltd. System and method for creating a database of multimedia content elements assigned to users
US10360253B2 (en) 2005-10-26 2019-07-23 Cortica, Ltd. Systems and methods for generation of searchable structures respective of multimedia data content
US8312031B2 (en) 2005-10-26 2012-11-13 Cortica Ltd. System and method for generation of complex signatures for multimedia data content
US10691642B2 (en) 2005-10-26 2020-06-23 Cortica Ltd System and method for enriching a concept database with homogenous concepts
US9466068B2 (en) 2005-10-26 2016-10-11 Cortica, Ltd. System and method for determining a pupillary response to a multimedia data element
US10372746B2 (en) 2005-10-26 2019-08-06 Cortica, Ltd. System and method for searching applications using multimedia content elements
US11604847B2 (en) 2005-10-26 2023-03-14 Cortica Ltd. System and method for overlaying content on a multimedia content element based on user interest
US9639532B2 (en) 2005-10-26 2017-05-02 Cortica, Ltd. Context-based analysis of multimedia content items using signatures of multimedia elements and matching concepts
US9384196B2 (en) 2005-10-26 2016-07-05 Cortica, Ltd. Signature generation for multimedia deep-content-classification by a large-scale matching system and method thereof
US8818916B2 (en) 2005-10-26 2014-08-26 Cortica, Ltd. System and method for linking multimedia data elements to web pages
US8326775B2 (en) 2005-10-26 2012-12-04 Cortica Ltd. Signature generation for multimedia deep-content-classification by a large-scale matching system and method thereof
US10621988B2 (en) 2005-10-26 2020-04-14 Cortica Ltd System and method for speech to text translation using cores of a natural liquid architecture system
US10380623B2 (en) 2005-10-26 2019-08-13 Cortica, Ltd. System and method for generating an advertisement effectiveness performance score
US10380267B2 (en) 2005-10-26 2019-08-13 Cortica, Ltd. System and method for tagging multimedia content elements
US10535192B2 (en) 2005-10-26 2020-01-14 Cortica Ltd. System and method for generating a customized augmented reality environment to a user
US10949773B2 (en) 2005-10-26 2021-03-16 Cortica, Ltd. System and methods thereof for recommending tags for multimedia content elements based on context
US10193990B2 (en) 2005-10-26 2019-01-29 Cortica Ltd. System and method for creating user profiles based on multimedia content
US9767143B2 (en) 2005-10-26 2017-09-19 Cortica, Ltd. System and method for caching of concept structures
US11386139B2 (en) 2005-10-26 2022-07-12 Cortica Ltd. System and method for generating analytics for entities depicted in multimedia content
US9558449B2 (en) 2005-10-26 2017-01-31 Cortica, Ltd. System and method for identifying a target area in a multimedia content element
US10191976B2 (en) 2005-10-26 2019-01-29 Cortica, Ltd. System and method of detecting common patterns within unstructured data elements retrieved from big data sources
US11403336B2 (en) 2005-10-26 2022-08-02 Cortica Ltd. System and method for removing contextually identical multimedia content elements
US9031999B2 (en) 2005-10-26 2015-05-12 Cortica, Ltd. System and methods for generation of a concept based database
US11361014B2 (en) 2005-10-26 2022-06-14 Cortica Ltd. System and method for completing a user profile
US10180942B2 (en) 2005-10-26 2019-01-15 Cortica Ltd. System and method for generation of concept structures based on sub-concepts
US10742340B2 (en) 2005-10-26 2020-08-11 Cortica Ltd. System and method for identifying the context of multimedia content elements displayed in a web-page and providing contextual filters respective thereto
US9372940B2 (en) 2005-10-26 2016-06-21 Cortica, Ltd. Apparatus and method for determining user attention using a deep-content-classification (DCC) system
US9396435B2 (en) 2005-10-26 2016-07-19 Cortica, Ltd. System and method for identification of deviations from periodic behavior patterns in multimedia content
US10698939B2 (en) 2005-10-26 2020-06-30 Cortica Ltd System and method for customizing images
US11216498B2 (en) 2005-10-26 2022-01-04 Cortica, Ltd. System and method for generating signatures to three-dimensional multimedia data elements
US8266185B2 (en) 2005-10-26 2012-09-11 Cortica Ltd. System and methods thereof for generation of searchable structures respective of multimedia data content
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US10733326B2 (en) 2006-10-26 2020-08-04 Cortica Ltd. System and method for identification of inappropriate multimedia content
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US8006314B2 (en) 2007-07-27 2011-08-23 Audible Magic Corporation System for identifying content of digital data
US9961374B2 (en) * 2008-03-07 2018-05-01 Iii Holdings 1, Llc Pause and replay of media content through bookmarks on a server device
US9239999B2 (en) * 2008-04-15 2016-01-19 Centurylink Intellectual Property Llc System and method for random voice communications through a social network
US20100058417A1 (en) * 2008-08-29 2010-03-04 Embarq Holdings Company, Llc Method and system for providing a social notification for a set-top box
US8676904B2 (en) 2008-10-02 2014-03-18 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US10255566B2 (en) 2011-06-03 2019-04-09 Apple Inc. Generating and processing task items that represent tasks to perform
US9503496B2 (en) * 2009-07-08 2016-11-22 Centurylink Intellectual Property Llc System and method for a media content reconciler
US8121618B2 (en) 2009-10-28 2012-02-21 Digimarc Corporation Intuitive computing methods and systems
US8756646B2 (en) * 2009-11-25 2014-06-17 Centurylink Intellectual Property Llc System and method for the exchange and storage of set-top box data
US20110137976A1 (en) * 2009-12-04 2011-06-09 Bob Poniatowski Multifunction Multimedia Device
US20150095428A1 (en) * 2009-12-16 2015-04-02 Eustace P. Isidore Dynamic communication networks integrated with community networking applications
US8660545B1 (en) * 2010-01-06 2014-02-25 ILook Corporation Responding to a video request by displaying information on a TV remote and video on the TV
MY160803A (en) * 2010-03-31 2017-03-31 Thomson Licensing Trick playback of video data
US9786159B2 (en) 2010-07-23 2017-10-10 Tivo Solutions Inc. Multi-function remote control device
US10013978B1 (en) * 2016-12-30 2018-07-03 Google Llc Sequence dependent operation processing of packet based data message transmissions
US10957002B2 (en) 2010-08-06 2021-03-23 Google Llc Sequence dependent or location based operation processing of protocol based data message transmissions
US8868651B2 (en) 2010-08-16 2014-10-21 Avon Products, Inc. Web community pre-population method and system
US8701043B2 (en) * 2010-08-26 2014-04-15 Verizon Patent And Licensing Inc. Methods and systems for dynamically providing access to enhanced content during a presentation of a media content instance
US9037971B2 (en) * 2010-09-15 2015-05-19 Verizon Patent And Licensing Inc. Secondary audio content by users
US9438876B2 (en) 2010-09-17 2016-09-06 Thomson Licensing Method for semantics based trick mode play in video system
JP5065541B2 (en) * 2010-10-29 2012-11-07 パナソニック株式会社 Communication service system
US8863165B2 (en) 2010-11-01 2014-10-14 Gracenote, Inc. Method and system for presenting additional content at a media system
US8880491B2 (en) * 2010-11-19 2014-11-04 At&T Intellectual Property I, L.P. Systems and methods to play media content selected using a portable computing device on a display device external to the portable computing device
US20120144424A1 (en) * 2010-12-07 2012-06-07 Prasanna Ganesan On-demand user-interface
AU2012208934B2 (en) * 2011-01-21 2016-02-18 Ginger Tetreault Systems and method for displaying and categorizing news feed posts
US9058611B2 (en) * 2011-03-17 2015-06-16 Xerox Corporation System and method for advertising using image search and classification
US9602870B2 (en) 2011-03-31 2017-03-21 Tvtak Ltd. Devices, systems, methods, and media for detecting, indexing, and comparing video signals from a video display in a background scene using a camera-enabled device
US9002490B2 (en) 2011-04-13 2015-04-07 Longsand Limted Methods and systems for generating frictionless social experience environment
US8493353B2 (en) * 2011-04-13 2013-07-23 Longsand Limited Methods and systems for generating and joining shared experience
US20120266084A1 (en) * 2011-04-18 2012-10-18 Ting-Yee Liao Image display device providing individualized feedback
US20120266077A1 (en) * 2011-04-18 2012-10-18 O'keefe Brian Joseph Image display device providing feedback messages
EP2700238B1 (en) 2011-04-19 2018-09-19 Nagravision S.A. Ethernet decoder device and method to access protected content
US20120271823A1 (en) * 2011-04-25 2012-10-25 Rovi Technologies Corporation Automated discovery of content and metadata
KR101211098B1 (en) 2011-04-25 2012-12-11 (주)엔써즈 System and method for providing advertisement related informatiion included in broadcasting to client terminal through network
US8744237B2 (en) * 2011-06-20 2014-06-03 Microsoft Corporation Providing video presentation commentary
RU2594000C2 (en) 2011-08-05 2016-08-10 Сони Корпорейшн Receiving device, receiving method, recording medium and information processing system
KR101828342B1 (en) * 2011-08-10 2018-02-12 삼성전자 주식회사 Broadcast signal receiver, method for providing broadcast signal relation information and server
US20130054375A1 (en) * 2011-08-24 2013-02-28 Accenture Global Services Limited Personalized travel experience with social media integration
US9454280B2 (en) 2011-08-29 2016-09-27 Intellectual Ventures Fund 83 Llc Display device providing feedback based on image classification
KR101310943B1 (en) * 2011-09-26 2013-09-23 (주)엔써즈 System and method for providing contents-related information associated with broadcasting contents
WO2013056146A1 (en) * 2011-10-14 2013-04-18 Google Inc. Wearable computers as media exposure meters
US8442265B1 (en) * 2011-10-19 2013-05-14 Facebook Inc. Image selection from captured video sequence based on social components
US9715581B1 (en) * 2011-11-04 2017-07-25 Christopher Estes Digital media reproduction and licensing
US9094649B2 (en) * 2011-11-28 2015-07-28 Microsoft Technology Licensing, Llc Adapting digital video recording based upon feedback
US9866915B2 (en) 2011-11-28 2018-01-09 Excalibur Ip, Llc Context relevant interactive television
US9654821B2 (en) 2011-12-30 2017-05-16 Sonos, Inc. Systems and methods for networked music playback
US9172994B2 (en) 2012-02-07 2015-10-27 Turner Broadcasting System, Inc. Method and system for an automatic content recognition abstraction layer
US8813032B2 (en) * 2012-02-17 2014-08-19 National Instruments Corporation Customizing synchronization of custom code among multiple programmable hardware elements within a system
US10681427B2 (en) * 2012-03-14 2020-06-09 Arris Enterprises Llc Sentiment mapping in a media content item
WO2013140037A1 (en) * 2012-03-19 2013-09-26 P2S Media Group Oy Method and apparatus for reducing duplicates of multimedia data items in service system
CN102629484B (en) * 2012-03-20 2015-07-01 秦汉香 Method and system for monitoring audio and video file to play
IN2014DN11195A (en) * 2012-04-01 2015-10-02 Tvtak Ltd
US9703932B2 (en) 2012-04-30 2017-07-11 Excalibur Ip, Llc Continuous content identification of broadcast content
US9075760B2 (en) 2012-05-07 2015-07-07 Audible, Inc. Narration settings distribution for content customization
AU2013259799A1 (en) * 2012-05-07 2014-11-27 Audible, Inc. Content customization
US10417037B2 (en) 2012-05-15 2019-09-17 Apple Inc. Systems and methods for integrating third party services with a digital assistant
US20130315562A1 (en) * 2012-05-22 2013-11-28 International Business Machines Corporation Integrating Social Media with Recordation of Broadcast Data
JP5768010B2 (en) * 2012-06-12 2015-08-26 東芝テック株式会社 Signage system and program
US9767479B2 (en) 2012-06-25 2017-09-19 Google Inc. System and method for deploying ads based on a content exposure interval
US10614801B2 (en) 2012-06-25 2020-04-07 Google Llc Protocol based computer network exposure interval content item transmission
US9674587B2 (en) 2012-06-26 2017-06-06 Sonos, Inc. Systems and methods for networked music playback including remote add to queue
EP2690593A1 (en) 2012-07-24 2014-01-29 Nagravision S.A. Method for marking and transmitting a content and method for detecting an identifyier of said content
US8948568B2 (en) 2012-07-31 2015-02-03 Google Inc. Customized video
US8863198B2 (en) 2012-08-17 2014-10-14 Flextronics Ap, Llc Television having silos that animate content source searching and selection
US11368760B2 (en) 2012-08-17 2022-06-21 Flextronics Ap, Llc Applications generating statistics for user behavior
US20140068689A1 (en) * 2012-08-17 2014-03-06 Flextronics Ap, Llc Systems and methods for providing social media with an intelligent television
JP5651661B2 (en) * 2012-09-07 2015-01-14 株式会社東芝 Electronic device, calendar information processing method and program
US9081778B2 (en) 2012-09-25 2015-07-14 Audible Magic Corporation Using digital fingerprints to associate data with a work
EP2712203A1 (en) 2012-09-25 2014-03-26 Nagravision S.A. Method and system for enhancing redistributed audio / video content
US9460204B2 (en) * 2012-10-19 2016-10-04 Sony Corporation Apparatus and method for scene change detection-based trigger for audio fingerprinting analysis
TWI528186B (en) * 2012-11-09 2016-04-01 財團法人資訊工業策進會 System and method for posting messages by audio signals
US9286456B2 (en) * 2012-11-27 2016-03-15 At&T Intellectual Property I, Lp Method and apparatus for managing multiple media services
US10127306B2 (en) * 2012-11-28 2018-11-13 International Business Machines Corporation Searching alternative data sources
US8839309B2 (en) * 2012-12-05 2014-09-16 United Video Properties, Inc. Methods and systems for displaying contextually relevant information from a plurality of users in real-time regarding a media asset
US8745666B1 (en) * 2012-12-11 2014-06-03 Eldon Technology Limited Predictive analytics for media content using scheduled timers and media usage
EP2938022A4 (en) * 2012-12-18 2016-08-24 Samsung Electronics Co Ltd Method and device for controlling home device remotely in home network system
US9167276B2 (en) 2012-12-28 2015-10-20 Turner Broadcasting System, Inc. Method and system for providing and handling product and service discounts, and location based services (LBS) in an automatic content recognition based system
US8990303B2 (en) 2013-01-31 2015-03-24 Paramount Pictures Corporation System and method for interactive remote movie watching, scheduling, and social connection
US10084840B2 (en) 2013-01-31 2018-09-25 Art Research And Technology, L.L.C. Social networking with video annotation
US9451001B2 (en) * 2013-01-31 2016-09-20 Art Research And Technology, L.L.C. Social networking with video annotation
US9472113B1 (en) 2013-02-05 2016-10-18 Audible, Inc. Synchronizing playback of digital content with physical content
KR102118209B1 (en) 2013-02-07 2020-06-02 애플 인크. Voice trigger for a digital assistant
US10652394B2 (en) 2013-03-14 2020-05-12 Apple Inc. System and method for processing voicemail
US10447826B2 (en) 2013-03-14 2019-10-15 Google Llc Detecting user interest in presented media items by observing volume change events
US8752113B1 (en) * 2013-03-15 2014-06-10 Wowza Media Systems, LLC Insertion of graphic overlays into a stream
US10748529B1 (en) 2013-03-15 2020-08-18 Apple Inc. Voice activated device for use with a voice-based digital assistant
US9009103B2 (en) * 2013-03-15 2015-04-14 Microsoft Technology Licensing, Llc Fingerprint-based, intelligent, content pre-fetching
US9501533B2 (en) 2013-04-16 2016-11-22 Sonos, Inc. Private queue for a media playback system
US9247363B2 (en) 2013-04-16 2016-01-26 Sonos, Inc. Playback queue transfer in a media playback system
US9361371B2 (en) 2013-04-16 2016-06-07 Sonos, Inc. Playlist update in a media playback system
US9123330B1 (en) * 2013-05-01 2015-09-01 Google Inc. Large-scale speaker identification
US9658994B2 (en) 2013-05-20 2017-05-23 Google Inc. Rendering supplemental information concerning a scheduled event based on an identified entity in media content
US9684484B2 (en) * 2013-05-29 2017-06-20 Sonos, Inc. Playback zone silent connect
US20140365299A1 (en) * 2013-06-07 2014-12-11 Open Tv, Inc. System and method for providing advertising consistency
US9317486B1 (en) 2013-06-07 2016-04-19 Audible, Inc. Synchronizing playback of digital content with captured physical content
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
US11218434B2 (en) 2013-06-12 2022-01-04 Google Llc Audio data packet status determination
KR102107678B1 (en) * 2013-07-03 2020-05-28 삼성전자주식회사 Server for providing media information, apparatus, method and computer readable recording medium for searching media information related to media contents
US9693030B2 (en) 2013-09-09 2017-06-27 Arris Enterprises Llc Generating alerts based upon detector outputs
US9508381B2 (en) * 2013-09-10 2016-11-29 Verizon Patent And Licensing Inc. DVR schedule collaboration methods and systems
US10623821B2 (en) 2013-09-10 2020-04-14 Tivo Solutions Inc. Method and apparatus for creating and sharing customized multimedia segments
KR20150033827A (en) * 2013-09-24 2015-04-02 삼성전자주식회사 Image display apparatus, server, and method for operating the same
US9094284B1 (en) 2013-10-02 2015-07-28 Tribune Broadcasting Company, Llc System and method for transmitting a packet stream to a device
CN103501449A (en) * 2013-10-08 2014-01-08 十分(北京)信息科技有限公司 Method and device for recommending video source associated with television program
JP6252100B2 (en) * 2013-10-24 2017-12-27 セイコーエプソン株式会社 Print server and printing system
US20150120648A1 (en) * 2013-10-26 2015-04-30 Zoom International S.R.O Context-aware augmented media
KR20150069355A (en) * 2013-12-13 2015-06-23 엘지전자 주식회사 Display device and method for controlling the same
US9311639B2 (en) 2014-02-11 2016-04-12 Digimarc Corporation Methods, apparatus and arrangements for device to device communication
KR20150106299A (en) * 2014-03-11 2015-09-21 주식회사 사운들리 System, method and recordable medium for providing related contents at low power
US10587693B2 (en) 2014-04-01 2020-03-10 Sonos, Inc. Mirrored queues
WO2015171835A1 (en) 2014-05-06 2015-11-12 Tivo Inc. Cloud-based media content management
US10003858B2 (en) 2014-05-09 2018-06-19 DISH Technologies L.L.C. Provisioning commercial-free media content
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US9966065B2 (en) 2014-05-30 2018-05-08 Apple Inc. Multi-command single utterance input method
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US9930375B2 (en) * 2014-06-16 2018-03-27 Nexidia Inc. Media asset management
US9934453B2 (en) * 2014-06-19 2018-04-03 Bae Systems Information And Electronic Systems Integration Inc. Multi-source multi-modal activity recognition in aerial video surveillance
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US9552587B2 (en) * 2014-07-11 2017-01-24 Sensoriant, Inc. System and method for mediating representations with respect to preferences of a party not located in the environment
WO2016028813A1 (en) * 2014-08-18 2016-02-25 Groopic, Inc. Dynamically targeted ad augmentation in video
US10602236B2 (en) 2014-09-17 2020-03-24 Ispot.Tv, Inc. Unique content sequence identification method and apparatus
JP2016061970A (en) * 2014-09-18 2016-04-25 株式会社東芝 Speech dialog device, method, and program
KR20160044954A (en) * 2014-10-16 2016-04-26 삼성전자주식회사 Method for providing information and electronic device implementing the same
WO2016068995A1 (en) * 2014-10-31 2016-05-06 Hewlett-Packard Development Company, L.P. Controlled content delivery
CN105763884A (en) * 2014-12-18 2016-07-13 广州市动景计算机科技有限公司 Video processing method, device and apparatus
US9922037B2 (en) 2015-01-30 2018-03-20 Splunk Inc. Index time, delimiter based extractions and previewing for use in indexing
US9723367B1 (en) * 2015-02-22 2017-08-01 Google Inc. Identifying content appropriate for children via a blend of algorithmic content curation and human review
US10175999B2 (en) * 2015-02-25 2019-01-08 Salesforce.Com, Inc. Converting video into a walkthrough for an application or an online service
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US10750236B2 (en) 2015-04-23 2020-08-18 The Nielsen Company (Us), Llc Automatic content recognition with local matching
US9819632B2 (en) * 2015-04-30 2017-11-14 Larry Scott Marso System and method for remotely directed filtering and sorting of near real-time audio or video messages
US10460227B2 (en) 2015-05-15 2019-10-29 Apple Inc. Virtual assistant in a communication session
US10200824B2 (en) 2015-05-27 2019-02-05 Apple Inc. Systems and methods for proactively identifying and surfacing relevant content on a touch-sensitive device
KR101674301B1 (en) * 2015-06-22 2016-11-08 케이티하이텔 주식회사 Advertising method using overlay sound personalised for two-way television
US20160378747A1 (en) * 2015-06-29 2016-12-29 Apple Inc. Virtual assistant for media playback
JP6763019B2 (en) * 2015-07-16 2020-09-30 インスケイプ データ インコーポレイテッド Systems and methods for partitioning search indexes to improve media segment identification efficiency
JP6896724B2 (en) * 2015-07-16 2021-06-30 インスケイプ データ インコーポレイテッド Systems and methods to improve workload management in ACR television monitoring systems
US9743138B2 (en) 2015-07-31 2017-08-22 Mutr Llc Method for sound recognition task trigger
US10740384B2 (en) 2015-09-08 2020-08-11 Apple Inc. Intelligent automated assistant for media search and playback
US10331312B2 (en) 2015-09-08 2019-06-25 Apple Inc. Intelligent automated assistant in a media environment
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
CN106548120B (en) * 2015-09-23 2020-11-06 北京丰源星际传媒科技有限公司 Cinema viewing atmosphere acquisition statistical method and system
US9848214B2 (en) 2015-10-01 2017-12-19 Sorenson Media, Inc. Sequentially overlaying media content
US9813781B2 (en) 2015-10-27 2017-11-07 Sorenson Media, Inc. Media content matching and indexing
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10956666B2 (en) 2015-11-09 2021-03-23 Apple Inc. Unconventional virtual assistant interactions
CN106973322A (en) * 2015-12-09 2017-07-21 财团法人工业技术研究院 Across the screen synch apparatus and method of content of multimedia and playing device and servomechanism
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
CN105759958A (en) * 2016-01-27 2016-07-13 中国人民解放军信息工程大学 Data interaction system and method
US10044710B2 (en) 2016-02-22 2018-08-07 Bpip Limited Liability Company Device and method for validating a user using an intelligent voice print
US10063918B2 (en) 2016-02-29 2018-08-28 Gracenote, Inc. Media channel identification with multi-match detection and disambiguation based on single-match
WO2017151443A1 (en) 2016-02-29 2017-09-08 Myteamcalls Llc Systems and methods for customized live-streaming commentary
US9924222B2 (en) 2016-02-29 2018-03-20 Gracenote, Inc. Media channel identification with multi-match detection and disambiguation based on location
US9930406B2 (en) 2016-02-29 2018-03-27 Gracenote, Inc. Media channel identification with video multi-match detection and disambiguation based on audio fingerprint
US10530714B2 (en) * 2016-02-29 2020-01-07 Oracle International Corporation Conditional automatic social posts
US20170257679A1 (en) 2016-03-01 2017-09-07 Tivo Solutions Inc. Multi-audio annotation
US10681059B2 (en) 2016-05-25 2020-06-09 CyberOwl Limited Relating to the monitoring of network security
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
US10438266B1 (en) * 2016-07-01 2019-10-08 Amazon Technologies, Inc. Server-based feature detection and generation of graphical representation of feature distinctions
US10609442B2 (en) 2016-07-20 2020-03-31 Art Research And Technology, L.L.C. Method and apparatus for generating and annotating virtual clips associated with a playable media file
JP6635381B2 (en) * 2016-07-22 2020-01-22 サイレックス・テクノロジー株式会社 Playback device, playback instruction device, playback system, playback device control method, playback instruction device control method, and playback system control method
US20180048940A1 (en) * 2016-08-15 2018-02-15 Rovi Guides, Inc. Systems and methods for using a home security system to alert a user about a media event
US10861045B2 (en) 2016-09-07 2020-12-08 Tivo Solutions Inc. Automatically labeling clusters of media content consumers
US10650621B1 (en) 2016-09-13 2020-05-12 Iocurrents, Inc. Interfacing with a vehicular controller area network
US10079871B2 (en) 2016-10-10 2018-09-18 Google Llc Customizing media items for playback on alternative playback devices paired with a user device
US10531227B2 (en) 2016-10-19 2020-01-07 Google Llc Time-delimited action suggestion system
US9961378B1 (en) 2016-10-25 2018-05-01 Rovi Guides, Inc. Systems and methods for causing a user to view secondary content that relates to a media asset from which a user has switched away
US10075767B2 (en) * 2016-12-12 2018-09-11 Facebook, Inc. Broadcast content view analysis based on ambient audio recording
EP3343483A1 (en) 2016-12-30 2018-07-04 Spotify AB System and method for providing a video with lyrics overlay for use in a social messaging environment
US10701438B2 (en) 2016-12-31 2020-06-30 Turner Broadcasting System, Inc. Automatic content recognition and verification in a broadcast chain
US10560419B2 (en) 2017-01-07 2020-02-11 International Business Machines Corporation Message presentation management in a social networking environment
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
US10979778B2 (en) 2017-02-01 2021-04-13 Rovi Guides, Inc. Systems and methods for selecting type of secondary content to present to a specific subset of viewers of a media asset
US9918135B1 (en) 2017-02-07 2018-03-13 The Directv Group, Inc. Single button selection to facilitate actions in a communications network
WO2018156130A1 (en) 2017-02-23 2018-08-30 Sensoriant, Inc. System and methods for modulating dissemination of content to mobile devices and robots
WO2018183430A1 (en) 2017-03-29 2018-10-04 Sorenson Media, Inc. Interactive overlays to determine viewer data
EP3603079A1 (en) 2017-03-29 2020-02-05 The Nielsen Company (US), LLC. Targeted content placement using overlays
CN110546932B (en) * 2017-04-06 2022-06-10 构造数据有限责任公司 System and method for improving device map accuracy using media viewing data
US10726832B2 (en) 2017-05-11 2020-07-28 Apple Inc. Maintaining privacy of personal information
DK179745B1 (en) 2017-05-12 2019-05-01 Apple Inc. SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
DK201770427A1 (en) 2017-05-12 2018-12-20 Apple Inc. Low-latency intelligent automated assistant
US20180336892A1 (en) 2017-05-16 2018-11-22 Apple Inc. Detecting a trigger of a digital assistant
US10303715B2 (en) 2017-05-16 2019-05-28 Apple Inc. Intelligent automated assistant for media exploration
US10396990B2 (en) 2017-05-22 2019-08-27 Rapid7, Inc. Verifying asset identity
US11134279B1 (en) 2017-07-27 2021-09-28 Amazon Technologies, Inc. Validation of media using fingerprinting
US10536757B2 (en) 2017-08-17 2020-01-14 The Nielsen Company (Us), Llc Methods and apparatus to synthesize reference media signatures
US11234060B2 (en) 2017-09-01 2022-01-25 Roku, Inc. Weave streaming content into a linear viewing experience
US11418858B2 (en) 2017-09-01 2022-08-16 Roku, Inc. Interactive content when the secondary content is server stitched
US10997620B2 (en) * 2017-09-18 2021-05-04 Vertigo Studios, Llc Blockchain-enabled system for controlling advertiser access to personal user data
US20190208236A1 (en) * 2018-01-02 2019-07-04 Source Digital, Inc. Coordinates as ancillary data
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
CN110324552A (en) * 2018-03-29 2019-10-11 沈阳美行科技有限公司 Grasping means, grasp shoot method, relevant apparatus equipment and the system of audio, video data
WO2019191708A1 (en) 2018-03-30 2019-10-03 Realnetworks, Inc. Socially annotated audiovisual content
US10928918B2 (en) 2018-05-07 2021-02-23 Apple Inc. Raise to speak
US11145294B2 (en) 2018-05-07 2021-10-12 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US10892996B2 (en) 2018-06-01 2021-01-12 Apple Inc. Variable latency device coordination
DK180639B1 (en) 2018-06-01 2021-11-04 Apple Inc DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT
DK179822B1 (en) 2018-06-01 2019-07-12 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US11550951B2 (en) 2018-09-18 2023-01-10 Inspired Patents, Llc Interoperable digital social recorder of multi-threaded smart routed media
US11475898B2 (en) 2018-10-26 2022-10-18 Apple Inc. Low-latency multi-speaker speech recognition
US10972799B2 (en) 2018-12-16 2021-04-06 The Nielsen Company (Us), Llc Media presentation device with voice command feature
US11670202B2 (en) 2019-01-24 2023-06-06 Outdoorlink, Inc. Systems and methods for monitoring electronic displays
US10965937B2 (en) 2019-01-24 2021-03-30 Outdoorlink, Inc. Systems and methods for monitoring electronic displays
US10743041B1 (en) 2019-01-31 2020-08-11 DISH Technologies L.L.C. Systems and methods for facilitating adaptive content splicing
GB2580937B (en) * 2019-01-31 2022-07-13 Sony Interactive Entertainment Europe Ltd Method and system for generating audio-visual content from video game footage
US10795531B2 (en) * 2019-02-01 2020-10-06 Adp, Llc Interface synchronization system and method
JP7397461B2 (en) 2019-03-06 2023-12-13 ドリームメーカー株式会社 Advertisement provision device, advertisement reproduction device, advertisement provision system, advertisement provision method and program
FR3093607A1 (en) * 2019-03-08 2020-09-11 Orange Audiovisual content restitution process
US11475884B2 (en) 2019-05-06 2022-10-18 Apple Inc. Reducing digital assistant latency when a language is incorrectly determined
US11423908B2 (en) 2019-05-06 2022-08-23 Apple Inc. Interpreting spoken requests
US11217251B2 (en) 2019-05-06 2022-01-04 Apple Inc. Spoken notifications
US11153648B2 (en) * 2019-05-10 2021-10-19 Roku, Inc. Content-modification system with transmission delay-based feature
US11140099B2 (en) 2019-05-21 2021-10-05 Apple Inc. Providing message response suggestions
US11289073B2 (en) 2019-05-31 2022-03-29 Apple Inc. Device text to speech
DK201970510A1 (en) 2019-05-31 2021-02-11 Apple Inc Voice identification in digital assistant systems
DK180129B1 (en) 2019-05-31 2020-06-02 Apple Inc. User activity shortcut suggestions
US11496600B2 (en) 2019-05-31 2022-11-08 Apple Inc. Remote execution of machine-learned models
US11360641B2 (en) 2019-06-01 2022-06-14 Apple Inc. Increasing the relevance of new available information
JP7403115B2 (en) * 2019-07-10 2023-12-22 株式会社 インターコム Video transmission device, application program and video transmission method
WO2021056255A1 (en) 2019-09-25 2021-04-01 Apple Inc. Text detection using global geometry estimators
US10880351B1 (en) 2019-10-16 2020-12-29 Dish Network L.L.C. Systems and methods for adapting content items to endpoint media devices
CN110996121A (en) * 2019-12-11 2020-04-10 北京市商汤科技开发有限公司 Information processing method and device, electronic equipment and storage medium
CA3170253A1 (en) * 2020-03-06 2021-09-10 Robert B. HUBBARD System and method for distributing multimedia content
US20210321169A1 (en) * 2020-04-10 2021-10-14 Sony Corporation Smart glasses closed captioning
US11108721B1 (en) 2020-04-21 2021-08-31 David Roberts Systems and methods for media content communication
US11012737B1 (en) * 2020-04-27 2021-05-18 Dish Network L.L.C. Systems and methods for audio adaptation of content items to endpoint media devices
US11043220B1 (en) 2020-05-11 2021-06-22 Apple Inc. Digital assistant hardware abstraction
US11810578B2 (en) 2020-05-11 2023-11-07 Apple Inc. Device arbitration for digital assistant-based intercom systems
US11392347B2 (en) * 2020-06-17 2022-07-19 Twitter, Inc. Audio messaging interface on messaging platform
US11652860B2 (en) * 2020-09-01 2023-05-16 Yahoo Assets Llc Synchronization of streaming content using live edge offsets
AU2021357055A1 (en) * 2020-10-06 2023-05-25 Arris Enterprises Llc System and method for audio control of concurrently displayed video programs
EP4133739A1 (en) * 2021-04-22 2023-02-15 Tappcelerator Media, S.L. Dynamically customizing media content
US11762934B2 (en) 2021-05-11 2023-09-19 Oracle International Corporation Target web and social media messaging based on event signals
US11516522B1 (en) * 2021-07-02 2022-11-29 Alphonso Inc. System and method for identifying potential commercial breaks in a video data stream by detecting absence of identified persons associated with program type content in the video data stream
TWI808456B (en) * 2021-07-30 2023-07-11 端點科技股份有限公司 Advertisement playing method, device and computer readable storage medium
ES1300408Y (en) * 2022-06-15 2023-08-30 Isart Josep Oriol Roca Ad replacement device

Citations (104)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4750213A (en) * 1986-06-09 1988-06-07 Novak Albert P Method and system for editing unwanted program material from broadcast signals
US5343251A (en) * 1993-05-13 1994-08-30 Pareto Partners, Inc. Method and apparatus for classifying patterns of television programs and commercials based on discerning of broadcast audio and video signals
US5504518A (en) * 1992-04-30 1996-04-02 The Arbitron Company Method and system for recognition of broadcast segments
US5668917A (en) * 1994-07-05 1997-09-16 Lewine; Donald A. Apparatus and method for detection of unwanted broadcast information
US5748263A (en) * 1995-03-07 1998-05-05 Ball; Bradley E. System for automatically producing infrared control signals
US5956455A (en) * 1990-12-20 1999-09-21 Rca Thomson Licensing Corporation Fault tolerant VCR recording control
US20010017667A1 (en) * 1998-04-03 2001-08-30 Frink Craig R. HDTV editing and effects previsualization using SDTV devices
US20010023431A1 (en) * 2000-01-18 2001-09-20 Mari Horiguchi Information processing device, information processing method and medium
US20020037104A1 (en) * 2000-09-22 2002-03-28 Myers Gregory K. Method and apparatus for portably recognizing text in an image sequence of scene imagery
US6404977B1 (en) * 1996-11-01 2002-06-11 Jerry Iggulden Method and apparatus for controlling a videotape recorder in real-time to automatically identify and selectively skip segments of a television broadcast signal during recording of the television signal
US20020099774A1 (en) * 2001-01-22 2002-07-25 Nec Corporation Information reproducing method and information reproducing system
US20020099552A1 (en) * 2001-01-25 2002-07-25 Darryl Rubin Annotating electronic information with audio clips
US20020124252A1 (en) * 2001-03-02 2002-09-05 Schaefer Scott R. Method and system to provide information alerts via an interactive video casting system
US20020152117A1 (en) * 2001-04-12 2002-10-17 Mike Cristofalo System and method for targeting object oriented audio and video content to users
US6469749B1 (en) * 1999-10-13 2002-10-22 Koninklijke Philips Electronics N.V. Automatic signature-based spotting, learning and extracting of commercials and other video content
US20030093806A1 (en) * 2001-11-14 2003-05-15 Vincent Dureau Remote re-creation of data in a television system
US20030093580A1 (en) * 2001-11-09 2003-05-15 Koninklijke Philips Electronics N.V. Method and system for information alerts
US20030095791A1 (en) * 2000-03-02 2003-05-22 Barton James M. System and method for internet access to a personal television service
US20030114145A1 (en) * 2001-12-17 2003-06-19 Nokia Corporation Initiating a wireless connection to a broadcast program
US20030163823A1 (en) * 1999-01-27 2003-08-28 Gotuit Media, Inc. Radio receiving, recording and playback system
US20030177503A1 (en) * 2000-07-24 2003-09-18 Sanghoon Sull Method and apparatus for fast metadata generation, delivery and access for live broadcast program
US6633651B1 (en) * 1997-02-06 2003-10-14 March Networks Corporation Method and apparatus for recognizing video sequences
US20030195851A1 (en) * 2002-04-11 2003-10-16 Ong Lance D. System for managing distribution of digital audio content
US6636688B1 (en) * 1998-05-13 2003-10-21 Sanyo Electric Co., Ltd. Video recording device
US20040059570A1 (en) * 2002-09-24 2004-03-25 Kazuhiro Mochinaga Feature quantity extracting apparatus
US6725250B1 (en) * 1996-11-29 2004-04-20 Ellis, Iii Frampton E. Global network computers
US20040078817A1 (en) * 2002-05-14 2004-04-22 Steven Horowitz Dynamic program events recording
US20040143349A1 (en) * 2002-10-28 2004-07-22 Gracenote, Inc. Personal audio recording system
US6771885B1 (en) * 2000-02-07 2004-08-03 Koninklijke Philips Electronics N.V. Methods and apparatus for recording programs prior to or beyond a preset recording time period
US6771316B1 (en) * 1996-11-01 2004-08-03 Jerry Iggulden Method and apparatus for selectively altering a televised video signal in real-time
US20050022251A1 (en) * 2002-07-30 2005-01-27 Kensuke Ohnuma Information processing system, information processing device and method, recording medium, and program
US20050028161A1 (en) * 2003-07-17 2005-02-03 Yukio Numakami Data-processing device, system thereof, method thereof, program thereof, and recording medium storing the program
US20050044561A1 (en) * 2003-08-20 2005-02-24 Gotuit Audio, Inc. Methods and apparatus for identifying program segments by detecting duplicate signal patterns
US20050149987A1 (en) * 2003-12-24 2005-07-07 Gilles Boccon-Gibod Television viewing communities
US20050154637A1 (en) * 2004-01-09 2005-07-14 Rahul Nair Generating and displaying level-of-interest values
US20050172312A1 (en) * 2003-03-07 2005-08-04 Lienhart Rainer W. Detecting known video entities utilizing fingerprints
US20050239545A1 (en) * 2003-07-14 2005-10-27 Bruce Rowe Programmatic control of gaming devices
US20060015609A1 (en) * 2004-07-15 2006-01-19 International Business Machines Corporation Automatically infering and updating an availability status of a user
US20060023849A1 (en) * 2004-07-30 2006-02-02 Timmins Timothy A Personalized voice applications in an information assistance service
US20060036688A1 (en) * 2004-08-12 2006-02-16 International Business Machines Corporation Method and system for managing interrupts in an instant messaging application
US20060064721A1 (en) * 2004-03-10 2006-03-23 Techfoundries, Inc. Method and apparatus for implementing a synchronized electronic program guide application
US20060074658A1 (en) * 2004-10-01 2006-04-06 Siemens Information And Communication Mobile, Llc Systems and methods for hands-free voice-activated devices
US20060116885A1 (en) * 2004-11-30 2006-06-01 Shostak Robert E System and method for improving recognition accuracy in speech recognition applications
US7061544B1 (en) * 1997-02-25 2006-06-13 Sanyo Electric Co., Ltd. Digital television receiver for receiving a digital television broadcast signal and simultaneously displaying a video picture and information contained therein
US7080392B1 (en) * 1991-12-02 2006-07-18 David Michael Geshwind Process and device for multi-level television program abstraction
US20060174277A1 (en) * 2004-03-04 2006-08-03 Sezan M I Networked video devices
US20060195859A1 (en) * 2005-02-25 2006-08-31 Richard Konig Detecting known video entities taking into account regions of disinterest
US20060230422A1 (en) * 1999-11-24 2006-10-12 David Kunin Method and apparatus for Internet TV
US20060239642A1 (en) * 2005-04-20 2006-10-26 Sony Corporation Communication system, recording apparatus and method, recording medium, and program
US20070001806A1 (en) * 2003-04-24 2007-01-04 Koninklijke Philips Electronics N.V. Alert filtering
US7170566B2 (en) * 2001-12-21 2007-01-30 Koninklijke Philips Electronics N.V. Family histogram based techniques for detection of commercials and other video content
US7171108B1 (en) * 2001-07-31 2007-01-30 Keen Personal Media, Inc. Audiovisual system to interrupt viewing of a first audiovisual program to provide notification of a second audiovisual program of interest to the user
US20070112939A1 (en) * 2005-11-17 2007-05-17 Sbc Knowledge Ventures L.P. System and method for home automation
US20070136744A1 (en) * 2003-09-22 2007-06-14 Koninklijke Philips Electronics N.V. System, device and method for collaborative zapping
US20070143778A1 (en) * 2005-11-29 2007-06-21 Google Inc. Determining Popularity Ratings Using Social and Interactive Applications for Mass Media
US20070140187A1 (en) * 2005-12-15 2007-06-21 Rokusek Daniel S System and method for handling simultaneous interaction of multiple wireless devices in a vehicle
US20070169155A1 (en) * 2006-01-17 2007-07-19 Thad Pasquale Method and system for integrating smart tags into a video data service
US20070186242A1 (en) * 2006-02-03 2007-08-09 Price James D Iii Personal content recorder suggestion and subscription
US20070192410A1 (en) * 2000-12-18 2007-08-16 Nortel Networks Limited Method and system for automatic handling of invitations to join communications sessions in a virtual team environment
US20070245243A1 (en) * 2006-03-28 2007-10-18 Michael Lanza Embedded metadata in a media presentation
US20070250716A1 (en) * 2000-05-02 2007-10-25 Brunk Hugh L Fingerprinting of Media Signals
US20080037151A1 (en) * 2004-04-06 2008-02-14 Matsushita Electric Industrial Co., Ltd. Audio Reproducing Apparatus, Audio Reproducing Method, and Program
US20080170836A1 (en) * 2007-01-12 2008-07-17 Sony Corporation Network system, terminal apparatus, recording apparatus, method of displaying record scheduling state, computer program for terminal apparatus, computer program for recording apparatus
US20080177752A1 (en) * 2007-01-19 2008-07-24 Samsung Electronics Co., Ltd. method of interactive video blogging
US20080175566A1 (en) * 2003-10-01 2008-07-24 Music Gremlin, Inc. Audio visual player apparatus and system and method of content distribution using the same
US20080184326A1 (en) * 2006-10-19 2008-07-31 Satoshi Nakajima Community and/or chat-based content recording and consumption
US20080235283A1 (en) * 2007-03-21 2008-09-25 The Regents Of The University Of California Generating audio annotations for search and retrieval
US20080306826A1 (en) * 2006-01-30 2008-12-11 Hoozware, Inc. System for Providing a Service to Venues Where People Aggregate
US7477739B2 (en) * 2002-02-05 2009-01-13 Gracenote, Inc. Efficient storage of fingerprints
US20090017792A1 (en) * 2004-05-12 2009-01-15 Fumiaki Matsumoto Mobile telephone having broadcast reception function
US20090021646A1 (en) * 2007-07-20 2009-01-22 Samsung Electronics Co., Ltd. Method and system for communication of uncompressed video information in wireless systems
US7486875B2 (en) * 2003-12-04 2009-02-03 Hitachi, Ltd. Method of recording multiple programs over a specified time period in separate program data files
US20090083742A1 (en) * 2007-09-25 2009-03-26 Microsoft Corporation Interruptability management via scheduling application
US20090088207A1 (en) * 2007-09-28 2009-04-02 Embarq Holdings Company Llc System and method for a wireless ringer function
US20090100469A1 (en) * 2007-10-15 2009-04-16 Microsoft Corporation Recommendations from Social Networks
US20090103893A1 (en) * 2005-05-17 2009-04-23 Mitsubishi Electric Corporation Recording Schedule Sharing System and Recording Schedule Sharing Apparatus
US20090124214A1 (en) * 2004-10-04 2009-05-14 Qualcomm Incorporated Remote front-end for a multi-antenna station
US20090133070A1 (en) * 2007-11-21 2009-05-21 United Video Properties, Inc. Enabling a friend to remotely modify user data
US20090144769A1 (en) * 2005-11-03 2009-06-04 Thomson Licensing Digital Video Recording Device and Method
US20090172108A1 (en) * 2007-12-28 2009-07-02 Surgo Systems and methods for a telephone-accessible message communication system
US20090169178A1 (en) * 2007-12-28 2009-07-02 Echostar Technologies Corporation Apparatus, system and method for storing and presenting to a user different types of content regarding a subject
US20090207979A1 (en) * 2008-02-19 2009-08-20 Charles Mark Russell System and method for recording and evaluating communication
US20090216847A1 (en) * 2007-11-14 2009-08-27 Qualcomm Incorporated Method and system for message value calculation in a mobile environment
US20090259690A1 (en) * 2004-12-30 2009-10-15 All Media Guide, Llc Methods and apparatus for audio recognitiion
US20090259499A1 (en) * 2008-04-09 2009-10-15 Sudhir Bhojwani Method and system employing a mobile device for soliciting user experience sharing
US20100023553A1 (en) * 2008-07-22 2010-01-28 At&T Labs System and method for rich media annotation
US20100040342A1 (en) * 2007-03-31 2010-02-18 Sony Deutschland Gmbh Method for determining a point in time within an audio signal
US20100111269A1 (en) * 2008-10-30 2010-05-06 Embarq Holdings Company, Llc System and method for voice activated provisioning of telecommunication services
US20100150321A1 (en) * 2008-12-15 2010-06-17 Embarg Holdings Company, Llc System and method for voice activated dialing from a home phone
US7774407B2 (en) * 2006-05-09 2010-08-10 International Business Machines Corporation Postponing an instant messaging session
US20100212001A1 (en) * 2009-02-13 2010-08-19 Samsung Electronics Co., Ltd. System and method for user login to a multimedia system using a remote control
US7805055B2 (en) * 2004-04-20 2010-09-28 Sony Computer Entertainment Inc. Recorder
US20100257052A1 (en) * 2004-08-31 2010-10-07 Integrated Media Measurement, Inc. Detecting and Measuring Exposure To Media Content Items
US7818771B2 (en) * 2004-11-23 2010-10-19 Palo Alto Research Center Incorporated Methods, apparatus, and program products for controlling presentation of an experiential data stream responsive to conversations in a shared social space
US20110041153A1 (en) * 2008-01-03 2011-02-17 Colin Simon Content management and delivery method, system and apparatus
US20110085781A1 (en) * 2009-10-13 2011-04-14 Rovi Technologies Corporation Content recorder timing alignment
US7930714B2 (en) * 2003-03-07 2011-04-19 Technology, Patents & Licensing, Inc. Video detection and insertion
US20110135283A1 (en) * 2009-12-04 2011-06-09 Bob Poniatowki Multifunction Multimedia Device
US7984473B1 (en) * 2000-06-14 2011-07-19 International Business Machines Corporation System and method for the coordination of short-term cyclic data and ephemeral content in a broadcast stream
US8156520B2 (en) * 2008-05-30 2012-04-10 EchoStar Technologies, L.L.C. Methods and apparatus for presenting substitute content in an audio/video stream using text data
US8233601B2 (en) * 2006-12-14 2012-07-31 Voxp Pte. Ltd. Interrupt payment system
US8364703B2 (en) * 2009-06-10 2013-01-29 Zeitera, Llc Media fingerprinting and identification system
US8370765B2 (en) * 2004-10-18 2013-02-05 Martin Derek P Computer system and method for inhibiting interruption of a user that is actively using the computer system
US20130223816A1 (en) * 2009-09-14 2013-08-29 Tivo Inc. Multifunction multimedia device

Family Cites Families (196)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4420769A (en) * 1978-03-22 1983-12-13 Novak Albert P Device for the automatic editing, at the receiver, of unwanted program material from broadcast electrical signals
US4230990C1 (en) 1979-03-16 2002-04-09 John G Lert Jr Broadcast program identification method and system
US5469207A (en) 1989-12-06 1995-11-21 British Broadcasting Corporation Method of labelling a broadcast signal including transmitting a sequence of program labels
US5228080A (en) 1990-06-25 1993-07-13 Colonial Data Technologies Corp. Method and apparatus for processing an incoming telephone call signal which may include a data message
JP3143135B2 (en) 1991-04-22 2001-03-07 三洋電機株式会社 Audio / video system
JPH0556386A (en) 1991-08-21 1993-03-05 Smk Corp Automatic video recording method for designated broadcasting program and automatic video recording control device
JP2540981Y2 (en) 1991-12-30 1997-07-09 株式会社クラレ Fiber bundle cutting device
JPH05260082A (en) 1992-03-13 1993-10-08 Toshiba Corp Text reader
SG48389A1 (en) 1993-06-03 1998-04-17 Thomson Multimedia Sa Method for programming a recording device and programming device
US5689641A (en) 1993-10-01 1997-11-18 Vicor, Inc. Multimedia collaboration system arrangement for routing compressed AV signal through a participant site without decompressing the AV signal
US5481294A (en) 1993-10-27 1996-01-02 A. C. Nielsen Company Audience measurement system utilizing ancillary codes and passive signatures
US7289643B2 (en) * 2000-12-21 2007-10-30 Digimarc Corporation Method, apparatus and programs for generating and utilizing content signatures
US20030093790A1 (en) 2000-03-28 2003-05-15 Logan James D. Audio and video program recording, editing and playback systems using metadata
US7269330B1 (en) 1996-11-01 2007-09-11 Televentions, Llc Method and apparatus for controlling a video recorder/player to selectively alter a video signal
US6167428A (en) 1996-11-29 2000-12-26 Ellis; Frampton E. Personal computer microprocessor firewalls for internet distributed processing
WO1999045702A1 (en) 1998-03-04 1999-09-10 United Video Properties, Inc. Program guide system with targeted advertising
US6243145B1 (en) 1998-05-01 2001-06-05 Scientific-Atlanta, Inc. Method and apparatus for browsing television channel information by category
JP3113632B2 (en) 1998-05-13 2000-12-04 三洋電機株式会社 Recording device
TW447221B (en) 1998-08-26 2001-07-21 United Video Properties Inc Television message system
TW463503B (en) 1998-08-26 2001-11-11 United Video Properties Inc Television chat system
US6317784B1 (en) 1998-09-29 2001-11-13 Radiowave.Com, Inc. Presenting supplemental information for material currently and previously broadcast by a radio station
US6243445B1 (en) * 1998-11-03 2001-06-05 At&T Corporation Method and apparatus for telephone data network access
US5956566A (en) 1998-12-17 1999-09-21 Taiwan Semiconductor Manufacturing Company, Ltd. Method and test site to monitor alignment shift and buried contact trench formation
US6282713B1 (en) 1998-12-21 2001-08-28 Sony Corporation Method and apparatus for providing on-demand electronic advertising
US6731788B1 (en) 1999-01-28 2004-05-04 Koninklijke Philips Electronics N.V. Symbol Classification with shape features applied to neural network
EP1197072B1 (en) 1999-03-30 2010-12-15 TiVo, Inc. Television viewer interface system
US6393412B1 (en) * 1999-09-23 2002-05-21 Peter Deep Method for allowing users to purchase professional services in a private chat room through a service brokerage via the internet
GB9922765D0 (en) 1999-09-28 1999-11-24 Koninkl Philips Electronics Nv Television
US6807574B1 (en) 1999-10-22 2004-10-19 Tellme Networks, Inc. Method and apparatus for content personalization over a telephone interface
US6593976B1 (en) 2000-02-14 2003-07-15 Koninklijke Philips Electronics N.V. Automatic return to input source when user-selected content reappears in input source
US6834308B1 (en) 2000-02-17 2004-12-21 Audible Magic Corporation Method and apparatus for identifying media content presented on a media playing device
US8910199B2 (en) 2000-02-25 2014-12-09 Interval Licensing Llc Targeted television content display
US6963897B1 (en) 2000-03-30 2005-11-08 United Devices, Inc. Customer services and advertising based upon device attributes and associated distributed processing system
JP2001285787A (en) 2000-03-31 2001-10-12 Nec Corp Video recording method, system therefor and recording medium therefor
US7096185B2 (en) 2000-03-31 2006-08-22 United Video Properties, Inc. User speech interfaces for interactive media guidance applications
US8006261B1 (en) 2000-04-07 2011-08-23 Visible World, Inc. System and method for personalized message creation and delivery
US8875198B1 (en) 2001-08-19 2014-10-28 The Directv Group, Inc. Network video unit
US6795530B1 (en) 2000-06-29 2004-09-21 Lanny Gilbert System and method for customized telephone greeting annoucements
US7822815B1 (en) 2000-08-07 2010-10-26 Cisco Technology, Inc. Unified messaging feature that plays greetings based on the received calling party number
JP3869639B2 (en) 2000-08-29 2007-01-17 株式会社日立製作所 Mobile phone terminal
GB0029861D0 (en) 2000-12-07 2001-01-24 Sony Uk Ltd Replaying video information
US7076270B2 (en) 2001-02-28 2006-07-11 Dell Products L.P. Docking station for wireless communication device
JP3832567B2 (en) 2001-03-07 2006-10-11 日本電気株式会社 Program recording apparatus and method
EP1380159A4 (en) 2001-04-20 2008-01-09 France Telecom Res And Dev L L Systems for selectively associating cues with stored video frames and methods of operating the same
EP1265439B1 (en) 2001-06-06 2009-07-08 Thomson Licensing Video signal processing system with auxiliary information processing capability
US20020188945A1 (en) 2001-06-06 2002-12-12 Mcgee Tom Enhanced EPG to find program start and segments
US8032909B2 (en) 2001-07-05 2011-10-04 Digimarc Corporation Watermarking and electronic program guides
US20030018970A1 (en) 2001-07-19 2003-01-23 Digeo, Inc. Object representation of television programs within an interactive television system
US20060161947A1 (en) 2001-09-05 2006-07-20 Indra Laksono Method and apparatus for customizing messaging within a cable system
US20030105739A1 (en) * 2001-10-12 2003-06-05 Hassane Essafi Method and a system for identifying and verifying the content of multimedia documents
US7269338B2 (en) * 2001-12-11 2007-09-11 Koninklijke Philips Electronics N.V. Apparatus and method for synchronizing presentation from bit streams based on their content
US20030121057A1 (en) * 2001-12-20 2003-06-26 Koninklijke Philips Electronics N.V. Script-based method for unattended control and feature extensions of a TV or settop box device
US20030126600A1 (en) * 2001-12-27 2003-07-03 Koninklijke Philips Electronics N.V. Smart suggestions for upcoming TV programs
US20030126267A1 (en) * 2001-12-27 2003-07-03 Koninklijke Philips Electronics N.V. Method and apparatus for preventing access to inappropriate content over a network based on audio or visual content
US7302160B1 (en) 2002-01-22 2007-11-27 Lsi Corporation Audio/video recorder with automatic commercial advancement prevention
US8155498B2 (en) 2002-04-26 2012-04-10 The Directv Group, Inc. System and method for indexing commercials in a video presentation
JP2005528497A (en) * 2002-05-30 2005-09-22 チバ スペシャルティ ケミカルズ ホールディング インコーポレーテッド Stabilized article
US6996390B2 (en) 2002-06-26 2006-02-07 Microsoft Corporation Smart car radio
JP2004056394A (en) 2002-07-18 2004-02-19 Fujitsu Ltd Control apparatus for controlling capturing apparatus and storage apparatus via lan, capturing apparatus for the same, storage apparatus, program, and method
JP4085729B2 (en) 2002-07-23 2008-05-14 ソニー株式会社 Signal recording apparatus and method, program, and recording medium
US6944224B2 (en) 2002-08-14 2005-09-13 Intervideo, Inc. Systems and methods for selecting a macroblock mode in a video encoder
US20040043724A1 (en) 2002-09-03 2004-03-04 Weast John C. Automated continued recording in case of program overrun
JP4103521B2 (en) 2002-09-26 2008-06-18 船井電機株式会社 Recording apparatus, recording / reproducing apparatus, and recording method
US7222071B2 (en) 2002-09-27 2007-05-22 Arbitron Inc. Audio data receipt/exposure measurement with code monitoring and signature extraction
TWI282312B (en) * 2002-12-04 2007-06-11 Seiko Epson Corp Tape printer and its printing control method, program and memory medium
US7483835B2 (en) 2002-12-23 2009-01-27 Arbitron, Inc. AD detection using ID code and extracted signature
JP2004222014A (en) 2003-01-16 2004-08-05 Victor Co Of Japan Ltd Recording and reproducing system for video/audio data
US8332326B2 (en) 2003-02-01 2012-12-11 Audible Magic Corporation Method and apparatus to identify a work received by a processing system
JP2004264186A (en) 2003-03-03 2004-09-24 Omron Corp Radio wave detection sensor
US20050149968A1 (en) 2003-03-07 2005-07-07 Richard Konig Ending advertisement insertion
KR20060002942A (en) * 2003-03-28 2006-01-09 코닌클리즈케 필립스 일렉트로닉스 엔.브이. Data block detect by fingerprint
JP2004297685A (en) 2003-03-28 2004-10-21 Victor Co Of Japan Ltd Program reservation setting method and server device
CN1795678A (en) 2003-04-03 2006-06-28 塞德纳专利服务有限责任公司 Content notification and delivery
JP4258756B2 (en) 2003-04-18 2009-04-30 日本ビクター株式会社 Server device, program reservation information processing method, and program reservation information processing program
US20040220858A1 (en) 2003-05-02 2004-11-04 Maggio Frank S. Method and system for verifying exposure to message content delivered via subscription networks
US20040226035A1 (en) 2003-05-05 2004-11-11 Hauser David L. Method and apparatus for detecting media content
US20040250212A1 (en) 2003-05-20 2004-12-09 Fish Edmund J. User interface for presence and geographic location notification based on group identity
US6987560B2 (en) 2003-05-30 2006-01-17 The Boeing Company Inverse synthetic aperture radar-based covert system for human identification
US8351761B2 (en) 2003-06-06 2013-01-08 Harris Technology, Llc Commercial skipping standalone device
JP4403367B2 (en) * 2003-06-06 2010-01-27 ソニー株式会社 Recording reservation information transmitting apparatus and receiving apparatus, recording reservation information sharing system, and recording reservation information transmitting method and receiving method
US20040260682A1 (en) 2003-06-19 2004-12-23 Microsoft Corporation System and method for identifying content and managing information corresponding to objects in a signal
KR100493902B1 (en) 2003-08-28 2005-06-10 삼성전자주식회사 Method And System For Recommending Contents
US20050066366A1 (en) 2003-09-22 2005-03-24 Kouichi Takamine Receiving apparatus, method for displaying in conjunction with television program, and printing control method
JP2005110047A (en) 2003-09-30 2005-04-21 Toshiba Corp Management apparatus and recording apparatus
US7788696B2 (en) * 2003-10-15 2010-08-31 Microsoft Corporation Inferring information about media stream objects
US7043232B2 (en) * 2003-11-10 2006-05-09 Lucent Technologies Inc. Method and system for sending personalized outgoing voicemail/multimedia mail messages based on the caller ID
WO2005046237A1 (en) * 2003-11-10 2005-05-19 Koninklijke Philips Electronics, N.V. Providing additional information
US8732221B2 (en) * 2003-12-10 2014-05-20 Magix Software Gmbh System and method of multimedia content editing
US8196168B1 (en) 2003-12-10 2012-06-05 Time Warner, Inc. Method and apparatus for exchanging preferences for replaying a program on a personal video recorder
US7895625B1 (en) * 2003-12-24 2011-02-22 Time Warner, Inc. System and method for recommending programming to television viewing communities
JP4009959B2 (en) 2004-01-07 2007-11-21 船井電機株式会社 TV receiver
US20090102973A1 (en) * 2004-01-09 2009-04-23 Harris Scott C Video split device
US7340678B2 (en) * 2004-02-12 2008-03-04 Fuji Xerox Co., Ltd. Systems and methods for creating an interactive 3D visualization of indexed media
US8949899B2 (en) 2005-03-04 2015-02-03 Sharp Laboratories Of America, Inc. Collaborative recommendation system
CA2933668C (en) 2004-04-23 2019-01-08 The Nielsen Company (Us), Llc Methods and apparatus to maintain audience privacy while determining viewing of video-on-demand programs
WO2005114450A1 (en) 2004-05-14 2005-12-01 Nielsen Media Research, Inc. Methods and apparatus for identifying media content
JP4664283B2 (en) 2004-06-08 2011-04-06 パナソニック株式会社 Program selection support device
US7840980B2 (en) 2004-11-04 2010-11-23 Koninklijke Philips Electronics N.V. Incorporation of lead actor information for TV recommenders
US20060111917A1 (en) * 2004-11-19 2006-05-25 International Business Machines Corporation Method and system for transcribing speech on demand using a trascription portlet
US20060109854A1 (en) 2004-11-22 2006-05-25 Cancel Ramon C Systems and methods to share information between digital video recorders
JP4252030B2 (en) 2004-12-03 2009-04-08 シャープ株式会社 Storage device and computer-readable recording medium
US20060136220A1 (en) 2004-12-22 2006-06-22 Rama Gurram Controlling user interfaces with voice commands from multiple languages
US8230456B2 (en) 2005-01-05 2012-07-24 Yahoo! Inc. Framework for delivering a plurality of content and providing for interaction with the same in a television environment
US8842977B2 (en) 2005-01-07 2014-09-23 Samsung Electronics Co., Ltd. Storage medium storing metadata for providing enhanced search function
KR100782810B1 (en) 2005-01-07 2007-12-06 삼성전자주식회사 Apparatus and method of reproducing an storage medium having metadata for providing enhanced search
US20080037953A1 (en) * 2005-02-03 2008-02-14 Matsushita Electric Industrial Co., Ltd. Recording/Reproduction Apparatus And Recording/Reproduction Method, And Recording Medium Storing Recording/Reproduction Program, And Integrated Circuit For Use In Recording/Reproduction Apparatus
JP2006229494A (en) 2005-02-16 2006-08-31 Sony Corp Information processing apparatus, method thereof and program
JP2006232113A (en) * 2005-02-25 2006-09-07 Toyo Seat Co Ltd Awning cloth joining structure of awning for vehicle
CN101180619B (en) * 2005-02-28 2012-05-23 雅虎公司 Media management system and method
US7818350B2 (en) 2005-02-28 2010-10-19 Yahoo! Inc. System and method for creating a collaborative playlist
US20060218617A1 (en) * 2005-03-22 2006-09-28 Microsoft Corporation Extensible content identification and indexing
US20080052742A1 (en) * 2005-04-26 2008-02-28 Slide, Inc. Method and apparatus for presenting media content
JP2006311098A (en) 2005-04-27 2006-11-09 Matsushita Electric Ind Co Ltd Portable terminal device
US7835505B2 (en) 2005-05-13 2010-11-16 Microsoft Corporation Phone-to-monitor connection device
US20060271947A1 (en) 2005-05-23 2006-11-30 Lienhart Rainer W Creating fingerprints
US8000685B2 (en) * 2005-06-13 2011-08-16 Alcatel Lucent Network support for distinctive voicemail greeting
JP4678246B2 (en) 2005-06-20 2011-04-27 船井電機株式会社 Program search support system
US20060294557A1 (en) * 2005-06-23 2006-12-28 Microsoft Corporation Presentation of information relating to change of a programming state
JP2007048212A (en) 2005-08-12 2007-02-22 Dainippon Printing Co Ltd System and device for providing information
US8768146B2 (en) 2005-10-24 2014-07-01 Microsoft Corporation Strategies for controlling presentation of media information based on a sampling of customer playback behavior
DE102005057161A1 (en) * 2005-11-30 2007-05-31 BSH Bosch und Siemens Hausgeräte GmbH Refrigerating appliance has sleeve through which delivery device is accessible and which projects from front side and is encompassed by encircling frame which projects from sleeve
JP2007173918A (en) 2005-12-19 2007-07-05 Matsushita Electric Ind Co Ltd Recording reservation system
US20070162502A1 (en) 2005-12-29 2007-07-12 United Video Properties, Inc. Media library in an interactive media guidance application
EP3206393A1 (en) 2005-12-29 2017-08-16 Rovi Guides, Inc. Systems and methods for episode tracking in an interactive media environment
US8607287B2 (en) * 2005-12-29 2013-12-10 United Video Properties, Inc. Interactive media guidance system having multiple devices
US9015736B2 (en) 2005-12-29 2015-04-21 Rovi Guides, Inc. Systems and methods for episode tracking in an interactive media environment
US8214516B2 (en) * 2006-01-06 2012-07-03 Google Inc. Dynamic media serving infrastructure
JP2007214861A (en) 2006-02-09 2007-08-23 Matsushita Electric Ind Co Ltd Television chat system, television chat terminal equipment, television chat server, television chat service provision method
US8689337B2 (en) * 2006-02-27 2014-04-01 Vobile, Inc. Systems and methods of fingerprinting and identifying video objects
US20070208715A1 (en) * 2006-03-02 2007-09-06 Thomas Muehlbauer Assigning Unique Content Identifiers to Digital Media Content
US7668867B2 (en) 2006-03-17 2010-02-23 Microsoft Corporation Array-based discovery of media items
FR2898749B1 (en) * 2006-03-20 2008-08-22 Alcatel Sa METHOD OF ADAPTATION OF COMMON USER PROFILE
US20070247477A1 (en) 2006-04-21 2007-10-25 Lowry Gregory N Method and apparatus for processing, displaying and viewing stereoscopic 3D images
US9154563B2 (en) 2006-04-24 2015-10-06 Aol Inc. Alerts for monitoring user status
US8074251B2 (en) 2006-06-05 2011-12-06 Palo Alto Research Center Incorporated Limited social TV apparatus
US7787697B2 (en) 2006-06-09 2010-08-31 Sony Ericsson Mobile Communications Ab Identification of an object in media and of related media objects
RU2009100847A (en) 2006-06-13 2010-07-20 Конинклейке Филипс Электроникс Н.В. (Nl) IDENTIFICATION LABEL, DEVICE, METHOD FOR IDENTIFICATION AND SYNCHRONIZATION OF VIDEO DATA
US8015014B2 (en) 2006-06-16 2011-09-06 Storz Endoskop Produktions Gmbh Speech recognition system with user profiles management component
US8306859B2 (en) 2006-07-21 2012-11-06 Say Media, Inc. Dynamic configuration of an advertisement
US7812854B1 (en) 2006-09-05 2010-10-12 Sprint Spectrum L.P. Digital rights management for mobile devices
KR100826557B1 (en) * 2006-10-11 2008-04-30 포스데이타 주식회사 Method and Apparatus for Generating and Playing Playback File Capable of Easily Changing Player
US20080130958A1 (en) * 2006-11-30 2008-06-05 Motorola, Inc. Method and system for vision-based parameter adjustment
GB2444973A (en) 2006-12-22 2008-06-25 British Sky Broadcasting Ltd Media demand and playback system
US7796024B2 (en) * 2007-02-07 2010-09-14 Db Systems, Llc Automated multi-purpose alert system with sensory interrupts
JP2008277933A (en) 2007-04-26 2008-11-13 Hitachi Ltd Video recording apparatus, video recording management server, and video recording management method
US20080271078A1 (en) 2007-04-30 2008-10-30 Google Inc. Momentary Electronic Program Guide
US8032383B1 (en) 2007-05-04 2011-10-04 Foneweb, Inc. Speech controlled services and devices using internet
US8094872B1 (en) 2007-05-09 2012-01-10 Google Inc. Three-dimensional wavelet based video fingerprinting
JP2010531482A (en) 2007-06-05 2010-09-24 イー−レーン システムズ インコーポレイテッド Media exchange system
US20080317439A1 (en) 2007-06-22 2008-12-25 Microsoft Corporation Social network based recording
WO2009005602A2 (en) 2007-06-27 2009-01-08 Dolby Laboratories Licensing Corporation Incremental construction of search tree with signature pointers for identification of multimedia content
US8429516B1 (en) * 2007-08-20 2013-04-23 Adobe Systems Incorporated Media player feedback
US20090063277A1 (en) * 2007-08-31 2009-03-05 Dolby Laboratiories Licensing Corp. Associating information with a portion of media content
JP5401461B2 (en) 2007-09-07 2014-01-29 フェイスブック,インク. Dynamic update of privacy settings in social networks
US8630625B2 (en) * 2007-09-14 2014-01-14 At&T Intellectual Property I, L.P. System and method for personalized messaging
US9191450B2 (en) * 2007-09-20 2015-11-17 Disney Enterprises, Inc. Measuring user engagement during presentation of media content
US20090091629A1 (en) 2007-10-03 2009-04-09 Casey Robert J TV/Movie actor identifcation device
KR100827846B1 (en) 2007-10-18 2008-05-07 (주)올라웍스 Method and system for replaying a movie from a wanted point by searching specific person included in the movie
GB2455280A (en) 2007-10-22 2009-06-10 Dwight Cavendish Systems Ltd Generating a security signature based on face analysis
JP4717871B2 (en) 2007-11-06 2011-07-06 シャープ株式会社 Content viewing apparatus and content recommendation method
JP2009124383A (en) * 2007-11-14 2009-06-04 Sony Corp Information processor, content processing system, computer program, content management method, and content retrieval method
US8015192B2 (en) 2007-11-20 2011-09-06 Samsung Electronics Co., Ltd. Cliprank: ranking media content using their relationships with end users
US8856833B2 (en) 2007-11-21 2014-10-07 United Video Properties, Inc. Maintaining a user profile based on dynamic data
JP4508229B2 (en) 2007-11-21 2010-07-21 ソニー株式会社 Display processing apparatus, display processing system, and display processing method
US20090138507A1 (en) 2007-11-27 2009-05-28 International Business Machines Corporation Automated playback control for audio devices using environmental cues as indicators for automatically pausing audio playback
CA2644155A1 (en) 2007-11-29 2010-02-09 Onestop Media Group Method of advertising
JP2009147684A (en) 2007-12-14 2009-07-02 Mitsubishi Electric Corp Program recording system
JP4618301B2 (en) * 2008-01-08 2011-01-26 ソニー株式会社 How to provide content
EP2083568A1 (en) 2008-01-22 2009-07-29 Avaya Technology Llc Open cable application platform set-top bos (STB) personal profiles and communications applications
JP2009181216A (en) 2008-01-29 2009-08-13 Toshiba Corp Electronic apparatus and image processing method
US8347334B2 (en) * 2008-01-31 2013-01-01 At&T Intellectual Property I, Lp System and method of recording television content
US20090210908A1 (en) 2008-02-15 2009-08-20 Sony Ericsson Mobile Communications Ab Portable communication device and associated method for sharing esg metadata
US8253772B2 (en) * 2008-04-04 2012-08-28 Centurylink Intellectual Property Llc Method, apparatus and system for incorporating voice or video communication into a television or compatible audio capable visual display
JP2011519454A (en) * 2008-04-13 2011-07-07 アイファロ メディア ゲーエムベーハー Media asset management
US8265990B2 (en) * 2008-05-15 2012-09-11 Utrom Processing Co. L.L.C. Method and system for selecting and delivering media content via the internet
US20100169911A1 (en) 2008-05-26 2010-07-01 Ji Zhang System for Automatically Monitoring Viewing Activities of Television Signals
WO2009143668A1 (en) * 2008-05-26 2009-12-03 Yuvad Technologies Co., Ltd. A method for automatically monitoring viewing activities of television signals
US8122094B1 (en) * 2008-11-05 2012-02-21 Kotab Dominic M Methods for performing an action relating to the scheduling of an event by performing one or more actions based on a response to a message
US8300676B2 (en) 2008-11-18 2012-10-30 Electronics And Telecommunications Research Institute Apparatus and method for communication
US20100131571A1 (en) * 2008-11-25 2010-05-27 Reuveni Yoseph Method application and system for characterizing multimedia content
US7853659B2 (en) * 2008-11-25 2010-12-14 International Business Machines Corporation Method for presenting personalized, voice printed messages from online digital devices to hosted services
US8813121B2 (en) 2008-12-02 2014-08-19 At&T Intellectual Property I, L.P. Delaying emergency alert system messages
US8538324B2 (en) 2009-02-03 2013-09-17 Sony Corporation Mobile phone dock for TV
US8639096B2 (en) 2009-04-15 2014-01-28 Cbs Interactive Inc. System and method of managing a digital video recorder using a user television broadcast list
US20100318596A1 (en) 2009-06-12 2010-12-16 Ann Bergman Systems and methods for providing readily updatable media content
US8428955B2 (en) 2009-10-13 2013-04-23 Rovi Technologies Corporation Adjusting recorder timing
US8221524B2 (en) * 2009-10-23 2012-07-17 Guild Associates, Inc. Oxygen removal from contaminated gases
US20110137976A1 (en) * 2009-12-04 2011-06-09 Bob Poniatowski Multifunction Multimedia Device
CN102741842A (en) 2009-12-04 2012-10-17 Tivo有限公司 Multifunction multimedia device
US10913003B2 (en) * 2012-03-13 2021-02-09 Sony Interactive Entertainment LLC Mini-games accessed through a sharing interface
US9081778B2 (en) 2012-09-25 2015-07-14 Audible Magic Corporation Using digital fingerprints to associate data with a work
US9665921B2 (en) 2012-12-29 2017-05-30 Futurewei Technologies, Inc. Adaptive OpenGL 3D graphics in virtual desktop infrastructure
US10659845B2 (en) * 2015-08-06 2020-05-19 Google Llc Methods, systems, and media for providing video content suitable for audio-only playback
US10154293B2 (en) * 2016-09-30 2018-12-11 Opentv, Inc. Crowdsourced playback control of media content
US10382806B2 (en) * 2016-11-14 2019-08-13 DISH Technologies L.L.C. Apparatus, systems and methods for controlling presentation of content using a multi-media table
JP7259251B2 (en) 2018-10-01 2023-04-18 株式会社デンソー Control device

Patent Citations (110)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4750213A (en) * 1986-06-09 1988-06-07 Novak Albert P Method and system for editing unwanted program material from broadcast signals
US5956455A (en) * 1990-12-20 1999-09-21 Rca Thomson Licensing Corporation Fault tolerant VCR recording control
US7080392B1 (en) * 1991-12-02 2006-07-18 David Michael Geshwind Process and device for multi-level television program abstraction
US5504518A (en) * 1992-04-30 1996-04-02 The Arbitron Company Method and system for recognition of broadcast segments
US5343251A (en) * 1993-05-13 1994-08-30 Pareto Partners, Inc. Method and apparatus for classifying patterns of television programs and commercials based on discerning of broadcast audio and video signals
US5668917A (en) * 1994-07-05 1997-09-16 Lewine; Donald A. Apparatus and method for detection of unwanted broadcast information
US5748263A (en) * 1995-03-07 1998-05-05 Ball; Bradley E. System for automatically producing infrared control signals
US6771316B1 (en) * 1996-11-01 2004-08-03 Jerry Iggulden Method and apparatus for selectively altering a televised video signal in real-time
US6404977B1 (en) * 1996-11-01 2002-06-11 Jerry Iggulden Method and apparatus for controlling a videotape recorder in real-time to automatically identify and selectively skip segments of a television broadcast signal during recording of the television signal
US6725250B1 (en) * 1996-11-29 2004-04-20 Ellis, Iii Frampton E. Global network computers
US6633651B1 (en) * 1997-02-06 2003-10-14 March Networks Corporation Method and apparatus for recognizing video sequences
US7061544B1 (en) * 1997-02-25 2006-06-13 Sanyo Electric Co., Ltd. Digital television receiver for receiving a digital television broadcast signal and simultaneously displaying a video picture and information contained therein
US20010017667A1 (en) * 1998-04-03 2001-08-30 Frink Craig R. HDTV editing and effects previsualization using SDTV devices
US6636688B1 (en) * 1998-05-13 2003-10-21 Sanyo Electric Co., Ltd. Video recording device
US20030163823A1 (en) * 1999-01-27 2003-08-28 Gotuit Media, Inc. Radio receiving, recording and playback system
US6469749B1 (en) * 1999-10-13 2002-10-22 Koninklijke Philips Electronics N.V. Automatic signature-based spotting, learning and extracting of commercials and other video content
US20060230422A1 (en) * 1999-11-24 2006-10-12 David Kunin Method and apparatus for Internet TV
US20010023431A1 (en) * 2000-01-18 2001-09-20 Mari Horiguchi Information processing device, information processing method and medium
US6771885B1 (en) * 2000-02-07 2004-08-03 Koninklijke Philips Electronics N.V. Methods and apparatus for recording programs prior to or beyond a preset recording time period
US7908635B2 (en) * 2000-03-02 2011-03-15 Tivo Inc. System and method for internet access to a personal television service
US20030095791A1 (en) * 2000-03-02 2003-05-22 Barton James M. System and method for internet access to a personal television service
US20070250716A1 (en) * 2000-05-02 2007-10-25 Brunk Hugh L Fingerprinting of Media Signals
US7984473B1 (en) * 2000-06-14 2011-07-19 International Business Machines Corporation System and method for the coordination of short-term cyclic data and ephemeral content in a broadcast stream
US20030177503A1 (en) * 2000-07-24 2003-09-18 Sanghoon Sull Method and apparatus for fast metadata generation, delivery and access for live broadcast program
US20020037104A1 (en) * 2000-09-22 2002-03-28 Myers Gregory K. Method and apparatus for portably recognizing text in an image sequence of scene imagery
US20070192410A1 (en) * 2000-12-18 2007-08-16 Nortel Networks Limited Method and system for automatic handling of invitations to join communications sessions in a virtual team environment
US20020099774A1 (en) * 2001-01-22 2002-07-25 Nec Corporation Information reproducing method and information reproducing system
US20020099552A1 (en) * 2001-01-25 2002-07-25 Darryl Rubin Annotating electronic information with audio clips
US20020124252A1 (en) * 2001-03-02 2002-09-05 Schaefer Scott R. Method and system to provide information alerts via an interactive video casting system
US20020152117A1 (en) * 2001-04-12 2002-10-17 Mike Cristofalo System and method for targeting object oriented audio and video content to users
US7171108B1 (en) * 2001-07-31 2007-01-30 Keen Personal Media, Inc. Audiovisual system to interrupt viewing of a first audiovisual program to provide notification of a second audiovisual program of interest to the user
US20030093580A1 (en) * 2001-11-09 2003-05-15 Koninklijke Philips Electronics N.V. Method and system for information alerts
US20030093806A1 (en) * 2001-11-14 2003-05-15 Vincent Dureau Remote re-creation of data in a television system
US20030114145A1 (en) * 2001-12-17 2003-06-19 Nokia Corporation Initiating a wireless connection to a broadcast program
US7170566B2 (en) * 2001-12-21 2007-01-30 Koninklijke Philips Electronics N.V. Family histogram based techniques for detection of commercials and other video content
US7477739B2 (en) * 2002-02-05 2009-01-13 Gracenote, Inc. Efficient storage of fingerprints
US20030195851A1 (en) * 2002-04-11 2003-10-16 Ong Lance D. System for managing distribution of digital audio content
US20040078817A1 (en) * 2002-05-14 2004-04-22 Steven Horowitz Dynamic program events recording
US7784078B2 (en) * 2002-07-30 2010-08-24 Sony Corporation Information processing system, information processing device and method, recording medium, and program
US20050022251A1 (en) * 2002-07-30 2005-01-27 Kensuke Ohnuma Information processing system, information processing device and method, recording medium, and program
US20040059570A1 (en) * 2002-09-24 2004-03-25 Kazuhiro Mochinaga Feature quantity extracting apparatus
US20040143349A1 (en) * 2002-10-28 2004-07-22 Gracenote, Inc. Personal audio recording system
US20050172312A1 (en) * 2003-03-07 2005-08-04 Lienhart Rainer W. Detecting known video entities utilizing fingerprints
US7738704B2 (en) * 2003-03-07 2010-06-15 Technology, Patents And Licensing, Inc. Detecting known video entities utilizing fingerprints
US7930714B2 (en) * 2003-03-07 2011-04-19 Technology, Patents & Licensing, Inc. Video detection and insertion
US20070001806A1 (en) * 2003-04-24 2007-01-04 Koninklijke Philips Electronics N.V. Alert filtering
US20050239545A1 (en) * 2003-07-14 2005-10-27 Bruce Rowe Programmatic control of gaming devices
US7548950B2 (en) * 2003-07-17 2009-06-16 Pioneer Corporation Data-processing device, system thereof, method thereof, program thereof, and recording medium storing the program
US20050028161A1 (en) * 2003-07-17 2005-02-03 Yukio Numakami Data-processing device, system thereof, method thereof, program thereof, and recording medium storing the program
US20050044561A1 (en) * 2003-08-20 2005-02-24 Gotuit Audio, Inc. Methods and apparatus for identifying program segments by detecting duplicate signal patterns
US20070136744A1 (en) * 2003-09-22 2007-06-14 Koninklijke Philips Electronics N.V. System, device and method for collaborative zapping
US20080175566A1 (en) * 2003-10-01 2008-07-24 Music Gremlin, Inc. Audio visual player apparatus and system and method of content distribution using the same
US7486875B2 (en) * 2003-12-04 2009-02-03 Hitachi, Ltd. Method of recording multiple programs over a specified time period in separate program data files
US20050149987A1 (en) * 2003-12-24 2005-07-07 Gilles Boccon-Gibod Television viewing communities
US20050154637A1 (en) * 2004-01-09 2005-07-14 Rahul Nair Generating and displaying level-of-interest values
US20060174277A1 (en) * 2004-03-04 2006-08-03 Sezan M I Networked video devices
US20060064721A1 (en) * 2004-03-10 2006-03-23 Techfoundries, Inc. Method and apparatus for implementing a synchronized electronic program guide application
US20080037151A1 (en) * 2004-04-06 2008-02-14 Matsushita Electric Industrial Co., Ltd. Audio Reproducing Apparatus, Audio Reproducing Method, and Program
US7805055B2 (en) * 2004-04-20 2010-09-28 Sony Computer Entertainment Inc. Recorder
US20090017792A1 (en) * 2004-05-12 2009-01-15 Fumiaki Matsumoto Mobile telephone having broadcast reception function
US7418497B2 (en) * 2004-07-15 2008-08-26 International Business Machines Corporation Automatically infering and updating an availability status of a user
US20060015609A1 (en) * 2004-07-15 2006-01-19 International Business Machines Corporation Automatically infering and updating an availability status of a user
US20060023849A1 (en) * 2004-07-30 2006-02-02 Timmins Timothy A Personalized voice applications in an information assistance service
US20060036688A1 (en) * 2004-08-12 2006-02-16 International Business Machines Corporation Method and system for managing interrupts in an instant messaging application
US20100257052A1 (en) * 2004-08-31 2010-10-07 Integrated Media Measurement, Inc. Detecting and Measuring Exposure To Media Content Items
US20060074658A1 (en) * 2004-10-01 2006-04-06 Siemens Information And Communication Mobile, Llc Systems and methods for hands-free voice-activated devices
US20090124214A1 (en) * 2004-10-04 2009-05-14 Qualcomm Incorporated Remote front-end for a multi-antenna station
US8370765B2 (en) * 2004-10-18 2013-02-05 Martin Derek P Computer system and method for inhibiting interruption of a user that is actively using the computer system
US7818771B2 (en) * 2004-11-23 2010-10-19 Palo Alto Research Center Incorporated Methods, apparatus, and program products for controlling presentation of an experiential data stream responsive to conversations in a shared social space
US20060116885A1 (en) * 2004-11-30 2006-06-01 Shostak Robert E System and method for improving recognition accuracy in speech recognition applications
US20090259690A1 (en) * 2004-12-30 2009-10-15 All Media Guide, Llc Methods and apparatus for audio recognitiion
US20060195859A1 (en) * 2005-02-25 2006-08-31 Richard Konig Detecting known video entities taking into account regions of disinterest
US20060239642A1 (en) * 2005-04-20 2006-10-26 Sony Corporation Communication system, recording apparatus and method, recording medium, and program
US20090103893A1 (en) * 2005-05-17 2009-04-23 Mitsubishi Electric Corporation Recording Schedule Sharing System and Recording Schedule Sharing Apparatus
US20090144769A1 (en) * 2005-11-03 2009-06-04 Thomson Licensing Digital Video Recording Device and Method
US20070112939A1 (en) * 2005-11-17 2007-05-17 Sbc Knowledge Ventures L.P. System and method for home automation
US20070143778A1 (en) * 2005-11-29 2007-06-21 Google Inc. Determining Popularity Ratings Using Social and Interactive Applications for Mass Media
US20070140187A1 (en) * 2005-12-15 2007-06-21 Rokusek Daniel S System and method for handling simultaneous interaction of multiple wireless devices in a vehicle
US20070169155A1 (en) * 2006-01-17 2007-07-19 Thad Pasquale Method and system for integrating smart tags into a video data service
US20080306826A1 (en) * 2006-01-30 2008-12-11 Hoozware, Inc. System for Providing a Service to Venues Where People Aggregate
US20070186242A1 (en) * 2006-02-03 2007-08-09 Price James D Iii Personal content recorder suggestion and subscription
US20070245243A1 (en) * 2006-03-28 2007-10-18 Michael Lanza Embedded metadata in a media presentation
US7774407B2 (en) * 2006-05-09 2010-08-10 International Business Machines Corporation Postponing an instant messaging session
US20080184326A1 (en) * 2006-10-19 2008-07-31 Satoshi Nakajima Community and/or chat-based content recording and consumption
US8233601B2 (en) * 2006-12-14 2012-07-31 Voxp Pte. Ltd. Interrupt payment system
US20080170836A1 (en) * 2007-01-12 2008-07-17 Sony Corporation Network system, terminal apparatus, recording apparatus, method of displaying record scheduling state, computer program for terminal apparatus, computer program for recording apparatus
US20080177752A1 (en) * 2007-01-19 2008-07-24 Samsung Electronics Co., Ltd. method of interactive video blogging
US20080235283A1 (en) * 2007-03-21 2008-09-25 The Regents Of The University Of California Generating audio annotations for search and retrieval
US20100040342A1 (en) * 2007-03-31 2010-02-18 Sony Deutschland Gmbh Method for determining a point in time within an audio signal
US20090021646A1 (en) * 2007-07-20 2009-01-22 Samsung Electronics Co., Ltd. Method and system for communication of uncompressed video information in wireless systems
US20090083742A1 (en) * 2007-09-25 2009-03-26 Microsoft Corporation Interruptability management via scheduling application
US20090088207A1 (en) * 2007-09-28 2009-04-02 Embarq Holdings Company Llc System and method for a wireless ringer function
US20090100469A1 (en) * 2007-10-15 2009-04-16 Microsoft Corporation Recommendations from Social Networks
US20090216847A1 (en) * 2007-11-14 2009-08-27 Qualcomm Incorporated Method and system for message value calculation in a mobile environment
US20090133070A1 (en) * 2007-11-21 2009-05-21 United Video Properties, Inc. Enabling a friend to remotely modify user data
US20090172108A1 (en) * 2007-12-28 2009-07-02 Surgo Systems and methods for a telephone-accessible message communication system
US20090169178A1 (en) * 2007-12-28 2009-07-02 Echostar Technologies Corporation Apparatus, system and method for storing and presenting to a user different types of content regarding a subject
US20110041153A1 (en) * 2008-01-03 2011-02-17 Colin Simon Content management and delivery method, system and apparatus
US20090207979A1 (en) * 2008-02-19 2009-08-20 Charles Mark Russell System and method for recording and evaluating communication
US20090259499A1 (en) * 2008-04-09 2009-10-15 Sudhir Bhojwani Method and system employing a mobile device for soliciting user experience sharing
US8156520B2 (en) * 2008-05-30 2012-04-10 EchoStar Technologies, L.L.C. Methods and apparatus for presenting substitute content in an audio/video stream using text data
US20100023553A1 (en) * 2008-07-22 2010-01-28 At&T Labs System and method for rich media annotation
US20100111269A1 (en) * 2008-10-30 2010-05-06 Embarq Holdings Company, Llc System and method for voice activated provisioning of telecommunication services
US20100150321A1 (en) * 2008-12-15 2010-06-17 Embarg Holdings Company, Llc System and method for voice activated dialing from a home phone
US20100212001A1 (en) * 2009-02-13 2010-08-19 Samsung Electronics Co., Ltd. System and method for user login to a multimedia system using a remote control
US8364703B2 (en) * 2009-06-10 2013-01-29 Zeitera, Llc Media fingerprinting and identification system
US20130223816A1 (en) * 2009-09-14 2013-08-29 Tivo Inc. Multifunction multimedia device
US20110085781A1 (en) * 2009-10-13 2011-04-14 Rovi Technologies Corporation Content recorder timing alignment
US20110135283A1 (en) * 2009-12-04 2011-06-09 Bob Poniatowki Multifunction Multimedia Device
US20140205267A1 (en) * 2009-12-04 2014-07-24 Tivo Inc. Multifunction multimedia device

Cited By (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9648380B2 (en) 2009-09-14 2017-05-09 Tivo Solutions Inc. Multimedia device recording notification system
US20110066663A1 (en) * 2009-09-14 2011-03-17 Gharaat Amir H Multifunction Multimedia Device
US20110066489A1 (en) * 2009-09-14 2011-03-17 Gharaat Amir H Multifunction Multimedia Device
US20110067099A1 (en) * 2009-09-14 2011-03-17 Barton James M Multifunction Multimedia Device
US8984626B2 (en) 2009-09-14 2015-03-17 Tivo Inc. Multifunction multimedia device
US11653053B2 (en) 2009-09-14 2023-05-16 Tivo Solutions Inc. Multifunction multimedia device
US10805670B2 (en) 2009-09-14 2020-10-13 Tivo Solutions, Inc. Multifunction multimedia device
US10097880B2 (en) 2009-09-14 2018-10-09 Tivo Solutions Inc. Multifunction multimedia device
US20110067066A1 (en) * 2009-09-14 2011-03-17 Barton James M Multifunction Multimedia Device
US9554176B2 (en) 2009-09-14 2017-01-24 Tivo Inc. Media content fingerprinting system
US9521453B2 (en) 2009-09-14 2016-12-13 Tivo Inc. Multifunction multimedia device
US9369758B2 (en) 2009-09-14 2016-06-14 Tivo Inc. Multifunction multimedia device
US9781377B2 (en) 2009-12-04 2017-10-03 Tivo Solutions Inc. Recording and playback system based on multimedia content fingerprints
US8806352B2 (en) 2011-05-06 2014-08-12 David H. Sitrick System for collaboration of a specific image and utilizing selected annotations while viewing and relative to providing a display presentation
US9224129B2 (en) 2011-05-06 2015-12-29 David H. Sitrick System and methodology for multiple users concurrently working and viewing on a common project
US8924859B2 (en) 2011-05-06 2014-12-30 David H. Sitrick Systems and methodologies supporting collaboration of users as members of a team, among a plurality of computing appliances
US20120284644A1 (en) * 2011-05-06 2012-11-08 David H. Sitrick Systems And Methodologies Comprising A Plurality Of Computing Appliances Having Input Apparatus And Display Apparatus And Logically Structured As A Main Team
US8918723B2 (en) * 2011-05-06 2014-12-23 David H. Sitrick Systems and methodologies comprising a plurality of computing appliances having input apparatus and display apparatus and logically structured as a main team
US8875011B2 (en) 2011-05-06 2014-10-28 David H. Sitrick Systems and methodologies providing for collaboration among a plurality of users at a plurality of computing appliances
US9330366B2 (en) 2011-05-06 2016-05-03 David H. Sitrick System and method for collaboration via team and role designation and control and management of annotations
US8918724B2 (en) 2011-05-06 2014-12-23 David H. Sitrick Systems and methodologies providing controlled voice and data communication among a plurality of computing appliances associated as team members of at least one respective team or of a plurality of teams and sub-teams within the teams
US8918721B2 (en) 2011-05-06 2014-12-23 David H. Sitrick Systems and methodologies providing for collaboration by respective users of a plurality of computing appliances working concurrently on a common project having an associated display
US20120284642A1 (en) * 2011-05-06 2012-11-08 David H. Sitrick System And Methodology For Collaboration, With Selective Display Of User Input Annotations Among Member Computing Appliances Of A Group/Team
US8914735B2 (en) 2011-05-06 2014-12-16 David H. Sitrick Systems and methodologies providing collaboration and display among a plurality of users
US8918722B2 (en) * 2011-05-06 2014-12-23 David H. Sitrick System and methodology for collaboration in groups with split screen displays
US11611595B2 (en) 2011-05-06 2023-03-21 David H. Sitrick Systems and methodologies providing collaboration among a plurality of computing appliances, utilizing a plurality of areas of memory to store user input as associated with an associated computing appliance providing the input
US8826147B2 (en) * 2011-05-06 2014-09-02 David H. Sitrick System and methodology for collaboration, with selective display of user input annotations among member computing appliances of a group/team
US20120284643A1 (en) * 2011-05-06 2012-11-08 David H. Sitrick System And Methodology For Collaboration in Groups With Split Screen Displays
US8990677B2 (en) 2011-05-06 2015-03-24 David H. Sitrick System and methodology for collaboration utilizing combined display with evolving common shared underlying image
US10402485B2 (en) 2011-05-06 2019-09-03 David H. Sitrick Systems and methodologies providing controlled collaboration among a plurality of users
US10484806B2 (en) * 2011-07-14 2019-11-19 Vivint, Inc. Managing audio output through an intermediary
US10070236B2 (en) 2011-07-14 2018-09-04 Vivint, Inc. Managing audio output through an intermediary
US9674623B2 (en) * 2011-07-14 2017-06-06 Vivint, Inc. Managing audio output through an intermediary
US20170013376A1 (en) * 2011-07-14 2017-01-12 Vivint, Inc. Managing audio output through an intermediary

Also Published As

Publication number Publication date
SG179092A1 (en) 2012-04-27
US9369758B2 (en) 2016-06-14
US20110066942A1 (en) 2011-03-17
EP3346715B1 (en) 2023-04-05
HK1257940A1 (en) 2019-11-01
CA2773558A1 (en) 2011-03-17
JP6124357B2 (en) 2017-05-10
US20160353181A9 (en) 2016-12-01
US10097880B2 (en) 2018-10-09
US20190037267A1 (en) 2019-01-31
EP3346701A1 (en) 2018-07-11
US8510769B2 (en) 2013-08-13
AU2010291945A9 (en) 2013-01-31
HK1257941A1 (en) 2019-11-01
SG179091A1 (en) 2012-04-27
JP2013504947A (en) 2013-02-07
EP3346715A1 (en) 2018-07-11
CN112734459A (en) 2021-04-30
JP2013504948A (en) 2013-02-07
EP2478700A1 (en) 2012-07-25
US20110066489A1 (en) 2011-03-17
CN102696223A (en) 2012-09-26
HK1257939A1 (en) 2019-11-01
US20110067099A1 (en) 2011-03-17
US9521453B2 (en) 2016-12-13
US9554176B2 (en) 2017-01-24
US20110063317A1 (en) 2011-03-17
US11653053B2 (en) 2023-05-16
EP3361377A1 (en) 2018-08-15
US20110064385A1 (en) 2011-03-17
CN102696233B (en) 2015-11-25
US8704854B2 (en) 2014-04-22
US20110064378A1 (en) 2011-03-17
EP3346377A1 (en) 2018-07-11
JP5969560B2 (en) 2016-08-17
CN107093100A (en) 2017-08-25
US20110067066A1 (en) 2011-03-17
US9036979B2 (en) 2015-05-19
US20110066663A1 (en) 2011-03-17
HK1257942A1 (en) 2019-11-01
US10805670B2 (en) 2020-10-13
CN102696233A (en) 2012-09-26
US9264758B2 (en) 2016-02-16
US20130332951A1 (en) 2013-12-12
WO2011032168A1 (en) 2011-03-17
HK1172178A1 (en) 2013-04-12
EP2478698A1 (en) 2012-07-25
CN107093100B (en) 2021-01-15
EP3346700A1 (en) 2018-07-11
EP3349436A1 (en) 2018-07-18
EP3361742A1 (en) 2018-08-15
US8984626B2 (en) 2015-03-17
JP2015029297A (en) 2015-02-12
HK1257943A1 (en) 2019-11-01
US20110064386A1 (en) 2011-03-17
US8417096B2 (en) 2013-04-09
WO2011032168A4 (en) 2011-05-05
US20110064377A1 (en) 2011-03-17
US20230283837A1 (en) 2023-09-07
EP2478700A4 (en) 2013-12-11
US20210067828A1 (en) 2021-03-04
JP2015008508A (en) 2015-01-15
CN102696223B (en) 2017-04-26
WO2011032167A1 (en) 2011-03-17
US20140229969A1 (en) 2014-08-14
US20130223816A1 (en) 2013-08-29
EP2478698A4 (en) 2014-01-01
AU2010291945A1 (en) 2012-03-29
CA2773323A1 (en) 2011-03-17
US9648380B2 (en) 2017-05-09
AU2010291946A1 (en) 2012-04-05
EP3361743A1 (en) 2018-08-15

Similar Documents

Publication Publication Date Title
US11653053B2 (en) Multifunction multimedia device
US20110137976A1 (en) Multifunction Multimedia Device

Legal Events

Date Code Title Description
AS Assignment

Owner name: TIVO INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BARTON, JAMES M.;LANIER, BRIAN;GHARAAT, AMIR H.;AND OTHERS;SIGNING DATES FROM 20100121 TO 20100211;REEL/FRAME:023930/0336

AS Assignment

Owner name: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT, MARYLAND

Free format text: SECURITY INTEREST;ASSIGNOR:TIVO SOLUTIONS INC.;REEL/FRAME:041076/0051

Effective date: 20160915

Owner name: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL

Free format text: SECURITY INTEREST;ASSIGNOR:TIVO SOLUTIONS INC.;REEL/FRAME:041076/0051

Effective date: 20160915

AS Assignment

Owner name: TIVO SOLUTIONS INC., CALIFORNIA

Free format text: CHANGE OF NAME;ASSIGNOR:TIVO INC.;REEL/FRAME:041493/0822

Effective date: 20160908

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION

AS Assignment

Owner name: TIVO SOLUTIONS INC., CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST IN PATENT RIGHTS;ASSIGNOR:MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT;REEL/FRAME:051109/0969

Effective date: 20191122