WO2009136236A1 - Electronic devices and methods that insert addressable chapter marks relative to advertising content in video streams - Google Patents

Electronic devices and methods that insert addressable chapter marks relative to advertising content in video streams Download PDF

Info

Publication number
WO2009136236A1
WO2009136236A1 PCT/IB2008/054688 IB2008054688W WO2009136236A1 WO 2009136236 A1 WO2009136236 A1 WO 2009136236A1 IB 2008054688 W IB2008054688 W IB 2008054688W WO 2009136236 A1 WO2009136236 A1 WO 2009136236A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
video stream
playback
storage controller
display
Prior art date
Application number
PCT/IB2008/054688
Other languages
French (fr)
Inventor
Simon Ekstrand
Original Assignee
Sony Ericsson Mobile Communications Ab
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Ericsson Mobile Communications Ab filed Critical Sony Ericsson Mobile Communications Ab
Priority to EP08874198.8A priority Critical patent/EP2274744B1/en
Priority to CN2008801290428A priority patent/CN102016997B/en
Priority to KR1020107027577A priority patent/KR101519694B1/en
Priority to JP2011508003A priority patent/JP5232296B2/en
Publication of WO2009136236A1 publication Critical patent/WO2009136236A1/en

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/30—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording
    • G11B27/3027—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording used signal is digitally coded
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/30—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording
    • G11B27/3081—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording used signal is a video-frame or a video-field (P.I.P)
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34—Indicating arrangements 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/37—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying segments of broadcast information, e.g. scenes or extracting programme ID
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4314—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/432—Content retrieval operation from a local storage medium, e.g. hard-disk
    • H04N21/4325—Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334—Recording operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4884—Data services, e.g. news ticker for displaying subtitles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6131—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a mobile phone network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/64315—DVB-H
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/812—Monomedia components thereof involving advertisement data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/61—Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/64—Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 for providing detail information

Definitions

  • the present invention relates to the field of broadcast video in general and, more particularly, to viewing broadcast programs and movie videos on wireless communication terminals and other electronic devices.
  • Wireless mobile terminals such as cellular phones, are increasingly being provided with capabilities to receive broadcast programs and movies from broadcast tiansmitteis, such as via a digital television receiver, and/or as a downloadable video stream via high -bandwidth wif eless transceivers and network servers.
  • Some wireless mobile terminals may also be available that can record at least a portion of received piograin/movic video.
  • Various embodiments of the present invention provide an electronic device that includes video storage memory, a video signal receiver, and a video storage controller.
  • the video signal receiver is configured to receive a video stream containing advertising content and program/movie content from a broadcast source.
  • the video storage controller is configured to identify locations of advertising content interspersed among program/movie content in the received video stream, and to record addressable chapter marks for the identified locations of the advertising content and a video stream that is based on the received video stream into the memory.
  • the addressable chapter marks may be displayed on a display and used by a viewer to jump playback of the video stream between the chapter marks.
  • the video storage controller is further configured to insert the addressable chapter marks within an address look-up table that is recorded within a same memory file that contains the video stream. [0007J In some further embodiments, the video storage controller is further configured to remove and replace each instance of the advertising content of the received video stream with a corresponding one of the addressable chapter marks to generate a modified video stream that is recorded into the memory.
  • the video storage controller is further configured to extract subtitle text that is embedded in the program/movie content portion of the received video stream and located within a defined play time relative to each of the identified locations of advertising content, and to insert the extracted subtitle text as part of the addressable chapter marks that aie rccoidcd with the video stream into the memory.
  • the video storage controller is further configuied to begin displaying on a display the extt acted subtitle text for a next occurring addressable chapter mark during playback of the video stream before the playback reaches that next occurring addressable chapter mark.
  • the video storage controller is further configured to capture a snapshot of a video frame of the program/movie content portion of the video stream following each of the identified locations of the advertising content, and to insert the captured snapshots as part of the addressable chapter marks that are recorded with the video stream into the memory.
  • the video storage controller is further configured to begin displaying on a display the captured snapshot for a next occurring addressable chapter mark during playback of the video stream before the playback reaches that next occurring addressable chapter mark.
  • the video storage controller is further configured to playback the video stream, which was recorded into the memory, onto a video display, to display on the display a playback timeline that indicates a playback length of the video stream and includes an indicia that indicates a present playback location within the playback timeline, and to display on the playback timeline at least a plurality of the addressable chapter marks having spacing therebetween that is proportional to their relative locations within the playback timeline of the video stream.
  • the video storage controller is further configured to respond to a viewer chapter selection signal by jumping a playback location within the video stream to locations defined by selected ones of the addressable chapter marks.
  • the video storage controller is further configured to respond to each occurrence of the viewer chapter selection signal by jumping the playback location to a different one of sequentially occurring time locations in the video stream defined by sequential ordered ones of the addressable chapter marks.
  • lhe video storage controller is iiuther configured to extract subtitle text that is embedded in the program/movie conient portion of the video stream recorded in the memory and loc ated wilhin a defined play time relative to a next playback occurring one of the displayed addressable chapter marks, and to begin displaying the extracted subtitle text before playback reaches that next occurring displayed addressable chapter mark.
  • the subtitle text comprises closed captioned text that is embedded in the program/movie content portion of the video stream recorded in the memory
  • the video storage controller is further configured to extract and display on the video display a defined number of words of the closed captioned text that occur prior to the next playback occurring one of the displayed addressable chapter marks.
  • the video storage controller is further configured to extract subtitle text that is embedded in the program/movie content portion of the video stream recorded in the memory and located within a defined play time relative to a plurality of the displayed addressable chapter marks, and to display on the display the extracted subtitle text for the plurality of the displayed addressable chapter marks.
  • the video storage controller is further configured to display the extracted subtitle text associated with a plurality of the displayed addressable chapter marks ordered on the display adjacent to those displayed addressable chapter marks.
  • the extracted subtitle text comprises closed captioned text that is embedded in the video stream recorded in the memory
  • the video storage controller is further configured to extract and display on the video display a defined number of words of the closed captioned text that occur following a plurality of the displayed addressable chapter marks.
  • the video storage controller is further configured to capture a snapshot of a video frame of the program/movie content portion of the video stream following a next playback occurring one of the displayed addressable chapter marks, and to begin displaying the captured snapshot before playback reaches that next occurring displayed addressable chapter mark.
  • the video storage controller is further configured to capture a snapshot oi a video iranie of the program/movie content poitioii of the video stream following each of the displayed addiessablc chaptei marks, and to display on the video display the captured snapshots for 1hc plurality oi the displayed addressable chapter marks
  • the video storage controller is fiuther configured to identify the location of each instance of the advertising content in the received video stream in response a threshold amount of change of scene content occurring between two sequential frames of the video stream during a time window defined around an expected time of occurrence of each instance of the advertising content.
  • the video storage controller is further configured to identifying the location of a first instance of the advertising content and to then determine a start location of a subsequent time window, which it will use to search for a second instance of the advertising content, as a defined time interval away from the identified location of the first instance of the advertising content.
  • the video storage controller is further configured to generate a message including an identifier for the video stream and the associated addressable chapter marks, and to transmit the message through an external network to another electronic device for use in displaying the video stream with the addressable chapter marks.
  • Figure 1 is a system diagram that illustrates a wireless mobile communication terminal that can receive broadcasi progranss/movics fiom over the aii broadcasters and/or from a program/movie seivcr in accordance with sonic embodiments of Ibc present invention
  • FIG. 1 is a block diagram of the mobile terminal of Figme 1 in accordance with some embodiments of the present invention
  • 100291 Figure 3 illustrates the mobile terminal of Figure 1 and shows the display of a recorded video playback timeline and chapter marks that are displayed relative to locations of identified advertising content in accordance with some embodiments of the present invention
  • Figure 4 illustrates the mobile terminal of Figure 1 and shows the display of a recorded video playback timeline, chapter marks, and associated subtitle text that is extracted from the program/movie content adjacent to locations of identified advertising content in accordance with some embodiments of the present invention
  • Figure 5 illustrates the mobile terminal of Figure 1 and shows the display of a recorded video playback timeline and chapter marks and associated video frame snapshots that are displayed relative to locations of identified advertising content in accordance with some embodiments of the present invention
  • Figure 6 illustrates a timeline of a video stream and associated time windows in which the mobile terminal searches for a location of advertising content in a received and/or recorded video streams in accordance with some embodiments of the present invention.
  • Figure 7 illustrates another timeline of a video stream and associated time windows in which the mobile terminal searches for a location of advertising content in a received and/or recorded video stream, and in which the time windows are dynamically shifted in response to identifying location of one or more instances of the advertising content in accordance with some embodiments of the present invention.
  • Some embodiments may be embodied in hardware and/or in software (including firmware, resident software, micro-code, etc.). Consequently, as used herein, the term "signal" may take the form of a continuous waveform and/or discrete value(s), such as digital value(s) in a memory or register. Furthermore, various embodiments may take the form of a computer program product on a computer-usable or computer-readable storage medium having computer-usable or computer-readable program code embodied in the medium for use by or in connection with an instruction execution system.
  • circuit and “controller” may take the form of digital circuitry, such as computer-readable program code executed by an instruction processing device(s) (e.g., general purpose microprocessor and/or digital signal processor), and/or analog circuitry.
  • instruction processing device e.g., general purpose microprocessor and/or digital signal processor
  • Various embodiments of the present invention may arise from a realization that advertisement breaks can correspond to locations where a viewer may want to be able to directly and easily access and step between during viewing of a program/movie. Accordingly, various embodiments of the present invention are directed to enabling a person who is watching a recorded program/movie to jump a playback location along a timeline that includes chapter marks which have been created based on the locations of advertising content which has been identified within the recorded program/movie.
  • the invention is not limited thereto. Instead, the invention may be applied to any electronic device that is configured to receive, record, and playback video streams containing advertising content and program/movie content.
  • a “wireless mobile terminal” or, abbreviated, “terminal” includes, but is not limited to, any electronic device that is configured to transmit/receive communication signals via a long range wireless interface such as, for example, a cellular interface, via a short range wireless interface such as, for example, a Bluetooth wireless interface, a wireless local area network (WLAN) interface such as IEEE 801.1 la-g, and/or via another radio frequency (RF) interface.
  • Example terminals include, but are not limited to, cellular phones, PDAs, and mobile computers that are configured to communicate with other communication devices via a cellular communication network, a Bluetooth communication network, WLAN communication network, and/or another RF communication network.
  • FIG. 1 is a system diagram that illustrates a wireless mobile communication terminal 100 that can receive a broadcast program/movie video stream from an over-the-air broadcaster via a satellite/terrestrial transmitter 1 10 and/or from a program/movie media server 120 in accordance with some embodiments of the present invention.
  • the video stream may be broadcast across a geographic area (e.g., satellite/over Ihc-air/cable service area) and/or broadcast on demand Io a particular subscriber.
  • lhe terminal 100 can connect and download a video slream from the media server 120 through a cellular base station transccivei 1 X), a cellular network 13 ⁇ , and a private/public network (e.g. Internet) 140.
  • the terminal ] 00 can download the video stream through a WLAN router/Bluetooth communication 150.
  • the media server 120 may download the program/movie stream requested by the terminal 100 to the terminal 100 as a data file, and/or it may stream the program/movie stream to the terminal 100 using, for example, the Real Time Streaming Protocol (RTSP) IETF RFC 2326 and/or RFC 3550.
  • RTSP Real Time Streaming Protocol
  • the terminal 100 may also communicate with another terminal 160 through the cellular transceiver 130 and/or through a short range wireless communication network, such as the WLAN 150 and/or a Bluetooth network.
  • Figure 2 is a block diagram of the mobile terminal 100 of Figure 1 in accordance with some embodiments of the present invention.
  • the terminal 100 can include a wireless RF transceiver 210, a microphone 220, a speaker 224, a video display 228, a user input interface 230 (e.g., keypad/keyboard/touch interface/user selectable buttons), a video controller 240, a broadcast media receiver 250, and video storage memory 260.
  • the broadcast media receiver 250 is configured to receive broadcast program/movie video over the air from a terrestrial and/or satellite transmitter (e.g., transmitter 110 in Figure 1) and may, for example, include a digital television receiver (e.g., high definition receiver- tuner).
  • a terrestrial and/or satellite transmitter e.g., transmitter 110 in Figure 1
  • a digital television receiver e.g., high definition receiver- tuner
  • the exemplary RF transceiver 210 can include a cellular transceiver 212, a WLAN transceiver 214 (e.g., compliant with one or more of the IEEE 801.1 la-g standards), and/or a Bluetooth transceiver 216.
  • the cellular transceiver 212 can communicate with the cellular transceiver 130 using one or more cellular communication protocols such as, for example, Global Standard for Mobile (GSM) communication, General Packet Radio Service (GPES), enhanced data rates for GSM evolution (EDGE), Integrated Digital Enhancement Network (il)EN), code division multiple access (GDMA), wideband -CDMA, CDMA2000, and/or Universal Mobile Telecommunications System (UMTS) to receive a program/movie video stream from the media server 120.
  • GSM Global Standard for Mobile
  • GPES General Packet Radio Service
  • EDGE enhanced data rates for GSM evolution
  • il Integrated Digital Enhancement Network
  • GDMA code division multiple access
  • CDMA2000 Code division multiple access
  • UMTS Universal Mobile Telecommunications System
  • the video controller 240 includes a video advertisement identification unit 242, a chapter mark insertion unit 244, and a video storage/playback unit 246.
  • the storage/playback unit 246 is configured to provide digital video recorder functionality by storing a video stream received via the broadcast media receiver 250 and/or the RF transceiver 210 into the video storage memory 260, and by reading and playing back stored video onto the display 228.
  • the video storage memory 260 can include a single memory device or a hierarchy of memory devices, such as nonvolatile semiconductor memory (e.g. flash memory) and/or a magnetic/optical disk drive.
  • Advertising content and program/movie content can alternately and repetitively occur in the received broadcast program/movie video stream.
  • the advertising identification unit 242 is configured to identify the locations of the advertising content interspersed among the program/movie content in the received video stream.
  • the chapter mark insertion unit 244 is configured to generate addressable chapter marks at locations that correspond to the identified locations of the advertising content.
  • the chapter mark insertion unit 244 can cause the video storage module 246 to record the generated addressable chapter marks into the memory 260.
  • the chapter marks are referred to as being addressable because they serve to identify locations within a recorded video stream where playback can be jumped to cause playback therefrom.
  • the chapter mark insertion unit 244 can be configured to remove and replace each instance of the advertising content of the received video stream with a corresponding one of the addressable chapter marks to generate a modified video stream.
  • the video storage/playback unit 246 can record the modified video stream into the memory 260.
  • the chapter mark insertion unit 244 can insert the addressable chapter marks into the video stream at locations that are adjacent to an end/start location of each instance of the advertising content to generate the modified video stream.
  • the chapter mark insertion unit 244 can insert the chapter marks into an address look up table that is recorded within a same memory file in the memory 260 that contains the video stream.
  • the chapter mark insertion unit 244 is further configured to extract subtitle texi thai is embedded in the program/movie content portion of the received video stream and located within a defined play time and/or a defined number of words relative to each of the identified locations of advertising content.
  • the extracted subtitle text may correspond to closed caption data content that is embedded within an audio portion of the video stream.
  • the chapter mark insertion unit 244 can insert the extracted subtitle text as part of the addressable chapter marks that are recorded with the video stream into the memory 260.
  • the chapter mark insertion unit 244 is further configured to capture a snapshot of a video frame of the program/movie content portion of the video stream following each of the identified locations of the advertising content. The chapter mark insertion unit 244 can insert the capture snapshots as part of the addressable chapter marks that are recorded with the video stream into the memory 260.
  • the video storage/playback module 246 is configured to playback the recorded video stream, which was recorded into the memory 260, onto the video display 228.
  • the video storage/playback module 246 is further configured to display on the display 228 a timeline that includes starting and ending indicia of the video stream and a present location indicia for a present location within the timeline between the starting and ending indicia, and to display on the timeline at least a plurality of the addressable chapter marks that are spaced apart by a distance that is proportional to their relative locations within the playback timeline of the video stream.
  • An exemplary embodiment of a display configuration that may be used during playback of recorded video is shown in Figure 3.
  • Figure 3 shows exemplary graphics that may be displayed by the video storage/playback module 246 on the display 228 during playback of a video stream.
  • the displayed graphics include a video playback timeline 300.
  • the timeline 300 includes starting and ending indicia that can correspond to a starting point and an ending point of the video stream.
  • a present location indicia 320 is moved along the timeline 300 to visually convey to a viewer how much of the video stream has been viewed and how much remains to be viewed.
  • 0056j Chapter marks S 10 are displayed along the timeline J00 at locations that are defined relative to the identified advcilising content in the video stream.
  • each chapter mark may be displayed at a location on timeline 300 thai coiicsponds to an end location and/oi start location of each instance of the advertising content in the received video stream.
  • Hach chapter mark may alternatively or additionally be displayed at a location on timeline 300 that corresponds to an end location and/or start location of each instance of the advertising content in the video stream that is read from the memory 260.
  • the spacing between the chapter marks is therefore proportional to the relative locations of the identified advertising content within the playback timeline of the video stream.
  • the video storage/playback module 246 responds to a viewer's chapter selection signal, created by a viewer's actuation of the user input interface 230, by jumping the playback location within the video stream to locations defined by selected ones of the addressable chapter marks. For example, a viewer can repetitively select the right side 330 of the illustrated jog-dial to jump the video stream playback location forward in time to cause the playback of successively later occurring time locations defined by the sequentially ordered addressable chapter marks 310. Similarly, the viewer can repetitively select the left side 340 of the illustrated jog-dial to jump the video stream playback location backward in time to cause playback of successively earlier occurring time locations defined by the sequentially ordered addressable chapter marks 310.
  • the chapter mark insertion unit 244 can extract subtitle text that is embedded in the program/movie content portion of the video stream recorded in the memory 260 and located within a defined play time and/or within a defined number of words relative to a next occurring one of the displayed addressable chapter marks during receipt of a video and/or during playback of a recorded video.
  • the video storage/playback module 246 can begin displaying the extracted subtitle text before playback reaches the next occurring displayed addressable chapter mark.
  • the chapter mark insertion unit 244 can extract the subtitle text 350 from a five second portion of the video stream and/or from ten words that occur immediately following the chapter mark 31 Oa which will next be reached by the present location indicia 320 during playback. 1 he video storage/playback module 246 can begin displaying the subtitle text 350 before the present location indicia 320 reaches the next occurring ehaptei mark 310a.
  • a user who is viewing the video can read the extracted subtitle text 350 and determine whether the present playback location should be advanced forward to the next occurring chapter mark 310a, or to another subsequent chapter mark.
  • the viewer can skip to the next chapter mark 310a by pressing the right side 330 of the jog-dial.
  • the viewer can skip to the next chapter mark 310a to skip the remaining portion of the present and subsequent advertisements which occur before the chapter mark 310a.
  • Figure 4 illustrates another embodiment of the video display 228 and shows the graphics that may be displayed during playback of video frames thereon.
  • the displayed graphics include a video playback timeline 400, a plurality of chapter marks 410a-e, and a present location indicia 420.
  • each of the chapter marks 410a-e can be displayed at a relative location along the timeline 400 of an end/start location of each instance of the identified advertising content of the video stream.
  • subtitle text that is extracted relative to a plurality of the displayed addressable chapter marks 410a-e is displayed on the display 228 adjacent to (e.g., below) each of the corresponding displayed addressable chapter marks 410a-e.
  • the subtitle text that is extracted for a defined length of time and/or for a defined number of words immediately before and/or after the first chapter mark 410a is displayed below the first chapter mark 410a.
  • the subtitle text that is extracted for a defined length of time (e.g., 4 seconds) and/or for a defined number of words (e.g., 5 words) immediately before and/or after the second chapter mark 410b is displayed below the first chapter mark 410b.
  • the subtitle text extracted before and/or after the third through fifth chapter marks 410c-e is displayed below the respective third through fifth chapter mark 410c-e.
  • a viewer who is viewing the video can read the extracted subtitle texi associated with each of the chapter marks 410a-e, and can determine therefrom whether the viewer desires to jump the present playback location to a previous or forward occurring one of the chapter marks A 10a-e.
  • Figure 5 illustrates another embodiment of the video display 228 and shows the graphics that may be displayed during playback of video frames thereon Referring to Piguie '->.
  • the displayed graphics include the video playback timeline 400 the plurality of chapter marks 410a-e, and the present location indicia 420 that were shown and described above with regard to Figure 4.
  • Flic graphics of Figure 5 differ from those of Figure 4 by the display in Figure 5 of a snapshot of a video frame of the program/movie content portion of the video stream following each of the displayed addressable chapter marks 410a ⁇ e.
  • the snapshots may be displayed on the display 228 adjacent to (e.g., below) each of the corresponding displayed addressable chapter marks 410a ⁇ e.
  • a snapshot 500a of a video frame that occurs following the first chapter mark 410a is displayed below the first chapter mark 410a.
  • a snapshot 500b of a video frame that occurs following the second chapter mark 410b is displayed below the first chapter mark 41Oa.
  • snapshots 500c-e of video frames following the third through fifth chapter marks 410c-e are displayed below the respective third through fifth chapter mark 410c-e.
  • a user who is viewing the video can visually observe the snapshot pictures 500a ⁇ e from a portion of the video following each of the displayed chapter marks 410a-e, and can determine therefrom whether the viewer desires to jump the present playback location to a previous or forwardly occurring one of the chapter marks 410a-e corresponding to one or more of the displayed snapshot pictures 500a-e.
  • the video storage/playback module 246 may display only one of the pictures 500a-e that corresponds to the next occurring displayed addressable chapter mark.
  • the snapshot picture 500d would be displayed because it follows the next occurring chapter mark 41Od adjacent to the present location indicia 420.
  • various ones of the snapshots 500a-e may be separately displayed as a user fast-forwards and/or rewinds the video playback past respective ones of the chapter marks 410a-e.
  • the snapshot 500b may be enlarged Lo fill the video display area when the user fast -forwards to within a defined distance of or crosses-over the chapter mark 410b.
  • the snapshots 500a -e may be repeating video clips having defined repetition times.
  • the video clip 500a may repetitively play five seconds of video leading up -to and/or following from Ilic defined chapter mark 410a, with the othei video clips 500b-e repetitively playing defined lengths of video associated in time with the respective chapter marks 410b-c.
  • the snapshots 500a-e may be displayed in rows and columns forming a grid.
  • Individual ones of the snapshots 500a-e may be separately enlarged (fish-eye enlargement) and displayed on an enlarged portion of a scrollbar and/or overlaid on a portion of the displayed video.
  • the area of the display that is used to display the video may be reduced to make room for an enlarged display of one or more of the snapshots 500a-e.
  • the accuracy and/or speed at which the advertising identification unit 240 can identify locations of advertising content in a received video stream and/or in a video stream that is read from the memory 260 may be improved by searching within defined time windows.
  • the time windows are defined around the expected times at which the instances of advertising content are expected to occur in the video stream. Exemplary operations of the advertising identification unit 240 are described below with regard to Figure 6.
  • a video timeline 600 is illustrated with a plurality of time windows 610a, 610b, and 610c which are overlaid thereon.
  • the time windows 610a-c each correspond to where during the video stream the advertising content is expected to occur.
  • advertising content may be expected to occur at periodically spaced intervals, such as every 15 minutes, the precise location of the beginning and/or end of the advertising content can vary over time because the broadcast service provider may shift the beginning of the advertisement content to correspond to the end of a naturally occurring scene change and/or at the end of a dialogue between actors in a scene in the program/movie.
  • the width of the time windows 610a-c may be defined based on a level of uncertainty of where advertising content will begin and/or will end in the video stream. (00711 For example, when advertising content is expected Io occur at more precisely known periodic intervals, the width of the 1imc windows 610a -c may be relatively small (e.g., a few seconds) around each one of the expected beginning/end locations 620a -o of the advertising content.
  • the advertising identification unit 242 may more quickly and accurately identify the beginning and/or end of each instance of the advertising content by searching within each of the time windows 610a-c to identify where a change of scene content occurs, with the change of scene content being defined as the beginning or end of the advertising content.
  • the advertising identification unit 242 may, for example, identify a transition between program/movie content and advertising content in response to identifying a black video frame occurring within the time windows 610a-c, and/or in response to identifying a threshold amount of change between the content of a present video frame and the content of a previous video frame occurring within the time windows 610a-c (which may be measured at the output of a MPEG decoder which compares video frames to identify changed content).
  • the advertising identification unit 242 can dynamically shift the location of the time windows in which the searching is carried out to identify the advertising content.
  • the advertising identification unit 242 may alternatively or additionally vary the width of the time windows in response to identifying a location of one or more instances of the advertising content in the video stream.
  • a timeline of a video stream is illustrated with a plurality of time windows 702a, 702b, and 702c.
  • the advertising identification unit 242 can search within an initial wider time window 702a to identify a first instance of advertising content in the video stream at location 710a. In response to identifying the first instance at location 710a, the advertising identification unit 242 can then search for subsequent instances of the advertising content in subsequent time windows 702b and 702c.
  • the starting location of the second time window 702b can be determined as a defined time interval 712 from the identified location 710a of the first instance of the advertising content.
  • the time window 702b can be narrower than the time window 702a because of the increased certainty with which the next instance 710b of advertising content in the video stream can be determined relative to the identified location 710a.
  • Ihe starting location of the subsequent time windows 702c can be determined as a defined time inteivaj 716 from ihe identified location /10b of the advertising content identified within the time window 702b.
  • the time window 702c may bo narrower than the time window 702b because of the increased DCtainty of the location of Lhe next instance 71 Oc of advertising content in the video stream relative to the previously identified location 710b of the advertising content.
  • the advertising identification unit 242 can observe a viewer's behavior during playback of a video stream from the memory 260 to determine the location of the start/end of advertising content in the video stream.
  • the advertising identification unit 242 can determine from that behavior that the location of that chapter mark is incorrectly shifted to the right of the start of the program/movie content portion of the video stream, and can correct the chapter mark location by shifting it to the left about the defined distance to correspond to about where the viewer stopped the reversal to continue the playback of the video stream.
  • the advertising identification unit 242 can determine from that behavior that the location of that chapter mark is incorrectly shifted to the left of the start of the program/movie content portion of video stream, and can correct the chapter mark location by shifting it to the right about the defined distance to correspond to about where the viewer stopped the fast- forward to continue the normal speed playback of the video stream.
  • the video controller 240 is configured to share the identified chapter mark locations with another communication device, such as with the wireless communication terminal 160 shown in Figure 1.
  • the video controller 240 may further share the extracted subtitle text and/or the snapshot pictures associated with the chapter mark locations with the other communication device. For example, the video controller 240 may generate a message that includes an identifier that identifies the video stream (e.g., name of the TV show and episode and/or name of a movie), the addressable chapter marks, the extracted subtitle text and/or the snapshot pictures associated with the chapter marks. Video controller 240 can trans ⁇ iii the generated message through the RV transceiver 210 to the othei terminal 160 via the ceiltilai base station transceiver 130 and/or the WL ⁇ N/BIuetooth network 110,
  • the video controller 240 can store the identified chapter mark locations and associated information (snapshot images, subtitle text, etc.) in a centralized network database, such as in an Internet accessible database repository, where they can be retrieved and used by other communication devices.
  • the Internet database may include, for example, the Internet Movie Database (IMDb) and/or the Grace-Note database.
  • the information in the network database may be compiled through an accumulation of submissions from a plurality of different communication device users, such as from users who have automatically (as described above) and/or manually generated chapter marks and associated information. Chapter marks that have been submitted by one user may be edited, deleted, and/or added-to by submissions from another user. [0080] Consequently, once the chapter marks and associated information have been defined for a particular video stream (i.e., a particular TV show or movie), they may be shared with other communication devices which can use them during playback of that video stream recorded thereon.
  • the present invention may be embodied as apparatus (terminals, servers, systems), methods, and computer program products. Accordingly, the present invention may take the form of an entirely hardware embodiment, a software embodiment or an embodiment combining software and hardware aspects all generally referred to herein as a "circuit" or "module.” It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, described herein can be implemented by computer program instructions.
  • These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
  • the contpuicr program instructions can be recorded on a computer readable storage medium, such as on hard disks, CD ROMs, optica) storage devices, or integrated circuit memory devices.
  • These computer program instructions on the computer-readable storage medium direct a computer or other programmable data processing apparatus Io function in a particular manner, such that the instructions stored in the computer-readable storage medium when executed by a processor produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks.
  • the computer program instructions may also be loaded onto and executed by a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.

Abstract

Various embodiments provide an electronic device that includes video storage memory, a video signal receiver, and a video storage controller. The video signal receiver is configured to receive a video stream containing advertising content and program/movie content from a broadcast source. The video storage controller is configured to identify locations of advertising content interspersed among program/movie content in the received video stream, and to record addressable chapter marks for the identified locations of the advertising content and a video stream that is based on the received video stream into the memory. The addressable chapter marks may be displayed on a display and used by a viewer to jump playback of the video stream between the chapter marks.

Description

ELECTRONIC DEVICES AND METHODS THAT INSERT ADDRESSABLE CHAPTER MARKS RELATIVE TO ADVERTISING CONTENT IN VIDEO
STREAMS
BACKGROUND OF THE INVENTION
[0001] The present invention relates to the field of broadcast video in general and, more particularly, to viewing broadcast programs and movie videos on wireless communication terminals and other electronic devices.
[0002] A wide variety of forms of delivery of video from broadcasted programs and movies have emerged. For example, it is now commonplace for televised programs and movies to be available from over-the-air terrestrial and satellite television service providers and Internet-based television providers. Programs and movies including, without limitation, televised shows, theatrical movies, news, music, and other content may be simultaneously broadcast over a wide geographic region and/or may be broadcast on-demand to a particular receiver. Many electronic devices are available that record received programs and movies for later playback for viewing. [0003] Wireless mobile terminals, such as cellular phones, are increasingly being provided with capabilities to receive broadcast programs and movies from broadcast tiansmitteis, such as via a digital television receiver, and/or as a downloadable video stream via high -bandwidth wif eless transceivers and network servers. Some wireless mobile terminals may also be available that can record at least a portion of received piograin/movic video.
(0004) Although advancements in mobile terminal features and communications technologies arc providing far more users the capability to obtain broadcast programs and movies through their mobile terminals, these capabilities may continue to be slowly adopted due to, for example, frustration users can experience from poor navigational aids to locations within recorded video and frequent interruptions from advertising content that is interspersed between program/movie content in the recorded video.
SUMMARY OF EMBODIMENTS OF THE INVENTION
[0005] Various embodiments of the present invention provide an electronic device that includes video storage memory, a video signal receiver, and a video storage controller. The video signal receiver is configured to receive a video stream containing advertising content and program/movie content from a broadcast source. The video storage controller is configured to identify locations of advertising content interspersed among program/movie content in the received video stream, and to record addressable chapter marks for the identified locations of the advertising content and a video stream that is based on the received video stream into the memory. The addressable chapter marks may be displayed on a display and used by a viewer to jump playback of the video stream between the chapter marks. [0006] In some further embodiments, the video storage controller is further configured to insert the addressable chapter marks within an address look-up table that is recorded within a same memory file that contains the video stream. [0007J In some further embodiments, the video storage controller is further configured to remove and replace each instance of the advertising content of the received video stream with a corresponding one of the addressable chapter marks to generate a modified video stream that is recorded into the memory. [0008] In some further embodiments, the video storage controller is further configured to extract subtitle text that is embedded in the program/movie content portion of the received video stream and located within a defined play time relative to each of the identified locations of advertising content, and to insert the extracted subtitle text as part of the addressable chapter marks that aie rccoidcd with the video stream into the memory.
[0009] In some further embodiments, the video storage controller is further configuied to begin displaying on a display the extt acted subtitle text for a next occurring addressable chapter mark during playback of the video stream before the playback reaches that next occurring addressable chapter mark. [001 §] In some further embodiments, the video storage controller is further configured to capture a snapshot of a video frame of the program/movie content portion of the video stream following each of the identified locations of the advertising content, and to insert the captured snapshots as part of the addressable chapter marks that are recorded with the video stream into the memory. [0011] In some further embodiments, the video storage controller is further configured to begin displaying on a display the captured snapshot for a next occurring addressable chapter mark during playback of the video stream before the playback reaches that next occurring addressable chapter mark.
[0012] In some further embodiments, the video storage controller is further configured to playback the video stream, which was recorded into the memory, onto a video display, to display on the display a playback timeline that indicates a playback length of the video stream and includes an indicia that indicates a present playback location within the playback timeline, and to display on the playback timeline at least a plurality of the addressable chapter marks having spacing therebetween that is proportional to their relative locations within the playback timeline of the video stream.
[0013] In some further embodiments, the video storage controller is further configured to respond to a viewer chapter selection signal by jumping a playback location within the video stream to locations defined by selected ones of the addressable chapter marks.
[0014] In some further embodiments, the video storage controller is further configured to respond to each occurrence of the viewer chapter selection signal by jumping the playback location to a different one of sequentially occurring time locations in the video stream defined by sequential ordered ones of the addressable chapter marks.
|OOiSJ Jn some furthei embodiments, lhe video storage controller is iiuther configured to extract subtitle text that is embedded in the program/movie conient portion of the video stream recorded in the memory and loc ated wilhin a defined play time relative to a next playback occurring one of the displayed addressable chapter marks, and to begin displaying the extracted subtitle text before playback reaches that next occurring displayed addressable chapter mark.
[0016] In some further embodiments, the subtitle text comprises closed captioned text that is embedded in the program/movie content portion of the video stream recorded in the memory, and the video storage controller is further configured to extract and display on the video display a defined number of words of the closed captioned text that occur prior to the next playback occurring one of the displayed addressable chapter marks.
[0017] In some further embodiments, the video storage controller is further configured to extract subtitle text that is embedded in the program/movie content portion of the video stream recorded in the memory and located within a defined play time relative to a plurality of the displayed addressable chapter marks, and to display on the display the extracted subtitle text for the plurality of the displayed addressable chapter marks.
[0018] In some further embodiments, the video storage controller is further configured to display the extracted subtitle text associated with a plurality of the displayed addressable chapter marks ordered on the display adjacent to those displayed addressable chapter marks.
[0019] In some further embodiments, the extracted subtitle text comprises closed captioned text that is embedded in the video stream recorded in the memory, and the video storage controller is further configured to extract and display on the video display a defined number of words of the closed captioned text that occur following a plurality of the displayed addressable chapter marks.
[0020] In some further embodiments, the video storage controller is further configured to capture a snapshot of a video frame of the program/movie content portion of the video stream following a next playback occurring one of the displayed addressable chapter marks, and to begin displaying the captured snapshot before playback reaches that next occurring displayed addressable chapter mark. (§0211 In some furtliei embodiments, the video storage controller is further configured to capture a snapshot oi a video iranie of the program/movie content poitioii of the video stream following each of the displayed addiessablc chaptei marks, and to display on the video display the captured snapshots for 1hc plurality oi the displayed addressable chapter marks
|0022] In some further embodiments, the video storage controller is fiuther configured to identify the location of each instance of the advertising content in the received video stream in response a threshold amount of change of scene content occurring between two sequential frames of the video stream during a time window defined around an expected time of occurrence of each instance of the advertising content.
[0023] In some further embodiments, the video storage controller is further configured to identifying the location of a first instance of the advertising content and to then determine a start location of a subsequent time window, which it will use to search for a second instance of the advertising content, as a defined time interval away from the identified location of the first instance of the advertising content. [0024] In some further embodiments, the video storage controller is further configured to generate a message including an identifier for the video stream and the associated addressable chapter marks, and to transmit the message through an external network to another electronic device for use in displaying the video stream with the addressable chapter marks.
[0025] Other apparatus, systems, methods, and/or computer program products according to exemplary embodiments will be or become apparent to one with skill in the art upon review of the following drawings and detailed description. It is intended that all such additional systems, methods, and/or computer program products be included within this description, be within the scope of the present invention, and be protected by the accompanying claims.
BRIEF DESCRIPTION OF THE DRAWINGS
[0026] The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate certain embodiments of the invention. In the drawings: [0027] Figure 1 is a system diagram that illustrates a wireless mobile communication terminal that can receive broadcasi progranss/movics fiom over the aii broadcasters and/or from a program/movie seivcr in accordance with sonic embodiments of Ibc present invention;
|0028J Figure 2 is a block diagram of the mobile terminal of Figme 1 in accordance with some embodiments of the present invention; 100291 Figure 3 illustrates the mobile terminal of Figure 1 and shows the display of a recorded video playback timeline and chapter marks that are displayed relative to locations of identified advertising content in accordance with some embodiments of the present invention;
[0030] Figure 4 illustrates the mobile terminal of Figure 1 and shows the display of a recorded video playback timeline, chapter marks, and associated subtitle text that is extracted from the program/movie content adjacent to locations of identified advertising content in accordance with some embodiments of the present invention; [0031] Figure 5 illustrates the mobile terminal of Figure 1 and shows the display of a recorded video playback timeline and chapter marks and associated video frame snapshots that are displayed relative to locations of identified advertising content in accordance with some embodiments of the present invention; [0032] Figure 6 illustrates a timeline of a video stream and associated time windows in which the mobile terminal searches for a location of advertising content in a received and/or recorded video streams in accordance with some embodiments of the present invention; and
[0033] Figure 7 illustrates another timeline of a video stream and associated time windows in which the mobile terminal searches for a location of advertising content in a received and/or recorded video stream, and in which the time windows are dynamically shifted in response to identifying location of one or more instances of the advertising content in accordance with some embodiments of the present invention.
DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION [0034] Various embodiments of the present invention will now be described more fully hereinafter with reference to the accompanying drawings. However, this invention should not be construed as limited to the embodiments set forth herein.
Rather, these embodiments ate provided so that this disclosure will be thorough and complete, and will convey the scope of the invention to those skilled in the art. [0035) It will be undei stood that, as used herein, the term "comprising" oi "comprises" is open-ended, and includes one or more stated elements, steps and/oi functions without precluding one or more unstated elements, steps and/or functions. Λs used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well unless the context dearly indicates otherwise. The term "and/or" and "/" includes any and all combinations of one or more of the associated listed items. In the drawings, the size and relative sizes of regions may be exaggerated for clarity. Like numbers refer to like elements throughout.
[0036] Some embodiments may be embodied in hardware and/or in software (including firmware, resident software, micro-code, etc.). Consequently, as used herein, the term "signal" may take the form of a continuous waveform and/or discrete value(s), such as digital value(s) in a memory or register. Furthermore, various embodiments may take the form of a computer program product on a computer-usable or computer-readable storage medium having computer-usable or computer-readable program code embodied in the medium for use by or in connection with an instruction execution system. Accordingly, as used herein, the terms "circuit" and "controller" may take the form of digital circuitry, such as computer-readable program code executed by an instruction processing device(s) (e.g., general purpose microprocessor and/or digital signal processor), and/or analog circuitry.
[0037J Embodiments are described below with reference to block diagrams and operational flow charts. It is to be understood that the functions/acts noted in the blocks may occur out of the order noted in the operational illustrations. For example, two blocks shown in succession may in fact be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved. Although some of the diagrams include arrows on communication paths to show a primary direction of communication, it is to be understood that communication may occur in the opposite direction to the depicted arrows.
[0038] Most television programs and many movies are written and filmed so as to facilitate the insertion of advertisement breaks, because advertisements have become a requirement by many broadcasters. In order to keep viewers interested in the program/movie and Io facilitate the perceived continuity of the program/movie following an advertisement, the programs/movies are often written with story lines that culminate before each anticipated advertisement break, and which start up new following each anticipated advertisement break. Λ natural breaking point in the story is therefore generally formed at the adveitiscment breaks.
[§039] Various embodiments of the present invention may arise from a realization that advertisement breaks can correspond to locations where a viewer may want to be able to directly and easily access and step between during viewing of a program/movie. Accordingly, various embodiments of the present invention are directed to enabling a person who is watching a recorded program/movie to jump a playback location along a timeline that includes chapter marks which have been created based on the locations of advertising content which has been identified within the recorded program/movie.
[0040] Although various embodiments of the present invention are described in the context of wireless mobile terminals, the invention is not limited thereto. Instead, the invention may be applied to any electronic device that is configured to receive, record, and playback video streams containing advertising content and program/movie content.
[0041] As used herein, a "wireless mobile terminal" or, abbreviated, "terminal" includes, but is not limited to, any electronic device that is configured to transmit/receive communication signals via a long range wireless interface such as, for example, a cellular interface, via a short range wireless interface such as, for example, a Bluetooth wireless interface, a wireless local area network (WLAN) interface such as IEEE 801.1 la-g, and/or via another radio frequency (RF) interface. Example terminals include, but are not limited to, cellular phones, PDAs, and mobile computers that are configured to communicate with other communication devices via a cellular communication network, a Bluetooth communication network, WLAN communication network, and/or another RF communication network. [0042] Figure 1 is a system diagram that illustrates a wireless mobile communication terminal 100 that can receive a broadcast program/movie video stream from an over-the-air broadcaster via a satellite/terrestrial transmitter 1 10 and/or from a program/movie media server 120 in accordance with some embodiments of the present invention. The video stream may be broadcast across a geographic area (e.g., satellite/over Ihc-air/cable service area) and/or broadcast on demand Io a particular subscriber.
[0043] lhe terminal 100 can connect and download a video slream from the media server 120 through a cellular base station transccivei 1 X), a cellular network 13^, and a private/public network (e.g. Internet) 140. Alternatively or additionally the terminal ] 00 can download the video stream through a WLAN router/Bluetooth communication 150. The media server 120 may download the program/movie stream requested by the terminal 100 to the terminal 100 as a data file, and/or it may stream the program/movie stream to the terminal 100 using, for example, the Real Time Streaming Protocol (RTSP) IETF RFC 2326 and/or RFC 3550. [0044] The terminal 100 may also communicate with another terminal 160 through the cellular transceiver 130 and/or through a short range wireless communication network, such as the WLAN 150 and/or a Bluetooth network. [0045] Figure 2 is a block diagram of the mobile terminal 100 of Figure 1 in accordance with some embodiments of the present invention. Referring to Figure 2, the terminal 100 can include a wireless RF transceiver 210, a microphone 220, a speaker 224, a video display 228, a user input interface 230 (e.g., keypad/keyboard/touch interface/user selectable buttons), a video controller 240, a broadcast media receiver 250, and video storage memory 260. [0046] It is to be understood that although the exemplary terminal 100 has been illustrated in Figure 2 with various separately defined elements for ease of illustration and discussion, the invention is not limited thereto. Instead, various functionality described herein in separate functional elements may be combined within a single functional element and, vice versa, functionally described herein in single functional elements can be carried out by a plurality of separate functional elements. [0047] The broadcast media receiver 250 is configured to receive broadcast program/movie video over the air from a terrestrial and/or satellite transmitter (e.g., transmitter 110 in Figure 1) and may, for example, include a digital television receiver (e.g., high definition receiver- tuner).
[0048 j The exemplary RF transceiver 210 can include a cellular transceiver 212, a WLAN transceiver 214 (e.g., compliant with one or more of the IEEE 801.1 la-g standards), and/or a Bluetooth transceiver 216. The cellular transceiver 212 can communicate with the cellular transceiver 130 using one or more cellular communication protocols such as, for example, Global Standard for Mobile (GSM) communication, General Packet Radio Service (GPES), enhanced data rates for GSM evolution (EDGE), Integrated Digital Enhancement Network (il)EN), code division multiple access (GDMA), wideband -CDMA, CDMA2000, and/or Universal Mobile Telecommunications System (UMTS) to receive a program/movie video stream from the media server 120.
[0049J The video controller 240 includes a video advertisement identification unit 242, a chapter mark insertion unit 244, and a video storage/playback unit 246. The storage/playback unit 246 is configured to provide digital video recorder functionality by storing a video stream received via the broadcast media receiver 250 and/or the RF transceiver 210 into the video storage memory 260, and by reading and playing back stored video onto the display 228. The video storage memory 260 can include a single memory device or a hierarchy of memory devices, such as nonvolatile semiconductor memory (e.g. flash memory) and/or a magnetic/optical disk drive. [0050] Advertising content and program/movie content can alternately and repetitively occur in the received broadcast program/movie video stream. The advertising identification unit 242 is configured to identify the locations of the advertising content interspersed among the program/movie content in the received video stream. The chapter mark insertion unit 244 is configured to generate addressable chapter marks at locations that correspond to the identified locations of the advertising content. The chapter mark insertion unit 244 can cause the video storage module 246 to record the generated addressable chapter marks into the memory 260. As will be described further below, the chapter marks are referred to as being addressable because they serve to identify locations within a recorded video stream where playback can be jumped to cause playback therefrom. [0051] The chapter mark insertion unit 244 can be configured to remove and replace each instance of the advertising content of the received video stream with a corresponding one of the addressable chapter marks to generate a modified video stream. The video storage/playback unit 246 can record the modified video stream into the memory 260. Alternatively or additionally, the chapter mark insertion unit 244 can insert the addressable chapter marks into the video stream at locations that are adjacent to an end/start location of each instance of the advertising content to generate the modified video stream. In some further embodiments, the chapter mark insertion unit 244 can insert the chapter marks into an address look up table that is recorded within a same memory file in the memory 260 that contains the video stream. |0052j In some furtlici embodiments, the chapter mark insertion unit 244 is further configured to extract subtitle texi thai is embedded in the program/movie content portion of the received video stream and located within a defined play time and/or a defined number of words relative to each of the identified locations of advertising content. The extracted subtitle text may correspond to closed caption data content that is embedded within an audio portion of the video stream. The chapter mark insertion unit 244 can insert the extracted subtitle text as part of the addressable chapter marks that are recorded with the video stream into the memory 260. [0053] In some further embodiments, the chapter mark insertion unit 244 is further configured to capture a snapshot of a video frame of the program/movie content portion of the video stream following each of the identified locations of the advertising content. The chapter mark insertion unit 244 can insert the capture snapshots as part of the addressable chapter marks that are recorded with the video stream into the memory 260.
[0054] In some further embodiments, the video storage/playback module 246 is configured to playback the recorded video stream, which was recorded into the memory 260, onto the video display 228. The video storage/playback module 246 is further configured to display on the display 228 a timeline that includes starting and ending indicia of the video stream and a present location indicia for a present location within the timeline between the starting and ending indicia, and to display on the timeline at least a plurality of the addressable chapter marks that are spaced apart by a distance that is proportional to their relative locations within the playback timeline of the video stream. An exemplary embodiment of a display configuration that may be used during playback of recorded video is shown in Figure 3. [0055] Figure 3 shows exemplary graphics that may be displayed by the video storage/playback module 246 on the display 228 during playback of a video stream. The displayed graphics include a video playback timeline 300. The timeline 300 includes starting and ending indicia that can correspond to a starting point and an ending point of the video stream. As the playback progresses, a present location indicia 320 is moved along the timeline 300 to visually convey to a viewer how much of the video stream has been viewed and how much remains to be viewed. |0056j Chapter marks S 10 are displayed along the timeline J00 at locations that are defined relative to the identified advcilising content in the video stream. For example, each chapter mark may be displayed at a location on timeline 300 thai coiicsponds to an end location and/oi start location of each instance of the advertising content in the received video stream. Hach chapter mark may alternatively or additionally be displayed at a location on timeline 300 that corresponds to an end location and/or start location of each instance of the advertising content in the video stream that is read from the memory 260. The spacing between the chapter marks is therefore proportional to the relative locations of the identified advertising content within the playback timeline of the video stream.
[0057] The video storage/playback module 246 responds to a viewer's chapter selection signal, created by a viewer's actuation of the user input interface 230, by jumping the playback location within the video stream to locations defined by selected ones of the addressable chapter marks. For example, a viewer can repetitively select the right side 330 of the illustrated jog-dial to jump the video stream playback location forward in time to cause the playback of successively later occurring time locations defined by the sequentially ordered addressable chapter marks 310. Similarly, the viewer can repetitively select the left side 340 of the illustrated jog-dial to jump the video stream playback location backward in time to cause playback of successively earlier occurring time locations defined by the sequentially ordered addressable chapter marks 310.
[0058] The chapter mark insertion unit 244 can extract subtitle text that is embedded in the program/movie content portion of the video stream recorded in the memory 260 and located within a defined play time and/or within a defined number of words relative to a next occurring one of the displayed addressable chapter marks during receipt of a video and/or during playback of a recorded video. The video storage/playback module 246 can begin displaying the extracted subtitle text before playback reaches the next occurring displayed addressable chapter mark. [0059] Thus, referring to the exemplary embodiment of Figure 3, the chapter mark insertion unit 244 can extract the subtitle text 350 from a five second portion of the video stream and/or from ten words that occur immediately following the chapter mark 31 Oa which will next be reached by the present location indicia 320 during playback. 1 he video storage/playback module 246 can begin displaying the subtitle text 350 before the present location indicia 320 reaches the next occurring ehaptei mark 310a.
[0060] In Ilils manner, a user who is viewing the video can read the extracted subtitle text 350 and determine whether the present playback location should be advanced forward to the next occurring chapter mark 310a, or to another subsequent chapter mark. Thus, for example, when the subtitle text 350 appears to correspond to an advertising portion of the video stream, the viewer can skip to the next chapter mark 310a by pressing the right side 330 of the jog-dial. Similarly, when the user is viewing an undesircd advertisement and the subtitle text 350 appears to correspond to a desired program/movie portion of the video stream, the viewer can skip to the next chapter mark 310a to skip the remaining portion of the present and subsequent advertisements which occur before the chapter mark 310a. [0061] Figure 4 illustrates another embodiment of the video display 228 and shows the graphics that may be displayed during playback of video frames thereon. Referring to Figure 4, the displayed graphics include a video playback timeline 400, a plurality of chapter marks 410a-e, and a present location indicia 420. As described above, each of the chapter marks 410a-e can be displayed at a relative location along the timeline 400 of an end/start location of each instance of the identified advertising content of the video stream. In contrast to the display shown in Figure 3, subtitle text that is extracted relative to a plurality of the displayed addressable chapter marks 410a-e is displayed on the display 228 adjacent to (e.g., below) each of the corresponding displayed addressable chapter marks 410a-e.
[0062] Thus, for example, the subtitle text that is extracted for a defined length of time and/or for a defined number of words immediately before and/or after the first chapter mark 410a is displayed below the first chapter mark 410a. Likewise, the subtitle text that is extracted for a defined length of time (e.g., 4 seconds) and/or for a defined number of words (e.g., 5 words) immediately before and/or after the second chapter mark 410b is displayed below the first chapter mark 410b. In this manner, the subtitle text extracted before and/or after the third through fifth chapter marks 410c-e is displayed below the respective third through fifth chapter mark 410c-e. Accordingly, a viewer who is viewing the video can read the extracted subtitle texi associated with each of the chapter marks 410a-e, and can determine therefrom whether the viewer desires to jump the present playback location to a previous or forward occurring one of the chapter marks A 10a-e.
[0063] Figure 5 illustrates another embodiment of the video display 228 and shows the graphics that may be displayed during playback of video frames thereon Referring to Piguie '->. the displayed graphics include the video playback timeline 400 the plurality of chapter marks 410a-e, and the present location indicia 420 that were shown and described above with regard to Figure 4. Flic graphics of Figure 5 differ from those of Figure 4 by the display in Figure 5 of a snapshot of a video frame of the program/movie content portion of the video stream following each of the displayed addressable chapter marks 410a~e. The snapshots may be displayed on the display 228 adjacent to (e.g., below) each of the corresponding displayed addressable chapter marks 410a~e.
[0064] Thus, for example, a snapshot 500a of a video frame that occurs following the first chapter mark 410a is displayed below the first chapter mark 410a. Likewise, a snapshot 500b of a video frame that occurs following the second chapter mark 410b is displayed below the first chapter mark 41Oa. In this manner, snapshots 500c-e of video frames following the third through fifth chapter marks 410c-e are displayed below the respective third through fifth chapter mark 410c-e. Accordingly, a user who is viewing the video can visually observe the snapshot pictures 500a~e from a portion of the video following each of the displayed chapter marks 410a-e, and can determine therefrom whether the viewer desires to jump the present playback location to a previous or forwardly occurring one of the chapter marks 410a-e corresponding to one or more of the displayed snapshot pictures 500a-e.
[0065] In some other embodiments, which may be useful when the area of the display 228 is insufficient to adequately display the video stream and a plurality of the snapshots 500a-e (e.g., the smaller display of Figure 3), the video storage/playback module 246 may display only one of the pictures 500a-e that corresponds to the next occurring displayed addressable chapter mark. Thus, in Figure 5 the snapshot picture 500d would be displayed because it follows the next occurring chapter mark 41Od adjacent to the present location indicia 420.
[00661 In some other embodiments, various ones of the snapshots 500a-e may be separately displayed as a user fast-forwards and/or rewinds the video playback past respective ones of the chapter marks 410a-e. Thus, for example, the snapshot 500b may be enlarged Lo fill the video display area when the user fast -forwards to within a defined distance of or crosses-over the chapter mark 410b.
[0067J In some othei embodiments, the snapshots 500a -e may be repeating video clips having defined repetition times. Flius, for example, the video clip 500a may repetitively play five seconds of video leading up -to and/or following from Ilic defined chapter mark 410a, with the othei video clips 500b-e repetitively playing defined lengths of video associated in time with the respective chapter marks 410b-c. [©068] Although an exemplary screen layout has been shown in Figure 5, the invention is not limited thereto. For example, the snapshots 500a-e may be displayed in rows and columns forming a grid. Individual ones of the snapshots 500a-e may be separately enlarged (fish-eye enlargement) and displayed on an enlarged portion of a scrollbar and/or overlaid on a portion of the displayed video. The area of the display that is used to display the video may be reduced to make room for an enlarged display of one or more of the snapshots 500a-e. [0069] In some other embodiments, the accuracy and/or speed at which the advertising identification unit 240 can identify locations of advertising content in a received video stream and/or in a video stream that is read from the memory 260, may be improved by searching within defined time windows. The time windows are defined around the expected times at which the instances of advertising content are expected to occur in the video stream. Exemplary operations of the advertising identification unit 240 are described below with regard to Figure 6. [0070] Referring to Figure 6, a video timeline 600 is illustrated with a plurality of time windows 610a, 610b, and 610c which are overlaid thereon. The time windows 610a-c each correspond to where during the video stream the advertising content is expected to occur. Although advertising content may be expected to occur at periodically spaced intervals, such as every 15 minutes, the precise location of the beginning and/or end of the advertising content can vary over time because the broadcast service provider may shift the beginning of the advertisement content to correspond to the end of a naturally occurring scene change and/or at the end of a dialogue between actors in a scene in the program/movie. Accordingly, the width of the time windows 610a-c may be defined based on a level of uncertainty of where advertising content will begin and/or will end in the video stream. (00711 For example, when advertising content is expected Io occur at more precisely known periodic intervals, the width of the 1imc windows 610a -c may be relatively small (e.g., a few seconds) around each one of the expected beginning/end locations 620a -o of the advertising content.
10072) The advertising identification unit 242 may more quickly and accurately identify the beginning and/or end of each instance of the advertising content by searching within each of the time windows 610a-c to identify where a change of scene content occurs, with the change of scene content being defined as the beginning or end of the advertising content. The advertising identification unit 242 may, for example, identify a transition between program/movie content and advertising content in response to identifying a black video frame occurring within the time windows 610a-c, and/or in response to identifying a threshold amount of change between the content of a present video frame and the content of a previous video frame occurring within the time windows 610a-c (which may be measured at the output of a MPEG decoder which compares video frames to identify changed content). [0073] In some further embodiments, the advertising identification unit 242 can dynamically shift the location of the time windows in which the searching is carried out to identify the advertising content. The advertising identification unit 242 may alternatively or additionally vary the width of the time windows in response to identifying a location of one or more instances of the advertising content in the video stream. Referring to Figure 7, a timeline of a video stream is illustrated with a plurality of time windows 702a, 702b, and 702c. The advertising identification unit 242 can search within an initial wider time window 702a to identify a first instance of advertising content in the video stream at location 710a. In response to identifying the first instance at location 710a, the advertising identification unit 242 can then search for subsequent instances of the advertising content in subsequent time windows 702b and 702c.
[0074] The starting location of the second time window 702b can be determined as a defined time interval 712 from the identified location 710a of the first instance of the advertising content. The time window 702b can be narrower than the time window 702a because of the increased certainty with which the next instance 710b of advertising content in the video stream can be determined relative to the identified location 710a.
[0075] Similarly. Ihe starting location of the subsequent time windows 702c can be determined as a defined time inteivaj 716 from ihe identified location /10b of the advertising content identified within the time window 702b. The time window 702c may bo narrower than the time window 702b because of the increased ceitainty of the location of Lhe next instance 71 Oc of advertising content in the video stream relative to the previously identified location 710b of the advertising content. |0076] In some fuithei embodiments, the advertising identification unit 242 can observe a viewer's behavior during playback of a video stream from the memory 260 to determine the location of the start/end of advertising content in the video stream. For example, when a viewer jumps to a chapter mark corresponding to the location 710b and then causes playback to reverse a defined distance before continuing the playback, the advertising identification unit 242 can determine from that behavior that the location of that chapter mark is incorrectly shifted to the right of the start of the program/movie content portion of the video stream, and can correct the chapter mark location by shifting it to the left about the defined distance to correspond to about where the viewer stopped the reversal to continue the playback of the video stream. [0077J By way of further example, when a viewer jumps to a chapter mark corresponding to the location 71 Ob and then causes playback to fast- forward a defined distance before continuing normal speed playback, the advertising identification unit 242 can determine from that behavior that the location of that chapter mark is incorrectly shifted to the left of the start of the program/movie content portion of video stream, and can correct the chapter mark location by shifting it to the right about the defined distance to correspond to about where the viewer stopped the fast- forward to continue the normal speed playback of the video stream. [0078] In some further embodiments, the video controller 240 is configured to share the identified chapter mark locations with another communication device, such as with the wireless communication terminal 160 shown in Figure 1. The video controller 240 may further share the extracted subtitle text and/or the snapshot pictures associated with the chapter mark locations with the other communication device. For example, the video controller 240 may generate a message that includes an identifier that identifies the video stream (e.g., name of the TV show and episode and/or name of a movie), the addressable chapter marks, the extracted subtitle text and/or the snapshot pictures associated with the chapter marks. Video controller 240 can transπiii the generated message through the RV transceiver 210 to the othei terminal 160 via the ceiltilai base station transceiver 130 and/or the WLΛN/BIuetooth network 110,
[0079| Alternatively or additionally, the video controller 240 can store the identified chapter mark locations and associated information (snapshot images, subtitle text, etc.) in a centralized network database, such as in an Internet accessible database repository, where they can be retrieved and used by other communication devices. The Internet database may include, for example, the Internet Movie Database (IMDb) and/or the Grace-Note database. The information in the network database may be compiled through an accumulation of submissions from a plurality of different communication device users, such as from users who have automatically (as described above) and/or manually generated chapter marks and associated information. Chapter marks that have been submitted by one user may be edited, deleted, and/or added-to by submissions from another user. [0080] Consequently, once the chapter marks and associated information have been defined for a particular video stream (i.e., a particular TV show or movie), they may be shared with other communication devices which can use them during playback of that video stream recorded thereon.
[0081] As will be appreciated by one of skill in the art, the present invention may be embodied as apparatus (terminals, servers, systems), methods, and computer program products. Accordingly, the present invention may take the form of an entirely hardware embodiment, a software embodiment or an embodiment combining software and hardware aspects all generally referred to herein as a "circuit" or "module." It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, described herein can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
[0082] The contpuicr program instructions can be recorded on a computer readable storage medium, such as on hard disks, CD ROMs, optica) storage devices, or integrated circuit memory devices. These computer program instructions on the computer-readable storage medium direct a computer or other programmable data processing apparatus Io function in a particular manner, such that the instructions stored in the computer-readable storage medium when executed by a processor produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks. f0083] The computer program instructions may also be loaded onto and executed by a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. [0084] In the drawings and specification, there have been disclosed embodiments of the invention and, although specific terms are employed, they are used in a generic and descriptive sense only and not for purposes of limitation, the scope of the invention being set forth in the following claims.

Claims

CLAIMS:
1. An electronic device being characterized by: a video storage memory; a video signal receiver that is configured to receive from a broadcast source a video stream containing advertising content and program/movie content; and a video storage controller that is configured to identify locations of advertising content interspersed among program/movie content in the received video stream, and to record addressable chapter marks for the identified locations of the advertising content and a video stream that is based on the received video stream into the memory.
2. Electronic device according to claim 1, wherein the video storage controller is further configured to insert the addressable chapter marks within an address look-up table that is recorded within a same memory file that contains the video stream.
3. Electronic device according to any of the claims 1-2, wherein the video storage controller is further configuicd to remove and replace each instance of the advertising coiπeni ol the leccivcd video stream with a corresponding one of the1 addressable chapter marks to generate a modified video stream that is recorded into the memory
4. Electronic device according to any of the claims 1 -3, wherein the video storage controller is further configured to extract subtitle text that is embedded in the program/movie content portion of the received video stream and located within a defined play time relative to each of the identified locations of advertising content, and to insert the extracted subtitle text as part of the addressable chapter marks that arc recorded with the video stream into the memory.
5. Electronic device according to claim 4, wherein the video storage controller is further configured to begin displaying on a display the extracted subtitle text for a next occurring addressable chapter mark during playback of the video stream before the playback reaches that next occurring addressable chapter mark.
6. Electronic device according to any of the claims 1-5, wherein the video storage controller is further configured to capture a snapshot of a video frame of the program/movie content portion of the video stream following each of the identified locations of the advertising content, and to insert the captured snapshots as part of the addressable chapter marks that are recorded with the video stream into the memory.
7. Electronic device according to claim 6, wherein the video storage controller is further configured to begin displaying on a display the captured snapshot for a next occurring addressable chapter mark during playback of the video stream before the playback reaches that next occurring addressable chapter mark.
8. Electronic device according to any of the claims 1-7, wherein the video storage controller is further configured to playback the video stream, which was recorded into the memory, onto a video display, to display on the display a playback timeline that indicates a playback length of the video stream and includes an indicia that indicates a present playback location within the playback timeline, and Io display on the playback timeline at least a plurality of the addressable chapter marks having spacing therebetween that is proportional to their relative locations within the playback timeline of the video stream.
9. Electronic device according to claim 8 wherein the video storage controllei is further configured to respond to a viewer chaptei selection signal by jumping a playback location within the video stream to locations defined by selected ones of the addressable chapter marks.
10. Electronic device according to claim 9, wherein the video storage controller is further configured to respond to each occurrence of the viewer chapter selection signal by jumping the playback location to a different one of sequentially occurring time locations in the video stream defined by sequential ordered ones of the addressable chapter marks.
1 1. Electronic device according to any of the claims 9-10, wherein the video storage controller is further configured to extract subtitle text that is embedded in the program/movie content portion of the video stream recorded in the memory and located within a defined play time relative to a next playback occurring one of the displayed addressable chapter marks, and to begin displaying the extracted subtitle text before playback reaches that next occurring displayed addressable chapter mark.
12. Electronic device according to claim 11, wherein the subtitle text comprises closed captioned text that is embedded in the program/movie content portion of the video stream recorded in the memory, and the video storage controller is further configured to extract and display on the video display a defined number of words of the closed captioned text that occur prior to the next playback occurring one of the displayed addressable chapter marks.
13. Electronic device according to any of the claims 9-12, wherein the video storage controller is further configured to extract subtitle text that is embedded in the program/movie content portion of the video stream recorded in the memory and located within a defined play time relative to a plurality of the displayed addressable chapter marks, and to display on Ihc display the extracted subtitle text for the plurality of the displayed addressable chaptc; marks.
14. Klccironic device according to claim 1 }. wherein the video storage controller is further configured to display the extracted subtitle text associated with a plurality of the displayed addressable cliaptei marks ordered on the display adjacent to those displayed addressable chapter marks.
15. Electronic device according to any of the claims 13-14, wherein the extracted subtitle text comprises closed captioned text that is embedded in the video stream recorded in the memory, and the video storage controller is further configured to extract and display on the video display a defined number of words of the closed captioned text that occur following a plurality of the displayed addressable chapter marks.
16. Electronic device according to any of the claims 9-15, wherein the video storage controller is further configured to capture a snapshot of a video frame of the program/movie content portion of the video stream following a next playback occurring one of the displayed addressable chapter marks, and to begin displaying the captured snapshot before playback reaches that next occurring displayed addressable chapter mark.
17. Electronic device according to any of the claims 9-16, wherein the video storage controller is further configured to capture a snapshot of a video frame of the program/movie content portion of the video stream following each of the displayed addressable chapter marks, and to display on the video display the captured snapshots for the plurality of the displayed addressable chapter marks.
18. Electronic device according to any of the claims 1-17, wherein the video storage controller is further configured to identify the location of each instance of the advertising content in the received video stream in response a threshold amount of change of scene content occurring between two sequential frames of the video stream during a time window defined around an expected time of occurrence of each instance of the advertising conlenl.
19. Hlccironic device according 1o claim 1 8. wherein the video storage controller is furtlici configured to identifying the location of a first instance of the advertising content and to then determine a start location of a subsequent time window, which it will use to search for a second instance of the advertising content, as a defined time interval away from the identified location of the first instance of the advertising content.
20. Electronic device according to any of the claims 1-19, wherein the video storage controller is further configured to generate a message including an identifier for the video stream and the associated addressable chapter marks, and to transmit the message through an external network to another electronic device for use in displaying the video stream with the addressable chapter marks.
Li
PCT/IB2008/054688 2008-05-08 2008-11-10 Electronic devices and methods that insert addressable chapter marks relative to advertising content in video streams WO2009136236A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP08874198.8A EP2274744B1 (en) 2008-05-08 2008-11-10 Electronic devices and methods that insert addressable chapter marks relative to advertising content in video streams
CN2008801290428A CN102016997B (en) 2008-05-08 2008-11-10 Electronic devices and methods that insert addressable chapter marks relative to advertising content in video streams
KR1020107027577A KR101519694B1 (en) 2008-05-08 2008-11-10 Electronic devices and methods that insert addressable chapter marks relative to advertising content in video streams
JP2011508003A JP5232296B2 (en) 2008-05-08 2008-11-10 Electronic device and method for inserting addressable heading marks relative to advertising content in a video stream

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US12/117,321 2008-05-08
US12/117,321 US8249423B2 (en) 2008-05-08 2008-05-08 Electronic devices and methods that insert addressable chapter marks relative to advertising content in video streams

Publications (1)

Publication Number Publication Date
WO2009136236A1 true WO2009136236A1 (en) 2009-11-12

Family

ID=40404167

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2008/054688 WO2009136236A1 (en) 2008-05-08 2008-11-10 Electronic devices and methods that insert addressable chapter marks relative to advertising content in video streams

Country Status (6)

Country Link
US (1) US8249423B2 (en)
EP (1) EP2274744B1 (en)
JP (1) JP5232296B2 (en)
KR (1) KR101519694B1 (en)
CN (1) CN102016997B (en)
WO (1) WO2009136236A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2472519A1 (en) * 2011-01-04 2012-07-04 Samsung Electronics Co., Ltd. Multi-video rendering for enhancing user interface usability and user experience
US8891935B2 (en) 2011-01-04 2014-11-18 Samsung Electronics Co., Ltd. Multi-video rendering for enhancing user interface usability and user experience
EP2824665A1 (en) * 2013-07-11 2015-01-14 LG Electronics Inc. Mobile terminal and method of controlling the mobile terminal
WO2016204936A1 (en) * 2015-06-18 2016-12-22 Apple Inc. Device, method, and graphical user interface for navigating media content
WO2017055876A1 (en) * 2015-10-02 2017-04-06 Culloma Technologies Limited Video and/or audio data processing system
US9928029B2 (en) 2015-09-08 2018-03-27 Apple Inc. Device, method, and graphical user interface for providing audiovisual feedback
US9990113B2 (en) 2015-09-08 2018-06-05 Apple Inc. Devices, methods, and graphical user interfaces for moving a current focus using a touch-sensitive remote control
EP3571837A4 (en) * 2017-02-02 2019-12-11 Huawei Technologies Co., Ltd. Content-aware energy savings for video streaming and playback on mobile devices
FR3099674A1 (en) * 2019-08-03 2021-02-05 Synchronized METHOD AND APPARATUS FOR ENRICHING MULTIMEDIA CONTENT BY META-INFORMATION
US11922006B2 (en) 2018-06-03 2024-03-05 Apple Inc. Media control for screensavers on an electronic device

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100082237A1 (en) * 2008-09-30 2010-04-01 Microsoft Corporation Journal service
KR101547936B1 (en) * 2008-12-24 2015-08-27 삼성전자 주식회사 Display apparatus and control method thereof
US8990692B2 (en) * 2009-03-26 2015-03-24 Google Inc. Time-marked hyperlinking to video content
US20120044254A1 (en) * 2009-04-28 2012-02-23 Keiko Watanuki Display apparatus, display method and program for executing the same
US8977783B2 (en) * 2009-10-21 2015-03-10 Media Ip, Llc High-speed secure content transfer to SD card from kiosk
US9595300B2 (en) * 2009-10-21 2017-03-14 Media Ip, Llc Contextual chapter navigation
US8942549B2 (en) * 2009-10-21 2015-01-27 Media Ip, Llc Resume point for digital media playback
US8898803B1 (en) 2010-01-11 2014-11-25 Media Ip, Llc Content and identity delivery system for portable playback of content and streaming service integration
US8745749B2 (en) 2010-11-15 2014-06-03 Media Ip, Llc Virtual secure digital card
US20120179967A1 (en) * 2011-01-06 2012-07-12 Tivo Inc. Method and Apparatus for Gesture-Based Controls
US20120209963A1 (en) * 2011-02-10 2012-08-16 OneScreen Inc. Apparatus, method, and computer program for dynamic processing, selection, and/or manipulation of content
US8775827B2 (en) 2011-03-28 2014-07-08 Media Ip, Llc Read and write optimization for protected area of memory
US8949879B2 (en) 2011-04-22 2015-02-03 Media Ip, Llc Access controls for known content
US9043444B2 (en) 2011-05-25 2015-05-26 Google Inc. Using an audio stream to identify metadata associated with a currently playing television program
US8484313B2 (en) 2011-05-25 2013-07-09 Google Inc. Using a closed caption stream for device metadata
US8903908B2 (en) * 2011-07-07 2014-12-02 Blackberry Limited Collaborative media sharing
CN104378331B (en) * 2013-08-14 2019-11-29 腾讯科技（北京）有限公司 The broadcasting of network media information and response processing method, device and system
US9557896B1 (en) * 2013-08-22 2017-01-31 Google Inc. Cloud-based tool for creating video interstitials
US9792957B2 (en) 2014-10-08 2017-10-17 JBF Interlude 2009 LTD Systems and methods for dynamic video bookmarking
US20160295256A1 (en) * 2015-03-31 2016-10-06 Microsoft Technology Licensing, Llc Digital content streaming from digital tv broadcast
EP3951579A1 (en) * 2015-12-15 2022-02-09 Huawei Technologies Co., Ltd. Operation track response method and operation track response apparatus
US11256923B2 (en) * 2016-05-12 2022-02-22 Arris Enterprises Llc Detecting sentinel frames in video delivery using a pattern analysis
EP3981164A4 (en) 2019-06-07 2023-05-31 Roku, Inc. Content-modification system with broadcast schedule utilization feature
WO2020247921A1 (en) * 2019-06-07 2020-12-10 The Nielsen Company (Us), Llc Content-modification system with in-band message data utilization feature
CN112543368A (en) * 2019-09-20 2021-03-23 北京小米移动软件有限公司 Video processing method, video playing method, video processing device, video playing device and storage medium
US20210258647A1 (en) * 2020-02-18 2021-08-19 JBF Interlude 2009 LTD Dynamic adaptation of interactive video players using behavioral analytics
US11882337B2 (en) 2021-05-28 2024-01-23 JBF Interlude 2009 LTD Automated platform for generating interactive videos
US11934477B2 (en) 2021-09-24 2024-03-19 JBF Interlude 2009 LTD Video player integration within websites

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222532B1 (en) * 1997-02-03 2001-04-24 U.S. Philips Corporation Method and device for navigating through video matter by means of displaying a plurality of key-frames in parallel
WO2002084598A1 (en) * 2001-04-10 2002-10-24 Artesia Technologies, Inc. Method and system for streaming media manager
US20030122966A1 (en) 2001-12-06 2003-07-03 Digeo, Inc. System and method for meta data distribution to customize media content playback
GB2423882A (en) * 2005-03-01 2006-09-06 Half Minute Media Ltd Acting on known video entities detected utilizing fingerprinting
US20060263045A1 (en) 2005-05-17 2006-11-23 Kabushiki Kaisha Toshiba Video image recording and reproducing apparatus and video image recording and reproducing method
US20070031118A1 (en) 2005-08-02 2007-02-08 Funai Electric Co., Ltd. Recording apparatus
US20070206923A1 (en) 2005-11-14 2007-09-06 Sony Corporation Information processing apparatus, display method thereof, and program thereof
US20080016089A1 (en) 2005-11-18 2008-01-17 Mika Nishiyama Recording/reproducing apparatus

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100552248B1 (en) * 1997-02-03 2006-06-15 코닌클리케 필립스 일렉트로닉스 엔.브이. Method and apparatus for navigating through video material by multiple key-frames parallel display
US6711741B2 (en) * 1999-04-07 2004-03-23 Intel Corporation Random access video playback system on a network
CN100379273C (en) * 1999-09-20 2008-04-02 提维股份有限公司 Closed caption tagging system
US7272295B1 (en) * 1999-11-10 2007-09-18 Thomson Licensing Commercial skip and chapter delineation feature on recordable media
US7401351B2 (en) * 2000-12-14 2008-07-15 Fuji Xerox Co., Ltd. System and method for video navigation and client side indexing
JP4593842B2 (en) * 2001-08-03 2010-12-08 キヤノン株式会社 Moving image retrieval apparatus and control method thereof
JP2003339031A (en) * 2002-05-20 2003-11-28 Hitachi Ltd Television receiver
US7735104B2 (en) * 2003-03-20 2010-06-08 The Directv Group, Inc. System and method for navigation of indexed video content
EP1469476A1 (en) * 2003-04-16 2004-10-20 Accenture Global Services GmbH Controlled multi-media program review
US20040210896A1 (en) * 2003-04-21 2004-10-21 Chou Charles C.L. Distributed interactive media authoring and recording
JP2004364234A (en) * 2003-05-15 2004-12-24 Pioneer Electronic Corp Broadcast program content menu creation apparatus and method
JP4203741B2 (en) * 2003-09-25 2009-01-07 日本電気株式会社 Data reproducing apparatus and data reproducing method
JP4124110B2 (en) * 2003-11-26 2008-07-23 ソニー株式会社 Content viewing support apparatus, content viewing support method, and computer program
CA2563107C (en) * 2004-03-29 2014-03-04 Nielsen Media Research, Inc. Methods and apparatus to detect a blank frame in a digital video broadcast signal
JP2005303742A (en) * 2004-04-13 2005-10-27 Daikin Ind Ltd Information processing apparatus and information processing method, program, and information processing system
TWI247239B (en) * 2004-06-18 2006-01-11 Via Tech Inc Advertising detection method and related system for detecting advertising according to specific beginning/ending images of advertising sections
JP4616274B2 (en) * 2004-11-02 2011-01-19 株式会社テレビ朝日データビジョン Still image content creation device with caption, still image content creation program with caption, and still image content creation system with caption
US7690011B2 (en) * 2005-05-02 2010-03-30 Technology, Patents & Licensing, Inc. Video stream modification to defeat detection
US7734579B2 (en) * 2006-02-08 2010-06-08 At&T Intellectual Property I, L.P. Processing program content material
JP2007266838A (en) * 2006-03-28 2007-10-11 Sharp Corp Recording and reproducing device, recording and reproducing method, and record medium recorded with recording and reproducing program
US7965923B2 (en) * 2006-05-01 2011-06-21 Yahoo! Inc. Systems and methods for indexing and searching digital video content
JP2008048297A (en) * 2006-08-21 2008-02-28 Sony Corp Method for providing content, program of method for providing content, recording medium on which program of method for providing content is recorded and content providing apparatus
JP2008277967A (en) * 2007-04-26 2008-11-13 Sony Corp Information processing device and information processing method, program, and recording medium
US20090222853A1 (en) * 2008-02-29 2009-09-03 At&T Knowledge Ventures, L.P. Advertisement Replacement System
US20090288112A1 (en) * 2008-05-13 2009-11-19 Porto Technology, Llc Inserting advance content alerts into a media item during playback
US9521437B2 (en) * 2009-06-17 2016-12-13 Google Technology Holdings LLC Insertion of recorded secondary digital video content during playback of primary digital video content

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222532B1 (en) * 1997-02-03 2001-04-24 U.S. Philips Corporation Method and device for navigating through video matter by means of displaying a plurality of key-frames in parallel
WO2002084598A1 (en) * 2001-04-10 2002-10-24 Artesia Technologies, Inc. Method and system for streaming media manager
US20030122966A1 (en) 2001-12-06 2003-07-03 Digeo, Inc. System and method for meta data distribution to customize media content playback
GB2423882A (en) * 2005-03-01 2006-09-06 Half Minute Media Ltd Acting on known video entities detected utilizing fingerprinting
US20060263045A1 (en) 2005-05-17 2006-11-23 Kabushiki Kaisha Toshiba Video image recording and reproducing apparatus and video image recording and reproducing method
US20070031118A1 (en) 2005-08-02 2007-02-08 Funai Electric Co., Ltd. Recording apparatus
US20070206923A1 (en) 2005-11-14 2007-09-06 Sony Corporation Information processing apparatus, display method thereof, and program thereof
US20080016089A1 (en) 2005-11-18 2008-01-17 Mika Nishiyama Recording/reproducing apparatus

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8891935B2 (en) 2011-01-04 2014-11-18 Samsung Electronics Co., Ltd. Multi-video rendering for enhancing user interface usability and user experience
EP2472519A1 (en) * 2011-01-04 2012-07-04 Samsung Electronics Co., Ltd. Multi-video rendering for enhancing user interface usability and user experience
US9639251B2 (en) 2013-07-11 2017-05-02 Lg Electronics Inc. Mobile terminal and method of controlling the mobile terminal for moving image playback
EP2824665A1 (en) * 2013-07-11 2015-01-14 LG Electronics Inc. Mobile terminal and method of controlling the mobile terminal
KR20220047396A (en) * 2015-06-18 2022-04-15 애플 인크. Device, method, and graphical user interface for navigating media content
KR20220162867A (en) * 2015-06-18 2022-12-08 애플 인크. Device, method, and graphical user interface for navigating media content
US11816303B2 (en) 2015-06-18 2023-11-14 Apple Inc. Device, method, and graphical user interface for navigating media content
US9652125B2 (en) 2015-06-18 2017-05-16 Apple Inc. Device, method, and graphical user interface for navigating media content
KR102551150B1 (en) 2015-06-18 2023-07-03 애플 인크. Device, method, and graphical user interface for navigating media content
US9639241B2 (en) 2015-06-18 2017-05-02 Apple Inc. Device, method, and graphical user interface for navigating media content
US10073592B2 (en) 2015-06-18 2018-09-11 Apple Inc. Device, method, and graphical user interface for navigating media content
US10073591B2 (en) 2015-06-18 2018-09-11 Apple Inc. Device, method, and graphical user interface for navigating media content
KR102471681B1 (en) 2015-06-18 2022-11-29 애플 인크. Device, method, and graphical user interface for navigating media content
WO2016204936A1 (en) * 2015-06-18 2016-12-22 Apple Inc. Device, method, and graphical user interface for navigating media content
US10572109B2 (en) 2015-06-18 2020-02-25 Apple Inc. Device, method, and graphical user interface for navigating media content
US10545635B2 (en) 2015-06-18 2020-01-28 Apple Inc. Device, method, and graphical user interface for navigating media content
US10152300B2 (en) 2015-09-08 2018-12-11 Apple Inc. Device, method, and graphical user interface for providing audiovisual feedback
US10599394B2 (en) 2015-09-08 2020-03-24 Apple Inc. Device, method, and graphical user interface for providing audiovisual feedback
US10963130B2 (en) 2015-09-08 2021-03-30 Apple Inc. Devices, methods, and graphical user interfaces for moving a current focus using a touch-sensitive remote control
US11262890B2 (en) 2015-09-08 2022-03-01 Apple Inc. Devices, methods, and graphical user interfaces for moving a current focus using a touch-sensitive remote control
US10474333B2 (en) 2015-09-08 2019-11-12 Apple Inc. Devices, methods, and graphical user interfaces for moving a current focus using a touch-sensitive remote control
US9990113B2 (en) 2015-09-08 2018-06-05 Apple Inc. Devices, methods, and graphical user interfaces for moving a current focus using a touch-sensitive remote control
US11635876B2 (en) 2015-09-08 2023-04-25 Apple Inc. Devices, methods, and graphical user interfaces for moving a current focus using a touch-sensitive remote control
US9928029B2 (en) 2015-09-08 2018-03-27 Apple Inc. Device, method, and graphical user interface for providing audiovisual feedback
US11960707B2 (en) 2015-09-08 2024-04-16 Apple Inc. Devices, methods, and graphical user interfaces for moving a current focus using a touch-sensitive remote control
WO2017055876A1 (en) * 2015-10-02 2017-04-06 Culloma Technologies Limited Video and/or audio data processing system
EP3571837A4 (en) * 2017-02-02 2019-12-11 Huawei Technologies Co., Ltd. Content-aware energy savings for video streaming and playback on mobile devices
US11922006B2 (en) 2018-06-03 2024-03-05 Apple Inc. Media control for screensavers on an electronic device
FR3099674A1 (en) * 2019-08-03 2021-02-05 Synchronized METHOD AND APPARATUS FOR ENRICHING MULTIMEDIA CONTENT BY META-INFORMATION

Also Published As

Publication number Publication date
CN102016997B (en) 2012-07-04
KR20110021864A (en) 2011-03-04
US20090282454A1 (en) 2009-11-12
US8249423B2 (en) 2012-08-21
CN102016997A (en) 2011-04-13
KR101519694B1 (en) 2015-05-12
JP2011524108A (en) 2011-08-25
JP5232296B2 (en) 2013-07-10
EP2274744B1 (en) 2014-12-17
EP2274744A1 (en) 2011-01-19

Similar Documents

Publication Publication Date Title
US8249423B2 (en) Electronic devices and methods that insert addressable chapter marks relative to advertising content in video streams
US9106941B2 (en) Method and apparatus for alternate content scheduling on mobile devices
JP4842944B2 (en) Select content from a stream of video or audio data
US20070186266A1 (en) Digital home movie library
CN102077602A (en) Interval based ad insertion used for the delivery of video streams
US11750856B2 (en) Addressable advertising insertion for playout delay
EP2214398B1 (en) A method for processing an audio/video stream
JP2007251803A (en) Recording and reproducing apparatus, mobile terminal device, recording and reproducing system, and recording and reproducing method
US20110314380A1 (en) Extensible video insertion control
US8683522B2 (en) Animated station identifier in program guides
JP2009055629A (en) Recording and reproducing apparatus, mobile terminal device, recording and reproducing system, and recording and reproducing method
WO2007145281A1 (en) Video reproducing device, video reproducing method, and video reproducing program
JP3576547B2 (en) Meta Information Service System on Network
KR102279404B1 (en) Apparatus and method for receiving and playing contents
CN105654352A (en) Interval-based advertisement insertion for video streaming delivery
JP5623108B2 (en) Information processing apparatus, information processing apparatus control method, and program
CN113347480A (en) Method and system for displaying video paster advertisement
JP2009017443A (en) Motion picture content viewing decision system
JP2004159040A (en) Meta-information service system over network

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200880129042.8

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08874198

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2011508003

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2008874198

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20107027577

Country of ref document: KR

Kind code of ref document: A