EP2773108B1 - Reception device, reception method, program, and information processing system - Google Patents

Reception device, reception method, program, and information processing system Download PDF

Info

Publication number
EP2773108B1
EP2773108B1 EP12843610.2A EP12843610A EP2773108B1 EP 2773108 B1 EP2773108 B1 EP 2773108B1 EP 12843610 A EP12843610 A EP 12843610A EP 2773108 B1 EP2773108 B1 EP 2773108B1
Authority
EP
European Patent Office
Prior art keywords
content
command
over
change
reception device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP12843610.2A
Other languages
German (de)
French (fr)
Other versions
EP2773108A1 (en
EP2773108A4 (en
Inventor
Naohisa Kitazato
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Saturn Licensing LLC
Original Assignee
Saturn Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Saturn Licensing LLC filed Critical Saturn Licensing LLC
Publication of EP2773108A1 publication Critical patent/EP2773108A1/en
Publication of EP2773108A4 publication Critical patent/EP2773108A4/en
Application granted granted Critical
Publication of EP2773108B1 publication Critical patent/EP2773108B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/835Generation of protective data, e.g. certificates
    • H04N21/8358Generation of protective data, e.g. certificates involving watermark
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H20/00Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/10Arrangements for replacing or switching information during the broadcast or the distribution
    • H04H20/106Receiver-side switching
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H2201/00Aspects of broadcast communication
    • H04H2201/40Aspects of broadcast communication characterised in that additional data relating to the broadcast data are available via a different channel than the broadcast channel
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H2201/00Aspects of broadcast communication
    • H04H2201/90Aspects of broadcast communication characterised by the use of signatures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/37Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying segments of broadcast information, e.g. scenes or extracting programme ID
    • H04H60/375Commercial

Definitions

  • the present technology relates to a reception device, a reception method, a program, and an information processing system, and particularly relates to a reception device capable of changing over content using a content identification technique, a reception method, a program, and an information processing system.
  • some reception devices like this have a VOD (video on demand) function to allow distribution content to be acquired from a distribution server at any time via the Internet and reproduced.
  • VOD video on demand
  • WO 2004/080073 A2 discloses a method and a system including a first aspect providing a television signal substitution system that replaces standard video segments with selected replacement portions. Video segments such as advertisements are detected using techniques such as fingerprinting or manual detection. The detected video segment is replaced with a selected replacement portion and output to an output device.
  • a second aspect provides an ad reselling system that sells targeted advertisements, which replaces standard advertisements in a video signal. Sponsors of the targeted advertisements are billed when their advertisements are used to replace other advertisements.
  • fingerprint data of known advertisements can be stored in a fingerprint database. When new fingerprint data is available, the fingerprint data can be automatically or manually transmitted to subscribers. Various techniques can be used to identify advertisements based on the fingerprint data.
  • EP 1705908 A2 discloses methods, systems and computer program products for identifying and distinguishing content, such as commercials, can be used with means for marking key frames within the commercials to facilitate replacement of commercials and other programming segments in such a way as to provide improved focus and relevance for targeted advertising based on known and/or dynamic conditions.
  • the identification of commercial features can also be used to provide improved trick play functionality while the commercial or other programming is rendered.
  • WO 2005/006758 A1 discloses a device and a method of relating one or more trigger actions with a multimedia signal and corresponding method and device for detecting one or more trigger actions in a multimedia signal.
  • One fingerprint is generated on the basis of a segment of the multimedia signal at each trigger time point.
  • the generated fingerprint(s) is stored in a database and communicated to playback devices.
  • playback fingerprints of the multimedia signal are generated and matched against fingerprints in the database.
  • associated trigger actions is retrieved.
  • the trigger time point is determined as a time point near or at a segment of the multimedia signal that caused a fingerprint to match. In this way, a simple and reliable way of detecting trigger markers for trigger actions is enabled without modifying the multimedia signal.
  • WO 2011/069035 A1 discloses a method for interpreting messages, user-defined alert conditions, voice commands and performing an action in response is described, A method for annotating media content is described. A method for presenting additional content associated with media content identified based on a fingerprint is described. A method for identifying that an advertisement portion of media content is being played based on a fingerprint derived from the media content is described. A method of one media device recording particular media content automatically in response to another media device recording the particular media content is described. A method of concurrently playing media content on multiple devices is described. A method of publishing information associated with recording of media content is described. A method of deriving fingerprints by media devices that meet an idleness criteria is described. A method of recording or playing media content identified based on fingerprints is described.
  • Patent Literature 1 JP 2006-245653A
  • ACR Automatic Content Recognition
  • the hybrid service of broadcast and communication would be able to be provided by identifying the content using the ACR technology and further providing the application program which is executed in association with the identified content.
  • the present technology is provided in consideration of such a circumstance to allow the content to be changed over using the content identification technique.
  • the command is a first command for requesting a user to confirm whether or not a change-over is required to be carried out, prior to a timing of change-over from the first content to the second content, or a second command for changing over from the first content to the second content.
  • the control part requests the user to confirm whether or not the change-over is required to be carried out, in response to the first command. In a case where the user permits the change-over to be carried out, the control part changes over from the first content to the second content in response to the second command.
  • the command is the first command, the second command, or a third command for causing the second content to be acquired prior to a timing of change-over from the first content to the second content.
  • the control part acquires the second content in response to the third command prior to a timing of change-over.
  • the control part changes over from the first content to the acquired second content in response to the second command.
  • the second command includes time information indicating a time to execute the second command.
  • the control part changes over from the first content to the second content when a timing of change-over arrives in accordance with the time information included in the second command.
  • the second command or the third command is settable for each user.
  • the command is a fourth command for setting a state in which it is possible to change to the second content that corresponds to a viewpoint designated by the user, or a fifth command for ending the state in which it is possible to change to the second content that corresponds to the viewpoint designated by the user.
  • the control part sets the state in which it is possible to change to the second content that corresponds to the viewpoint designated by the user in response to the fourth command.
  • the control part ends the state in which it is possible to change to the second content that corresponds to the viewpoint designated by the user in response to the fifth command.
  • the reception device further includes a buffer configured to sequentially store data of the received first content when the first content is changed over to the second content, and an output part configured to output the first content stored in the buffer while the second content is being output, when the second content is changed over to the first content.
  • the reception device further includes an output part configured to output the received first content when the second content is changed over to the first content.
  • the identification result acquisition part acquires the identification result for the first content identified using an ACR (Automatic Content Recognition) technology from the extracted feature amount.
  • ACR Automatic Content Recognition
  • the first content is broadcast content broadcasted via a broadcast network
  • the second content is distribution content distributed from a distribution server via a communication network.
  • the feature amount extraction part extracts the feature amount from any one or both of a video signal and an audio signal of the first content.
  • the reception device may be an independent device or an internal block constituting one device.
  • a reception method or program according to the first aspect of the present technology is a reception method or program, as defined in claims 9 and 15, which corresponds to the reception device according to the first aspect of the present technology described above.
  • first content is received, wherein the first content is broadcast content broadcasted via a broadcast network, a feature amount is extracted from any one or both of a video signal and an audio signal of the received first content, wherein the feature amount is finger print information, an identification result, received from an Automatic Content Recognition, ACR, server, for the first content identified using an ACR technology from the extracted feature amount is acquired, a command, received from a command server, is acquired for controlling an operation of changing over between the first content and the second content different from the first content depending on the acquired identification result, wherein the second content is distribution content distributed from a distribution server via a communication network, and the first content is changed over to the second content depending on the acquired command.
  • ACR Automatic Content Recognition
  • the content can be changed over using the content identification technique.
  • FIG. 1 illustrates a broadcast system 1 of this embodiment.
  • This broadcast system 1 is configured to include a broadcast device 11, reception device 12, ACR server 13, command server 14, and distribution server 15.
  • the broadcast system 1 is an example of an information processing system.
  • the reception device 12, ACR server 13, command server 14, and distribution server 15 are coupled with each other via the Internet 16.
  • the broadcast device 11 is configured to transmit (broadcast) a digital television broadcast signal of broadcast content corresponding to a digital television program, CM or the like.
  • the reception device 12 receives the digital television broadcast signal transmitted from the broadcast device 11 to acquire video and audio of the broadcast content.
  • the reception device 12 outputs the acquired video and audio to a display (display 21 in FIG. 2 ) and a speaker (speaker 22 in FIG. 2 ), respectively.
  • reception device 12 may exist as a single device or be built in a digital television receiver, video recorder or the like, for example. Additionally, a detailed configuration of the reception device 12 will be described later with reference to FIG. 2 .
  • the reception device 12 periodically accesses the ACR server 13 via the Internet 16 to inquire the identification result for the broadcast content.
  • a feature amount hereinafter, also referred to as finger print information
  • the ACR server 13 includes a database having registered therein the feature amount extracted from the video signal and audio signal of any broadcast content.
  • the ACR server 13 identifies the broadcast content using the ACR (Automatic Content Recognition) technology in response to an inquiry from any terminal device coupled with the Internet 16.
  • the ACR server 13 collates the finger print information from the reception device 12 with the database to identify the broadcast content such as the digital television program and transmits the identification result therefor to the reception device 12 via the Internet 16.
  • the reception device 12 accesses the command server 14 via the Internet 16 depending on the identification result received from the ACR server 13 to acquire a video switch command.
  • the video switch command means a command for controlling an operation of changing over between the broadcast content from the broadcast device 11 and distribution content from the distribution server 15.
  • the command server 14 manages the video switch command.
  • the command server 14 transmits the video switch command to the reception device 12 via the Internet 16 in response to the inquiry from the reception device 12.
  • the reception device 12 controls the operation of changing over from the broadcast content to the distribution content in response to the video switch command received from the command server 14. Moreover, the reception device 12 accesses the distribution server 15 via the Internet 16 in response to the video switch command received from the command server 14 to acquire the video and audio of the distribution content. The reception device 12 outputs the acquired video and audio to the display and the speaker, respectively.
  • the distribution server 15 accumulates and manages one or more pieces of distribution content.
  • the distribution server 15 transmits (distributes) the distribution content to the reception device 12 via the Internet 16 in response to the inquiry from the reception device 12.
  • the broadcast system 1 is configured as below.
  • FIG. 2 is a diagram illustrating a configuration example of the reception device 12 in FIG. 1 .
  • the reception device 12 is configured to include a tuner 31, primary demultiplexer 32, retention buffer 33, retention controller 34, secondary demultiplexer 35, video decoder 36, audio decoder 37, switch 38, synthesis unit 39, video output unit 40, audio output unit 41, finger print extraction unit 42, communication I/F 43, command analysis unit 44, control unit 45, memory 46, operation unit 47, change-over controller 48, streaming processor 49, and content decoder 50.
  • the tuner 31 receives and demodulates the digital television broadcast signal from the broadcast device 11 to supply a multiplexed stream obtained as a result thereof to the primary demultiplexer 32.
  • the primary demultiplexer 32 extracts a TS (transport stream) which a user selects from the multiplexed stream supplied by the tuner 31 and supplies to the retention buffer 33.
  • the retention buffer 33 is constituted by a high-capacity record medium such as a HDD (hard disk drive) or a memory, for example.
  • the retention buffer 33 operates in accordance with control from the retention controller 34 in a pass-through mode or retention mode which is described later.
  • the retention buffer 33 when operating in the retention mode, sequentially stores data of the TS supplied from the primary demultiplexer 32.
  • the TS data stored in the retention buffer 33 is sequentially read out from the retention buffer 33 in accordance with control from the retention controller 34, and supplied to the secondary demultiplexer 35.
  • the retention buffer 33 when operating in the pass-through mode, supplies the TS data from the primary demultiplexer 32 as it is without storing therein to the secondary demultiplexer 35.
  • the retention controller 34 controls the retention buffer 33 in accordance with control from the change-over controller 48.
  • the secondary demultiplexer 35 separates the TS supplied from the retention buffer 33 to supply the separated video stream and audio stream to the video decoder 36 and the audio decoder 37, respectively.
  • the video decoder 36 decodes the video stream from the secondary demultiplexer 35 to supply a video signal obtained as a result thereof to the switch 38 and the finger print extraction unit 42.
  • the audio decoder 37 decodes the audio stream from the secondary demultiplexer 35 to supply an audio signal obtained as a result thereof to the switch 38 and the finger print extraction unit 42.
  • the switch 38 is supplied with the video signal from the video decoder 36 and the audio signal from the audio decoder 37 as well as the video signal and audio signal corresponding to the distribution content from the content decoder 50 which is described later.
  • the switch 38 supplies any one of the video signals which are supplied from the video decoder 36 and content decoder 50 to the synthesis unit 39 in accordance with control from the change-over controller 48. Moreover, the switch 38 supplies any one of the audio signals which are supplied from the audio decoder 37 and content decoder 50 to the audio output unit 41 in accordance with control from the change-over controller 48.
  • the synthesis unit 39 is supplied with the video signal from the switch 38 and the video signal corresponding to a message regarding content change-over from the change-over controller 48.
  • the synthesis unit 39 supplies the video signal from the switch 38 to the video output unit 40.
  • the synthesis unit 39 when supplied with the video signal corresponding to the message from the change-over controller 48, synthesizes the video signal from the change-over controller 48 with the video signal from the switch 38 to supply to the video output unit 40.
  • the video output unit 40 outputs the video signal supplied from the synthesis unit 39 to the display 21.
  • the audio output unit 41 outputs the audio signal supplied from the switch 38 to the speaker 22. This allows the video of the broadcast content or distribution content to be displayed on the display 21 and the audio thereof to be output from the speaker 22.
  • the display 21 and the speaker 22 may be configured to be in one unit together with the reception device 12.
  • the finger print extraction unit 42 is supplied with the video signal from the video decoder 36 and the audio signal from the audio decoder 37.
  • the finger print extraction unit 42 extracts the feature amount from any one or both of the video signal and the audio signal to supply as the finger print information to the communication I/F 43.
  • the communication I/F 43 transmits the finger print information from the finger print extraction unit 42 via the Internet 16 to the ACR server 13. Moreover, the communication I/F 43 receives the identification result for the broadcast content transmitted from the ACR server 13 to supply to the control unit 45.
  • the control unit 45 executes a program for control stored in the memory 46 in advance to control the operation of each unit in the reception device 12.
  • the memory 46 is stored in advance with the program for control which is to be executed by the control unit 45.
  • This program for control can be updated on the basis of the digital television broadcast signal or update data acquired via the Internet 16.
  • the memory 46 stores appropriately various kinds of data from the control unit 45.
  • the operation unit 47 accepts various operations from the user to notify the control unit 45 of operation signals corresponding thereto.
  • control unit 45 acquires the identification result from the communication I/F 43.
  • the control unit 45 controls the communication I/F 43 depending on the acquired identification result to access the command server 14 via the Internet 16 and inquire for the video switch command.
  • the communication I/F 43 receives the video switch command transmitted from the command server 14 to supply to the command analysis unit 44.
  • the command analysis unit 44 acquires the video switch command from the communication I/F 43.
  • the command analysis unit 44 analyzes the acquired video switch command and supplies an analysis result thereof to the control unit 45.
  • the control unit 45 supplies the analysis result for the video switch command from the command analysis unit 44 to the change-over controller 48.
  • the change-over controller 48 controls the operation of changing over from the broadcast content to the distribution content on the basis of the analysis result for the video switch command from the control unit 45. Additionally, the change-over controller 48 controls the communication I/F 43 to access the distribution server 15 via the Internet 16 and request for the distribution content. The communication I/F 43 receives the distribution content transmitted from distribution server 15 to supply to the streaming processor 49.
  • the streaming processor 49 subjects the data of the distribution content supplied from the communication I/F 43 to a process required for streaming reproduction and supplies the distribution content for streaming reproduction obtained as a result thereof to the content decoder 50.
  • the content decoder 50 separates an AV stream constituting the distribution content for streaming reproduction supplied from the streaming processor 49 into the video stream and the audio stream.
  • the content decoder 50 decodes the separated video stream and audio stream respectively and supplies the video signal and audio signal obtained as a result thereof to the switch 38.
  • the reception device 12 is configured as described above.
  • FIG. 3 is a sequence diagram illustrating the cooperation among devices upon the content change-over.
  • the broadcast device 11 transmits the digital television broadcast signal.
  • the reception device 12 selects a channel desired by the user to receive the digital television broadcast signal from the broadcast device 11.
  • the reception device 12 displays the video of the broadcast content corresponding to the received broadcast signal on the display 21 and outputs the audio corresponding to the same from the speaker 22 (S1).
  • the reception device 12 periodically extracts the feature amounts from the video signal and audio signal of the broadcast content (S2), these feature amounts are transmitted as the finger print information to the ACR server 13 (S3).
  • the ACR server 13 performs an ACR identification processing to identify the broadcast content of the channel being selected by the reception device 12 by collating the finger print information from the reception device 12 with the database (S4). Specifically, as shown in FIG. 4 , when the ACR server 13 receives the inquiry by way of the finger print information from the reception device 12, an ACR identification processing unit 13A collates the finger print information with an FP database 13B prepared in advance to identify the broadcast content of the channel being selected by the reception device 12.
  • the finger print information is, for example, inherent information on the entire pieces of broadcast content or partial constituent elements
  • the FP database 13B has registered therein the inherent information on a large number of pieces of broadcast content in advance.
  • the ACR identification processing determines a degree of similarity or coincidence of the inherent information, for example. Note that as a determination method of the degree of similarity or coincidence, known techniques disclosed in various literatures and the like can be used. Usage of the ACR technology can make it possible to identify the broadcast content from the feature amount in the video signal and audio signal without depending on the information such as resolution, aspect ratio, bit rate, or format of the broadcast content.
  • the FP database 13B has stored therein information indicating a destination for acquisition of the video switch command (hereinafter, referred to as command acquisition destination information) in association with the channel identification information.
  • command acquisition destination information a URL (uniform resource locator) of the command server 14 is described.
  • the ACR identification processing unit 13A acquires the command acquisition destination information corresponding to the identified channel number from the FP database 13B. Then, the ACR identification processing unit 13A transmits the channel identification information, time position information, and command acquisition destination information as an identification result of the ACR identification processing to the reception device 12 which is a source of the inquiry (S5).
  • the reception device 12 acquires the identification result from the ACR server 13 to analyze the identification result (S6).
  • the reception device 12 in accordance with the analysis result for the identification result, accesses the command server 14 at the URL described in the command acquisition destination information and transmits the channel identification information and time position information to inquire the video switch command which is to be executable in the reception device 12 (S7).
  • the command server 14 transmits the video switch command corresponding to the channel identification information and time position information to the reception device 12 in response to the inquiry from the reception device 12 (S8). Specifically, the command server 14 manages the video switch command to be executable for each piece of broadcast content depending on a content change-over timing scheduled in advance, for example.
  • the command server 14 specifies the video switch command which is to be executable in a time zone corresponding to the time position information in the broadcast content corresponding to the channel identification information from the reception device 12. For example, the command server 14 specifies, on the basis of the time position information from the reception device 12, one or more video switch commands to be operated while a duration (e.g., for a few seconds) from a time when the target finger print information is extracted in the reception device 12 to a time when the next finger print information is extracted. Then, the command server 14 transmits the specified video switch command via the Internet 16 to the reception device 12.
  • a duration e.g., for a few seconds
  • the reception device 12 acquires and analyzes the video switch command from the command server 14 (S9). Then, the reception device 12, in accordance with the analysis result for the video switch command, requests the distribution server 15 for the distribution content to change over from the broadcast content to the distribution content (S10).
  • the reception device 12 acquires the video switch command depending on the identification result of the ACR identification processing on the broadcast content such that the broadcast content is changed over to distribution content A in response to the acquired video switch command.
  • the reception device 12 acquires the video switch command depending on the result of the ACR identification processing on the distribution content A of a change-over destination such that the distribution content A is changed over to distribution content B in response to the relevant video switch command.
  • a content resuming position in the case of returning from the change-over destination content to change-over original content can be set such that the reproduction is resumed from a scene at the time of changing over as in the case of returning from the distribution content B to the distribution content A.
  • the content resuming position may be set such that, as in the case of returning from the distribution content A to the broadcast content, the reproduction may be resumed from a scene in the broadcast content which is being broadcasted at this time.
  • the cooperation among the devices constituting the broadcast system 1 allows the reception device 12 to be provided with the video switching command corresponding to the identification result obtained from the ACR identification processing on the content being viewed. Then, the reception device 12 performs the change-over process between the broadcast content and the distribution content in response to the video switching command.
  • the video switch commands are classified into any of a switch command, preload command, preselect command, enable switch command, or disable switch command.
  • FIG. 6 shows elements constituting the video switch command as the switch command.
  • the switch command is a command for controlling the reception device 12 to change over the output content, that is, to change over a stream which is to be decoded and output.
  • Switch ID is identification information given to an event in which the stream is changed over.
  • Command Code is a code number indicating that the relevant video switch command is the switch command.
  • Switching Time indicates a time to perform the relevant command for carrying out stream change-over. This time is specified by way of an absolute time and date, relative time or PTS, for example.
  • the absolute time and date is specified in a case where the switch command is performed when a certain time and date set in advance arrives regardless of a progress of the broadcast content.
  • the relative time is specified in a case where the switch command is performed when a certain time period is lapsed from a time as a reference in the broadcast content. For example, a relative time period from the start time of the broadcast content is specified as the relative time.
  • the PTS is specified in a case where the switch command is performed by use of the PTS (presentation time stamp) which is time information for carrying out synchronized reproduction.
  • PTS presentation time stamp
  • STC system time clock
  • Target Media Type indicates whether the stream of the change-over destination is the broadcast content, MP4 format distribution content, MPEG2_TS format distribution content, or AVC_TS format distribution content.
  • Target Stream URL indicates a destination URL for acquisition of the stream of the change-over destination.
  • Stream Start Position indicates a reproduction start time position of the stream of the change-over destination. This reproduction start time position is specified in seconds, for example.
  • Retention Mode indicates which mode of the pass-through mode or the retention mode is used for a mode in changing over between the broadcast content and the distribution content.
  • a mode upon the content changing-over is described later in detail with reference to FIG. 11 .
  • Personalized Mode indicates whether or not user authentication is required in acquiring the distribution content as well as which of a device ID or password of the reception device 12 is used upon the relevant user authentication. This makes it possible to set the switch command for each user.
  • Auto Switch Flag indicates whether to confirm with the user about the stream change-over before that.
  • Switching Message is a question sentence presented to the user in the case of confirming with user about the stream change-over before that.
  • Loop Back Mode specifies whether a non-loop back mode is set or a loop back mode is set.
  • the loop back mode indicates that after changing over the stream, the reproduction is resumed from a scene at the time of changing over the stream of the change-over original after the stream of the change-over destination is completed.
  • the non-loop back mode indicates the cases of change-over other than the loop back mode.
  • FIG. 7 shows elements constituting the video switch command as the preload command.
  • the preload command is a command for controlling the reception device 12 to receive the change-over destination content prior to the content change-over timing.
  • Switch ID is identification information given to an event in which the stream is changed over.
  • Command Code is a code number indicating that the relevant video switch command is the preload command.
  • Target Media Type indicates whether the stream of the change-over destination is the broadcast content, MP4 format distribution content, MPEG2_TS format distribution content, or AVC_TS format distribution content.
  • Target Stream URL indicates a destination URL for acquisition of the stream of the change-over destination.
  • Stream Start Position indicates a reproduction start time position of the stream of the change-over destination.
  • Loop Back Mode specifies which of the above described non-loop back mode or loop back mode is set.
  • Personalized Mode indicates whether or not the user authentication is required in acquiring the distribution content as well as which of a device ID or password of the reception device 12 is used upon the relevant user authentication. This makes it possible to set the preload command for each user.
  • Time to Switch indicates an estimated time period until the change-over to the content which is acquired in response to the relevant preload command. This estimated time period is set in seconds, for example.
  • FIG. 8 shows elements constituting the video switch command as the preselect command.
  • the preselect command is a command for controlling the reception device 12 to confirm with the user about whether the content change-over is required prior to the content change-over timing.
  • Switch ID is identification information given to an event in which the stream is changed over.
  • Command Code is a code number indicating the relevant video switch command is the preselect command.
  • Time to Switch indicates an estimated time period until the change-over to the stream which is selected in response to the relevant preselect command.
  • FIG. 9 shows elements constituting the video switch command as the enable switch command.
  • the enable switch command is a command for controlling the reception device 12 to acquire a VRT capable of viewpoint switching for the content which is a panorama type multiple-perspective video program or theater type multiple-perspective video program, for example.
  • Switch ID is identification information given to an event in which the stream is changed over.
  • Command Code is a code number indicating that the relevant video switch command is the enable switch command.
  • the Switching Meta URL is a destination URL for acquisition of VRT.
  • the VRT view relation table
  • the VRT view relation table
  • the reception device 12 can perform the viewpoint switching for the content which is the panorama type multiple-perspective video program or theater type multiple-perspective video program on the basis of the information included in the VRT.
  • FIG. 10 indicates elements constituting the video switch command as the disable switch command.
  • the disable switch command is a command for controlling the reception device 12 to disable the acquired VRT so as to be incapable of the viewpoint switching for the content which is the panorama type multiple-perspective video program or theater type multiple-perspective video program, for example.
  • Switch ID is identification information given to an event in which the stream is changed over.
  • Command Code is a code number indicating that the relevant video switch command is the disable switch command.
  • FIG. 11 is a diagram illustrating an exemplary mode in changing over between the broadcast content and the distribution content.
  • the pass-through mode is a mode for the change-over in which after the reproduction of the distribution content which has been changed over from the broadcast content, when again returning from the distribution content to the broadcast content, the change-over is carried out to a scene in the broadcast content being broadcasted at this time.
  • the change-over to the distribution content may be carried out only when CM1 and CM2 inserted during the program are broadcasted.
  • the broadcast content is not displayed which corresponds to the duration while the distribution content such as CM1 and CM2 is displayed, and the program being broadcasted at this time (Program A) is displayed.
  • the operation of the reception device 12 in this case is such that in changing over from the broadcast content to the distribution content, the retention buffer 33 supplies due to zero delay the TS data from the primary demultiplexer 32 to the secondary demultiplexer 35. Then, since the secondary demultiplexer 35 does not need data of the broadcast content while the distribution content is displayed, the TS data is discarded. This allows the scene of the broadcast content being broadcasted at that time to be displayed on a screen of the display 21 when returning from the distribution content to the broadcast content after that.
  • the retention mode is a mode for the change-over in which after the reproduction of the distribution content which has been changed over from the broadcast content, when again returning from the distribution content to the broadcast content, the change-over is carried out to a scene in broadcast content at the time of changing over from the broadcast content to the distribution content.
  • the change-over may be carried out at a predetermined timing from the broadcast content to the distribution content.
  • the distribution content is inserted into the broadcast content, and data of the broadcast content corresponding to the duration while the distribution content is displayed is stored in the retention buffer 33. Then, when returning from the distribution content to the broadcast content, the broadcast content data is read out from the retention buffer 33 to resume and display the broadcast content (Program A) from the scene at the time of change-over with time shifted.
  • the broadcast content (Program A) broadcasted in real time is completed and other broadcast content (Program B) is started
  • the broadcast content (Program A) may be resumed from a scene in midway thereof or the other broadcast content (Program B) may be resumed from the top.
  • the operation of the reception device 12 in this case is such that in changing over from the broadcast content to the distribution content, the TS data from the primary demultiplexer 32 is sequentially written into and stored in the retention buffer 33. At this time, since reading out of the TS data is stopped in the retention buffer 33, the TS data while the distribution content is displayed is sequentially stored in the retention buffer 33. After that, when returning from the distribution content to the broadcast content, the retention buffer 33 has stored therein the TS data while the distribution content is reproduced, which TS data is supplied to the secondary demultiplexer 35. This allows the scene in the broadcast content at the time of changing over from the broadcast content to the distribution content to be displayed on the screen of the display 21.
  • FIG. 12 shows a utilization example of the preselect command in an auto-switching operation.
  • the reception device 12 in a case of changing over from the broadcast content to the distribution content, receives a preselect command C1 corresponding to the identification result obtained by the ACR identification processing on the broadcast content prior to the change-over timing. After that, the reception device 12 receives a switch command C2 corresponding to the identification result obtained by the ACR identification processing on the broadcast content.
  • the reception device 12 in response to the preselect command C1, prompts the user to select whether to execute the content change-over.
  • the user in response to a message "change over?" superimposed on the video of the broadcast content P11 being viewed, the user selects the content change-over, an auto-switch is set for a content change-over event indicated by Switch ID of the preselect command C1.
  • the no change-over is set for the content change-over event indicated by Switch ID of the preselect command C1.
  • the content change-over is automatically carried out after a time for content change-over arrives.
  • the pass-through mode or the retention mode is determined in response to Retention Mode in the switch command C2.
  • the pass-through mode is set, a video P13 of the broadcast content is displayed on the display 21 when the video P21 of the distribution content is completed.
  • the content change-over is not carried out, and change-over is carried out from the video P11 of the broadcast content to a video P12 thereof, for example. Then, when the video P12 of the broadcast content is completed, the video P13 is displayed on the display 21.
  • the content change-over is automatically carried out after a predetermined time for change-over arrives.
  • FIG. 13 shows a utilization example of the preselect command and preload command in the auto-switching operation.
  • the reception device 12 in the case of change-over from the broadcast content to the distribution content, receives the preselect command C1 and preload command C3 corresponding to the identification result obtained by the ACR identification processing on the broadcast content prior to the change-over timing. After that, the reception device 12 receives the switch command C2 corresponding to the identification result obtained by the ACR identification processing on the broadcast content at a timing prior to the change-over.
  • the reception device 12 in response to the preselect command C1, prompts the user to select whether to execute the content change-over.
  • the user in response to a message "change over?" superimposed on the video of the broadcast content P11, the user selects the content change-over, an auto-switch is set for a content change-over event indicated by Switch ID of the preselect command C1.
  • the reception device 12 receives the preload command C3, the distribution content of the change-over destination is started to be acquired in response to the preload command C3.
  • the content change-over is quickly carried out from the broadcast content to the preloaded distribution content after a time for content change-over arrives.
  • the distribution content of the change-over destination is already preloaded upon the change-over, the change-over is quickly carried out from the video P11 to the video P21.
  • the reception device 12 receives a preload command C4 corresponding to an identification result obtained by the ACR identification processing on the distribution content and the broadcast content is started to be acquired from the broadcast device 11 designated by way of the preload command C4. Then, in the reception device 12, when reproduction of the distribution content is completed, the change-over is quickly carried out from distribution content to the preloaded broadcast content.
  • the video P13 of the broadcast content is displayed on the display 21 when the video P21 of the distribution content is completed.
  • the change-over destination content is acquired in advance. Then, the change-over is automatically carried out to content acquired in advance after a predetermined time for change-over arrives.
  • FIG. 14 shows a utilization example of the switch command in a manual switching operation.
  • the reception device 12 in a case of changing over from the broadcast content to the distribution content, receives at the change-over timing the switch command C2 corresponding to the identification result obtained by the ACR identification processing on the broadcast content.
  • the reception device 12 in a case where the Auto Switch Flag in the switch command C2 is set to a manual switch, displays toward the user a message such as "change over?" to prompt the user to select whether to execute the content change-over.
  • the distribution content of the change-over destination is started to be acquired and the content is changed over.
  • the change-over is carried out to the change-over destination content.
  • command correspondent process corresponding to the ACR identification result a command correspondent process (hereinafter, referred to as command correspondent process corresponding to the ACR identification result) in a case where the reception device 12 receives the video switch command corresponding to the identification result obtained by the ACR identification processing.
  • FIG. 15 is a flowchart illustrating the command correspondent process corresponding to the ACR identification result by the reception device 12. This command correspondent process corresponding to the ACR identification result is repeatedly performed when the user views the broadcast content such as a program, that is, while the reception device 12 is receiving the digital television broadcast signal from the broadcast device 11.
  • the finger print extraction unit 42 determines whether or not a predetermined time lapses and waits for the predetermined time to lapse to extract the finger print information from the video signal and audio signal of the broadcast content (step S12). In other words, the finger print extraction unit 42 extracts the finger print information periodically at a predetermined interval of, for example, several seconds.
  • the finger print extraction unit 42 controls the communication I/F 43 to transmit the extracted finger print information via the Internet 16 to the ACR server 13 to inquire the identification result for the broadcast content of the channel being selected.
  • the ACR server 13 performs the ACR identification processing on the basis of the finger print information to transmit the identification result therefor to the reception device 12. Note that when the ACR server 13 cannot get the identification result for the broadcast content, the identification result is not transmitted.
  • control unit 45 controls the communication I/F 43 to determine whether or not the identification result is received from the ACR server 13 as an identification result inquiry destination.
  • step S14 if determined that the identification result is not received, the process returns to step S11, and this and subsequent processes are repeated. For example, in a case where the reception device 12 selects a channel of halted broadcast, if the finger print information is extracted, the broadcast content cannot be identified on the ACR server 13 side such that the identification result is not transmitted (or such that the identification result may be transmitted with presenting there is no corresponding content).
  • step S14 if determined that the identification result is received, the process proceeds to step S15, and at step S15 the control unit 45 analyzes the identification result for the broadcast content of the channel being selected, the content being received by the communication I/F 43.
  • obtained as the identification result are the channel identification information, time position information, and command acquisition destination information of the broadcast content of the channel being selected.
  • the control unit 45 controls the communication I/F 43, accesses the command server 14 corresponding to the URL indicated by the command acquisition destination information and transmits the channel identification information and time position information to inquire the video switch command which is to be executable in the reception device 12.
  • the command server 14 acquires and transmits to the reception device 12 the video switch command which is to be executable in the time zone corresponding to the time position information in the broadcast content corresponding to the channel identification information on the basis of the schedule set in advance.
  • control unit 45 controls the communication I/F 43 to determine whether or not the video switch command is received from the command server 14 as a video switch command inquiry destination.
  • step S17 if determined that the video switch command is not received, the process returns to step S11, and this and subsequent processes are repeated. For example, in a case where the command server 14 has no video switch command matching conditions defined in the channel identification information and time position information, the video switch command is not transmitted (or the video switch command may be transmitted with presenting no process is needed).
  • step S17 if determined that the video switch command is received, the process proceeds to step S18.
  • the command analysis unit 44 analyzes the video switch command.
  • the change-over controller 48 depending on the analysis result for the video switch command, performs a process corresponding to a kind of the command indicated by Command Code thereof. The process corresponding to a kind of each video switch command will be described later in detail with reference to FIGs. 16 to 20 .
  • step S11 if determined that at step S11 a predetermined time does not lapse, the process proceeds to step S19.
  • the control unit 45 determines whether or not the user inputs a viewpoint switching operation.
  • step S19 if determined that the viewpoint switching operation is not input, the process returns to step S11.
  • the viewpoint switching operation input by the user is enabled only when the viewpoint switching is enabled in the enable switch correspondent process in FIG. 19 described later.
  • the process proceeds to step S20.
  • the control unit 45 controls each related unit in the reception device 12 to receive and reproduce the distribution content corresponding to a designated viewpoint for changing over the video.
  • FIG. 16 is a flowchart illustrating a process in a case where the received video switch command is a preselect command and corresponds to step S18 in FIG. 15 (hereinafter, referred to as preselect command correspondent process).
  • the change-over controller 48 presents a question sentence described in Switching Message of the preselect command to the user to prompt to select whether to change over the content.
  • the change-over controller 48 determines whether or not the content change-over is selected correspondingly to an instruction from the user with respect to the presented question sentence.
  • step S32 if the content change-over is selected, the process proceeds to step S33.
  • step S33 the change-over controller 48 sets the auto-switch to the content change-over indicated by Switch ID of the preselect command.
  • the preselect command correspondent process ends.
  • the timeout is decided on the basis of Time to Switch. Then, when the preselect command correspondent process ends, the process returns to step S18 in FIG. 15 , and this and subsequent processes are performed.
  • FIG. 17 is a flowchart illustrating a process in a case where the received video switch command is a preload command and corresponds to step S18 in FIG. 15 (hereinafter, referred to as preload command correspondent process).
  • the change-over controller 48 determines whether or not the content change-over indicated by Switch ID of the preload command is set with the auto-switch in response to the preselect command received prior to the relevant preload command. If determined that at step S51 the auto-switch is set, the process proceeds to step S52. At step S52, the change-over controller 48 controls each related unit in the reception device 12 to start to prepare for receiving the distribution content of the change-over destination.
  • the preload command correspondent process ends. Then, when the preload command correspondent process ends, the process returns to step S18 in FIG. 15 , and this and subsequent processes are performed.
  • FIG. 18 is a flowchart illustrating a process in a case where the received video switch command is a switch command and corresponds to step S18 in FIG. 15 (hereinafter, referred to as switch command correspondent process).
  • step S71 the change-over controller 48, in accordance with the analysis result for the video switch command from the control unit 45, determines whether or not Auto Switch Flag of the switch command is the auto-switch. If determined that at step S71 it is the auto-switch, the process proceeds to step S72.
  • step S72 the change-over controller 48, in accordance with the analysis result for the video switch command from the control unit 45, determines whether or not the distribution content of the change-over destination is already preloaded. If determined that at step S72 it is not already preloaded, the process proceeds to step S73.
  • the change-over controller 48 determines whether or not the content change-over indicated by Switch ID is set with the auto-switch in response to the preselect command received prior to the relevant switch command. If determined that at step S73 the auto-switch is set, the process proceeds to step S74.
  • the change-over controller 48 in accordance with the analysis result for the video switch command from the control unit 45, controls each related unit in the reception device 12 to start to prepare for receiving the distribution content of the change-over destination.
  • step S75 the change-over controller 48 determines whether or not the time for content change-over arrives on the basis of the time for change-over indicated by Switching Time of the switch command. Then, if the time for content change-over arrives ("YES" in step S75) the process proceeds to step S76.
  • the process at step S75 is skipped and the process proceeds to step S76.
  • the change-over controller 48 controls each related unit in the reception device 12 to change over the content to that of the change-over destination.
  • the change-over is carried out from the broadcast content to the preloaded distribution content to start to reproduce the distribution content.
  • step S71 Auto Switch Flag of the switch command is not the auto-switch, that is, is the manual switch
  • the process proceeds to step S77.
  • the change-over controller 48 in accordance with the analysis result for the video switch command from the control unit 45, presents the question sentence described in Switching Message of the switch command to the user to prompt to select whether to change over the content.
  • step S78 the change-over controller 48 determines whether or not the content change-over is selected in response to the presented question sentence. If at step S78 the content change-over is selected, the process proceeds to step S74, and the processes of step S74 and subsequent steps described above are performed.
  • step S78 if at step S78 the content change-over is not selected or at step S79 the selection timeout lapses, the content change-over is not carried out to end the switch command correspondent process. Then, when the switch command correspondent process ends, the process returns to step S18 in FIG. 15 , and this and subsequent processes are performed.
  • FIG. 19 is a flowchart illustrating a process in a case where the received video switch command is an enable switch command and corresponds to step S18 in FIG. 15 (hereinafter, referred to as enable switch command correspondent process).
  • the change-over controller 48 controls each related unit in the reception device 12 to acquire and analyze the VRT on the basis of Switching Meta URL of the enable switch command.
  • the change-over controller 48 enables the viewpoint switching to present that the viewpoint is switchable to the user such as by displaying an arrow indicating a direction of viewpoint to be switchable on the display, for example.
  • the enable switch command correspondent process ends here, the process returns to step S18 in FIG. 15 , and this and subsequent processes are performed.
  • FIG. 20 is a flowchart illustrating a process in a case where the received video switch command is a disable switch command and corresponds to step S18 in FIG. 15 (hereinafter, referred to as disable switch command correspondent process).
  • step S111 the change-over controller 48 disables the acquired VRT in response to the enable switch command. This makes the viewpoint switching impossible.
  • the disable switch command correspondent process ends here, the process returns to step S18 in FIG. 15 , and this and subsequent processes are performed.
  • the command correspondent processes corresponding to the ACR identification result described above allow the reception device 12 to extract the finger print information from the data of the received broadcast content, and acquire the identification result identified from the finger print information using the ACR technology. Then, the reception device 12 acquires the video switch command depending on the identification result for the broadcast content to control the operation of changing over from the broadcast content to the distribution content in response to the video switch command. This makes it possible to change over the content using the ACR technology. Particularly, the content change-over process using the ACR technology can be quickly carried out.
  • the video switch command is a command for controlling the operation of changing over between the first content in the change-over original and the second content in the change-over destination, and can be executed regardless of types of content as change-over targets.
  • the first content may be, besides the broadcast content, distribution content for streaming reproduction or download reproduction, NRT content acquired by way of NRT (non real time) broadcast and the like, for example.
  • the second content may be, besides the distribution content for streaming reproduction, the broadcast content, distribution content for download reproduction, NRT content and the like, for example.
  • the finger print information is extracted from the video signal and audio signal of the distribution content and transmitted to the ACR server 13. Then, the ACR server 13 performs the ACR identification processing to here transmit as the identification result the content identification information, time position information, and command acquisition destination information.
  • the broadcast content is acquired from the broadcast device 11
  • the channel identification information is obtained as the identification result
  • the content identification information such as the content ID is obtained as the identification result.
  • the reception device 12 accesses the command server 14 corresponding to the URL described in the command acquisition destination information and transmits the content identification information and time position information to inquire the video switch command which is to be executable in the reception device 12. Then, the reception device 12 controls the content change-over operation in response to the video switch command from the command server 14.
  • the series of processes described above can be executed by hardware but can also be executed by software.
  • a program that constructs such software is installed into a computer.
  • the expression "computer” includes a computer in which dedicated hardware is incorporated and a general-purpose personal computer or the like that is capable of executing various functions when various programs are installed.
  • FIG. 21 is a block diagram showing a hardware configuration example of a computer that performs the above-described series of processing using a program.
  • a central processing unit (CPU) 101 a read only memory (ROM) 102 and a random access memory (RAM) 103 are mutually connected by a bus 104.
  • CPU central processing unit
  • ROM read only memory
  • RAM random access memory
  • An input/output interface 105 is also connected to the bus 104.
  • An input unit 106, an output unit 107, a recording unit 108, a communication unit 109, and a drive 110 are connected to the input/output interface 105.
  • the input unit 106 is configured from a keyboard, a mouse, a microphone or the like.
  • the output unit 107 is configured from a display, a speaker or the like.
  • the recording unit 108 is configured from a hard disk, a non-volatile memory or the like.
  • the communication unit 109 is configured from a network interface or the like.
  • the drive 110 drives a removable medium 111 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory or the like.
  • the CPU 101 loads a program that is recorded, for example, in the recording unit 108 onto the RAM 103 via the input/output interface 105 and the bus 104, and executes the program.
  • a program that is recorded for example, in the recording unit 108 onto the RAM 103 via the input/output interface 105 and the bus 104, and executes the program.
  • the above-described series of processing is performed.
  • Programs to be executed by the computer 100 are provided being recorded in the removable medium 111 which is a packaged medium or the like. Also, programs may be provided via a wired or wireless transmission medium, such as a local area network, the Internet or digital satellite broadcasting.
  • the program can be installed in the recording unit 108 via the input/output interface 105. Further, the program can be received by the communication unit 109 via a wired or wireless transmission medium and installed in the recording unit 108. Moreover, the program can be installed in advance in the ROM 102 or the recording unit 108.
  • program executed by a computer may be a program that is processed in time series according to the sequence described in this specification or a program that is processed in parallel or at necessary timing such as upon calling.
  • a processing step herein for describing a program which causes the computer to perform various processing does not necessarily have to be processed chronologically in the order described in a flow chart. It also includes processing performed in parallel or individually (for example, parallel processing or processing by an object).
  • the program may be a program executed by a single computer or may be a program executed in a distribution manner by a plurality of computers.
  • the program may be transmitted remotely to a computer to be executed.
  • a system has the meaning of a set of a plurality of configured elements (such as an apparatus or a module (part)), and does not take into account whether or not all the configured elements are in the same casing. Therefore, the system may be either a plurality of apparatuses, stored in separate casings and connected through a network, or a plurality of modules within a single casing.
  • the present disclosure can adopt a configuration of cloud computing which processes by allocating and connecting one function by a plurality of apparatuses through a network.
  • each step described by the above mentioned flow charts can be executed by one apparatus or by allocating a plurality of apparatuses.
  • the plurality of processes included in this one step can be executed by one apparatus or by allocating a plurality of apparatuses.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Circuits Of Receivers In General (AREA)

Description

    Technical Field
  • The present technology relates to a reception device, a reception method, a program, and an information processing system, and particularly relates to a reception device capable of changing over content using a content identification technique, a reception method, a program, and an information processing system.
  • Background Art
  • It is expected that in a reception device for digital television broadcast represented by a digital television receiver, a service will be widespread whereby to acquire and execute an application program to be executed in association with broadcast content such as a program and CM from an application server connected to the Internet. For this reason, a technology for attaining such a hybrid service as a fusion of broadcast and communication has been discussed (e.g., refer to Patent Literature 1).
  • In addition, some reception devices like this have a VOD (video on demand) function to allow distribution content to be acquired from a distribution server at any time via the Internet and reproduced.
  • WO 2004/080073 A2 discloses a method and a system including a first aspect providing a television signal substitution system that replaces standard video segments with selected replacement portions. Video segments such as advertisements are detected using techniques such as fingerprinting or manual detection. The detected video segment is replaced with a selected replacement portion and output to an output device. A second aspect provides an ad reselling system that sells targeted advertisements, which replaces standard advertisements in a video signal. Sponsors of the targeted advertisements are billed when their advertisements are used to replace other advertisements. In a third aspect, fingerprint data of known advertisements can be stored in a fingerprint database. When new fingerprint data is available, the fingerprint data can be automatically or manually transmitted to subscribers. Various techniques can be used to identify advertisements based on the fingerprint data.
  • EP 1705908 A2 discloses methods, systems and computer program products for identifying and distinguishing content, such as commercials, can be used with means for marking key frames within the commercials to facilitate replacement of commercials and other programming segments in such a way as to provide improved focus and relevance for targeted advertising based on known and/or dynamic conditions. The identification of commercial features can also be used to provide improved trick play functionality while the commercial or other programming is rendered.
  • WO 2005/006758 A1 discloses a device and a method of relating one or more trigger actions with a multimedia signal and corresponding method and device for detecting one or more trigger actions in a multimedia signal. One fingerprint is generated on the basis of a segment of the multimedia signal at each trigger time point. The generated fingerprint(s) is stored in a database and communicated to playback devices. During playback fingerprints of the multimedia signal are generated and matched against fingerprints in the database. When a match is found, associated trigger actions is retrieved. The trigger time point is determined as a time point near or at a segment of the multimedia signal that caused a fingerprint to match. In this way, a simple and reliable way of detecting trigger markers for trigger actions is enabled without modifying the multimedia signal.
  • WO 2011/069035 A1 discloses a method for interpreting messages, user-defined alert conditions, voice commands and performing an action in response is described, A method for annotating media content is described. A method for presenting additional content associated with media content identified based on a fingerprint is described. A method for identifying that an advertisement portion of media content is being played based on a fingerprint derived from the media content is described. A method of one media device recording particular media content automatically in response to another media device recording the particular media content is described. A method of concurrently playing media content on multiple devices is described. A method of publishing information associated with recording of media content is described. A method of deriving fingerprints by media devices that meet an idleness criteria is described. A method of recording or playing media content identified based on fingerprints is described.
  • Citation List Patent Literature
  • Patent Literature 1: JP 2006-245653A
  • Summary of Invention Technical Problem
  • On the other hand, a technology for identifying the content referred to as ACR (Automatic Content Recognition) has been known. The ACR technology carries out content identification by collating a feature amount extracted from a video signal and audio signal of the content which is to be identified with a database having registered therein feature amounts extracted in advance from video signals and audio signals of many pieces of content.
  • The hybrid service of broadcast and communication would be able to be provided by identifying the content using the ACR technology and further providing the application program which is executed in association with the identified content.
  • On the other hand, a case may be assumed where broadcast content broadcasted via a broadcast network and distribution content distributed via a communication network are changed over from each other at a predetermined timing for the purpose of changing over from a program to a CM or the like, for example. In a case of performing such a change-over process using the ACR technology, in response to an identification result for content the changing-over is performed to the other content, where the change-over of that content is required to be quickly carried out.
  • However, a technical scheme is currently not established for performing a content changing-over process using the ACR technology.
  • The present technology is provided in consideration of such a circumstance to allow the content to be changed over using the content identification technique.
  • Solution to Problem
  • According to the first aspect of the present technology, there is provided a reception device as defined in claim 1,
  • The command is a first command for requesting a user to confirm whether or not a change-over is required to be carried out, prior to a timing of change-over from the first content to the second content, or a second command for changing over from the first content to the second content. The control part requests the user to confirm whether or not the change-over is required to be carried out, in response to the first command. In a case where the user permits the change-over to be carried out, the control part changes over from the first content to the second content in response to the second command.
  • The command is the first command, the second command, or a third command for causing the second content to be acquired prior to a timing of change-over from the first content to the second content. In a case where the user permits the change-over to be carried out, the control part acquires the second content in response to the third command prior to a timing of change-over. The control part changes over from the first content to the acquired second content in response to the second command.
  • The second command includes time information indicating a time to execute the second command. The control part changes over from the first content to the second content when a timing of change-over arrives in accordance with the time information included in the second command.
  • The second command or the third command is settable for each user.
  • The command is a fourth command for setting a state in which it is possible to change to the second content that corresponds to a viewpoint designated by the user, or a fifth command for ending the state in which it is possible to change to the second content that corresponds to the viewpoint designated by the user. The control part sets the state in which it is possible to change to the second content that corresponds to the viewpoint designated by the user in response to the fourth command. The control part ends the state in which it is possible to change to the second content that corresponds to the viewpoint designated by the user in response to the fifth command.
  • The reception device further includes a buffer configured to sequentially store data of the received first content when the first content is changed over to the second content, and an output part configured to output the first content stored in the buffer while the second content is being output, when the second content is changed over to the first content.
  • The reception device further includes an output part configured to output the received first content when the second content is changed over to the first content.
  • The identification result acquisition part acquires the identification result for the first content identified using an ACR (Automatic Content Recognition) technology from the extracted feature amount.
  • The first content is broadcast content broadcasted via a broadcast network, The second content is distribution content distributed from a distribution server via a communication network.
  • The feature amount extraction part extracts the feature amount from any one or both of a video signal and an audio signal of the first content.
  • The reception device may be an independent device or an internal block constituting one device.
  • A reception method or program according to the first aspect of the present technology is a reception method or program, as defined in claims 9 and 15, which corresponds to the reception device according to the first aspect of the present technology described above.
  • In the reception device, reception method, and program according to the first aspect of the present technology, first content is received, wherein the first content is broadcast content broadcasted via a broadcast network, a feature amount is extracted from any one or both of a video signal and an audio signal of the received first content, wherein the feature amount is finger print information, an identification result, received from an Automatic Content Recognition, ACR, server, for the first content identified using an ACR technology from the extracted feature amount is acquired, a command, received from a command server, is acquired for controlling an operation of changing over between the first content and the second content different from the first content depending on the acquired identification result, wherein the second content is distribution content distributed from a distribution server via a communication network, and the first content is changed over to the second content depending on the acquired command.
  • Advantageous Effects of Invention
  • According to the first aspect and second aspect of the present technology, the content can be changed over using the content identification technique.
  • Brief Description of Drawings
    • [FIG. 1] FIG. 1 is a diagram illustrating a configuration example of a broadcast system.
    • [FIG. 2] FIG. 2 is a diagram illustrating a configuration example of a reception device.
    • [FIG. 3] FIG. 3 is a sequence diagram illustrating cooperation among devices.
    • [FIG. 4] FIG. 4 is a diagram for explaining a concept of ACR technology.
    • [FIG. 5] FIG. 5 is a diagram for explaining a transmission timing of a video switch command.
    • [FIG. 6] FIG. 6 is a diagram illustrating elements of a switch command.
    • [FIG. 7] FIG. 7 is a diagram illustrating elements of a preload command.
    • [FIG. 8] FIG. 8 is a diagram illustrating elements of a preselect command.
    • [FIG. 9] FIG. 9 is a diagram illustrating elements of an enable switch command.
    • [FIG. 10] FIG. 10 is a diagram illustrating elements of a disable switch command.
    • [FIG. 11] FIG. 11 is a diagram for explaining a mode in changing-over between broadcast content and distribution content.
    • [FIG. 12] FIG. 12 is a diagram explaining a utilization example of the preselect command in an auto-switching operation.
    • [FIG. 13] FIG. 13 is a diagram explaining utilization examples of the preselect command and preload command in the auto-switching operation.
    • [FIG. 14] FIG. 14 is a diagram explaining a utilization example of the switch command in a manual switching operation.
    • [FIG. 15] FIG. 15 is a flowchart illustrating a command correspondent process depending on an ACR identification result.
    • [FIG. 16] FIG. 16 is a flowchart illustrating a preselect command correspondent process.
    • [FIG. 17] FIG. 17 is a flowchart illustrating a preload command correspondent process.
    • [FIG. 18] FIG. 18 is a flowchart illustrating a switch command correspondent process.
    • [FIG. 19] FIG. 19 is a flowchart illustrating an enable command correspondent process.
    • [FIG. 20] FIG. 20 is a flowchart illustrating a disable command correspondent process.
    • [FIG. 21] FIG. 21 is a diagram illustrating a configuration example of a computer.
    Description of Embodiments
  • Hereinafter an explanation will be given of embodiments of the present technology with reference to the drawings.
  • [Configuration example of broadcast system]
  • FIG. 1 illustrates a broadcast system 1 of this embodiment. This broadcast system 1 is configured to include a broadcast device 11, reception device 12, ACR server 13, command server 14, and distribution server 15. The broadcast system 1 is an example of an information processing system. In addition, the reception device 12, ACR server 13, command server 14, and distribution server 15 are coupled with each other via the Internet 16.
  • The broadcast device 11 is configured to transmit (broadcast) a digital television broadcast signal of broadcast content corresponding to a digital television program, CM or the like.
  • The reception device 12 receives the digital television broadcast signal transmitted from the broadcast device 11 to acquire video and audio of the broadcast content. The reception device 12 outputs the acquired video and audio to a display (display 21 in FIG. 2) and a speaker (speaker 22 in FIG. 2), respectively.
  • Note that the reception device 12 may exist as a single device or be built in a digital television receiver, video recorder or the like, for example. Additionally, a detailed configuration of the reception device 12 will be described later with reference to FIG. 2.
  • Moreover, the reception device 12 periodically accesses the ACR server 13 via the Internet 16 to inquire the identification result for the broadcast content. At that time, a feature amount (hereinafter, also referred to as finger print information) extracted from a video signal and audio signal of the broadcast content is transmitted to the ACR server 13.
  • The ACR server 13 includes a database having registered therein the feature amount extracted from the video signal and audio signal of any broadcast content. The ACR server 13 identifies the broadcast content using the ACR (Automatic Content Recognition) technology in response to an inquiry from any terminal device coupled with the Internet 16. The ACR server 13 collates the finger print information from the reception device 12 with the database to identify the broadcast content such as the digital television program and transmits the identification result therefor to the reception device 12 via the Internet 16.
  • The reception device 12 accesses the command server 14 via the Internet 16 depending on the identification result received from the ACR server 13 to acquire a video switch command. Here, the video switch command means a command for controlling an operation of changing over between the broadcast content from the broadcast device 11 and distribution content from the distribution server 15.
  • The command server 14 manages the video switch command. The command server 14 transmits the video switch command to the reception device 12 via the Internet 16 in response to the inquiry from the reception device 12.
  • The reception device 12 controls the operation of changing over from the broadcast content to the distribution content in response to the video switch command received from the command server 14. Moreover, the reception device 12 accesses the distribution server 15 via the Internet 16 in response to the video switch command received from the command server 14 to acquire the video and audio of the distribution content. The reception device 12 outputs the acquired video and audio to the display and the speaker, respectively.
  • The distribution server 15 accumulates and manages one or more pieces of distribution content. The distribution server 15 transmits (distributes) the distribution content to the reception device 12 via the Internet 16 in response to the inquiry from the reception device 12.
  • The broadcast system 1 is configured as below.
  • [Configuration example of reception device]
  • FIG. 2 is a diagram illustrating a configuration example of the reception device 12 in FIG. 1.
  • The reception device 12 is configured to include a tuner 31, primary demultiplexer 32, retention buffer 33, retention controller 34, secondary demultiplexer 35, video decoder 36, audio decoder 37, switch 38, synthesis unit 39, video output unit 40, audio output unit 41, finger print extraction unit 42, communication I/F 43, command analysis unit 44, control unit 45, memory 46, operation unit 47, change-over controller 48, streaming processor 49, and content decoder 50.
  • The tuner 31 receives and demodulates the digital television broadcast signal from the broadcast device 11 to supply a multiplexed stream obtained as a result thereof to the primary demultiplexer 32.
  • The primary demultiplexer 32 extracts a TS (transport stream) which a user selects from the multiplexed stream supplied by the tuner 31 and supplies to the retention buffer 33.
  • The retention buffer 33 is constituted by a high-capacity record medium such as a HDD (hard disk drive) or a memory, for example. The retention buffer 33 operates in accordance with control from the retention controller 34 in a pass-through mode or retention mode which is described later.
  • Specifically, the retention buffer 33, when operating in the retention mode, sequentially stores data of the TS supplied from the primary demultiplexer 32. The TS data stored in the retention buffer 33 is sequentially read out from the retention buffer 33 in accordance with control from the retention controller 34, and supplied to the secondary demultiplexer 35. On the other hand, the retention buffer 33, when operating in the pass-through mode, supplies the TS data from the primary demultiplexer 32 as it is without storing therein to the secondary demultiplexer 35.
  • The retention controller 34 controls the retention buffer 33 in accordance with control from the change-over controller 48.
  • The secondary demultiplexer 35 separates the TS supplied from the retention buffer 33 to supply the separated video stream and audio stream to the video decoder 36 and the audio decoder 37, respectively.
  • The video decoder 36 decodes the video stream from the secondary demultiplexer 35 to supply a video signal obtained as a result thereof to the switch 38 and the finger print extraction unit 42.
  • The audio decoder 37 decodes the audio stream from the secondary demultiplexer 35 to supply an audio signal obtained as a result thereof to the switch 38 and the finger print extraction unit 42.
  • The switch 38 is supplied with the video signal from the video decoder 36 and the audio signal from the audio decoder 37 as well as the video signal and audio signal corresponding to the distribution content from the content decoder 50 which is described later.
  • The switch 38 supplies any one of the video signals which are supplied from the video decoder 36 and content decoder 50 to the synthesis unit 39 in accordance with control from the change-over controller 48. Moreover, the switch 38 supplies any one of the audio signals which are supplied from the audio decoder 37 and content decoder 50 to the audio output unit 41 in accordance with control from the change-over controller 48.
  • The synthesis unit 39 is supplied with the video signal from the switch 38 and the video signal corresponding to a message regarding content change-over from the change-over controller 48.
  • The synthesis unit 39 supplies the video signal from the switch 38 to the video output unit 40. In addition, the synthesis unit 39, when supplied with the video signal corresponding to the message from the change-over controller 48, synthesizes the video signal from the change-over controller 48 with the video signal from the switch 38 to supply to the video output unit 40.
  • The video output unit 40 outputs the video signal supplied from the synthesis unit 39 to the display 21. In addition, the audio output unit 41 outputs the audio signal supplied from the switch 38 to the speaker 22. This allows the video of the broadcast content or distribution content to be displayed on the display 21 and the audio thereof to be output from the speaker 22. Here, the display 21 and the speaker 22 may be configured to be in one unit together with the reception device 12.
  • The finger print extraction unit 42 is supplied with the video signal from the video decoder 36 and the audio signal from the audio decoder 37. The finger print extraction unit 42 extracts the feature amount from any one or both of the video signal and the audio signal to supply as the finger print information to the communication I/F 43.
  • The communication I/F 43 transmits the finger print information from the finger print extraction unit 42 via the Internet 16 to the ACR server 13. Moreover, the communication I/F 43 receives the identification result for the broadcast content transmitted from the ACR server 13 to supply to the control unit 45.
  • The control unit 45 executes a program for control stored in the memory 46 in advance to control the operation of each unit in the reception device 12. The memory 46 is stored in advance with the program for control which is to be executed by the control unit 45. This program for control can be updated on the basis of the digital television broadcast signal or update data acquired via the Internet 16. In addition, the memory 46 stores appropriately various kinds of data from the control unit 45. The operation unit 47 accepts various operations from the user to notify the control unit 45 of operation signals corresponding thereto.
  • Further, the control unit 45 acquires the identification result from the communication I/F 43. The control unit 45 controls the communication I/F 43 depending on the acquired identification result to access the command server 14 via the Internet 16 and inquire for the video switch command. The communication I/F 43 receives the video switch command transmitted from the command server 14 to supply to the command analysis unit 44.
  • The command analysis unit 44 acquires the video switch command from the communication I/F 43. The command analysis unit 44 analyzes the acquired video switch command and supplies an analysis result thereof to the control unit 45. The control unit 45 supplies the analysis result for the video switch command from the command analysis unit 44 to the change-over controller 48.
  • The change-over controller 48 controls the operation of changing over from the broadcast content to the distribution content on the basis of the analysis result for the video switch command from the control unit 45. Additionally, the change-over controller 48 controls the communication I/F 43 to access the distribution server 15 via the Internet 16 and request for the distribution content. The communication I/F 43 receives the distribution content transmitted from distribution server 15 to supply to the streaming processor 49.
  • The streaming processor 49 subjects the data of the distribution content supplied from the communication I/F 43 to a process required for streaming reproduction and supplies the distribution content for streaming reproduction obtained as a result thereof to the content decoder 50.
  • The content decoder 50 separates an AV stream constituting the distribution content for streaming reproduction supplied from the streaming processor 49 into the video stream and the audio stream. The content decoder 50 decodes the separated video stream and audio stream respectively and supplies the video signal and audio signal obtained as a result thereof to the switch 38.
  • The reception device 12 is configured as described above.
  • [Cooperation among devices]
  • Next, with reference to FIG. 3 to FIG. 5, an explanation will be given of cooperation among devices constituting the broadcast system 1 in FIG. 1. FIG. 3 is a sequence diagram illustrating the cooperation among devices upon the content change-over.
  • As shown in FIG. 3, the broadcast device 11 transmits the digital television broadcast signal. The reception device 12 selects a channel desired by the user to receive the digital television broadcast signal from the broadcast device 11. The reception device 12 displays the video of the broadcast content corresponding to the received broadcast signal on the display 21 and outputs the audio corresponding to the same from the speaker 22 (S1).
  • Further, the reception device 12 periodically extracts the feature amounts from the video signal and audio signal of the broadcast content (S2), these feature amounts are transmitted as the finger print information to the ACR server 13 (S3).
  • The ACR server 13 performs an ACR identification processing to identify the broadcast content of the channel being selected by the reception device 12 by collating the finger print information from the reception device 12 with the database (S4). Specifically, as shown in FIG. 4, when the ACR server 13 receives the inquiry by way of the finger print information from the reception device 12, an ACR identification processing unit 13A collates the finger print information with an FP database 13B prepared in advance to identify the broadcast content of the channel being selected by the reception device 12.
  • Here, the finger print information (feature amount) is, for example, inherent information on the entire pieces of broadcast content or partial constituent elements, and the FP database 13B has registered therein the inherent information on a large number of pieces of broadcast content in advance. The ACR identification processing determines a degree of similarity or coincidence of the inherent information, for example. Note that as a determination method of the degree of similarity or coincidence, known techniques disclosed in various literatures and the like can be used. Usage of the ACR technology can make it possible to identify the broadcast content from the feature amount in the video signal and audio signal without depending on the information such as resolution, aspect ratio, bit rate, or format of the broadcast content.
  • In this ACR identification processing, obtained are information for identifying a channel number of the broadcast content such as a program (hereinafter, referred to as channel identification information) and information indicating a time position where the finger print information is extracted in a case of representing the relevant broadcast content in terms of a timeline from the start to the end thereof (hereinafter, referred to as time position information). In addition, the FP database 13B has stored therein information indicating a destination for acquisition of the video switch command (hereinafter, referred to as command acquisition destination information) in association with the channel identification information. For example, as the command acquisition destination information, a URL (uniform resource locator) of the command server 14 is described.
  • The ACR identification processing unit 13A acquires the command acquisition destination information corresponding to the identified channel number from the FP database 13B. Then, the ACR identification processing unit 13A transmits the channel identification information, time position information, and command acquisition destination information as an identification result of the ACR identification processing to the reception device 12 which is a source of the inquiry (S5).
  • The reception device 12 acquires the identification result from the ACR server 13 to analyze the identification result (S6). In addition, the reception device 12, in accordance with the analysis result for the identification result, accesses the command server 14 at the URL described in the command acquisition destination information and transmits the channel identification information and time position information to inquire the video switch command which is to be executable in the reception device 12 (S7).
  • The command server 14 transmits the video switch command corresponding to the channel identification information and time position information to the reception device 12 in response to the inquiry from the reception device 12 (S8). Specifically, the command server 14 manages the video switch command to be executable for each piece of broadcast content depending on a content change-over timing scheduled in advance, for example.
  • The command server 14 specifies the video switch command which is to be executable in a time zone corresponding to the time position information in the broadcast content corresponding to the channel identification information from the reception device 12. For example, the command server 14 specifies, on the basis of the time position information from the reception device 12, one or more video switch commands to be operated while a duration (e.g., for a few seconds) from a time when the target finger print information is extracted in the reception device 12 to a time when the next finger print information is extracted. Then, the command server 14 transmits the specified video switch command via the Internet 16 to the reception device 12.
  • The reception device 12 acquires and analyzes the video switch command from the command server 14 (S9). Then, the reception device 12, in accordance with the analysis result for the video switch command, requests the distribution server 15 for the distribution content to change over from the broadcast content to the distribution content (S10).
  • For example, as shown in FIG. 5, the reception device 12 acquires the video switch command depending on the identification result of the ACR identification processing on the broadcast content such that the broadcast content is changed over to distribution content A in response to the acquired video switch command. In addition, the reception device 12 acquires the video switch command depending on the result of the ACR identification processing on the distribution content A of a change-over destination such that the distribution content A is changed over to distribution content B in response to the relevant video switch command.
  • Then, when the reception device 12 completes reproduction of the distribution content B, reproduction of the distribution content A is resumed and further, when the reproduction of the distribution content A is completed, the broadcast content is resumed to be viewed. Note that as shown in FIG. 5, for example, a content resuming position in the case of returning from the change-over destination content to change-over original content can be set such that the reproduction is resumed from a scene at the time of changing over as in the case of returning from the distribution content B to the distribution content A. Further, the content resuming position may be set such that, as in the case of returning from the distribution content A to the broadcast content, the reproduction may be resumed from a scene in the broadcast content which is being broadcasted at this time. These content resuming positions are controlled depending on the pass-through mode or retention mode which is described later.
  • As described above, the cooperation among the devices constituting the broadcast system 1 allows the reception device 12 to be provided with the video switching command corresponding to the identification result obtained from the ACR identification processing on the content being viewed. Then, the reception device 12 performs the change-over process between the broadcast content and the distribution content in response to the video switching command.
  • [Detail of video switching command]
  • Next, with reference to FIG. 6 to FIG. 10, an explanation will be given of five kinds of video switch commands. The video switch commands are classified into any of a switch command, preload command, preselect command, enable switch command, or disable switch command.
  • FIG. 6 shows elements constituting the video switch command as the switch command. The switch command is a command for controlling the reception device 12 to change over the output content, that is, to change over a stream which is to be decoded and output.
  • Switch ID is identification information given to an event in which the stream is changed over. Command Code is a code number indicating that the relevant video switch command is the switch command.
  • Switching Time indicates a time to perform the relevant command for carrying out stream change-over. This time is specified by way of an absolute time and date, relative time or PTS, for example. The absolute time and date is specified in a case where the switch command is performed when a certain time and date set in advance arrives regardless of a progress of the broadcast content. Additionally, the relative time is specified in a case where the switch command is performed when a certain time period is lapsed from a time as a reference in the broadcast content. For example, a relative time period from the start time of the broadcast content is specified as the relative time.
  • Further, the PTS is specified in a case where the switch command is performed by use of the PTS (presentation time stamp) which is time information for carrying out synchronized reproduction. In other words, to Switching Time, a system specifying with hour, minute and second and a system specifying with an STC (system time clock) value of TS can be applied.
  • Target Media Type indicates whether the stream of the change-over destination is the broadcast content, MP4 format distribution content, MPEG2_TS format distribution content, or AVC_TS format distribution content. Target Stream URL indicates a destination URL for acquisition of the stream of the change-over destination. Stream Start Position indicates a reproduction start time position of the stream of the change-over destination. This reproduction start time position is specified in seconds, for example.
  • Retention Mode indicates which mode of the pass-through mode or the retention mode is used for a mode in changing over between the broadcast content and the distribution content. Here, a mode upon the content changing-over is described later in detail with reference to FIG. 11.
  • Personalized Mode indicates whether or not user authentication is required in acquiring the distribution content as well as which of a device ID or password of the reception device 12 is used upon the relevant user authentication. This makes it possible to set the switch command for each user. Auto Switch Flag indicates whether to confirm with the user about the stream change-over before that. Switching Message is a question sentence presented to the user in the case of confirming with user about the stream change-over before that.
  • Return Flag indicates whether or not the reproduction is resumed from a scene at the time of changing over the stream of the change-over original after the stream of the change-over destination is completed. Note that instead of Retention Mode and Return Flag described above, Loop Back Mode in which those elements are combined into one unit may be added as an element. In other words, Loop Back Mode specifies whether a non-loop back mode is set or a loop back mode is set. Here, the loop back mode indicates that after changing over the stream, the reproduction is resumed from a scene at the time of changing over the stream of the change-over original after the stream of the change-over destination is completed. The non-loop back mode indicates the cases of change-over other than the loop back mode.
  • FIG. 7 shows elements constituting the video switch command as the preload command. The preload command is a command for controlling the reception device 12 to receive the change-over destination content prior to the content change-over timing.
  • Switch ID is identification information given to an event in which the stream is changed over. Command Code is a code number indicating that the relevant video switch command is the preload command.
  • Target Media Type indicates whether the stream of the change-over destination is the broadcast content, MP4 format distribution content, MPEG2_TS format distribution content, or AVC_TS format distribution content. Target Stream URL indicates a destination URL for acquisition of the stream of the change-over destination. Stream Start Position indicates a reproduction start time position of the stream of the change-over destination.
  • Loop Back Mode specifies which of the above described non-loop back mode or loop back mode is set.
  • Personalized Mode indicates whether or not the user authentication is required in acquiring the distribution content as well as which of a device ID or password of the reception device 12 is used upon the relevant user authentication. This makes it possible to set the preload command for each user. Time to Switch indicates an estimated time period until the change-over to the content which is acquired in response to the relevant preload command. This estimated time period is set in seconds, for example.
  • FIG. 8 shows elements constituting the video switch command as the preselect command. The preselect command is a command for controlling the reception device 12 to confirm with the user about whether the content change-over is required prior to the content change-over timing.
  • Switch ID is identification information given to an event in which the stream is changed over. Command Code is a code number indicating the relevant video switch command is the preselect command.
  • Switching Message is the question sentence presented to the user in the case of confirming with user about the stream change-over before that. Time to Switch indicates an estimated time period until the change-over to the stream which is selected in response to the relevant preselect command.
  • FIG. 9 shows elements constituting the video switch command as the enable switch command. The enable switch command is a command for controlling the reception device 12 to acquire a VRT capable of viewpoint switching for the content which is a panorama type multiple-perspective video program or theater type multiple-perspective video program, for example.
  • Switch ID is identification information given to an event in which the stream is changed over. Command Code is a code number indicating that the relevant video switch command is the enable switch command.
  • Switching Meta URL is a destination URL for acquisition of VRT. Here, the VRT (view relation table) is a table referred to when the content is changed over and includes information such as a viewpoint column type of each of a plurality of multiple-perspective videos constituting the relevant content, and a destination URL for acquisition, for example. The reception device 12 can perform the viewpoint switching for the content which is the panorama type multiple-perspective video program or theater type multiple-perspective video program on the basis of the information included in the VRT.
  • FIG. 10 indicates elements constituting the video switch command as the disable switch command. The disable switch command is a command for controlling the reception device 12 to disable the acquired VRT so as to be incapable of the viewpoint switching for the content which is the panorama type multiple-perspective video program or theater type multiple-perspective video program, for example.
  • Switch ID is identification information given to an event in which the stream is changed over. Command Code is a code number indicating that the relevant video switch command is the disable switch command.
  • As described above, the video switch command is explained in detail.
  • [Detail of mode upon content change-over]
  • Next, an explanation will be given in detail of the pass-through mode and retention mode described above. FIG. 11 is a diagram illustrating an exemplary mode in changing over between the broadcast content and the distribution content.
  • First, with reference to A of FIG. 11, the pass-through mode will be explained.
  • The pass-through mode is a mode for the change-over in which after the reproduction of the distribution content which has been changed over from the broadcast content, when again returning from the distribution content to the broadcast content, the change-over is carried out to a scene in the broadcast content being broadcasted at this time.
  • For example, as shown in A of FIG. 11, in a case where a program (Program A) is broadcasted as the broadcast content, the change-over to the distribution content may be carried out only when CM1 and CM2 inserted during the program are broadcasted. In this case, when returning from the distribution content to the broadcast content, the broadcast content is not displayed which corresponds to the duration while the distribution content such as CM1 and CM2 is displayed, and the program being broadcasted at this time (Program A) is displayed.
  • The operation of the reception device 12 in this case is such that in changing over from the broadcast content to the distribution content, the retention buffer 33 supplies due to zero delay the TS data from the primary demultiplexer 32 to the secondary demultiplexer 35. Then, since the secondary demultiplexer 35 does not need data of the broadcast content while the distribution content is displayed, the TS data is discarded. This allows the scene of the broadcast content being broadcasted at that time to be displayed on a screen of the display 21 when returning from the distribution content to the broadcast content after that.
  • Next, with reference to B of FIG. 11, the retention mode will be explained.
  • The retention mode is a mode for the change-over in which after the reproduction of the distribution content which has been changed over from the broadcast content, when again returning from the distribution content to the broadcast content, the change-over is carried out to a scene in broadcast content at the time of changing over from the broadcast content to the distribution content.
  • For example, as shown in B of FIG. 11, in a case where broadcast content (Program A) is broadcasted as the broadcast content, the change-over may be carried out at a predetermined timing from the broadcast content to the distribution content. In this case, the distribution content is inserted into the broadcast content, and data of the broadcast content corresponding to the duration while the distribution content is displayed is stored in the retention buffer 33. Then, when returning from the distribution content to the broadcast content, the broadcast content data is read out from the retention buffer 33 to resume and display the broadcast content (Program A) from the scene at the time of change-over with time shifted.
  • Note that when returning from the distribution content to the broadcast content, in a case where the broadcast content (Program A) broadcasted in real time is completed and other broadcast content (Program B) is started, the broadcast content (Program A) may be resumed from a scene in midway thereof or the other broadcast content (Program B) may be resumed from the top.
  • The operation of the reception device 12 in this case is such that in changing over from the broadcast content to the distribution content, the TS data from the primary demultiplexer 32 is sequentially written into and stored in the retention buffer 33. At this time, since reading out of the TS data is stopped in the retention buffer 33, the TS data while the distribution content is displayed is sequentially stored in the retention buffer 33. After that, when returning from the distribution content to the broadcast content, the retention buffer 33 has stored therein the TS data while the distribution content is reproduced, which TS data is supplied to the secondary demultiplexer 35. This allows the scene in the broadcast content at the time of changing over from the broadcast content to the distribution content to be displayed on the screen of the display 21.
  • [Explanation of reception device operation]
  • Next, an explanation will be given of three kinds of utilization examples of the video switch command described above.
  • FIG. 12 shows a utilization example of the preselect command in an auto-switching operation.
  • In the relevant utilization example, the reception device 12, in a case of changing over from the broadcast content to the distribution content, receives a preselect command C1 corresponding to the identification result obtained by the ACR identification processing on the broadcast content prior to the change-over timing. After that, the reception device 12 receives a switch command C2 corresponding to the identification result obtained by the ACR identification processing on the broadcast content.
  • In other words, the reception device 12, in response to the preselect command C1, prompts the user to select whether to execute the content change-over. Here, in a case where, for example, in response to a message "change over?" superimposed on the video of the broadcast content P11 being viewed, the user selects the content change-over, an auto-switch is set for a content change-over event indicated by Switch ID of the preselect command C1. In contrast, in a case where the user selects the no content change-over, the no change-over is set for the content change-over event indicated by Switch ID of the preselect command C1.
  • After that, in the reception device 12, when the switch command C2 is received, in the case where the auto-switch is set in response to the above preselect command C1, the content change-over is automatically carried out after a time for content change-over arrives. For example, in the example in FIG. 12, first, the auto-switch is set for a content change-over event of Switch ID = A by way of the preselect command C1, and thereafter, the time for change-over from the broadcast content to the distribution content is set at a content change-over event of Switch ID = A by way of the switch command C2. Then, when Switching Time = T1 lapses, the change-over is carried out from a video P11 of the broadcast content to a video P21 of the distribution content. In the case of carrying out the content change-over, the pass-through mode or the retention mode is determined in response to Retention Mode in the switch command C2. In the example of FIG. 12, since the pass-through mode is set, a video P13 of the broadcast content is displayed on the display 21 when the video P21 of the distribution content is completed.
  • On the other hand, in the case where the no change-over is set for a content change-over event of Switch ID = A, the content change-over is not carried out, and change-over is carried out from the video P11 of the broadcast content to a video P12 thereof, for example. Then, when the video P12 of the broadcast content is completed, the video P13 is displayed on the display 21.
  • As described above, in the utilization example of the preselect command in the auto-switching operation, in the case where whether to execute the change-over is confirmed prior to the relevant content change-over and the content change-over is selected, the content change-over is automatically carried out after a predetermined time for change-over arrives.
  • However, in the case of the utilization example in FIG. 12, since the distribution content of the change-over destination is acquired in response to the switch command, the content may not be quickly changed over. Therefore, next, a utilization example in which the content can be quickly changed over will be explained.
  • FIG. 13 shows a utilization example of the preselect command and preload command in the auto-switching operation.
  • In the relevant utilization example, the reception device 12, in the case of change-over from the broadcast content to the distribution content, receives the preselect command C1 and preload command C3 corresponding to the identification result obtained by the ACR identification processing on the broadcast content prior to the change-over timing. After that, the reception device 12 receives the switch command C2 corresponding to the identification result obtained by the ACR identification processing on the broadcast content at a timing prior to the change-over.
  • In other words, the reception device 12, in response to the preselect command C1, prompts the user to select whether to execute the content change-over. Here, in a case where, for example, in response to a message "change over?" superimposed on the video of the broadcast content P11, the user selects the content change-over, an auto-switch is set for a content change-over event indicated by Switch ID of the preselect command C1. Then, when the reception device 12 receives the preload command C3, the distribution content of the change-over destination is started to be acquired in response to the preload command C3. After that, in the reception device 12, when the switch command C2 is received, in the case where the auto-switch is set in response to the above preselect command C1, the content change-over is quickly carried out from the broadcast content to the preloaded distribution content after a time for content change-over arrives.
  • For example, in the example in FIG. 13, first, the auto-switch is set for a content change-over event of Switch ID = A by way of the preselect command C1, and thereafter, the distribution content is started to be acquired from the distribution server 15 designated by way of the preload command C3. In addition, the time for change-over from the broadcast content to the distribution content is set at a content change-over event of Switch ID = A by way of the switch command C2. Then, when Switching Time = T1 lapses, the change-over is carried out from the video P11 of the broadcast content to a video P21 of the preloaded distribution content. In other words, since the distribution content of the change-over destination is already preloaded upon the change-over, the change-over is quickly carried out from the video P11 to the video P21.
  • After that, the reception device 12 receives a preload command C4 corresponding to an identification result obtained by the ACR identification processing on the distribution content and the broadcast content is started to be acquired from the broadcast device 11 designated by way of the preload command C4. Then, in the reception device 12, when reproduction of the distribution content is completed, the change-over is quickly carried out from distribution content to the preloaded broadcast content. Here, also in the example of FIG. 13, since the pass-through mode is set, the video P13 of the broadcast content is displayed on the display 21 when the video P21 of the distribution content is completed.
  • As described above, in the utilization example of the preselect command and preload command in the auto-switching operation, in the case where whether to execute the change-over is confirmed prior to the relevant content change-over and the content change-over is selected, the change-over destination content is acquired in advance. Then, the change-over is automatically carried out to content acquired in advance after a predetermined time for change-over arrives.
  • In this way, in the case of the utilization example in FIG. 13, since the distribution content of the change-over destination is acquired in response to the preload command, the content can be quickly changed over.
  • FIG. 14 shows a utilization example of the switch command in a manual switching operation.
  • In the relevant utilization example, the reception device 12, in a case of changing over from the broadcast content to the distribution content, receives at the change-over timing the switch command C2 corresponding to the identification result obtained by the ACR identification processing on the broadcast content.
  • In other words, the reception device 12, in a case where the Auto Switch Flag in the switch command C2 is set to a manual switch, displays toward the user a message such as "change over?" to prompt the user to select whether to execute the content change-over. Here, in a case where the user selects the content change-over, the distribution content of the change-over destination is started to be acquired and the content is changed over.
  • Note that in a case where Retention Mode in the switch command C2 is set to the retention mode, the data of the change-over original broadcast content is buffered even while waiting for a selection operation input from the user such that a video display state is brought into a pause state. In addition, in a case where Retention Mode in the switch command is set to the pass-through mode, while waiting for the selection operation input from the user, the change-over original broadcast content is passed through to continue to display the video of the broadcast content.
  • In the example of FIG. 14 also, since the pass-through mode is set, when the video P21 of the distribution content is completed, the video P13 of the broadcast content is displayed on the display 21.
  • As described above, in the utilization example of the switch command in the manual switching operation, in the case where whether to execute the change-over is confirmed at the relevant content change-over timing, and the content change-over is selected, the change-over is carried out to the change-over destination content.
  • [Command correspondent process corresponding to ACR identification result]
  • Next, with reference to FIG. 15 to FIG. 20, an explanation will be given of a command correspondent process (hereinafter, referred to as command correspondent process corresponding to the ACR identification result) in a case where the reception device 12 receives the video switch command corresponding to the identification result obtained by the ACR identification processing.
  • FIG. 15 is a flowchart illustrating the command correspondent process corresponding to the ACR identification result by the reception device 12. This command correspondent process corresponding to the ACR identification result is repeatedly performed when the user views the broadcast content such as a program, that is, while the reception device 12 is receiving the digital television broadcast signal from the broadcast device 11.
  • The finger print extraction unit 42, at step S11, determines whether or not a predetermined time lapses and waits for the predetermined time to lapse to extract the finger print information from the video signal and audio signal of the broadcast content (step S12). In other words, the finger print extraction unit 42 extracts the finger print information periodically at a predetermined interval of, for example, several seconds.
  • At step S13, the finger print extraction unit 42 controls the communication I/F 43 to transmit the extracted finger print information via the Internet 16 to the ACR server 13 to inquire the identification result for the broadcast content of the channel being selected. The ACR server 13 performs the ACR identification processing on the basis of the finger print information to transmit the identification result therefor to the reception device 12. Note that when the ACR server 13 cannot get the identification result for the broadcast content, the identification result is not transmitted.
  • At step S14, the control unit 45 controls the communication I/F 43 to determine whether or not the identification result is received from the ACR server 13 as an identification result inquiry destination.
  • At step S14, if determined that the identification result is not received, the process returns to step S11, and this and subsequent processes are repeated. For example, in a case where the reception device 12 selects a channel of halted broadcast, if the finger print information is extracted, the broadcast content cannot be identified on the ACR server 13 side such that the identification result is not transmitted (or such that the identification result may be transmitted with presenting there is no corresponding content).
  • On the other hand, at step S14, if determined that the identification result is received, the process proceeds to step S15, and at step S15 the control unit 45 analyzes the identification result for the broadcast content of the channel being selected, the content being received by the communication I/F 43. Here, obtained as the identification result are the channel identification information, time position information, and command acquisition destination information of the broadcast content of the channel being selected.
  • At step S16, the control unit 45 controls the communication I/F 43, accesses the command server 14 corresponding to the URL indicated by the command acquisition destination information and transmits the channel identification information and time position information to inquire the video switch command which is to be executable in the reception device 12. The command server 14 acquires and transmits to the reception device 12 the video switch command which is to be executable in the time zone corresponding to the time position information in the broadcast content corresponding to the channel identification information on the basis of the schedule set in advance.
  • At step S17, the control unit 45 controls the communication I/F 43 to determine whether or not the video switch command is received from the command server 14 as a video switch command inquiry destination.
  • At step S17, if determined that the video switch command is not received, the process returns to step S11, and this and subsequent processes are repeated. For example, in a case where the command server 14 has no video switch command matching conditions defined in the channel identification information and time position information, the video switch command is not transmitted (or the video switch command may be transmitted with presenting no process is needed).
  • On the other hand, at step S17, if determined that the video switch command is received, the process proceeds to step S18. At step S18, the command analysis unit 44 analyzes the video switch command. In addition, the change-over controller 48, depending on the analysis result for the video switch command, performs a process corresponding to a kind of the command indicated by Command Code thereof. The process corresponding to a kind of each video switch command will be described later in detail with reference to FIGs. 16 to 20.
  • Note that if determined that at step S11 a predetermined time does not lapse, the process proceeds to step S19. At step S19, the control unit 45 determines whether or not the user inputs a viewpoint switching operation. At step S19, if determined that the viewpoint switching operation is not input, the process returns to step S11.
  • Here, the viewpoint switching operation input by the user is enabled only when the viewpoint switching is enabled in the enable switch correspondent process in FIG. 19 described later. On the other hand, if determined that at step S19 the viewpoint switching operation is input by the user, the process proceeds to step S20. At step S20, the control unit 45 controls each related unit in the reception device 12 to receive and reproduce the distribution content corresponding to a designated viewpoint for changing over the video.
  • As described above, the command correspondent process corresponding to the ACR identification result is explained.
  • [Preselect command correspondent process]
  • FIG. 16 is a flowchart illustrating a process in a case where the received video switch command is a preselect command and corresponds to step S18 in FIG. 15 (hereinafter, referred to as preselect command correspondent process).
  • At step S31, the change-over controller 48 presents a question sentence described in Switching Message of the preselect command to the user to prompt to select whether to change over the content. At step S32, the change-over controller 48 determines whether or not the content change-over is selected correspondingly to an instruction from the user with respect to the presented question sentence.
  • At step S32, if the content change-over is selected, the process proceeds to step S33. At step S33, the change-over controller 48 sets the auto-switch to the content change-over indicated by Switch ID of the preselect command.
  • Note that if the content change-over is not selected at step S32 or if the selection timeout lapses, the preselect command correspondent process ends. The timeout is decided on the basis of Time to Switch. Then, when the preselect command correspondent process ends, the process returns to step S18 in FIG. 15, and this and subsequent processes are performed.
  • As described above, the preselect command correspondent process is explained.
  • [Preload command correspondent process]
  • FIG. 17 is a flowchart illustrating a process in a case where the received video switch command is a preload command and corresponds to step S18 in FIG. 15 (hereinafter, referred to as preload command correspondent process).
  • At step S51, the change-over controller 48 determines whether or not the content change-over indicated by Switch ID of the preload command is set with the auto-switch in response to the preselect command received prior to the relevant preload command. If determined that at step S51 the auto-switch is set, the process proceeds to step S52. At step S52, the change-over controller 48 controls each related unit in the reception device 12 to start to prepare for receiving the distribution content of the change-over destination.
  • Here, if determined that at step S51 the content change-over indicated by Switch ID of the preload command is not set with auto-switch, the preload command correspondent process ends. Then, when the preload command correspondent process ends, the process returns to step S18 in FIG. 15, and this and subsequent processes are performed.
  • As described above, the preload command correspondent process is explained.
  • [Switch command correspondent process]
  • FIG. 18 is a flowchart illustrating a process in a case where the received video switch command is a switch command and corresponds to step S18 in FIG. 15 (hereinafter, referred to as switch command correspondent process).
  • At step S71, the change-over controller 48, in accordance with the analysis result for the video switch command from the control unit 45, determines whether or not Auto Switch Flag of the switch command is the auto-switch. If determined that at step S71 it is the auto-switch, the process proceeds to step S72. At step S72, the change-over controller 48, in accordance with the analysis result for the video switch command from the control unit 45, determines whether or not the distribution content of the change-over destination is already preloaded. If determined that at step S72 it is not already preloaded, the process proceeds to step S73.
  • At step S73, the change-over controller 48, in accordance with the analysis result for the video switch command from the control unit 45, determines whether or not the content change-over indicated by Switch ID is set with the auto-switch in response to the preselect command received prior to the relevant switch command. If determined that at step S73 the auto-switch is set, the process proceeds to step S74.
  • At step S74, the change-over controller 48, in accordance with the analysis result for the video switch command from the control unit 45, controls each related unit in the reception device 12 to start to prepare for receiving the distribution content of the change-over destination.
  • At step S75, the change-over controller 48 determines whether or not the time for content change-over arrives on the basis of the time for change-over indicated by Switching Time of the switch command. Then, if the time for content change-over arrives ("YES" in step S75) the process proceeds to step S76. Here, if Switching Time of the switch command is not set, the process at step S75 is skipped and the process proceeds to step S76.
  • At step S76, the change-over controller 48 controls each related unit in the reception device 12 to change over the content to that of the change-over destination. Here, for example, the change-over is carried out from the broadcast content to the preloaded distribution content to start to reproduce the distribution content.
  • Note that if determined that at step S72 the distribution content of the change-over destination is already preloaded, the processes at steps S73 and S74 are skipped. In addition, if determined that at step S73 the content change-over indicated by Switch ID is not set with the auto-switch in response to the preselect command received prior to the relevant switch command, steps S74 to S76 are skipped, and the content change-over is not carried out to end the switch command correspondent process.
  • On the other hand, if determined that at step S71 Auto Switch Flag of the switch command is not the auto-switch, that is, is the manual switch, the process proceeds to step S77. At step S77, the change-over controller 48, in accordance with the analysis result for the video switch command from the control unit 45, presents the question sentence described in Switching Message of the switch command to the user to prompt to select whether to change over the content.
  • When at step S77 the question sentence is presented, at step S78 the change-over controller 48 determines whether or not the content change-over is selected in response to the presented question sentence. If at step S78 the content change-over is selected, the process proceeds to step S74, and the processes of step S74 and subsequent steps described above are performed.
  • On the other hand, if at step S78 the content change-over is not selected or at step S79 the selection timeout lapses, the content change-over is not carried out to end the switch command correspondent process. Then, when the switch command correspondent process ends, the process returns to step S18 in FIG. 15, and this and subsequent processes are performed.
  • As described above, the switch command correspondent process is explained.
  • [Enable switch command correspondent process]
  • FIG. 19 is a flowchart illustrating a process in a case where the received video switch command is an enable switch command and corresponds to step S18 in FIG. 15 (hereinafter, referred to as enable switch command correspondent process).
  • At step S91, the change-over controller 48 controls each related unit in the reception device 12 to acquire and analyze the VRT on the basis of Switching Meta URL of the enable switch command. At step S92, the change-over controller 48 enables the viewpoint switching to present that the viewpoint is switchable to the user such as by displaying an arrow indicating a direction of viewpoint to be switchable on the display, for example. The enable switch command correspondent process ends here, the process returns to step S18 in FIG. 15, and this and subsequent processes are performed.
  • As described above, the enable switch command correspondent process is explained.
  • [Disable switch command correspondent process]
  • FIG. 20 is a flowchart illustrating a process in a case where the received video switch command is a disable switch command and corresponds to step S18 in FIG. 15 (hereinafter, referred to as disable switch command correspondent process).
  • At step S111, the change-over controller 48 disables the acquired VRT in response to the enable switch command. This makes the viewpoint switching impossible. The disable switch command correspondent process ends here, the process returns to step S18 in FIG. 15, and this and subsequent processes are performed.
  • As described above, the disable switch command correspondent process is explained.
  • The command correspondent processes corresponding to the ACR identification result described above allow the reception device 12 to extract the finger print information from the data of the received broadcast content, and acquire the identification result identified from the finger print information using the ACR technology. Then, the reception device 12 acquires the video switch command depending on the identification result for the broadcast content to control the operation of changing over from the broadcast content to the distribution content in response to the video switch command. This makes it possible to change over the content using the ACR technology. Particularly, the content change-over process using the ACR technology can be quickly carried out.
  • Note that the above explanation describes the change-over from the broadcast content to the distribution content, but, the change-over original content is not limited to the broadcast content, and further the change-over destination content is not limited to the distribution content. In other words, the video switch command is a command for controlling the operation of changing over between the first content in the change-over original and the second content in the change-over destination, and can be executed regardless of types of content as change-over targets. For example, the first content may be, besides the broadcast content, distribution content for streaming reproduction or download reproduction, NRT content acquired by way of NRT (non real time) broadcast and the like, for example. Additionally, the second content may be, besides the distribution content for streaming reproduction, the broadcast content, distribution content for download reproduction, NRT content and the like, for example.
  • In a case where the first content as the change-over original is distribution content for streaming reproduction or download reproduction, the finger print information is extracted from the video signal and audio signal of the distribution content and transmitted to the ACR server 13. Then, the ACR server 13 performs the ACR identification processing to here transmit as the identification result the content identification information, time position information, and command acquisition destination information. In other words, if the broadcast content is acquired from the broadcast device 11, the channel identification information is obtained as the identification result, and if the distribution content is acquired, the content identification information such as the content ID is obtained as the identification result. Then, the reception device 12 accesses the command server 14 corresponding to the URL described in the command acquisition destination information and transmits the content identification information and time position information to inquire the video switch command which is to be executable in the reception device 12. Then, the reception device 12 controls the content change-over operation in response to the video switch command from the command server 14.
  • For example, in a case where a content provider wants to insert a CM into the distribution content distributed in streaming via the Internet 16, a case can be assumed that since the application program such as a browser is already being operated often in the reception device 12, the application program cannot instruct the content change-over. The present technology directly changes over the content in response to the video switch command without using the application program, allowing the content change-over process to be quickly performed even in a case like this.
  • [Configuration Example of Computer to Which Present Technology is Applied]
  • The series of processes described above can be executed by hardware but can also be executed by software. When the series of processes is executed by software, a program that constructs such software is installed into a computer. Here, the expression "computer" includes a computer in which dedicated hardware is incorporated and a general-purpose personal computer or the like that is capable of executing various functions when various programs are installed.
  • FIG. 21 is a block diagram showing a hardware configuration example of a computer that performs the above-described series of processing using a program.
  • In the computer 100, a central processing unit (CPU) 101, a read only memory (ROM) 102 and a random access memory (RAM) 103 are mutually connected by a bus 104.
  • An input/output interface 105 is also connected to the bus 104. An input unit 106, an output unit 107, a recording unit 108, a communication unit 109, and a drive 110 are connected to the input/output interface 105.
  • The input unit 106 is configured from a keyboard, a mouse, a microphone or the like. The output unit 107 is configured from a display, a speaker or the like. The recording unit 108 is configured from a hard disk, a non-volatile memory or the like. The communication unit 109 is configured from a network interface or the like. The drive 110 drives a removable medium 111 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory or the like.
  • In the computer configured as described above, the CPU 101 loads a program that is recorded, for example, in the recording unit 108 onto the RAM 103 via the input/output interface 105 and the bus 104, and executes the program. Thus, the above-described series of processing is performed.
  • Programs to be executed by the computer 100 (the CPU 101) are provided being recorded in the removable medium 111 which is a packaged medium or the like. Also, programs may be provided via a wired or wireless transmission medium, such as a local area network, the Internet or digital satellite broadcasting.
  • In the computer 100, by inserting the removable medium 111 into the drive 110, the program can be installed in the recording unit 108 via the input/output interface 105. Further, the program can be received by the communication unit 109 via a wired or wireless transmission medium and installed in the recording unit 108. Moreover, the program can be installed in advance in the ROM 102 or the recording unit 108.
  • It should be noted that the program executed by a computer may be a program that is processed in time series according to the sequence described in this specification or a program that is processed in parallel or at necessary timing such as upon calling.
  • A processing step herein for describing a program which causes the computer to perform various processing does not necessarily have to be processed chronologically in the order described in a flow chart. It also includes processing performed in parallel or individually (for example, parallel processing or processing by an object).
  • The program may be a program executed by a single computer or may be a program executed in a distribution manner by a plurality of computers. The program may be transmitted remotely to a computer to be executed.
  • Further, in the present disclosure, a system has the meaning of a set of a plurality of configured elements (such as an apparatus or a module (part)), and does not take into account whether or not all the configured elements are in the same casing. Therefore, the system may be either a plurality of apparatuses, stored in separate casings and connected through a network, or a plurality of modules within a single casing.
  • An embodiment of the disclosure is not limited to the embodiments described above, and various changes and modifications may be made without departing from the scope of the disclosure as defined in the appended claims.
  • For example, the present disclosure can adopt a configuration of cloud computing which processes by allocating and connecting one function by a plurality of apparatuses through a network.
  • Further, each step described by the above mentioned flow charts can be executed by one apparatus or by allocating a plurality of apparatuses.
  • In addition, in the case where a plurality of processes is included in one step, the plurality of processes included in this one step can be executed by one apparatus or by allocating a plurality of apparatuses.
  • Reference Signs List
  • 1
    broadcast system
    11
    broadcast device
    12
    reception device
    13
    ACR server
    14
    command server
    15
    distribution server
    16
    Internet
    31
    tuner
    33
    retention buffer
    34
    retention controller
    42
    finger print extraction unit
    43
    communication I/F
    44
    command analysis unit
    45
    control unit
    48
    change-over controller
    100
    computer,
    101
    CPU

Claims (15)

  1. A reception device comprising:
    a reception part (31) configured to receive first content, wherein the first content is broadcast content broadcasted via a broadcast network;
    a feature amount extraction part (42) configured to extract a feature amount from any one or both of a video signal and an audio signal of the received first content, wherein the feature amount is fingerprint information;
    an identification result acquisition part (45) configured to acquire an identification result, received from an Automatic Content Recognition, ACR, server, for the first content identified using an ACR technology from the extracted feature amount, the identification result including command acquisition destination information;
    a command acquisition part (44) configured to acquire a command, received from a command server identified by command acquisition destination information included in the acquired identification result, for controlling an operation of changing over between the first content and second content different from the first content depending on the acquired identification result, wherein the second content is distribution content distributed from a distribution server via a communication network and wherein the command is a first command for requesting a user to confirm whether or not a change-over is required to be carried out, prior to a timing of change-over from the first content to the second content, or a second command for changing over from the first content to the second content; and
    a control part (48) configured to control an operation of changing over from the first content to the second content in response to the acquired command, wherein the control part (48) is configured to request the distribution server to distribute the distribution content and to request the user to confirm whether or not the change-over is required to be carried out, in response to the first command, and, in a case where the user permits the change-over to be carried out, to change over from the first content to the second content in response to the second command.
  2. The reception device according to claim 1, wherein
    the command is the first command, the second command, or a third command for causing the second content to be acquired prior to a timing of change-over from the first content to the second content, and
    in a case where the user permits the change-over to be carried out, the control part (48) acquires the second content in response to the third command prior to a timing of change-over, and
    the control part (48) changes over from the first content to the acquired second content in response to the second command.
  3. The reception device according to claim 2, wherein
    the second command includes time information indicating a time to execute the second command, and
    the control part changes over from the first content to the second content when a timing of change-over arrives in accordance with the time information included in the second command.
  4. The reception device according to claim 2, wherein the second command or the third command is settable for each user.
  5. The reception device according to any one of claims 2 to 4, wherein
    the command is a fourth command for setting a state in which it is possible to change to the second content that corresponds to a viewpoint designated by the user, or a fifth command for ending the state in which it is possible to change to the second content that corresponds to the viewpoint designated by the user, and
    the control part (48) is configured to set the state in which it is possible to change to the second content that corresponds to the viewpoint designated by the user in response to the fourth command, and
    the control part (48) is configured to end the state in which it is possible to change to the second content that corresponds to the viewpoint designated by the user in response to the fifth command.
  6. The reception device according to any one of claims 1 to 5, further comprising:
    a buffer (33) configured to sequentially store data of the received first content when the first content is changed over to the second content; and
    an output part (40) configured to output the first content stored in the buffer while the second content is being output, when the second content is changed over to the first content.
  7. The reception device according to any one of claims 1 to 6, further comprising:
    an output part (40) configured to output the received first content when the second content is changed over to the first content.
  8. The reception device according to any of claims 1 to 7, wherein the reception device is a digital television receiver.
  9. A reception method in a reception device, the reception method comprising the steps of:
    by the reception device
    receiving first content, wherein the first content is broadcast content broadcasted via a broadcast network;
    extracting a feature amount from data of the received first content, wherein the feature amount is fingerprint information;
    acquiring an identification result, received from an Automatic Content Recognition, ACR, server, for the first content identified using an ACR technology from the extracted feature amount, the identification result including command acquisition destination information;
    acquiring a command, received from a command server identified by command acquisition destination information included in the acquired identification result, for controlling an operation of changing over between the first content and second content different from the first content depending on the acquired identification result, wherein the second content is distribution content distributed from a distribution server via a communication network and wherein the command is a first command for requesting a user to confirm whether or not a change-over is required to be carried out, prior to a timing of change-over from the first content to the second content, or a second command for changing over from the first content to the second content; and
    controlling an operation of changing over from the first content to the second content in response to the acquired command, including requesting the distribution server to distribute the distribution content and requesting the user to confirm whether or not the change-over is required to be carried out, in response to the first command, and, in a case where the user permits the change-over to be carried out, changing over from the first content to the second content in response to the second command.
  10. The reception method according to claim 9, wherein
    the command is the first command, the second command, or a third command for causing the second content to be acquired prior to a timing of change-over from the first content to the second content, and
    in a case where the user permits the change-over to be carried out, acquiring the second content in response to the third command prior to a timing of change-over, and
    changing over from the first content to the acquired second content in response to the second command.
  11. The reception method according to claim 10, wherein
    the second command includes time information indicating a time to execute the second command, and
    it is changed over from the first content to the second content when a timing of change-over arrives in accordance with the time information included in the second command.
  12. The reception method according to claim 10, wherein the second command or the third command is settable for each user.
  13. The reception method according to any one of claims 10 to 12, wherein
    the command is a fourth command for setting a state in which it is possible to change to the second content that corresponds to a viewpoint designated by the user, or a fifth command for ending the state in which it is possible to change to the second content that corresponds to the viewpoint designated by the user,
    wherein the reception method further comprises
    setting the state in which it is possible to change to the second content that corresponds to the viewpoint designated by the user in response to the fourth command, and
    ending the state in which it is possible to change to the second content that corresponds to the viewpoint designated by the user in response to the fifth command.
  14. The reception method according to any one of claims 9 to 13, further comprising:
    sequentially storing data of the received first content in a buffer when the first content is changed over to the second content, and
    outputting the first content stored in the buffer while the second content is being output, when the second content is changed over to the first content.
  15. A program causing a computer to carry out the steps of the reception method as defined in any one of claims 9 to 14 when said program is executed by the computer.
EP12843610.2A 2011-10-26 2012-10-18 Reception device, reception method, program, and information processing system Active EP2773108B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2011234555A JP6071184B2 (en) 2011-10-26 2011-10-26 Receiving apparatus, receiving method, program, and information processing system
PCT/JP2012/076884 WO2013061851A1 (en) 2011-10-26 2012-10-18 Reception device, reception method, program, and information processing system

Publications (3)

Publication Number Publication Date
EP2773108A1 EP2773108A1 (en) 2014-09-03
EP2773108A4 EP2773108A4 (en) 2015-05-06
EP2773108B1 true EP2773108B1 (en) 2020-04-15

Family

ID=48167684

Family Applications (1)

Application Number Title Priority Date Filing Date
EP12843610.2A Active EP2773108B1 (en) 2011-10-26 2012-10-18 Reception device, reception method, program, and information processing system

Country Status (9)

Country Link
US (1) US10356473B2 (en)
EP (1) EP2773108B1 (en)
JP (1) JP6071184B2 (en)
KR (1) KR102020689B1 (en)
CN (1) CN103891302A (en)
AR (1) AR088399A1 (en)
CA (1) CA2846828C (en)
MX (1) MX2014004676A (en)
WO (1) WO2013061851A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9210208B2 (en) * 2011-06-21 2015-12-08 The Nielsen Company (Us), Llc Monitoring streaming media content
JP6569315B2 (en) * 2015-06-12 2019-09-04 日本電気株式会社 Video surveillance system, video surveillance method, and video surveillance program
US9930406B2 (en) 2016-02-29 2018-03-27 Gracenote, Inc. Media channel identification with video multi-match detection and disambiguation based on audio fingerprint
US9924222B2 (en) * 2016-02-29 2018-03-20 Gracenote, Inc. Media channel identification with multi-match detection and disambiguation based on location
US10063918B2 (en) 2016-02-29 2018-08-28 Gracenote, Inc. Media channel identification with multi-match detection and disambiguation based on single-match
US10574373B2 (en) * 2017-08-08 2020-02-25 Ibiquity Digital Corporation ACR-based radio metadata in the cloud
US10904587B2 (en) * 2018-07-19 2021-01-26 Gracenote, Inc. Establishment and use of time mapping based on interpolation using low-rate fingerprinting, to help facilitate frame-accurate content revision
WO2020231817A1 (en) * 2019-05-10 2020-11-19 The Nielsen Company (Us), Llc Content-modification system with determination of input-buffer switching delay feature
KR20210051048A (en) * 2019-10-29 2021-05-10 삼성전자주식회사 Electronic apparatus and control method thereof
US11363321B2 (en) * 2019-10-31 2022-06-14 Roku, Inc. Content-modification system with delay buffer feature

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6209028B1 (en) * 1997-03-21 2001-03-27 Walker Digital, Llc System and method for supplying supplemental audio information for broadcast television programs
AU4691001A (en) 2000-04-14 2001-10-30 Nippon Telegraph & Telephone Method, system, and apparatus for acquiring information concerning broadcast information
US7712123B2 (en) * 2000-04-14 2010-05-04 Nippon Telegraph And Telephone Corporation Method, system, and apparatus for acquiring information concerning broadcast information
JP3994682B2 (en) * 2000-04-14 2007-10-24 日本電信電話株式会社 Broadcast information transmission / reception system
JP2005537731A (en) * 2002-08-30 2005-12-08 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ How to embed fingerprints for multimedia content identification
JP4344185B2 (en) * 2003-01-28 2009-10-14 シャープ株式会社 Client terminal device, information processing method, sub-client terminal device, computer-executable program, and recording medium
US20040237102A1 (en) 2003-03-07 2004-11-25 Richard Konig Advertisement substitution
WO2005006758A1 (en) * 2003-07-11 2005-01-20 Koninklijke Philips Electronics N.V. Method and device for generating and detecting a fingerprint functioning as a trigger marker in a multimedia signal
JP4691216B2 (en) 2005-02-28 2011-06-01 株式会社日立国際電気 Digital broadcast receiver
US20060218617A1 (en) * 2005-03-22 2006-09-28 Microsoft Corporation Extensible content identification and indexing
JP4664793B2 (en) * 2005-09-30 2011-04-06 株式会社東芝 Broadcast receiving apparatus and broadcast receiving method
KR101485040B1 (en) * 2007-10-30 2015-01-23 삼성전자주식회사 Method for broadcast related information and display apparatus using the same
JP2009302891A (en) * 2008-06-13 2009-12-24 Sony Corp Information processing device
KR101599465B1 (en) * 2009-03-03 2016-03-04 삼성전자주식회사 Server and method for providing synchronization information client apparatus and method for synchronizing additional information with broadcast program
US9015741B2 (en) * 2009-04-17 2015-04-21 Gracenote, Inc. Method and system for remotely controlling consumer electronic devices
JP5428697B2 (en) * 2009-09-16 2014-02-26 ソニー株式会社 Receiving device, receiving method, transmitting device, and computer program
CN102741842A (en) 2009-12-04 2012-10-17 Tivo有限公司 Multifunction multimedia device
JP5668512B2 (en) 2011-02-15 2015-02-12 ソニー株式会社 Information processing apparatus and information processing method
RU2594000C2 (en) 2011-08-05 2016-08-10 Сони Корпорейшн Receiving device, receiving method, recording medium and information processing system
EP3439294B1 (en) 2011-08-24 2023-06-14 Saturn Licensing LLC Reception apparatus, reception method, program and information processing system
TWI528749B (en) 2011-09-06 2016-04-01 Sony Corp A signal receiving device, a signal receiving method, an information processing program and an information processing system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
MX2014004676A (en) 2014-05-28
EP2773108A1 (en) 2014-09-03
US20140337874A1 (en) 2014-11-13
KR20140092814A (en) 2014-07-24
CA2846828C (en) 2021-04-06
US10356473B2 (en) 2019-07-16
CN103891302A (en) 2014-06-25
JP6071184B2 (en) 2017-02-01
JP2013093740A (en) 2013-05-16
EP2773108A4 (en) 2015-05-06
AR088399A1 (en) 2014-05-28
KR102020689B1 (en) 2019-09-10
WO2013061851A1 (en) 2013-05-02
CA2846828A1 (en) 2013-05-02

Similar Documents

Publication Publication Date Title
EP2773108B1 (en) Reception device, reception method, program, and information processing system
US10440423B2 (en) Reception device, reception method, program, and information processing system
CN103329554B (en) Reception device, method of reseptance, offer device, offer method, program and broadcast system
US9451202B2 (en) Content-based highlight recording of television programming
US20130071090A1 (en) Automatic content recongition system and method for providing supplementary content
EP1975938A1 (en) Method for determining a point in time within an audio signal
KR20140053984A (en) Reception device, reception method, program, and information processing system
CN103299648A (en) Method for receiving enhanced service and display apparatus thereof
KR20140007907A (en) Transmission device, transmission method, receiving device, receiving method, program, and broadcasting system
CN104285448A (en) Automatic commercial playback system
KR20150035808A (en) Transmission device, information processing method, program, reception device, and application linking system
JP6228456B2 (en) Supply device, supply method, reception device, reception method, program, and broadcasting system
EP2621180A2 (en) Electronic device and audio output method
RU2630432C2 (en) Receiving apparatus, data processing technique, programme, transmission apparatus and transferring programmes interaction system
JP5316543B2 (en) Data transmission device and data reception device
CN101304509B (en) Recording control apparatus, method for controlling recording control apparatus and recording control system
KR20230029438A (en) Display device and controlling method of display device
KR101930488B1 (en) Metadata Creating Method and Apparatus for Linkage Type Service
CN104768060A (en) Channel switching method and device
JP3833670B2 (en) Information processing apparatus, information processing method, program, and information processing system
EP3312782A1 (en) Device and method for targeted advertising
KR102049119B1 (en) Method and Apparatus for providing recording service in cloud environment
CN112243589A (en) Receiving device and receiving method, transmitting and receiving system and method executed by transmitting and receiving system, video playing device and video playing method
CN112399210A (en) Multimedia playing equipment and control method and device thereof
WO2011121318A1 (en) Method and apparatus for determining playback points in recorded media content

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20140408

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
RA4 Supplementary search report drawn up and despatched (corrected)

Effective date: 20150407

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 7/173 20110101AFI20150330BHEP

Ipc: G06F 17/30 20060101ALI20150330BHEP

Ipc: H04H 60/37 20080101ALI20150330BHEP

Ipc: H04H 20/10 20080101ALI20150330BHEP

17Q First examination report despatched

Effective date: 20160218

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SATURN LICENSING LLC

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 21/8358 20110101ALI20191015BHEP

Ipc: H04N 7/173 20110101AFI20191015BHEP

Ipc: H04N 21/438 20110101ALI20191015BHEP

Ipc: H04H 20/10 20080101ALI20191015BHEP

Ipc: H04N 21/472 20110101ALI20191015BHEP

Ipc: H04H 60/37 20080101ALI20191015BHEP

INTG Intention to grant announced

Effective date: 20191104

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602012069352

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1258683

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200515

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200415

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200715

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200716

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200815

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200817

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1258683

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200415

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200715

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602012069352

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

26N No opposition filed

Effective date: 20210118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201018

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20201031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201031

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201031

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201018

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200415

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230514

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20231024

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20231026

Year of fee payment: 12

Ref country code: DE

Payment date: 20231027

Year of fee payment: 12