Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/16—Analogue secrecy systems; Analogue subscription systems
  • H04N7/162—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing
  • H04N7/165—Centralised control of user terminal ; Registering at central
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V20/00—Scenes; Scene-specific elements
  • G06V20/40—Scenes; Scene-specific elements in video content
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
  • H04N21/4305—Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
  • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
  • H04N21/454—Content or additional data filtering, e.g. blocking advertisements
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
  • H04N21/454—Content or additional data filtering, e.g. blocking advertisements
  • H04N21/4545—Input to filtering algorithms, e.g. filtering a region of the image
  • H04N21/45452—Input to filtering algorithms, e.g. filtering a region of the image applied to an object-based stream, e.g. MPEG-4 streams
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
  • H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
  • H04N21/4662—Learning process for intelligent management, e.g. learning user preferences for recommending movies characterized by learning algorithms
  • H04N21/4666—Learning process for intelligent management, e.g. learning user preferences for recommending movies characterized by learning algorithms using neural networks, e.g. processing the feedback provided by the user
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
  • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/85—Assembly of content; Generation of multimedia applications
  • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
  • H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL

Definitions

• the present invention relates to a device and a method for synchronizing broadcast audiovisual programs and additional information, as well as to corresponding applications.
• a central server receives from program centers a program guide, which contains information relating to the programs to be broadcast. A viewer can thus, directly from their television, access information that interests them.
• a particularly useful and user-friendly system would offer viewers the possibility of seeing information relating to the program being broadcast live on their screen. This display (superimposed on the image or spatially shifted) would then be automatic, and would last for for example a few seconds, or would be activated by the user.
• Certain channels do send signals to identify the program currently being broadcast, but most of them do not use such a technique, and the programs concerned are in the minority.
• the present invention provides a device and a method for synchronizing broadcast audiovisual programs and additional information, in particular allowing synchronized real-time display of the programs and additional information.
• the device and the method of the invention also make possible a sound diffusion of the additional information (for example for the visually impaired), which can interrupt the sound diffusion of the program for a short time or, possibly, be superimposed on it with a higher intensity. .
• the device and method of the invention also have applications based on the use of complementary information for purposes other than broadcasting, in particular for automatic recordings on video recorders.
• Other applications relate to the substitution of content for audiovisual programs.
• the user can for example decide in advance an automatic replacement and in real time on the screen of a certain category of programs (for example variety shows) by another (for example fiction films), by means of a selection from several sources of distribution (several channels, Internet, local storage system ).
• the invention relates to a device for synchronizing broadcast audiovisual programs and additional information according to claim 1.
• broadcasting channel means any channel or set of communication channels for information coming from broadcasting means and intended for reception means, corresponding to a given broadcasting schedule.
• broadcasting of audiovisual programs is carried out indifferently from all techniques, such as wireless broadcasting network, satellite, cable, Internet or local storage system.
• the information set for each program contains meaningful information about that program, such as one or more of the following:
• the information set also includes other information, useful for understanding the program (therefore for example for real-time display) but not very determining for the recognition of semantic elements, therefore preferably not used for correlation, for example : - director, author of the script, composer,
• the semantic elements extracted are meanings significant for recognition, that is to say for the connection of these semantic elements with the information used.
• they advantageously include: - a family of shapes (for example a moving ball to identify a football match, busts in medium shots to identify debates or presenters %),
• a sound level for example a higher sound level to identify advertisements
• a rhythm of movement for example a fast rhythm to identify advertisements and slow for identifying a debate in the studio
• Image and / or sound detection and recognition of semantic elements is implemented by techniques which are known per se.
• the correlation of semantic elements with available information advantageously uses artificial intelligence methods, built for example around neural networks (artificial intelligence motor association - self-learning).
• the device of the invention however imposes on these recognition techniques the constraint of a choice from an ordered list, which basically amounts to positioning a pointer in this list. This constraint relating to the lists in the program guide makes recognition possible, because it imposes a framework limited to the area of analysis.
• the recognition capacity is acquired by learning, and not programmed a priori.
• This learning leaves flexibility to the system and allows a large number of parameters related to the image and sound of the programs broadcast (semantic elements) and the information used (set of information) to be taken into account.
• the set of all parameters can provide reliable results. These are manifested by the most significant probability for the positioning of the pointer in each list, which corresponds to the strongest correlation between the semantic elements and the sets of information in the list.
• the invention is thus based on the combination of three nested functions:
• An important advantage of the invention is that it does not require any particular means to be implemented at the transmission level, the identification of the appropriate information being able to be entirely carried out upon reception, whether the latter is final (terminals, such as interactive TVs) or intermediate TVs (servers).
• the device according to the invention is preferably located geographically in a central server, designed to make the information obtained available to reception means.
• the central server then advantageously systematically synchronizes on a selection of channels, and transmits the information to the users automatically (for example each time the channel is changed for a few seconds) and / or on request.
• the synchronization device of the invention is in accordance with claim 2, and advantageously in claim 3.
• the positioning of the pointer in each of the ordered lists is necessarily done in one direction, towards a rank greater than or equal to the current position of the pointer. This amounts to imposing the choice of information relating to the current program or to a subsequent program - unless the list is updated.
• This additional constraint facilitates recognition operations, at the cost of an additional restriction on the determination of the relevant information sets.
• the initial positioning of the pointer in the list is advantageously obtained by means of the times indicated in the program guide and the current time.
• the summary block advantageously takes into account the set of information last selected to update the indicator. This method can make it possible to optimally position the indicators over time, and therefore make the determination of the current indicator more secure and more efficient. However, it implies that the update is done continuously. In addition, in the event of an error in the automatic selection of an indicator, this error may have repercussions on subsequent choices through less efficiency or new errors.
• the summary block uses the times indicated in the program guide for default positioning. The two forms of updating are advantageously combined, the indicator of each list preferably having its position modified each time that updating by schedule or by selection leads to a position subsequent to the current position in the list - this modification does not affect the set of information in use, but only the recognition operations.
• the synchronization device is for example implemented periodically, in time slots close to the start and end times indicated in the program guides and / or at the request of users.
• this order relation constraint is not imposed. This makes it possible to reverse programs, which can occur, for example, in the presence of sports programs broadcast live.
• the invention also relates to applications of the device of the invention, as set out in claims 8 to 10. It also relates to a method for synchronizing broadcast audiovisual programs and additional information, as defined in claim 11.
• FIG. 1 is a block diagram showing a synchronization device according to the invention, in its environment
• FIG. 1 shows a program guide used by the device of Figure 1;
• FIG. 3 illustrates the principle operation of pointing one of the indicators used in the device of FIG. 1, to the corresponding list in the program guide of FIG. 2.
• a central unit 2 (FIG. 1) of an audiovisual program receiver 10 is provided for receiving the content of the programs 10 from a broadcasting unit 1 (for example a broadcaster) and for having access to a program guide 20 an information center 3 (for example a dedicated service provider).
• the central unit 2 is then able to produce from the programs 10 and information from the information center 3, audiovisual programs 15 broadcast with synchronized complementary information, and to communicate these programs 15 to broadcasting means 4 to 1. 'screen.
• the central unit 2 more precisely comprises:
• a synthesis block 5 responsible for controlling all of the operations and in particular for synchronizing the programs 10 with selected information
• a memory 6 intended to store information relating to the program guide 20 and the extraction of appropriate information from this guide 20,
• a recognition unit 8 of semantic elements intended to relate the semantic elements 41-43 identified and information coming from the program guide 20.
• the recognition unit 8 operates on the basis of lists 21, 22 and 23 (FIG. 2) arranged chronologically from sets of information (timetables, duration, title, summary, etc.) respectively referenced 21 -
• Each of the lists 21 to 23 is associated with a broadcasting channel (television channel) and its information sets 21 ⁇ -21 n ⁇ , 22-
• the recognition unit 8 is capable of selecting respectively the set of information 44, 45 or 46 from this list which is most probably correlated with the semantic elements 41, 42 or 43 extracted from this program by the detection set 7.
• This recognition unit 8 is provided to perform a preliminary learning allowing him, by means of learning materials comprising semantic elements and associated information, to make the most judicious selections. This learning is advantageously continued during use.
• the recognition unit 8 for example implements neural network techniques associated with an artificial intelligence engine.
• an additional constraint brings into play indicators 31, 32 and 33 (FIGS. 1 and 3) pointing respectively to the current sets of information selected in lists 21, 22 and 23.
• These indicators 31 to 33 stored in memory 6, give the sets of information corresponding to the audiovisual programs last broadcast respectively on each of the broadcasting channels (for example, the indicator 31 points to the set 21 2 which corresponds to the program last broadcast on the first chain - Figure 3).
• the additional constraint imposed by the recognition unit 8 is for example that the set of information to be selected from one of the lists 21, 22 or 23 is located downstream of the set of information pointed to by the indicator 31, 32 or 33.
• the chronological nature of the lists is thus used to make it safer and / or easier to identify the appropriate information.
• the selection of a set of information is authorized downstream, but on condition that the latter is not more than two units distant from the current one.
• the summary block 5 is responsible for updating the indicators 31 to
• one selects from the chronologically ordered list 21 of sets of information associated with the first channel, the set of information 44 most probably correlated with the semantic elements 41 and respecting the constraint chosen on the displacement of the indicator 31 associated with the list 21, by means of the recognition unit 8;

Priority Applications (1)

Applications Claiming Priority (4)

Publications (1)

Family

ID=8173703

Family Applications (1)

Country Status (8)

Families Citing this family (6)

Family Cites Families (9)

• 2001
  • 2001-05-22 WO PCT/EP2001/005853 patent/WO2001091462A1/fr not_active Application Discontinuation
  • 2001-05-22 CN CN01809480A patent/CN1429455A/zh active Pending
  • 2001-05-22 AU AU2001272415A patent/AU2001272415A1/en not_active Abandoned
  • 2001-05-22 MX MXPA02011594A patent/MXPA02011594A/es active IP Right Grant
  • 2001-05-22 US US10/276,385 patent/US7015972B2/en not_active Expired - Lifetime
  • 2001-05-22 JP JP2001586920A patent/JP2003534740A/ja not_active Withdrawn
  • 2001-05-22 KR KR1020027014792A patent/KR20020093976A/ko not_active Application Discontinuation
  • 2001-05-22 EP EP01951512A patent/EP1293094A1/de not_active Withdrawn

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events