Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N5/00—Details of television systems
  • H04N5/76—Television signal recording
  • H04N5/91—Television signal processing therefor
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
  • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
  • G06F16/73—Querying
  • G06F16/738—Presentation of query results
  • G06F16/739—Presentation of query results in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
  • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
  • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
  • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
  • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
  • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
• • G—PHYSICS
  • G11—INFORMATION STORAGE
  • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
  • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
  • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
  • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
  • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/41—Structure of client; Structure of client peripherals
  • H04N21/4104—Peripherals receiving signals from specially adapted client devices
  • H04N21/4112—Peripherals receiving signals from specially adapted client devices having fewer capabilities than the client, e.g. thin client having less processing power or no tuning capabilities
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N5/00—Details of television systems
  • H04N5/76—Television signal recording
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/47—End-user applications
  • H04N21/485—End-user interface for client configuration
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/47—End-user applications
  • H04N21/488—Data services, e.g. news ticker
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N9/00—Details of colour television systems
  • H04N9/79—Processing of colour television signals in connection with recording
  • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
  • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
  • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal

Definitions

• the invention relates to a method for creating a summary of an audiovisual document, and a device for creating the summary.
• the present invention is in the context of viewing audiovisual documents.
• the broadcaster may propose summaries of different lengths. But the user or viewer can not define itself the duration and content that remain determined by the broadcaster. It can not change the duration or the nature of the sequences constituting the summary except to proceed to a partial visualization of the sequence by skipping some parts of the sequence. For example, in the case of a news program, with the usual techniques available to the program's creator, the broadcaster must adjust the duration of his sequence at a fixed time to advance. The same report may give rise to several montages depending on the time of day to which it is broadcast. For example, the same report broadcast on the 13-hour newscast may last 5 minutes, but it will only take 3 minutes in the 20-hour newscast.
• US 6,807,362 - GIRGENSOHN describes a method for producing a summary from an audiovisual document.
• the document is cut into clips of equal duration and each clip is associated with a dissatisfaction value.
• the program will extract the clips based on the dissatisfaction value in order to develop a summary.
• Document US2005 / 141859 describes a method for creating a summary from sequences of an audiovisual document.
• a capacity parameter is associated with each sequence and depending on this parameter, the device incorporates or not the sequence in the summary.
• the invention relates to a method for producing a summary of an audiovisual program transmitted by a broadcaster, granting the user more flexibility as to the choice of the duration and / or theme chosen.
• the invention makes it possible, among other things, to create content whose durations can be adjusted by the user.
• the audiovisual receiver adjusts according to the criteria defined by the user the duration of the summary thus created.
• the invention relates to a method for creating a summary of an audiovisual document recorded in an audiovisual receiver and composed of a series of sequences; characterized in that at least one sequence is associated with a dependency parameter indicating the importance of this sequence for understanding all or part of the document, the method comprising:
• the summary thus created comprises both first sequences selected by the user and second sequences helping to the overall understanding of the summary.
• the dependency parameter makes it possible to associate a first sequence with at least one second. Second sequences are thus added to the first sequences that are selected by the user, this addition allowing among others to better understand the summary.
• the user introduces a duration for the summary. The total duration of the first and second sequences must not exceed the allowed time. Thus, the user controls better the creation of his summary.
• the link to the second sequence is associated with a dependency value defining the importance of this second sequence for understanding the first sequence. The second most important sequences are added in priority to the summary. In this way, only the most important sequences are added.
• the dependency value is compared to a default value to determine whether the associated sequence is embedded in the summary. In this way, the process is autonomous and the user does not need to set the threshold for the selection of the second sequences.
• the user introduces criteria for the selection of the first sequences. In this way, it does not need to select them manually, the module does this by comparing the introduced criterion with attribute values associated with each sequence.
• a second process of creating a new summary is started by increasing the values of the selection criteria introduced by the user so as to select fewer first sequences.
• the duration of the summary corresponds to the duration introduced by the user
• the method comprises a step of displaying an indication of its duration.
• the invention also relates to an audiovisual transmission receiver comprising means for memorizing at least one audiovisual document cut in sequence, and means for displaying at least parts of said document, characterized in that at least one sequence is associated with a dependency parameter indicating the importance of this sequence for understanding all or part of the document, the receiver comprises a means for selecting at least one so-called first sequence, a means for producing a summary composed of the first sequences selected and second sequences of said document, said second sequences respecting a determined dependency parameter value.
• FIG. 1 represents a television receiver for the implementation of the invention
• FIG. 2 represents a flowchart of the various steps of the method according to the invention.
• FIG. 3 represents an example of a table of parameters associated with each sequence of the document
• FIG. 4 shows a flowchart of the different steps of an exemplary implementation of the invention.
• FIG. 5 shows a screen appearance for the control of the content viewing module.
• a multimedia receiver 1 equipped with a display device 2 is described.
• a decoder is described here, but other devices are also conceivable and apply to the present invention, for example a personal computer or a "PVR" (ie a high capacity and random access recording device). , such as the THOMSON DTH7000 model produced and marketed by the applicant) or any device capable of accessing audiovisual content and having means for creating and displaying menus.
• the receiver comprises a central unit 3 connected to a program memory 12, and an interface 5 for communication with a high-speed digital bus 6 for transmitting audio / video data in real time.
• This network is preferably public and allows access to remote servers, the most common is the IP network.
• the receiver may also receive audio / video data from a broadcast network through a receiving antenna associated with a demodulator 4.
• the receiver further comprises an infrared receiver 7 for receiving the signals. signals from a remote control 8, a memory 9 for storing audiovisual contents and a database, and an audio / video decoding logic 10 for generating audiovisual signals sent to the television screen 2.
• the remote control is equipped with the arrow keys 1 ⁇ ⁇ , -> and ⁇ - and the keys: "OK" and "Select” which we will see later on.
• the memory 9 is advantageously a hard disk of several hundreds of megabytes, for recording at least several hours of audiovisual content. These audiovisual contents are identified by a title recorded in the database.
• the receiver also includes a circuit 11 for displaying data on the screen, often called the OSD circuit, of the English “On Screen Display” (literally meaning "display on the screen”).
• the OSD circuit 11 is a text and graphics generator which makes it possible to display on the screen menus, pictograms (for example, a number corresponding to the channel displayed) and which makes it possible to display the navigation menus in accordance with the present invention, and in particular one or more button bars.
• the OSD circuit 11 is controlled by the Central Unit 3 and a software module 13 stored in the memory 12.
• the software module 13 is advantageously made in the form of a program recorded in read-only memory. It can also be realized in the form of a specialized circuit of the ASIC type for example.
• the digital bus 6 and / or the broadcast network transmit to the receiver data comprising multimedia contents and descriptive data of these contents.
• the descriptive data includes classification elements generally called "attributes", accessible multimedia contents.
• the descriptive data are for example meta-data (or "metadata” in English) defined according to the MPEG7 standard. These data are, among other things, attribute values making it possible to characterize documents according to certain criteria.
• the document is sequenced by the provider that also initializes the attribute values for each sequence. All the data is stored in the database of the memory 9 of the receiver. Module 13 then extracts the information from this database and processes it to carry out the navigation menus displayed on the screen and in particular one or more button bars.
• Figure 2 shows a general flowchart of the operations according to an exemplary embodiment of the present invention.
• the document is split into sequences (step 2.1) and attribute values associated with criteria are calculated for each sequence (step 2.2).
• the first criterion is time, each sequence has a start time referenced from the beginning of the document and a duration.
• a second criterion is the theme. For example, the user can select in priority sequences having a strong emotion, the selection module will then choose these sequences. In the example of realization, one finds several criteria of theme: drama, action, presence of landscape.
• Another criterion is parental control. Each sequence is marked by a code of 1 to 6 defining its level of violence, level 6 being the most violent and normally forbidden to children and adolescents. The user can thus select a level in a range for example from 1 to 4, which makes it possible to prohibit the introduction of too violent sequences in the summary. As a result, the introduction of this criterion makes it possible to prohibit certain sequences.
• a criterion determined by the producer of the document makes it possible to mark certain sequences as being important to the understanding of the summary being drawn up.
• a first variant consists in defining an index of comprehension. More value the index of comprehension is high for a sequence, the more it is important and useful for the user to follow the sequence of the semantic content of the document. Whatever the criteria selected by the user, it is useful that the most important sequences for comprehension be incorporated into the summary.
• the set of attributes constitutes a table associated with the audiovisual document.
• Figure 3 shows schematically such a table.
• the document is divided into 16 sequences. This cut is made so that each sequence can be separated from that which precedes it without denaturing in principle the informative or artistic value of the sequence.
• the document as well as the attribute values associated with the sequences are associated so that they can be downloaded in one block.
• the selection criteria are: the dramatic intensity of the sequence, the intensity of the action, the fact that the sequence shows a landscape, the value of parental control.
• the table includes the indication of the duration of each sequence. As we will see later, the user can set a maximum and minimum duration for the generated summary. The duration parameter of the sequence will then be taken into account, as well as the value of the comprehension index.
• Another variant consists in defining a dependency parameter between sequences. For each so-called “first" sequence, the producer associates or not one or more dependent sequences or "seconds" which should preferably precede and / or follow the first sequence within a summary.
• This variant not shown in the table of FIG. 3, consists of using a dependency parameter consisting of a possibly empty list of sequence identifiers dependent on the first sequence.
• the sequence n ° 3 is associated with the sequence 4, so if the n ° 3 sequence is selected and visualized according to the criteria defined by the user, the sequence n ° 4 which does not necessarily answer these criteria , will also be selected.
• association link is not bijective, so that if sequence # 4 is selected, sequence # 3 will not necessarily be.
• This variant does not exclude to associate also the index of comprehension with each second sequence making it possible to define a priority in the choice of the second sequences to be added. In this way, the summary creation program can determine an order when adding the second sequences.
• the document is then made available to users (step 2.3).
• a user selects a document and uploads it with his attribute table. Everything is recorded in the hard disk 9 of the receiver 1.
• the user starts content viewing module, called "MVC".
• this module is materially a program managed by the microprocessor, although conceptually, it is an application processing data packets, in the same way as an audio or video receiver, for which dedicated circuits are used.
• the module presents, using a menu displayed on the screen, information concerning all the documents stored in the hard disk. The user navigates through this menu by visually highlighting documents saved using the arrow keys.
• the MVC module displays general information related to the document, for example:
• the MVC module waits for instructions from the user to enable him to make a summary of the document. Entering values is done either by using the numeric keypad on the remote control 8 or by selecting icons representing numbers on the screen.
• the user selects one or more criteria, possibly adding an attribute value.
• the MVC module scans the attribute table and selects all the sequences for which the attributes selected by the user have a value greater than a determined threshold. This threshold is either user-determined or a default threshold defined by the event producer.
• the action attribute defines the level of action of each sequence, the levels of this attribute are evaluated from 1 to 6, or 6 corresponds to sequences having a lot of action (a pursuit scene for example).
• the user can introduce a minimum level of 3, in which case all sequences having a level equal to 3, 4, 5 or 6 are selected by the MVR module.
• One variant consists in that the producer of the event itself initializes the value of the level, for example at the value 5.
• the MVC module will add sequences that do not correspond to the criteria introduced by the user. but who will help in understanding the summary.
• the summary is produced by concatenation of the selected sequences.
• the user manually selects the first sequences by viewing them or by viewing images identifying these sequences.
• the MVC module then adds second sequences helping to understand the summary thus created.
• the selection of the second sequences thus added may advantageously be carried out taking into account the comprehension index associated with each second sequence, the sequences having the best indices for a given first sequence being firstly added.
• An improvement consists in that the summary created by the MVC module does not exceed a duration determined by the user. With the help of Figure 4, we will detail a flow chart of realization taking into account this improvement.
• the user has previously selected a document cut into sequences.
• step 4.1 the user introduces at least one summary realization criterion and a maximum duration.
• the module then initializes its variables: the duration of the summary being created is set to 0, and the index pointing the sequences in the table is set to 1 to read the attributes of the first sequence (4.2).
• the MVC module reads the attribute values that are associated with the current sequence and that correspond to the performance criteria.
• the module tests the cumulative value of these attributes and compares it with a minimum selection value. If the value is lower, the module tests whether this sequence would be useful for a good understanding of the summary being created (step 4.5). The test consists in comparing the comprehension index with a threshold value. If the comprehension index is greater than the threshold, the sequence is retained. If the value is greater than or equal to the selection value, the sequence is also retained.
• step 4.8 the module tests whether the end of the array is reached and therefore if there are no more sequences to be processed. If this is not the case, the module goes to step 4.9 of increasing the sequence index of one unit, then skips to step 4.3 of reading the attributes of the next sequence. If the last sequence is reached, the module tests whether the total duration of the summary does not exceed the maximum duration indicated by the user (step 4.10). If this is the case, the summary is too long, the MVC module then increases the minimum selection value (step 4.11) and returns to step 4.2.
• the MVC module scans the table a second time and adds all the dependent sequences of at least one of the previously selected sequences. If the duration is too long, the MVC module eliminates the selection of certain first sequence by increasing for example the minimum selection value, thus the module will retain fewer dependent sequences, and the summary will be shorter. In this way, only the second most important sequences are added to the summary, until the duration of the summary is reached.
• the MVC module allows the user to control the selection of the added sequences for a good understanding of the created summary. For example, a user who relies on the criteria of dramatic intensity and action to elaborate the summary, may indicate that the sequences added by the dependence parameter respect a weak parental index. In this way, the scenes added by the MVC module are still subject to some control of the user.
• the MVC module integrates visualization commands of the summary thus produced.
• Figure 5 shows an example of a screen appearance for the viewing such a summary.
• the sequences composing the summary appear at the top of the screen 30 and a control panel 41 at the bottom of the screen.
• This banner contains the following command icons, proposed to the user: - End of MVC, return to normal viewing of the show (42).
• an unrepresented window appears on the screen indicating the total duration of the summary and the present moment with respect to the beginning. In this way, the user sees how long it will take for him to visualize his summary.
• the invention is not limited to television decoders but can be applied to any device for receiving audiovisual broadcasts.
• the audiovisual broadcasts may in particular be received in the form of a video cassette or any other medium for transporting an audiovisual program, the reception means then becoming a means of reading an audiovisual medium.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Theoretical Computer Science (AREA)
• Signal Processing (AREA)
• Physics & Mathematics (AREA)
• Databases & Information Systems (AREA)
• Data Mining & Analysis (AREA)
• General Engineering & Computer Science (AREA)
• General Physics & Mathematics (AREA)
• Library & Information Science (AREA)
• Computational Linguistics (AREA)
• Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
• Television Signal Processing For Recording (AREA)
• Management Or Editing Of Information On Record Carriers (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=36441437

Family Applications (1)

Country Status (6)

Families Citing this family (2)

Family Cites Families (13)

• 2005
  • 2005-07-25 FR FR0552290A patent/FR2889016A1/fr active Pending
• 2006
  • 2006-07-07 WO PCT/EP2006/064031 patent/WO2007012556A1/fr not_active Application Discontinuation
  • 2006-07-07 US US11/989,141 patent/US8645830B2/en not_active Expired - Fee Related
  • 2006-07-07 JP JP2008523296A patent/JP5237803B2/ja not_active Expired - Fee Related
  • 2006-07-07 CN CN2006800267849A patent/CN101228585B/zh not_active Expired - Fee Related
  • 2006-07-07 EP EP06777661A patent/EP1908073A1/de not_active Withdrawn

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events