WO2016170288A1

WO2016170288A1 - System for creating and reproducing a composite document

Info

Publication number: WO2016170288A1
Application number: PCT/FR2016/050961
Authority: WO
Inventors: Guillaume RIVALS; Axel HAUGUEL; Grégory BERNARD
Original assignee: Real Digit
Priority date: 2015-04-23
Filing date: 2016-04-22
Publication date: 2016-10-27
Also published as: FR3035561A1; FR3035561B1

Abstract

The invention relates essentially to a system for creating and reproducing (100) a composite document, said system comprising: - a module (121) for obtaining a first multimedia stream comprising at least one video component comprising a plurality of images, - a module (122) for extracting N sequences of images of said video component, - a module (124) for generating N second multimedia streams, each second multimedia stream comprising at least one video component corresponding to one of said N sequences of images (850), - a module (125) for creating said composite document on the basis of the N second multimedia streams, - a module (132) for opening M windows in a display interface (165) of said system, - a reproduction module (134) able to launch M instances of a multimedia reader (166) of said system, so as to reproduce at least the video component of at least one second multimedia stream in a loop in at least one of said windows.

Description

SYSTEM FOR CREATING AND RETURNING A DOCUMENT

COMPOSITE

Background of the invention

The present invention relates to the field of creating and rendering a multimedia composite document.

The invention applies in particular to the creation and reproduction of composite documents comprising several multimedia streams, each stream comprising a video component.

In a known manner, Internet sites offer to rent and buy multimedia documents such as videos (for example a movie). These sites provide users with a preview of a movie trailer.

Thus, a user of a terminal (for example a mobile terminal such as a digital tablet or a mobile phone) intending to rent or buy a video can watch the trailer of films that interest him to make his choice.

This trailer, proposed by the film distribution company, requires many hours of work from the technicians of this company and is not always available.

In addition, the size of the media file corresponding to the trailer is important and therefore the loading of this trailer by the terminal of the user can take time, which can discourage the user to watch the trailer and to buy or rent the movie.

There is therefore a need for a solution that makes it possible to very quickly propose to the user of a terminal a presentation of the content of a multimedia document such as a video. Obiet and summary of the invention

For this purpose, the present invention relates to a system for creating and restoring a composite document, the system comprising:

a module for obtaining a first multimedia stream comprising at least one video component comprising a plurality of images,

a module for extracting N image sequences from the video component, N being an integer greater than or equal to 1,

a module for generating N second multimedia streams, each second multimedia stream comprising at least one video component corresponding to one of the N image sequences,

a module for creating the composite document from the N second multimedia streams,

an opening module for M windows in a display interface of the system, the M windows not completely overlapping each other, M being an integer greater than or equal to 2, and

- A rendering module capable of launching M instances of a media player of the system, so as to restore at least the video component of at least a second multimedia stream, the video component being looped in at least one of the windows.

"Multimedia flow" means a flow of multimedia data generated by the opening of a multimedia resource, such as a multimedia file, a video sensor, or a television program broadcast.

By "loop" means that the video component of the second multimedia stream is restored at least twice in one of the windows. Thus, the loop can be finite or infinite.

The invention is advantageous in that it makes it possible to create from a starting multimedia stream (for example a movie) a composite document containing several image sequences of this starting multimedia stream. Thus, a user can consult at the same time the different sequences of extracted images. The loopback rendering allows the user time to consult all the sequences of restored images. Thus, it is proposed to the user a composite document allowing him to quickly get an idea about the content of the original multimedia stream.

The invention further relates to a server comprising:

a module for generating N second multimedia streams, each second multimedia stream comprising at least one video component corresponding to one of the N image sequences, and

a module for creating a composite document from the N second multimedia streams.

In a particular embodiment, the server or the system further comprises a format conversion module of each image sequence extracted by the extraction module, preferably in a format of lower resolution than the resolution of the video component. of the first multimedia stream.

Thus, a future download of the composite document created from the image sequences is facilitated, making the composite document very accessible.

In a particular embodiment, the server or the system comprises:

a module for detecting a point of interest in a component of the first multimedia stream, and

a module for selecting an image sequence according to the point of interest. In a particular embodiment, the server or the system comprises:

a module for positioning a beacon in the video component of the first multimedia stream, and

a module for selecting an image sequence according to the beacon.

The invention further relates to a method of creating a composite document, the method comprising the following steps:

obtaining a first multimedia stream comprising at least one video component comprising a plurality of images,

extracting N image sequences from the video component, N being an integer greater than or equal to 1,

generation of N second multimedia streams, each second multimedia stream comprising at least one video component corresponding to one of the N image sequences, and

creation of the composite document from the N second multimedia streams.

The invention further relates to a terminal capable of rendering a composite document comprising N second multimedia streams, each second multimedia stream comprising at least one video component, the terminal comprising:

a module for opening M windows in a display interface of the terminal, the M windows not completely overlapping each other, M being an integer greater than or equal to 2, and

- A restitution module adapted to launch M instances of a media player of the terminal so as to restore at least the video component of at least a second multimedia stream, the video component being looped in at least one of the windows. In a particular embodiment of the terminal or the system, the coordinates of each window are determined dynamically according to the orientation of the terminal and / or the resolution of the video components of the second multimedia streams and the resolution of the interface. display.

In a particular embodiment of the terminal or the system, the windows constitute a partition of the display interface of the terminal or the system.

In a particular embodiment of the terminal or the system, the partition is regular.

In a particular embodiment of the terminal or the system,

M is equal to four, and

the partition is in a 4x1, 1x4 or 2x2 format, depending on the orientation of the terminal and / or the resolution of the video components of the second multimedia streams and the resolution of the display interface.

The invention further relates to a method for rendering a composite document comprising N second multimedia streams, each second multimedia stream comprising at least one video component, the method comprising the following steps:

opening M windows in a display interface of a terminal, the M windows not completely overlapping each other, M being an integer greater than or equal to 2, and

launching M instances of a media player of the terminal so as to render at least the video component of at least one second multimedia stream, the video component being looped back in at least one of the windows.

In a particular embodiment, the various steps of the creation method are determined by instructions of computer programs. Consequently, the invention also relates to a computer program on an information medium (or recording medium), this program being capable of being implemented in a server or more generally in a computer, this program comprising instructions adapted to the implementation of the steps of a creation process as defined above.

The invention also relates to an information carrier (or recording medium) readable by a terminal or more generally by a computer, and comprising instructions of a computer program as mentioned above.

In a particular embodiment, the various steps of the rendering method are determined by computer program instructions.

Consequently, the invention also relates to a computer program on an information carrier (or recording medium), this program being capable of being implemented in a terminal or more generally in a computer, this program comprising instructions adapted to the implementation of the steps of a method of restitution as defined above.

The invention further relates to an information carrier (or recording medium) readable by a server or more generally by a computer, and comprising instructions of a computer program as mentioned above.

The programs mentioned above can use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in a particular compiled form, or in n any other desirable form.

The information carriers mentioned above may be any entity or device capable of storing the program. By for example, the media may comprise storage means, such as a rewritable non-volatile memory (of the EEPROM or Flash NAND type for example), or such as a ROM, for example a CD ROM or a microelectronic circuit ROM, or still a magnetic recording means, for example a hard disk.

On the other hand, the information carriers may be a transmissible medium such as an electrical or optical signal, which may be conveyed via an electrical or optical cable, by radio or by other means. The programs according to the invention may in particular be downloaded on an Internet-type network.

Alternatively, the information carriers may be an integrated circuit in which the programs are incorporated, the circuit being adapted to execute or to be used in the execution of the method in question. Brief description of the drawings

Other features and advantages of the present invention will emerge from the description given below, with reference to the accompanying drawings which illustrate an embodiment having no limiting character. In the figures:

FIG. 1 schematically represents the hardware architecture of a system for creating and restoring a composite document according to a first embodiment, and a first example of a hardware architecture of a qualification system. an assessment of a multimedia document; FIG. 2 schematically represents a particular example of the creation and reproduction system and the qualification system of FIG. 1; Figures 3a and 3b show, schematically, examples of an extraction module of the creation and reproduction system according to the first embodiment;

FIG. 4 schematically represents the hardware architecture of a creation and rendering system according to a second embodiment, and the first example of a hardware architecture of the qualification system;

FIG. 5 represents, in the form of a flowchart, the main steps of a method for creating a composite document according to the first embodiment;

FIG. 6 schematically represents a multimedia file and second multimedia files generated by the creation and rendering system according to the first embodiment;

FIGS. 7a and 7b show, in the form of flowcharts, examples of sub-steps of an extraction step of the method for creating a composite document according to the first embodiment;

FIG. 8 represents, in the form of a flowchart, the main steps of a method of rendering a composite document according to the first embodiment;

Figures 9a and 9b show, schematically, a display interface of the creation and reproduction system according to the first embodiment;

FIG. 10 represents, in the form of a flowchart, the main steps of a method for detecting and monitoring a pointer implemented by the qualification system of FIG. FIG. 11 represents, in the form of a flowchart, the main steps of an analysis method implemented by the qualification system of FIG. 1;

FIG. 12 represents, in the form of a flowchart, the main steps of a method of recommending a multimedia document.

Detailed description of several embodiments

Figure 1 shows a terminal 160 and a server 170. In one example, the terminal 160 is a mobile terminal such as a mobile phone or a digital tablet.

The terminal 160 includes a device 130 for rendering a composite document 900, a device for detecting and tracking a pointer 140 on a display interface and an analysis device 150. In this example, the terminal 160 can include an application downloaded beforehand, for example from a download platform. The application then comprises the modules of the rendering device 130, the detection and monitoring device 140 and the analysis device 150 described below.

The terminal 160 further includes a display interface 165, a media player 166 and communication means 167. In one example, the display interface 165 is touch sensitive.

The server 170 comprises a device 120 for creating a composite document 900, and a recommendation device 195. In addition, the server 170 includes a database 198 storing multimedia files 800, and communication means 175, capable of communicating with the communication means 167 of the terminal 160 via a telecommunications network 190. The network 190 may be for example an Internet network. The authoring device 120 comprises a module 121 for obtaining a first multimedia stream, said initial multimedia stream.

The starting multimedia stream may be a stream generated by the opening of a multimedia file 800 of the database 198.

The first multimedia stream comprises at least one video component 820 of the multimedia file 800, this video component 820 comprising a plurality of images 822 (see FIG. 6).

In a variant, the multimedia source stream may be any type of multimedia stream comprising at least one video component comprising a plurality of images, in particular a stream transmitted by the network 190.

The authoring device 120 comprises an extraction module 122 of N image sequences 850 of said video component 820, N being an integer greater than or equal to 1, for example equal to 4. As shown in FIG. image sequence 850 may comprise consecutive images 822 of the video component 820. Alternatively, an image sequence 850 may comprise non-consecutive images 822 of the video component 820, for example, every other image 822. In addition, an image sequence 850 may include an image repetition 822.

FIGS. 3a and 3b, described in detail below, represent examples of extraction modules 122. The extraction module 122 thus makes it possible to extract N image sequences 850 from the first multimedia stream.

In this example, the authoring device 120 includes a conversion module 123 of the format of each image sequence 850 extracted by the extraction module 122, preferably in a format of lower resolution than the resolution of the video component 820. of the starting multimedia stream. In a variant, the conversion module 123 can reduce the number at least one image sequence 850. Alternatively, the format of each image sequence 850 can be converted into a format adapted to the media player 166 of the terminal 160. It is thus possible to reduce the size of the images. sequences of 850 images after their extraction.

The creation device 120 comprises a generation module 124 of

N second multimedia streams. Each second multimedia stream is for example recorded in a multimedia file 860. Each second generated multimedia stream is such that it comprises a video component 870 corresponding to one of said N extracted image sequences 850. Thus, the generation module 124 uses each image sequence 850 extracted to form one of the second multimedia streams.

The authoring device 120 comprises a creation module 125 of said composite document 900 from the N second multimedia streams. It is thus possible to bring together in one document the extracted 850 image sequences.

If the user wishes to obtain an overview of the starting multimedia stream, he can then obtain the composite document 900 by downloading it from the server 170. It is then possible to implement a reproduction of the image sequences 850 of the composite document 900 .

The reproduction device 130 comprises an opening module 132 of

M windows 1100 in a display interface 165 of the terminal 160, M being an integer greater than or equal to 2, for example equal to 4. In one example, M is greater than or equal to the number N. The M windows 1100 do not not completely overlap. The windows 1100 can be arranged according to various detailed arrangements, in particular below.

In addition, the rendering device 130 includes a reproduction module 134 able to launch M instances of a media player 166 of said terminal 160, so as to restore the video component 870 of at least one second multimedia stream, in a loop, in at least one of said windows 1100.

By "loop" is meant that each video component 870 is restored at least twice in a window 1100. Thus, the loop can be finite or infinite.

When the number N is equal to the number M, each window 1100 may correspond to the video component 870 of a second different multimedia stream. When the number N is less than the number M, the video component 870 of a second multimedia stream can be restored in several different windows 1100. When the number N is greater than the number M, the video component 870 of a second multimedia stream may not be restored.

The renditions of the video components 870 can be simultaneous. Thus, a user can consult at the same time and on the same terminal 160 the different image sequences 850 extracted. The loopback reproduction makes it possible to allow the user time to consult all the image sequences 850 rendered. Thus, it is proposed to the user a composite document 900 allowing him to quickly get an idea about the content of the original multimedia stream.

Alternatively, the renditions of the video components 870 may not be simultaneous.

When the image sequences 850 of the composite document 900 are restored by the terminal 160, the user indicates how much he appreciates the content of the starting multimedia stream from which the composite document 900 originates.

For this purpose, the detection and tracking device 140 comprises a detection and tracking module 142, able to detect and track at least one pointer on the display interface 165 of said terminal 160, and to produce a result from detection and monitoring. When the display interface 165 is touch sensitive, the pointer may be a contact area on the display interface 165, for example a contact area between a finger or a stylus-like object and the display interface. 165. The pointer can also be a pointer to a pointing device such as a computer mouse or a remote control such as a joystick.

The result obtained can be for example a displacement of the pointer on the display interface 165, or a duration during which the pointer is positioned on a predetermined zone of the display interface 165 and / or the position of the pointer on the display interface 165. display interface 165.

In one example, during the restitution of the image sequences 850 of the composite document 900, the output of the detection and tracking module 142 is directed to the analysis device 150, whereas in normal times, when the components of a multimedia stream is output by the media player 166, this output is directed to the media player 166, so that the user can give orders to the media player 166, such as a pause of the restitution. The detected displacement thus defines an appreciation of the composite document 900. In addition, the entire display surface of the display interface 165 can be used to give the judgment and the degree of appreciation.

The detection and tracking device 140 comprises a mode change module 144, able to modify the restitution of the composite document 900, on production of the result. In one example, this modification is a closure of the composite document 900. In another example, this modification is an iconification of the composite document 900. This closure or this iconification can be optionally followed by the opening and restitution of another composite document, as described above. The analysis device 150 comprises an analysis module 152, able to determine from the result produced an appreciation and a degree of appreciation of the composite document 900. The degree of appreciation corresponds to a value chosen from a group comprising at least three values. The terminal 160 can therefore determine the judgment, that is to say if the user's appreciation is positive or negative. The terminal 160 can furthermore determine whether this assessment is more or less pronounced, for example if the user has a weakly positive or very positive opinion on the composite document 900, and thus the multimedia stream starting from the restitution.

The judgment and the degree of appreciation are then sent by the terminal 160 to the server 170 via the network 190 and the communication means 167 and 175.

The recommendation device 195 of the server 170 includes a recommendation module 188, able to recommend a multimedia document, such as a composite document, according to the judgment and the degree of appreciation received, and according to the metadata associated with the audit. multimedia document. Following the qualification of the interest in the 900 composite document by the user, it is thus possible to determine other multimedia documents likely to please the user. The composite documents 900 created as described above can then be sent in turn to the user to qualify them as well.

We then obtain a loop of refunds, qualifications and successive recommendations for various 900 composite documents submitted to the user.

In other words, in the sense of the invention, FIG. 1 schematically represents the hardware architecture of a system for creating and restoring 100 a multimedia document (for example a composite document) according to a first embodiment , and a first example of the hardware architecture of a qualification system 110 of an assessment of a multimedia document such as a composite document 900.

The creation and reproduction system 100 comprises the creation device 120 and the reproduction device 130.

The qualification system 110 comprises the detection and tracking device 140 and the analysis device 150.

FIG. 2 represents a particular example of the systems and devices generally described with reference to FIG.

More specifically, Figure 2 shows the terminal 160 and the server 170. In one example, the terminal 160 is a mobile terminal such as a mobile phone or a digital tablet.

The terminal 160 comprises in particular a processor 161, a read-only memory 162, a random access memory 163, a non-volatile memory 164, the display interface 165, the media player 166 and the communications means 167. The terminal 160 also includes a screen.

The read-only memory 162 constitutes a recording medium readable by the processor 161 and on which is recorded a first computer program PI according to the invention, comprising instructions for the execution of the steps of a reproduction method according to the present invention. the invention, the steps of this method of restitution being described later with reference to Figure 8, in the first embodiment.

This first computer program PI equivalently defines functional modules (software) of the rendering device 130, such as, in particular, the opening module 132 of M windows and the reproduction module 134.

A second computer program P2 is stored in the read-only memory 162. This second computer program P2 includes instructions for executing the steps of a detection and monitoring method. a pointer, the steps of this detection and tracking method being described later with reference to FIG.

This second computer program P2 equivalently defines functional modules (software) of the detection and tracking device 140, such as in particular the detection and tracking module 142 and the mode change module 144.

A third computer program P3 is stored in the read-only memory 162. This third computer program P3 comprises instructions for carrying out the steps of an analysis method, the steps of this analysis method being described later. with reference to Figure 11.

This third computer program P3 equivalently defines functional modules (software) of the analysis device 150, such as, in particular, the analysis module 152.

The server 170 comprises in particular a processor 171, a read-only memory 172, a random access memory 173, a non-volatile memory 174 and communications means 175. The server 170 furthermore comprises a database 198, for example positioned in the non-volatile memory. volatile 174.

The read-only memory 172 constitutes a recording medium readable by the processor 171 and on which is recorded a fourth computer program P4 according to the invention, comprising instructions for executing the steps of a method of creating a composite document 900 according to the invention, the steps of this method of creation being described later with reference to Figure 5 in the first embodiment.

This fourth computer program P4 equivalently defines functional (software) modules of the authoring device 120, such as, in particular, the module 121 for obtaining a first multimedia stream, the extraction module 122 for N sequences. images of a video component of a first multimedia stream, the conversion module 123 of the format of each extracted image sequence, the generation module 124 of N second multimedia streams, and the creation module 125 of a composite document 900 from the N seconds multimedia stream.

A fifth computer program P5 is stored in the read-only memory 172. This fifth computer program P5 includes instructions for executing the steps of a method for recommending a multimedia document, the steps of this method of recommendation. being described later with reference to FIG.

This fifth computer program P5 equivalently defines functional modules (software) of the recommendation device 195, such as in particular the recommendation module 188 of a multimedia document.

The extraction module 122 may comprise:

a detection module 200 of a point of interest in a component of the first multimedia stream, and

a selection module 210 of a sequence of images as a function of the point of interest (see FIG. 3a).

In a variant, the extraction module 122 may comprise:

a positioning module 220 of a beacon in the video component of the first multimedia stream, and

a selection module 230 of a sequence of images according to said beacon (see FIG. 3b).

The communication means 175 of the server 170 are able to communicate via a network 190 with the communications means 167 of the terminal 160.

FIG. 4 schematically represents the hardware architecture of the creation and rendering system 100 according to a second embodiment, and the first example of hardware architecture of the qualification system 110. This second embodiment is a variant of the first embodiment described above with reference to FIGS. 1 and 2 and differs only in that the terminal 160 comprises, in addition to the rendering device 130, the device detection and tracking 140 and the analysis device 150, the creation device 120. In other words, the terminal 160 creates the composite document 900.

With respect to the particular example shown in FIG. 2, the fourth computer program P4 is thus recorded in the read-only memory 162 of the terminal 160.

In a variant of the first embodiment described above, a first server and a second server are substituted for the server 170. The fourth and fifth computer programs P4 and P5 are thus stored in dead memories of different servers.

FIG. 5 represents a method for creating a composite document 900 according to the first embodiment, implemented by the authoring device 120 executing the fourth computer program P4 recorded in the read-only memory 172 of the server 170.

In a step S710 (see FIG. 5), the obtaining module 121 obtains a first multimedia stream, called the starting multimedia stream.

As shown in FIG. 6, the multimedia file 800 includes a header 810 and a video component 820 comprising a plurality of images 822. This multimedia file 800 may further comprise a text component 830 and / or an audio component 840. The textual component 830 for example contains subtitles corresponding to the sounds and dialogs that includes the audio component 840.

The first multimedia stream comprises at least the video component 820 of the multimedia file 800, and may further include the text component 830 and / or the audio component 840.

As a variant, the initial multimedia stream is downloaded via the communication means 175. This multimedia stream comprises at least one video component comprising a plurality of images.

This step S710 is followed by a step S720 of extraction, by the extraction module 122, of N image sequences 850 of the video component 820 of the starting multimedia stream, N being an integer greater than or equal to 1 for example equal to 4.

As shown in FIG. 6, an image sequence 850 may comprise consecutive images 822 of the video component 820. As a variant, an image sequence 850 may comprise non-consecutive images 822 of the video component 820, for example a image 822 on two. In addition, an image sequence 850 may include an image repetition 822.

In one example, this extraction step S720 includes;

a substep S7201 of detection, by the detection module

200 of Figure 3a, a point of interest in a component of the original multimedia stream (see Figure 7a),

a substep S7202 of selection, by the selection module 210 of FIG. 3a, of a sequence of images 850 as a function of the point of interest.

More specifically, in the substep S7201, the detection module 200 can detect N points of interest in one of the components 820, 830, 840 of the initial multimedia stream. The selection module 210 selects then, in substep S7202, each of N frames of images 850 as a function of a different point of interest.

The point of interest may be a detected plane change in the video component 820, a detected motion in the video component 820, or a peak volume detected in the audio component 840 of the outgoing multimedia stream.

If the point of interest is detected in the video component 820, the selected image sequence 850 has at least one image 822 including the point of interest. For example, the image sequence 850 includes the first image 822 having the point of interest and a given number of images 822 following this first image 822. In another example, the image sequence 850 comprises the first image 822 having the point of interest and a given number of images 822 preceding this first image 822. In yet another example, the image sequence 850 comprises the first image 822 having the point of interest, a first given number of images 822 preceding this first image 822, and a second given number of images 822 according to this first image 822.

The N sequences of images 850 can intersect with each other or not. In one example, each image sequence 850 has between 10 and 200 images 822.

Alternatively, in the substep S7201, the detection module 200 detects a number of points of interest less than N. The selection module 210 then selects, in the substep S7202, at least two of the N sequences. 850 images according to the same point of interest.

In another variant, in the substep S7201, the detection module 200 detects a number of points of interest greater than N. The selection module 210 then selects, in the substep S7202, the at least one of the N sequences of 850 images according to several points of interest.

In another example, the extraction step S720 comprises;

a positioning sub-step S7203, by the positioning module 220 of FIG. 3b, of a beacon in the video component 820 of the starting multimedia stream (see FIG. 7b),

a sub-step S7204 of selection, by the selection module 230 of FIG. 3b, of a sequence of images 850 as a function of the beacon.

More specifically, in the substep S7203, the positioning module 220 automatically (or with the help of the user) position N tags in the video component 820. Each tag can be positioned randomly or regularly. For example, the video component 820 of the starting multimedia stream can be divided into N parts of equal length, and each tag can be positioned at the beginning of each of these N parts.

As a variant, in the substep S7203, the positioning module 220 sets a beacon number smaller than N. The selection module 230 then selects at least two of the N image sequences 850 as a function of the same beacon.

In another variant, in the substep S7203, the positioning module 220 sets a beacon number greater than N. The selection module 230 then selects at least one of the N sequences of images 850 according to several tags.

Alternatively, in the substep S7203, the positioning module 220 uses statistical data specifying a degree of attention or user interest for each image sequence of a plurality of image sequences of the multimedia stream. starting point, to position the tags at the level of the most attractive sequences. This data is for example downloaded at the same time as the initial multimedia stream, in step S700.

During the extraction step S720, the title of the starting multimedia stream can be extracted from the header 810.

During a step S730 (see FIG. 5), the format of each image sequence 850 extracted by the extraction module 122 is converted, by the conversion module 123, preferably into a format of lower resolution than the resolution of the video component 820 of the original multimedia stream.

In one example, this lower resolution format is an MP4 format or a GIFs format.

In a variant, the conversion module 123 can reduce the number of images of at least one image sequence 850. In a variant, the format of each image sequence 850 can be converted into a format adapted to the multimedia player 166 of the terminal 160.

During a step S740, N second multimedia streams are generated by the generation module 124. Each second multimedia stream is for example recorded in a multimedia file 860. Each second multimedia stream comprises at least one video component 870 corresponding to one of said N sequences of images 850, that is to say having one of the N image sequences 850 (see FIG. 6).

Each second multimedia stream further includes a header 880, and may include a text component 890, but has no audio component.

The text component 890 comprises, for example, subtitles corresponding to the sounds and dialogues that comprised the portion of the audio component 840 of the source multimedia stream corresponding to the sequence of images 850 that comprises the video component 870 of the second multimedia stream. This text component 890 can be extracted from the source multimedia stream by the extraction module 122, during the extraction of the corresponding image sequence 850.

This text component 870 can also be created independently.

During a step S750, a composite document 900 is created by the creation module 125, from N second multimedia streams generated by the generation module 124, and optionally the title extracted during the extraction step S720.

FIG. 8 represents, again according to the first embodiment, a rendering method, implemented by the rendering device 130 executing the first computer program PI recorded in the read-only memory 162 of the terminal 160.

During a step S1000, the composite document 900 created in the step S750 is received via the communication means 167 of the terminal 160.

During a step S1010, M windows 1100 are opened in the display interface 165 by the opening module 132 (see FIGS. 9a and 9b), M being an integer greater than or equal to 2, for example equal to 4. In one example, M is greater than or equal to the number N.

During a step S1020, M instances of the media player 166 are launched by the reproduction module 134, so that the reproduction module 134 restores at least the video component 870 of at least a second multimedia stream, this 870 video component being looped in at least one of said windows 1100. A text component 890 can also be restored if at least one of the second multimedia stream has one. In addition, the title can be displayed.

By "loop" is meant that each video component 870 is rendered at least twice in one of the windows 1100. Thus, the loop can be finite or infinite. When the number N is equal to the number M, each window 1100 may correspond to the video component 870 of a second different multimedia stream. When the number N is less than the number M, the video component 870 of a second multimedia stream can be restored in several different windows 1100. When the number N is greater than the number M, the video component 870 of a second multimedia stream may not be restored.

The renditions of the video components 870 can be simultaneous or not simultaneous.

During step S1020, the coordinates of each window 1100 can be determined dynamically according to the orientation of the terminal 160 and / or the resolution of the video components 870 of the second multimedia streams and the resolution of the interface 165 of the terminal 160. Thus, the size of the window 1100 and its position are determined dynamically.

In addition, the windows 1100 may constitute a partition of the display interface 165. This partition may be regular or irregular. In one example, the display interface 165 occupies the entire screen of the terminal 160.

FIGS. 9a and 9b show a regular partition of the display interface 165, when the number M is equal to 4. This partition is in a 4x1 format when the terminal 160 is oriented so that the longest sides of the terminal 160 are substantially perpendicular to the ground 1200 (see Figure 9a), and is in a 2x2 format when the terminal 160 is oriented so that the longer sides of the terminal 160 are substantially parallel to the ground (see Figure 9b). Alternatively, this partition is in a 1x4 format when the terminal 160 is oriented so that the longer sides of the terminal 160 are substantially parallel to the ground. The creation method described with reference to FIG. 5 and the rendering method described with reference to FIG. 8 can be grouped together in a method for creating and restoring a composite document 900, implemented by the authoring system and of restitution 100.

In the second embodiment, the method for creating a composite document 900 differs from the creation method according to the first embodiment described above only in that it is implemented by the creation device 120 executing the fourth computer program P4 stored in the read-only memory 162 of the terminal 160. The starting multimedia stream is then downloaded via the communication means 167 in the step S710. In addition, in the second embodiment, step S1000 of the rendering process is not performed.

The creation and playback system 100 makes it possible to create, from the starting multimedia stream (for example a film), a composite document 900 containing several image sequences 850 of this starting multimedia stream. The user's terminal rendering each image sequence in a corresponding window and simultaneously, the user can view all the extracted 850 image sequences at the same time. Thus, it is proposed to the user a composite document 900 allowing him to quickly get an idea about the content of the original multimedia stream.

During the restitution of the image sequences of the composite document 900, the user can indicate to what extent he appreciates the content of the starting multimedia stream from which the composite document 900 originates.

FIG. 10 shows a method for detecting and tracking a pointer, implemented by the detection and tracking device 140 executing the second computer program P2 recorded in the read-only memory 162 of the terminal 160.

During a step S1200, a video component of at least one multimedia document is restored by the terminal 160. This step S1200 can in particular correspond to the step S1020 of restitution of the rendering method described with reference to FIG. 8, in which the image sequences 850 of the composite document 900 are restored by the terminal 160. In a variant, the multimedia document can be a multimedia stream as described above.

During a step S1210, the detection and tracking module 142 detects and tracks at least one pointer on the display interface 165 and produces a result from the detection and tracking.

When the display interface 165 is touch sensitive, the pointer may be a contact area on the display interface 165, for example a contact area between a finger or a stylus-like object and the display interface. 165. The pointer can also be a pointer to a pointing device such as a computer mouse or a remote control such as a joystick.

In one example, when the image sequences 850 of the composite document 900 are restored, the output of the detection and tracking module 142 is directed to the analysis device 150, whereas in normal times, when the components of a multimedia stream is output by the media player 166, this output is directed to the media player 166, so that the user can give orders to the media player 166, such as a pause of the restitution. The detected displacement thus defines an appreciation of the composite document 900.

In an example where the result is a move, the move is a pointer's path. This trajectory is defined by a starting point, an end point, and the curve connecting these two points. If this curve is rectilinear, the trajectory has a direction and a direction. In the example where the pointer is a contact zone, the trajectory of the contact zone is defined by a starting zone corresponding to the first contact between the finger or the object and the interface 165, a corresponding arrival zone. at the last contact between the finger or the object and the interface 165, and the curve connecting these two zones. If this curve is rectilinear, the trajectory has a direction and a direction.

In another example where the result is a displacement, and where the pointer is a contact zone, the displacement is an enlargement of the contact zone. This widening is defined by a starting zone corresponding to the first contact between the finger or the object and the interface 165, an arrival zone corresponding to the last contact between the finger or the object and the interface 165, and a maximum contact area corresponding to the largest area of contact area measured between the first contact and the last contact.

During a step S1220, the mode change module 144 modifies the reproduction of the multimedia document, on production of the result. In one example, this change is a closing of the multimedia document. In another example, this modification is an iconification of the multimedia document. This closure or this iconification can be followed possibly by the opening and the restitution of another multimedia document, such as the restitution of a composite document described above.

FIG. 11 represents an analysis method implemented by the analysis device 150 executing the third computer program P3 recorded in the read-only memory 162 of the terminal 160.

During a step 1300, the analysis module 152 determines from the result produced in step S1210 an appreciation and a degree of appreciation of the multimedia document. Appreciation is an appreciation positive or negative. The degree of appreciation corresponds to a value chosen from a group comprising at least three values, for example the group {0,1,2}. The terminal 160 can thus determine whether this assessment is more or less marked, for example if the user has a weakly positive or very positive opinion on the multimedia document.

For example, when the result produced is a trajectory as defined above, the analysis module 152 determines said judgment as a function of the direction of the trajectory, and / or said degree of appreciation as a function of the length of the trajectory. .

A positive judgment may for example be associated with a direction of trajectory at the interface 165 and a negative judgment may then be associated with the opposite direction of trajectory at the same interface 165.

A degree of appreciation can be determined as a value substantially proportional to the length of the trajectory. For example, a value of 0 may be associated with a trajectory length less than or equal to one-third of a reference length, a value of 1 may be associated with a trajectory length strictly between one third and two thirds of the length reference, and a value of 2 may be associated with a path length greater than or equal to two-thirds of the reference length.

In another example where the pointer is a contact zone and the result produced is an enlargement, the analysis module 152 determines said judgment as a function of the position of a first contact of said at least one contact zone. For example, the interface 165 may be partitioned between a first portion and a second portion, so that if the first contact is located at the first portion, said judgment is positive, and if the first contact is located at the the second part, that assessment is negative. In addition, the analysis module 152 determines the said degree of appreciation as a function of the widening of the said at least one contact zone.

For example, if the area of the maximum contact area between the departure zone and the arrival zone is less than 110% of the area of the departure zone, the degree of appreciation is 0; if the area of the maximum contact area is between 110 and 120% of the area of the departure zone, the degree of appreciation is 1; if the area of the maximum contact area is greater than 120% of the area of contact of the area of the departure zone, the degree of appreciation is 2.

In another example, the judgment and / or the degree of appreciation can be determined according to the number of detected paths.

In another example, the judgment and / or the degree of appreciation can be determined according to the starting point of the trajectory.

In another example, the judgment and / or the degree of appreciation can be determined according to a duration of contact between the first contact and the last contact.

In another example, the judgment and / or the degree of appreciation can be determined according to a pressure on the terminal 160 or an acceleration of the terminal 160.

The method further comprises a step S1310 for sending judgment and / or appreciation to the server 170 via the network 190 and the communication means 167 and 175.

The detection and monitoring method described with reference to FIG. 10 and the analysis method described with reference to FIG. 11 can be grouped together in a method of qualifying an assessment of a multimedia document, such as a document composite 900, implemented by the qualification system 110.

The user can thus, by a simple gesture, give an assessment (for example positive or negative) and a degree of appreciation on the multimedia document whose image sequences 850 are being restored. In addition, this qualification system 110 is very suitable for mobile terminals or terminals having a touch display interface, since the entire display surface can be used to give the appreciation and the degree of appreciation.

Following the qualification of the interest in the multimedia document by the user, it is possible to determine other multimedia documents likely to please the user.

FIG. 12 represents a method for recommending a multimedia document, implemented by the recommendation device 195 executing the fifth computer program P5 recorded in the read-only memory 172. The recommended multimedia document is for example a composite document that is different from the composite document 900 for which the judgment and / or the degree of appreciation were determined in step S1300.

During a step S1400, a multimedia document is recommended by the recommendation module 188, according to the appreciation and degree of appreciation sent in the step S1310, and according to the metadata associated with said multimedia document.

In one example, the metadata includes, for example, a duration, a coding format and / or a director or performer's name.

The composite documents created as described above, for example stored in the database 198, can then be submitted in turn to the user that he also qualifies them.

We then obtain a loop of refunds, qualifications and successive recommendations for various composite documents submitted to the user.

Claims

1. System for creating and restoring (100) a composite document (900), said system comprising:

a obtaining module (121) of a first multimedia stream comprising at least one video component (820) comprising a plurality of images (822),

an extraction module (122) of N image sequences (850) of said video component (820), N being an integer greater than or equal to 1,

a generation module (124) for N second multimedia streams, each second multimedia stream comprising at least one video component (870) corresponding to one of said N image sequences (850),

a module for creating (125) said composite document (900) from the N second multimedia streams,

an opening module (132) for M windows (1100) in a display interface (165) of said system, said M windows (1100) not completely overlapping each other, M being an integer greater than or equal to 2, and

a reproduction module (134) capable of launching M instances of a multimedia player (166) of said system, so as to restore at least the video component (870) of at least one second multimedia stream, said video component (870); ) being looped in at least one of said windows (1100).

2. Server comprising:

a module for obtaining (121) a first multimedia stream comprising at least one video component (820) comprising a plurality of images (822), an extraction module (122) of N image sequences (850) of said video component (820), N being an integer greater than or equal to 1,

a generation module (124) for N second multimedia streams, each second multimedia stream comprising at least one video component (870) corresponding to one of said N image sequences (850), and

a module for creating (125) a composite document (900) from the N second multimedia streams.

3. Server according to claim 2, further comprising a conversion module (123) of the format of each image sequence (850) extracted by the extraction module (122), preferably in a format of lower resolution than the resolving the video component (820) of the first multimedia stream.

4. Server according to claim 2 or 3, wherein the extraction module (122) comprises:

a detection module (200) for a point of interest in a component (820, 840) of the first multimedia stream, and

a module for selecting (210) an image sequence (850) according to said point of interest.

5. Server according to any one of claims 2 to 4, wherein the extraction module (122) comprises:

a positioning module (220) for a beacon in the video component (820) of the first multimedia stream, and

a module for selecting (230) an image sequence (850) according to said beacon.

6. A method for creating a composite document (900), said method comprising the following steps:

obtaining (S700) a first multimedia stream comprising at least one video component (820) comprising a plurality of images (822),

extraction (S720) of N image sequences (850) of said video component (820), N being an integer greater than or equal to 1,

generation (S740) of N second multimedia streams, each second multimedia stream comprising at least one video component (820) corresponding to one of said N picture sequences (850), and

creating (S750) said composite document (900) from the N second multimedia streams.

7. Computer program (P4) comprising instructions for performing the steps of a creation method according to claim 6 when said program is executed by a server.

8. A server-readable recording medium on which is recorded a computer program (P4) comprising instructions for performing the steps of a creation method according to claim 6.

9. Terminal capable of rendering a composite document (900) comprising N second multimedia streams, each second multimedia stream comprising at least one video component (870), said terminal comprising:

an opening module (132) of M windows (1100) in a display interface (165) of said terminal, said M windows (11100) not completely overlapping each other, M being an integer greater than or equal to 2, and a reproduction module (134) capable of launching M instances of a multimedia player (166) of said terminal so as to restore at least the video component (870) of at least one second multimedia stream, said video component (870) being looped back into at least one of said windows (1100).

Terminal according to claim 9, wherein the coordinates of each window (1100) are determined dynamically according to the orientation of the terminal and / or the resolution of the video components (870) of the second multimedia streams and the resolution of said display interface (165).

The terminal of claim 9 or 10, wherein said windows (1100) constitute a partition of said display interface (165) of the terminal.

Terminal according to claim 11, wherein said partition is regular.

Terminal according to claim 10 and 12, wherein:

M is equal to four, and

said partition is in a 4x1, 1x4 or 2x2 format, depending on the orientation of the terminal and / or the resolution of the video components (870) of the second multimedia streams and the resolution of said display interface (165).

14. Method for rendering a composite document (900) comprising N second multimedia streams, each second multimedia stream comprising at least one video component (870), said method comprising the following steps:

opening M windows (1100) in a display interface (165) of a terminal, said M windows (1100) not completely overlapping each other, M being an integer greater than or equal to 2, and

launching M instances of a media player (166) of said terminal so as to restore at least the video component (870) of at least one second multimedia stream, said video component (870) being looped back in at least one said windows (1100).

15. Computer program (PI) comprising instructions for performing the steps of a restitution method according to claim 14 when said program is executed by a terminal.

16. A terminal-readable recording medium on which a computer program (PI) is recorded including instructions for performing the steps of a restitution method according to claim 14.