FR3035294A1 - METHOD FOR GENERATING SYNCHRONIZED SLIDESHOW WITH AUDIO EVENTS - Google Patents

Abstract

A method for generating a synchronized slide show with audio events, the method comprising the steps of: rendering an audio recording, playing a synchronization file related to the audio recording and defining start and end times time windows (EC1-EC11) associated respectively with an image rank of a sequence of images, and display effects to be applied to an image during each time window, the start and end times of each window time being synchronized with audio events of the audio recording, and successively generating picture frames in synchronism with the playback of the audio recording, determining for each frame at least one active time window according to the start times of the frame and start and end time windows, and determining the image corresponding to each active time window, e n function of the image rank associated with the active time window, each frame being formed from the image corresponding to each active time window, by applying to it the display effects of the active time window defined for the moment of start of frame

Description

TECHNICAL FIELD The present invention relates to the presentation of image data in synchronism with audio events of an audio recording. Conventional video editing software provides users with the ability to edit, manage, and create different types of video content that can combine and link video clips, text, still images, and sounds. Some of these softwares may allow to introduce visual effects such as, gradually blurring or attenuating an image or a video sequence, and transitions to progressively move from one image or video sequence to another. Thus with these software, the user can set the display duration of each still image, and the duration of each transition, and assign a transition effect. However, making a slide show using such software is long and tedious, so that these software are little used. Furthermore, methods for combining audio recording with an image sequence or a video sequence are still rudimentary. U.S. Patent No. 8,626,322 discloses a method for analyzing an audio recording for extracting characterization data such as a number of beats per minute, a rhythmic force, a harmonic complexity, and for combining an image sequence with the audio recording based on the characterization data. It turns out that audio record analysis methods are unreliable in that they fail to always extract relevant characterization data to synchronize the display of a sequence of images with an audio recording. . In addition, these methods are rudimentary in that they do not make it possible to extract from an audio recording sufficiently detailed characterization data to determine effects to be applied to a displayed image based on these detailed characterization data. In particular, these methods of analysis fail to distinguish sound source differences (musical instruments, human voices) in an audio recording.

3035294 2 This difficulty of extraction is accentuated especially when the recording has undergone an encoding or a compression which led to the suppression of some information, notably certain frequencies inaudible by the human ear. However, this information is often crucial to facilitate the extraction of these characterization data. It is therefore desirable to provide a method for reliably extracting an audio file characterization data for synchronizing a slide show and in particular display effects for animating the images of the slide show. It may also be desirable to be able to accurately define audio event display effects identified in an audio recording, and to be able to accurately synchronize these effects with the display of images of a slide show.

Embodiments are directed to a method of generating a synchronized slideshow with audio events, the method comprising steps performed by a terminal including: storing an image data sequence including ordered images, rendering an audio recording , read a synchronization file related to the audio recording and defining time windows for displaying an image, each time window being defined by data defining times of beginning and end of the time window, and being associated with an image rank of the image data sequence and display effect data to be applied to an image to be displayed during the time window, the start and end times of each time window being synchronized with audio events of the audio recording, and successively generating picture frames in synchronism with the playback of the audio recording, each frame of image to be displayed during a frame period, determining for each frame of image: at least one active time window as a function of a frame start time and data defining the times of start and end of the time windows, an image of the image data sequence to be displayed for each active time window, according to the image rank associated with the active time window, and a display animation for each image to be displayed, based on the display effect data of the corresponding active time window and the frame start time, each frame of image being formed from the image corresponding to each active time window, to which is applied the display animation determined for the image. According to one embodiment, a display transition between two successive images of the image data sequence is defined by a time overlap period of two successive time windows, and a transition display animation defined by the data of the image data sequence. display effect of the two successive time windows during the time overlap period. According to one embodiment, median times of the display transitions are synchronized with audio events of the audio recording. According to one embodiment, the method comprises steps of displaying the image frames generated on the screen of the terminal, or of generating a video sequence gathering the generated image frames. According to one embodiment, the image display effect data of each time window define, for each frame period included in the time window, at least one of the following parameters: a value and a speed of image display attenuation variation, zoom image rate and speed of image, angle and rotational speed of the image with respect to a picture display window, a value, a speed and a direction of movement of the image with respect to a display window of the image, an amplitude, a vibration frequency and a parameter subjected to the vibration selected from among a translation, a rotation, a zooming or attenuation of the image, geometric variations of the image format, color variations of the image, and an amplitude, and a vibration frequency to be applied to a mechanical vibrator of the terminal.

According to one embodiment, the image display effect data of each time window comprise for each display effect parameter a set of points defining a variation curve of the display effect parameter. , extending between times of start and end of the time window.

According to one embodiment, the method comprises steps of merging several synchronization files and corresponding merging of the associated audio recording files. According to one embodiment, the merging of several synchronization files comprises steps of: placing in the first position in a file resulting from a file selected from the synchronization files to be merged, including a label indicating that it can appear at the beginning of a slide show, disposition as a result of a previous file inserted in the resulting file, of a file selected from the synchronization files to be merged having labels indicating a start volume and / or a start number of beats having values close to an end sound volume and a number of end beats indicated in the previous file, and last position in the resulting file of a selected file among the synchronization files to be merged with a label indicating that it may appear at the end of a slide show. Embodiments also include a method of generating a synchronization file operable to generate a synchronized slideshow with audio events, the method comprising steps of generating a main synchronization file comprising: reading a recording file audio to be linked to the main synchronization file, and display in a graphical human-machine interface image a waveform defined from the audio recording file, receiving from an operator actions identifying audio events in the audio recording, define in connection with the identified audio events transition times, define start times and end times of time windows from the transition times, the start and end times of each time window respectively corresponding to a time of beginning of a transition and an end time of a next transition, the i nstants of transitions and the times of start and end time windows being defined in relation to a common time axis with the waveform, receive and process controls for adjusting the durations of transitions, and adjust the start times and end of time windows as a function of the adjusted transition times, receiving transition effect data from the operator, and receiving image display effect parameter data for the operator from the operator for a window time, the display effect parameter data comprising for each specified parameter points of a parameter variation curve between the start and end times of the time window, and write in the main synchronization file the data received and / or defined for each time window and each transition. According to one embodiment, the transition instants are located in the middle of a transition, the start and end times of the time windows being defined according to a predefined transition time attributed to each transition. According to one embodiment, the method comprises a step of generating a synchronization file derived from the main synchronization file, the derived synchronization file being used to implement the method of generating a slideshow defined previously. . According to one embodiment, the generation of the synchronization file comprises the steps of: extracting the main synchronization file from a series of consecutive time windows, defining animation parameters for displaying the extracted time windows, as a function of the display effect parameters defined for the extracted time windows, the animation parameters being directly exploitable by image animation functions of a terminal operating system used to render the synchronized slideshow with audio events, and extracting the corresponding audio recording file of an audio recording extract corresponding to the extracted time windows. According to one embodiment, certain time windows defined in the main synchronization file include an indication that the time window is associated with the same image as the previous time window, the generation of the derived synchronization file comprising a step of merging two consecutive time windows associated with the same image. According to one embodiment, the generation of the derived synchronization file comprising steps of introducing slide show start and end transitions into the derived sync file and into an audio recording snippet corresponding to the file. derived synchronization. Embodiments also relate to a terminal configured to implement the method of generating a slideshow defined above. Embodiments also relate to a terminal configured to implement the method of generating a synchronization file defined above.

Exemplary embodiments of the invention will be described in the following, without limitation in connection with the accompanying figures in which: Figure 1 schematically shows a system for generating synchronization files and distribute files of Each of the audio recordings associated with a synchronization file 15 for displaying a series of images, according to one embodiment, FIGS. 2 and 3 diagrammatically represent displayed images, according to one embodiment, during the generation of images. a synchronization file, FIG. 4 diagrammatically represents part of the display and synchronization data relating to the display of an image of the series of images, FIG. 5 schematically represents a part of the display data. and of synchronization relating to a transition between the display of two successive images, FIG. 6 schematically represents a mode of defined timing data relating to the display of images and the transitions between the display of two successive images, FIG. 7 represents steps of an image selection process and an audio recording to generate a slide show, FIG. 8 shows steps performed to generate a slide show from synchronization data, an audio recording file and image data, FIG. 9 represents an image displayed during the execution of a method of sorting images.

Fig. 1 shows a system for generating synchronization files and distributing audio recording files each associated with a synchronization file, for generating and displaying a slideshow from a series of images. The system includes an SRV server and FT, MT user terminals, which can connect to the SRV server via an NT network such as the Internet. The SRV server is connected to a DB database and GT operator terminals configured to generate MF, SF synchronization files from AF audio recording files, AFE. User terminals may include FT personal computers and MT mobile terminals such as "smart" phones (smartphones) and digital tablets. The system may also include other servers each associated with a database containing a portion of the data stored in the DB database, including audio recording files each associated with a synchronization file. The URLs of these servers or the audio and synchronization files they store can be stored in the DB database.

To generate the MF, SF synchronization files, the GT operator terminals access the DB database via the SRV server to select and obtain AF audio recording files. The GT operator terminals are configured to play back and playback the selected audio recording file.

Fig. 2 shows an image displayed by the GT terminal when the operator has selected an audio recording file AF. In the following, the term "image" may refer to a digital photograph or an image of a digital video sequence, or more generally a graphic object or a set of graphic objects, each represented by a matrix of points or susceptible to be displayed on a computer screen or mobile terminal. The image of Figure 2 shows an AWF waveform representative of two stereophonic channels contained in the selected audio recording file. This image also includes an SLB selection bar and a ZS zoom bar for selecting a time window of the AWF waveform to be specifically displayed on the display screen. The display area of the AWF waveform has a vertical bar CPT displayed during the sound reproduction of the selected audio recording file and constituting a cursor moving from the left to the right indicating the instant of the audio recording being played back in the AWF waveform. The ZS zoom bar extends for the duration of the selected audio recording and has a dark area defining the portion of the audio recording corresponding to the displayed AWF waveform. The operator can move the left and right boundaries of the dark area in the ZS zoom bar to change the area of the displayed AWF waveform. FIG. 3 represents an image displayed by the GT terminal when the operator has introduced synchronization data into the terminal GT. These timing data include ECO-EC11 time slots for displaying an image and TT transition data, numbered 1 to 11 in Fig. 3, between each pair of successive time windows. Each time window EC1-EC12 and each transition TT is defined by data specifying start and end times of the time window or transition. The left and right edges of the ECO-EC11 time windows and TT transitions indicate the start times and the end of the time window or transition, with respect to the AWF waveform. The GT terminal operator has the ability to set and move the left and right edges of each time window and transition as desired according to the AWF waveform or by listening to the corresponding audio recording and by locating the position of the CPT cursor at the remarkable moments of the audio recording. Each time window EC1-EC11 is associated with an image rank of a series of images to be specified by the user of one of the FT, MT terminals. The ECO time window is not associated with any image, but corresponds to the blank period at the beginning of the audio file. The ECO window makes it possible to define a first TT transition, numbered 1, for displaying a first image of the series of images. The time windows ECO-EC11 are divided into two horizontal bands to allow overlaps between the time windows to be defined, the duration of each overlap corresponding to the duration of a corresponding TT transition. The image of FIG. 3 also shows a marker bar MB in which the operator can introduce markers MK for identifying the musical structure of the audio recording, and in particular for delimiting remarkable areas in the audio recording. such as an introduction, verses, chorus, solo phases, etc., selected from a list of zone types. Each time window EC1-EC11 makes it possible to specify display effect parameters of an image to be displayed during the time window. Thus, FIG. 4 represents an exemplary graphic content of a time window EC <n> that can correspond to one of the time windows EC1-EC11 presented in the image of FIG. 3. The time window EC <n> comprises a plurality of display effect zones EF1-EF6 each specifying a display effect parameter. Each display effect area specifies for a respective display parameter an evolution curve of the value of this parameter. Each evolution curve specified in a display effect area EF1-EF6 extends between the left and right edges of the time window EC <n>, i.e. between the start times and end of the time window EC <n>. Each evolution curve of a display parameter is defined by two left and right endpoints and possibly intermediate points, and a line segment connecting the two points of each pair of consecutive points. Thus the curve of the display effect EF2 is defined by points PTO to PT5 and segments SG1 to SG5 between the points PTO-PT5. The display effect areas EF1-EF6 may indicate a neutral level NL indicating where is located the value of the display parameter not introducing a modification of the original image. The positions of the points are defined between 0 and 100% or between -100% and + 100% of a maximum value of the parameter considered indicated in a zone at the top left of the display effect zone. Thus, the display effect parameters can define for example a zoom, a rotation, a translation, a vibration, or an attenuation of the image. The display parameters may comprise, for example: a ZLV value and a zooming speed ZSP, an FLV value between 0 and 100% and a FSP transparency or attenuation rate of change. image, - an angle RANG and a rotational speed RSP of the image with respect to a window for displaying the image, 5 - an amplitude, a speed and a direction of translation of the image with respect to a window for displaying the image, - an amplitude, a frequency and a direction of vibration (in translation along x or y, in rotation, in zoom or attenuation), - geometric variations of the image format, - color variations of the image, etc. Each time window EC <n> may include an indicator specifying whether the time window is associated with the same image (image duplication) as the previous time window EC <n-1> or whether it is associated with a subsequent image in the series of images selected by the user. Thus the time window EC <n> comprises an inferior band divided into a left part TPM and a right part DPM, the right part DPM being white or colored to indicate if the image attributed to the previous temporal window is also attributed to this window Time. The right portion TPM of this strip can be used to specify that the time window is preferably associated with an image identified as remarkable by the operator. This indication can cause a modification of the display rank of the series of images selected by the user.

In particular, FIG. 5 represents the transitions TT <n> and TT <n + 1> before and after the time window EC <n>. The transition TT <n> is located between the time windows EC <n-1> and EC <n>, and the transition TT <n + 1> is located between the time windows EC <n> and EC <n + 1> . FIG. 6 represents on a time axis the start and end times and the durations of the time windows EC <n-1>, EC <n> and EC <n + 1> and transitions TT <n> and TT < n + 1>. The left edge, that is, the start time ECP <n> of the time window EC <n> corresponds to the start time of the transition TT <n>. The right edge, that is to say the end time of the time window EC <n-1> corresponds to the end time of the transition TT <n>. Similarly, the left edge, i.e., the start time ECP <n + 1> of the time window EC <n + 1> corresponds to the start time of the transition TT < n + 1>. The right edge, that is to say the end time of the time window EC <n> corresponds to the end time of the transition TT <n + 1>. In FIG. 6, each time window EC <n> is defined by a position ECP <n> corresponding to the start time of the time window, and a duration ECW <n>. Likewise, each transition TT <n> is defined by a position TTP <n> corresponding to the median time of the transition, and a duration TTW <n>. Thus, the start time ECP <n> of the time window EC <n> is equal to the start time of the transition TT <n>, which is equal to 10 TTP <n> - TTVV <n> / 2. The end time of the time window EC <n> (equal to ECP <n> + ECW <n>) is equal to the end time of the transition TT <n + 1>, that is, tell TTP <n + 1> + TTW <n + 1> / 2. The terminal GT is configured to allow an operator to graphically specify time windows as defined above in synchronism with audio events of the audio recording in the selected audio file AF and whose AWF waveform is presented in synchronism with the time windows (Figure 3). These audio events can be detected on the displayed waveform or by listening to the audio recording. These audio events can also be detected by a signal processing applied to the audio recording. Such signal processing may provide, for example, amplitude, frequency and / or energy versus time diagrams, which may be displayed adjacent to or in place of the AWF waveform. These diagrams are intended to allow the operator to more easily and accurately identify events related to the timing of the audio recording, which can not be discerned either by listening to the audio recording or by viewing the AWF waveform. These audio events may be for example a beat of the audio recording, a snare drum, a guitar riff (a short succession of chords played repeatedly), a piano chord veneer , etc. Another audio signal analysis tool can be used to precisely place a transition at the instant of a beat or peak amplitude of the sound.This analysis tool can be configured as well. to position transitions or other useful data in the definition of the display effects or display effect parameter variation curves, the operator then only has to refine the position of the display effects. The GT terminal can also import information from external processing applied to the audio recording, in particular to define the effects of the display as a function of its perception of the audio recording. setting transitions TT <n>, or any data useful for determining EF display effect parameters. The GT terminal can thus implement several audio signal analysis tools that can be activated by the operator if necessary, to assist the human ear. At each occurrence of a detected audio event, the operator can specify the position of a transition by entering a command on the terminal GT, for example by a mouse click, or the operation of a dedicated keyboard key, this has the effect of specifying the instants TTP <n> 15 medians transitions TT <n>. This operation has the effect of creating transitions TT <n> of a predefined duration and time windows EC <n> between the transitions. The operator can then adjust the duration of each transition TT <n> or each time window EC <n>, which has the effect of adjusting the duration of each time window EC <n> or each transition TT < n>. The operator can then define EF display effects for each time window and a transition mode for each transition. For this purpose, the terminal GT is configured to allow the operator to add or delete EF display effect areas and to move and add points in the display effect areas EF.

The GT terminal is also configured to provide the operator with copy-and-paste functions for duplicating time window and transition sequences, which it can associate with repetitive phases of the audio recording. The display screen of the GT terminal may include an image display window, to display the effects obtained on a series of images, as and when the time windows and transitions are defined. Once the operator has defined all the time windows of an audio recording file, all the data specifying these time windows are collected in a main FM 35 synchronization file which is inserted into the DB database, associated with it. the corresponding audio recording file AF 3035294. An example of a main synchronization file is given in Appendix L. This file is written in a standard language such as JSON (JavaScript Object Notation). Conversely, such an MF file can be read and graphically represented in the form as shown in Fig. 3. The main synchronization file MF introduced by a keyword "AudioCase" collating the designation of an audio recording file and synchronization data corresponding to the audio file. The main synchronization file MF includes an "AudioFile" keyword for entering an audio recording file name. The main synchronization file MF then comprises: a list of markers introduced by the keyword "listMarkers", a list of labels introduced by the keyword "tags". a list of zones introduced by the keyword "listZones", a list of transitions introduced by the keyword "listTransition", a list of data of specification of time windows, introduced by the keyword "listPhotoFile" and a list of derived synchronization files extracted from the main synchronization file, this list being introduced by the keyword "listSubCases". The list of markers corresponds to the various markers MK introduced in the marking bar MB. Each marker MK is associated in the list at a position defined for example in milliseconds since the beginning of the audio file. The zone list corresponds to the areas delimited by the MK markers. Each zone of the list is associated with a number 1, 2, 3, 4, 5, corresponding to a type of zone (introduction, verse, chorus, solo, ...). These markers can be displayed by the GT terminal on several lines, each line being assigned to a category of marker, for example 30 - line 1: markers delimiting the verse / chorus structure of the piece, - line 2: markers identifying repetitive patterns within the choruses / couplets, - line 3: specific markers introduced by the operator, line 4: other markers, 3035294 14 The list of transitions defines each TT transition introduced via the GT terminal (FIG. 3). Each transition is defined by a transition time in milliseconds, introduced by the keyword "widthTransition", a type of transition, introduced by the keyword 5 "typeTransition, and a position in milliseconds, introduced by the keyword" The position of each transition corresponds to the median time of the TTP <n> transition as shown in Figure 6. In the example of Appendix I, the transition type is "FADE" meaning that Next image is displayed on the previous image by adjusting its opacity from 0 to 100%.

Other types of transitions can be implemented by applying zoom, horizontal or vertical translation, rotation combined with zoom, and so on. In the list of time windows, each time window includes keywords "isDUPLICATE", "isTOP" and "effect". The keyword 15 isDUPLICATE "introduces a Boolean value indicating if the image corresponding to the time window is identical to that attributed to the previous time window The key word" isTOP "introduces a Boolean value indicating if the image corresponding to the time window is an image indicated as remarkable by the user The keyword "effect" 20 introduces a list defining all the display effects EF1-EF6 to be applied to the corresponding image Each element in the "effect" list "includes keywords" duration "," timeposition "," param "and" typeEffect "The keywords" duration "and" timeposition "respectively introduce the duration and start time of the effect. key "typeEffect" defines a type of display effect corresponding to those defined for zones EF1-EF6 The keyword "param" makes it possible to define the curves specified in zones EF1-EF6. introduces a list of display effects, each a display effect being introduced by the keyword "effectPoint". Each display effect is defined by a list of points including at least one start point and one end point of the curve, each point being defined by coordinate values "x" and "y", a maximum value entered. by the keyword "max" on which is applied a percentage defined by the curve, a type of effect introduced by the key word "name", and a type of parameter introduced by the key word "typeParam". The effect types can be for example: 35 - "f.level" to set an attenuation value, 3035294 15 - "tx.speed" and "tx.level", "ty.speed" and "ty.level" "to define a speed and a translation value in x and y, -" z.speed "and" zievel "to define a speed and a zoom value, -" r.speed "and" r.level "to define a speed and a value of rotation.

5 Other keywords could be present like "isENERGY", "isPARTNER", "isPUB", etc ... The key word "isENERGY" introduces a Boolean value indicating if the corresponding temporal window is a window of high intensity audio energy. The keyword "isPARTNER" introduces a Boolean value indicating whether the corresponding time window is a window for receiving a photo of a trading partner. The keyword "isPUB" introduces a Boolean value indicating whether the corresponding time window is a window intended to host an advertisement image. The first time window defined in Appendix I is empty and corresponds to the white of the beginning of the audio file, for example the ECO time window of FIG. 3. The second time window corresponds for example to the window EC1. From an MF master synchronization file it is possible to extract SF derived synchronization files. For this purpose, one or more extraction bars SFB are displayed in the AWF waveform 20 (FIG. 3). In the example of FIG. 3, derived synchronization files including the time windows EC1 to EC4, and including the time windows from the window EC5 have been extracted by manually positioning the beginning and the end of a colored bar in SFB bars. This operation has the effect of extracting an integer number of time windows from the main synchronization file MF and generating a derived SF synchronization file from the extracted time windows and associated display parameters, and extracting a file. AFE audio recording corresponding to the time range defined by the time windows extracted in the derived synchronization file SF. The SF derived synchronization file is stored in the DB database, associated with the corresponding AFE file. To these two files, can be added a file corresponding to the thumbnail of the album of the audio recording from which the AFE file is extracted, as well as a CRC (Cyclic redundancy check) file for checking the integrity of the other 35 files. All of these three files can be compressed, for example in the form of a ZIP file, before being loaded into the DB database. Users then have download access from their MT, FT terminal to SF derived synchronization files and their associated AFE audio recording snippet files, thus stored in the DB database. Whenever a SF derived synchronization file is extracted from a main MF synchronization file, an element can be added in the "listSubFrames" list of extracted derived synchronization files, contained in the main synchronization file MF. An example of a derived synchronization file SF is given in Annex II. This file is also written in a standard language such as JSON. To generate a SF derived synchronization file from a main MF sync file, all transitions and display effects integrated into the time windows are converted into animation properties corresponding to the basic commands of the interface. graph of the different terminals MT, FT, and the time slots associated with the same image are merged ("isDUPLICATE": true). A derived synchronization file SF therefore contains a list of time windows corresponding to the time windows EC <n> extracted from the main synchronization file MF, each time window of the file SF being associated with animation properties resulting from the translation of the properties. display of the time window, read in the MF file, these animation properties being directly exploitable by the operating system (OS) of the terminal MT, FT to control the display of images of the slide show. The resources of the terminal MT, FT implemented to operate an SF file are therefore minimized. Even a low end terminal can exploit a SF file defining complex display effects and at a high rate. Each time window of a SF derived synchronization file includes keywords "duration", "isTOP", "effect", "position" and "idPhoto".

The keywords "duration" and "position" respectively introduce the duration and start time of the time window, in milliseconds. The keyword "isTOP" is simply extracted from the main synchronization file MF. The keyword "idPhoto" makes it possible to specify an image rank number assigned to the time window, in the series of images associated with the user-derived synchronization file. The keyword "effect" introduces a list 3035294 17 defining all the display effects EF1-EF6 to be applied to the corresponding image. Each element of the "effect" list is introduced by the "param" keyword and defines a display effect. Each display effect is defined by a list of effects each introduced by the keyword "effectPoint", followed by a type of effect introduced by the keyword "typeEffect". Each keyword "effectPoint" is followed by a list of coordinates (x, y) of points, and a name introduced by the keyword "narrate". The y values of the points are calculated by multiplying the percentage defined for the corresponding point in the main synchronization file MF by the maximum value introduced by the keyword "max". The keyword "typeEffect" defines a type of display parameter. Thus, the keyword "typeEffect" can be associated with the values "SCALE" (to define a zoom value), "OPACITY" (for an opacity value), "TRANSLATE" (to define an amplitude and a direction of translation of the image), "ROTATE" (to define an angle of rotation of the image), ...

The derived synchronization file SF given in Appendix II specifies a first time window (corresponding to the ECO window of FIG. 3 - "idPhoto": 0)) starting at the instant -130 ms and lasting 3160 ms. The first time window therefore ends at the instant 3030 ms. The second time slot is assigned to the rank 1 image ("idPhoto": 1), starts at the instant 2620 ms and lasts 2287 ms. As a result, the first and second time windows overlap for a duration of 410 ms defining a first display transition of the first image. The second time window ends at the moment 4807 ms. The third time window is assigned to the rank 2 image ("idPhoto": 2), starts at the instant 4647 ms and lasts 1910 ms. The second and third time windows thus overlap for a duration of 160 ms defining a second display transition between the first and second images. The third time window ends at the instant 6557 ms. From the derived timing file in Appendix II it can thus be determined in particular that the transitions between the second and third images and between the third and fourth images are 260 ms. Two SF derived sync files and the two associated AFE audio recording snippet files may be concatenated to form a single SF derived sync file and a single audio recording extract file AFE. It is preferable for this reason that the two audio files are related to the same musical genre and that the waveform at the end of the first merged audio recording extract file corresponds to the waveform of the beginning of the second file. merged audio recording extract. The SF derived synchronization files and their associated AFE audio recording snippet file can thus be assembled into new SF derived synchronization files associated with their AFE audio recording snippet file. To provide a "soft" transition between two audio record extracts thus assembled, the SF derived synchronization files may comprise additional information introduced by the following tags: - "isStart" indicating whether the corresponding audio recording extract is usable or not at the beginning of a slide show (for example if sound volume increases gradually at the beginning of the audio recording extract), 15 - "isEnd" indicating whether the corresponding audio recording extract is usable or not at the end of a slide show (if sound volume gradually decreases at the end of the audio recording extract), - "StartLevel" indicating a volume level at the beginning (typically during the first 100 to 300 ms) of the extract of corresponding audio recording 20, - "EndLevel" indicating a volume level at the end (typically during the last 100 to 300 ms) of the corresponding audio recording extract, - "CPM" indicates an average number of scrolling time slots per minute for the corresponding audio recording extract.

Other tags may also be provided for defining MT terminal limitations, FT such as a maximum bit rate per minute or a maximum number of time slots with respect to the total playback time of the audio recording clip. AFE, a maximum number of images displayed per 30 minutes, etc. To obtain a smooth transition between two audio recording extracts, the two audio recording extracts must fulfill, for example, the following conditions: the ratio between the average numbers of time slots running by 35 minutes of the second audio recording extract , and the first audio recording extract, for example is between 0.9xN and 1.1xN, or between 0.9 / N and 1.1 / N, N being typically set at 1, 2 or 4, the ratio between the initial volume "StartLevel" at the beginning of the second audio recording extract, and the final volume "EndLevel" at the end of the first 5 audio recording extract is for example between 0.8 and 1.2, - the first extract audio recording can be used at the beginning of a slide show ("isStart": true), - the last audio recording clip can be used at the end of a slide show ("isEnd": true).

Figure 7 shows steps S1 to S12 of an image and audio data selection method for generating a slide show. This method is implemented by an application installed in an FT, MT user terminal. In step S1, a home menu is displayed to allow the user to generate a new slideshow or select a slideshow in the memory of the FT, MT terminal or accessed by the latter. In step S2, if the user selects the option to generate a new slide show, step S3 is executed, otherwise steps S10 and S11 are executed. In step S3, the user has the ability to select images or audio recording files, or to terminate the generation of a new slideshow. If the user chooses to select images, steps S6 to S9 are executed. If the user chooses to select an audio file, steps S4 and S5 are executed. Finally, if the user chooses to end the creation of a new slideshow, step S11 or S2 is executed.

In step S4, a selection menu of a musical genre is displayed. At the selection of a musical genre by the user, a list of audio recording files corresponding to the selected musical genre is displayed in step S5. For this purpose, the terminal FT, MT accesses the server SRV to obtain this list and display it on the screen of the terminal. Of course, the selection of an audio recording file may include the transmission by the FT, MT terminal of a search request entered by the user to the SRV server, and the transmission in response by the SRV server from a list corresponding to the search query. Upon receiving a search request, the SRV server searches the DB database. When the user has chosen an audio recording file, the FT, MT terminal transmits to the SRV server an identifier of the selected audio recording file, and the server transmits in response addresses (URLs) pointing to the audio file. corresponding AFE audio recording and to the associated derived synchronization file SF, these 5 files can be stored on the SRV server or another server. Upon receipt of these files, the FT, MT terminal executes step S3 again. In step S6, the terminal FT, MT invites the user to select images stored in folders or in social networks. When the user has finished selecting pictures, step S7 is executed. In step S7, the FT, MT terminal prompts the user to select multiple images. The FT, MT terminal also offers the user the possibility of editing each selected image, for example to crop or modify parameters such as brightness or contrast (step S8). This edition can be performed with each image selection or after all the images have been selected. In step S9, the terminal FT, MT offers the user the possibility of terminating the selection of images. If the user wishes to continue selecting images, step S6 or S7 is executed again, otherwise step S3 is executed. In step S10, the terminal provides the user with the ability to select an existing slideshow, i.e. a picture list, a SF derived sync file, and an associated AFE audio file, in the terminal memory. In step S11, the terminal FT, MT offers the user the possibility to display the selected slide show or to generate a video recording file from the selected slide show. In step S12, the FT, MT terminal displays the image list of the selected slideshow and synchronously renders the soundtrack contained in the associated AFE audio file, exploiting the synchronization data in the associated SF file. . In step S13, the terminal FT, MT generates a video sequence corresponding to a video recording of the selected slideshow, and saves the video sequence in a file. At the end of steps S12 and S13, the terminal FT, MT executes step S1 again. Fig. 8 shows steps S21 to S28 executed by the FT, MT terminal during step S12. Steps S21 to S28 are executed successively by the FT, MT terminal. In step S21, the terminal FT, MT 35 opens the derived synchronization file SF selected by the user. In step S22, the terminal FT, MT opens the audio file AFE corresponding to the file SF and transmits it to an audio reproduction program APLY. In step S23, the FT, MT terminal initializes an image counter n. In step S24, the FT, MT terminal opens the n-rank image file in the image series of the slideshow. In step S25, the FT, MT terminal reads the display parameters and the animation properties specified for the time window EC <n> of rank n in the derived synchronization file SF. In step S26, the FT, MT terminal provides the n-rank image to be displayed and the animation properties read to its graphics processor via the terminal operating system (and graphics processor driver). GDRV). In step S27, the terminal FT, MT increments the image counter n by one. In step S28, the terminal FT, MT tests whether the last time window EC <n> has been read in the file SF. If this is the case, the restitution of the slide show is completed, otherwise the terminal FT, MT executes again the steps S24 to S28.

In step S26, the terminal FT, MT successively generates image frames, each image frame to be displayed at a frame start time during a frame period of fixed duration (typically 16.6 msec). for "smartphones", corresponding to a frequency of refresh of the screen of the terminal FT, MT of 60 Hz). Each frame of image corresponds to the contents of the video memory of the terminal at a given moment, and therefore to the image displayed on the screen of the terminal at this moment. For this purpose, the terminal FT, MT determines for each image frame: at least one active time window as a function of the frame start time and the start and end times of the time windows EC <n> and 25 EC <n-1>, - a PCT image <n>, PCT <n-1> of the image data sequence, to be displayed for each active time window, according to the image rank associated with the window time, and - display animation parameters for each image to be displayed, in 3C function of the display effect data of the corresponding active time window, and the start time of the frame, each frame of image being formed from the image corresponding to each active time window, to which the display animations determined for the image at the start of frame are applied.

The display animation parameters are calculated at each start of the frame, by linear interpolation from the right-hand segments defined by the "x" and "y" coordinates of the points introduced by the keyword. "effectPoint" in the SF file, respecting the frame period In step S26, the display animation parameters are transmitted to the operating system functions of the FT, MT terminal to control the processor S13 differs from step S12 in that the frames calculated in step S26 are not transmitted to the image animation functions of the terminal operating system FT, MT, but are encoded and compressed in a video recording file in MP4 format for example According to one embodiment, the still images displayed for a certain duration are encoded in an optimized manner, taking into account that most of the time the images are displayed. of In one embodiment, the frames calculated in step S26 are gathered into small video sequences of a typical duration of one second, which are then encoded in parallel, these small encoded video sequences being then concatenated into a video. only final video sequence. This method greatly limits the size of the necessary temporary storage space (up to several hundred MB (megabytes) or several GB (gigabytes) for a few minutes of video footage) used by the terminal. Indeed, some terminals only have a few hundred MB.

The FT, MT terminal may also be configured to assemble SF derived synchronization files to generate a single slide show in which several audio recording extracts are chained. Once the user has selected the images to be inserted into the slide show to generate steps S6 to S9), the terminal FT, MT constitutes from the SF derived synchronization files stored in the terminal, a list of derived synchronization files. SF defining a total number of time windows substantially equal to the number of images chosen by the user. If the number of images selected is insufficient relative to the total number of time windows of the selected SF files, the terminal may use a second time some of the selected images, for example the first images. If the number of images selected is greater than the total number of time windows of the selected SF files, the terminal may use delete some of the selected images, for example the latest images. Then, the FT, MT terminal assembles the selected derived synchronization files and the associated audio recording extract files, in particular according to the respective values of the labels isStart "," isEnd "," StartVolume "," EndVolume ", For this purpose, the FT, MT terminal can choose as a first derived SF synchronization file to be assembled, a derived synchronization file containing an "isStart" tag at the value "true" and a tag " isEnd "set to" false. The FT, MT terminal can choose as a second or nth derived SF synchronization file to be assembled, a derived synchronization file containing an "isEnd" tag set to "false", and labels "StartVolume" and "CPM" having values close (according to the previously mentioned rules) of the labels "EndVolume" and "CPM" of the derived synchronization file selected previously The terminal FT, MT can finally choose as the last SF derived synchronization file to be assembled, a derived synchronization file containing an "isEnd" tag set to "true", and "StartVolume" and "CPM" labels 20 having close values (according to the rules previously indicated) "EndVolume" and "CPM" labels of the second-to-last derived synchronization file selected. In a simplified embodiment, the MT, FT terminal can assemble several SF synchronization files without taking into account the values of the "isEnd", "StartVolume", "EndVolume", and "CPM" tags. According to another embodiment, when the synchronization file SF comprises parameters "isSTART" and "isEND" to "false", one to four pairs of SF and audio synchronization files AFE can be generated: 1) a first couple with the parameters "isSTART" and "isEND" to "false", 2) a second pair with the parameter "isSTART" to "true" and the parameter "isEND" to "false", the corresponding audio file AFE being modified in him providing a fast fade in, 3035294 24 3) a third pair with the parameter "isSTART" set to "false" and the parameter "isEND" to "true", the corresponding audio file being modified by providing a fast fade out, 4) a fourth pair with the parameters "isSTART" and "isEND" to "true", for which the corresponding audio file will have been modified by bringing it a fast fade in and a fast fade out. Thus, for example, the fourth pair (having parameters "isSTART" and "isEND" to "true") can be used separately, by means of the fade operations described in the following.

According to one embodiment, slide show start and end transitions are introduced into a SF derived sync file and into the corresponding AFE audio file. These transitions are applied to the beginning and end of audio recording and the first and last time windows of the SF file. The parameters defining these transitions and their duration depend on audio parameters (in particular the "CPM" parameter) extracted from the SF file considered. The start and end transitions applied to the audio recording extract may be of the fade type. The interest of such beginning and ending transitions is multiple. They avoid the audio "click" effects that appear in compressed audio tracks when they are cut off. The beginning and the end of the melted audio pieces appear much more natural and pleasing to the human ear than a cut audio track. Thus, it is possible to render a slide show on numerous audio file extracts, which makes it possible to propose a large number of audio pieces adapted to the rendering of a small number of images (a few tens). Indeed, the most commonly generated slideshows include a small number of images. For example, the start transition, allowing in particular to preserve the "attack" of an SF file, can be a simple "FADE" type fade performed in the half-width of the TT transition period defined at the beginning of the SF file. For example, the end transition to finish the slide show cleanly can also be a simple "FADE" type fade having a duration proportional to the "beat trend" of the SF file considered. The "beat trend" can be determined from the most common duration of the time windows defined in the SF file.

Thus, the longer the corresponding audio recording has a slow rate of the number of time windows per minute (parameter "CPM"), the longer the fade out will be. According to one embodiment, the FT, MT terminal orders the images selected according to their date of creation and the place of their taking if they are photographs or videos. This information can also be used to distribute the images into groups of images relating to the same place or the same event, the groups of images being allocated to separate derived synchronization files. According to one embodiment, the FT, MT terminal is configured to separate in episodes a set of images (photographs or videos), according to dates and places of shooting images. Each episode is then associated with an SF sync file in the user's preferred genre, best matching the number of episode images. The episodes are then concatenated as previously described.

According to one embodiment, a video sequence is associated with an SF synchronization file or a series of time windows defined in such a file, in the following manner. The video sequence is transformed into a sequence of still images by keeping only the images of the video sequence corresponding substantially to the positions of TT transitions of the series of time windows defined in the synchronization file. When rendering the corresponding AFE audio file, the images extracted from the video sequence are animated according to the effects of the time windows defined in the SF synchronization file, as would be any image. These arrangements make it possible to obtain a display effect of photographs taken in bursts, animated to the rhythm of the music, which is particularly well suited to video sequences of sports scenes for example. According to one embodiment, certain effects inscribed in the synchronization file MF, SF can be applied not only to the image frames displayed, but also to other peripherals directly or indirectly connected to the terminal, such as for example a vibrator integrated in the MT terminal, such a vibrator can be controlled in frequency and amplitude, defined by effect parameters recorded in the MF, SF synchronization files. Thus, vibrations can not only be transcribed by vibrating the image displayed on the screen, but also by vibrating the MT terminal that the user holds in his hand. In this way the user can perceive vibrations synchronously, by his hand through the vibrator, by his eyes through the display screen, and by his ears through a headphones. The present application also relates to an image sorting method that can be executed independently of the slideshow generation method described above. As such, this sorting method alone constitutes a distinct invention capable of being protected independently of the slide generation method. Due to the presence of an image sensor in most mobile phones, thousands of photographs and videos accumulate in the memories of phones and personal computers, and on servers connected to the Internet. Many of these photographs, though often of good quality, end up being forgotten by the person who took them. This sorting method 15 can be implemented in the form of an image sorting application installed in terminals such as FT, MT terminals, in order to offer the user the possibility of processing thus quickly. a large number of images and quickly create lists of images that can be used in particular to generate a slide show.

One embodiment therefore relates to a sorting method implemented in a terminal, the method comprising the steps of: displaying on a screen of the terminal, several parts each corresponding to a respective value of a first criterion of sorting, each part being itself divided into several sorting areas each corresponding to a respective value of a second sorting criterion, -b- displaying an image to be sorted in a first window of the terminal screen, -c receiving from a user a sorting command consisting of a selection of one of the sorting areas of one of the parts displayed for the image displayed in the first window, of attributing to the image a value of first sorting criterion and a second sorting criterion value, depending on the selected sorting area, and repeating steps -b- to -d- for each new image to be sorted. The step of displaying an image on the terminal screen may be preceded by a step of receiving a selected file location by the user. The step -d- can consist in inserting into a file containing the image or in the name of this file the values of the first and second criteria assigned to the image. The step -d- may also alternatively consist of moving or copying the file to a folder corresponding to the value of the first criterion and a subfolder corresponding to the value of the second criterion assigned to the image. The step -d- may also alternatively consist in creating in a table a record associating a file location containing the image with the values of the first and second criteria assigned to the image.

Step e may also include displaying the image that has just been sorted in a second window of the terminal screen, the method comprising receiving the user of a command designating a zone. sorting for the image displayed in the second window, and assigning to the image displayed in the second window a value of the first sorting criterion and a value of the second sorting criterion, depending on the selected sort area. The method may also include steps of receiving a designation command by the user of one of the sorting areas, and displaying successively in the first window of the images having been associated with the sorting criterion values corresponding to the designated sorting area. The user can then assign new sort criterion values to the image displayed in the first window. The method may also include a step of moving all the image files corresponding to the designated sorting area into a specific folder relating to the values of the first and second sort criteria. FIG. 9 represents an exemplary image displayed during execution by the FT, MT terminal of an application implementing the image sorting method. This image divides the screen of the terminal FT, MT, oriented in landscape mode, into several parts comprising for example five parts 30 called "CATI" to "CAT5" distributed along the edges of the display screen of the terminal. The "CATI" and "CAT2" portions are disposed along the upper edge of the display screen. The "CAT3" and "CAT4" portions are arranged along the lower edge of the display screen. The "CAT5" portion is disposed along the left side edge of the display screen. Each "CATI" to "CAT5" portion includes a plurality of sorting areas, for example three, 3035294 referred to as "QUI" to "QU3". The central PCT region of the display screen is used to display an image to be sorted. Another image display area PPCT is disposed above the central image display area PCT, between the "CATI" and "CAT2" portions. In a right side region of the screen are two areas PB and FD, the area FB representing a bin and the area FD representing an open file. In a central region in the lower part of the display screen is an information zone IZ in which information on the current sorting (number of images remaining to be sorted) and / or information extracted from 10 is displayed. the image displayed in the PCT area. Of course other provisions of the parts "CATI" to "CAT5" can be envisaged without departing from the scope of the present invention. Also, the number of "CATI" parts to "CAT5" and the number of "QUI" to "QU3" zones can be modified without departing from the scope of the present invention. The number of sorting criteria is also not limited to two, but can be extended to more than two criteria, for example by subdividing each of the zones "QU1" to "QU3" into subfields each corresponding to to a sort value of a third criterion. In addition, the zones "WHO" to "QU3" are not necessarily identical in the different parts "CATI" to "CAT5". It can also be expected that the displayed labels of the regions and zones can be defined by the user. In the example of FIG. 9, the parts "CATI" to "CAT5" are assigned to a respective category of image (for example (family, friends, work, private, other, etc.), while the zones "QU1" to "QU3" are assigned to respective image quality (e.g., good, average, bad) .First, the user must designate the FD area to select an accessible image file folder by the terminal FT, MT The selection of a folder containing images results in the display by the terminal FT, MT of a first image in the PCT zone.The sorting of the images 30 can then be performed by moving (with the finger or pointer) the image of the PCT zone to one of the "QUI" to "QU3" zones of one of the "CATI" to "CAT5" parts or the PB zone. image of the PCT zone to one of the "QUI" to "QU3" zones, has the effect of selecting a "CATx" region among the "CATI" to "CAT5" regions and a "QUy" zone among the zones " WHO "to 3035294 29" QU3 "from the region" QUy ". This selection may have the effect of triggering a move or a copy by the FT, MT terminal of the file containing the image displayed in the PCT zone to a subfolder of the "CATx / QUy" type created for this purpose, and / or to insert labels of values corresponding to 5 "CATx" and "QUy °" or their labels, in the file containing the image or in the name of this file, and / or to insert a record in a table database, associating for each image an image file location (for example a URL - Uniform Resource Locator) with labels of parts "CAT1" to "CAT5" and areas "QU1" to "QU3" selected for 10 each image The selection of the PB zone may result in the deletion of the corresponding image file, or the displacement of this file in a folder of images to be deleted, provided for this purpose. to one of the "QU1" to "QU3" zones and PB also causes the display of a new image in the PCT zone, and the transfer 15 of the image that has just been classified in the PPCT zone. The image displayed in the area PPCT can also be moved to one of the areas "QU1" to "QU3", which allows to assign the same image to several categories. In this way, a simple designation of one of the areas "QU1" to "QU3" makes it possible to carry out a double criteria sorting such as by category and by quality.

The sorting application also offers the possibility of rotating the image displayed in the PCT area, for example by placing two fingers on the screen and rotating both fingers in the desired direction. This action changes the orientation of the image in the corresponding image file. A double click in the PCT or PPCT area may trigger the full screen display of the image. A double click on the image displayed in full screen allows to return to the previous image as shown in Figure 9. A click on one of the areas "QU1" to "QU3" can scroll in the PCT area all the images that have been assigned to this area, which can be used to change their assignment category. When all the images in the folder chosen following a click on the FD area have been sorted, the user has the possibility to choose another folder by a new click on the FD area. Once all the desired images have been sorted, the application offers the possibility of transferring to a user-selected folder each group of image files assigned to a "QU1" zone at 35 "QU3".

The images in each list can be ordered by date of creation or ordered by the user. It will be apparent to those skilled in the art that the present invention is capable of various alternative embodiments and various applications.

In particular, the invention is not limited to the definition of time windows by a start time and duration and the definition of transitions by a median time and duration. It goes without saying that time windows and transitions can be defined differently, for example by start and end times or end times and times. 3035294 31 "APPENDIX I (integral to the description) Content excerpt from a master sync file 5 {" AudioCase ": {" AudioFile ":" 06 xxxx.aac "," barl nfo ": {" IistTags " : "masterframe_id": 0, // identifier of the synchronization file "ppm_moy": 101, // average number of images displayed per minute 10 "ppm_min": 7, // number ppm minimum "ppm_max": 444, // number of maximum ppm "cpm_moy": 118, // average number of windows displayed per minute "cpm_min": 7, // number cpm minimum "cpm_max": 444, // number cpm maximum 15 "cpm_ppm": 1, / / ratio between cpm and ppm "total_duration": 191, // total duration of the corresponding audio recording "nb_photo": 324, // corresponding number of images displayed "nb_photo_top": 0, // number of preferred temp windows of the file // 20 "version_fg": "V401", // version of the software of generation of the file "masterframe_validated": true, // indicator of validation of the file "operator_artistic": "ppp", // identifier of the opera r having generated the file "validated_by": "vvv", // identifier of the operator having validated the file "validated_date": "ddd", // date of the validation of the file 25 "last_update_date": "ddd", / / date of last modification of the file "song_title": "ttt", "major": "mmm", "album": "bbb", "artist": "aaa", // references of // the corresponding audio recording "categories": // definition of categories to which rhit_of the_moment_end ":" ddd ", // belongs to the record 30" best_year: null, // corresponding audio "mood": ["mood_party", "mood_bittersweet"], "pace ": [" pace_fast_rough "]," release_year ": yyy," countries ": cc," sung ": dd," gem ": false," deluxe ": true, 35" cur: false, "instrumentarfalse, 303 5 2 94 32 "genre" fgenre_techno "," genre_dancel, "theme": ["theme_2010"], nhit_of_the_momentstart ":" ddd ")," comment_3 ":" "," comment4 ":" "," comment_2 ": 4" " , "comment_1": "", // fields // reserved for inserting comments {"listMarkers": [{"marker": 277}, {"marker": 2756}, {"marker": 31915}, { "marker": 3 7910}, {"marker": 43075}, {"marker": 48807}, {"marker": 53820}, {"marker": 59954}, {"marker": 65551}, 10 {"marker": 71181 }, {"marker": 76093}, {"marker": 82395}, {"marker": 88009}, {"marker": 93637}, {"marker": 98453}, {"marker": 210852}, {"marker": 233575}, {"marker": 255965}, {"marker": 258799}, {"marker": 260257}, {"marker": 261726}, 15 {"marker": 264374}, { "marker": 265770}, {"marker": 267167}, {"marker": 270011}, {"marker": 271376}, {"marker": 272824}, {"marker": 275606}, {"marker" ": 277001}, {" marker ": 278370}, {" marker ": 279044}, {" marker ": 300436}]," listZones ": 20 [{" zone ": 2}, {" zone ": 1 }, {"zone": 0}, {"zone": 1}, {"zone": 3}, {"zone": 3}, {"zone": 5}, {"zone": 2}, {"zone": 3}, {"zone": 3}, {"zone": 5}, {"zone": 4}, {"zone": 2}, {"zone": 4}, {" zone ": 2}, {" zone ": 4}, {" zone ": 3}, {" zone ": 3}, {" zone ": 3}, {" zone ": 3}, {" zone " : 3}, {"zone": 3}, {"zone": 3}, {"zone": 3}, 25 {"zone": 6}, {"zone": 6}, {"zone": 5}, {"zone": 5}, {"zone": 4}, {"zone": 4}, {"zone": 2}, {"zone": 2}, {"zone": 0} , {"zone": 6} 11, "IistTransition": [{"widthTransition": 451, "transitionType": "FADE", "position": 286}, {"widthTransition": 260, "transitionType": "FADE", "position": 2709}, 30 {"widthTransition": 260, "transitionType": "FADE", "position": 4544}, {"widthTransition": 260, "typeTransition": "FADE", "position": 6400}, {"widthTransition": 260, "transitionType": "FADE", "position": 7316}, {"widthTransition": 260, "transitionType": "FADE", "position": 9262}, {"widthTransition": 260, "transitionType": "FADE", "position": 10188} 35, {"widthTransition": 260, "transitionType": "FADE", " position ": 12000}, 3035294 33 {" widthTransition ": 260," transitionType ":" FADE "," position ": 12963}, {" widthTransition ": 260," transitionType "," FADE "," position ": 14764 }, {"widthTransition": 410, "typeTransition": "FADE", "position": 17589}, {"widthTransition": 260, "typeTransition": "FADE", "position": 19541}, 5 {"widthTransition ": 10," typeTransition ":" FADE "," position ": 324278), {" widthTransition ": 10," typeTransition ":" FADE "," position ": 324673}, {" widthTransition ": 10," typeTransition ":" FADE "," position ": 325079}, {" widthTransition ": 10," transitionType ":" FADE "," position ": 3254 86}], 10 "IistPhotoFile": [{"isDUPLICATE": false, "isTOP": false, "effect": 1]}, {"isDU PLI CATE": false, "isTOP": false, "effect": [{"duration": 2778, "timeposition": 61, "param": 15 [{"effectPoint": [{"x": 0, "y": 0}, {"x": 1, "y" : 1}], "max": 1, "name": "flevel", "typeParam": 0}], "typeEffect": "FADE"}, {"duration": 2778, "timeposition": 61, " param ": 20 [{" effectPoint ": [{" x ": 0," y ": 0}, {" x ": 1," y ": 0}]," max ": 20," name ": "tx.speed", "typeParam": 1}, {"effectPoint": [{"x": 0, "y": 0}, {"x": 1, "y": 0}], 25 " max ": 1," name ":" tx.level "," typeParam ": 1}, {" effectPoint ": [{" x ": 0," y ": 0.5}, {" x ": 1," y ": 0.5}]," nnax ": 20," name ":" ty.speed "," typeParam ": 1}, {" effectPoint ": 30 [{" x ": 0," y ": 0} , {"x": 1, "y": 0}], "max": 1, "name": "ty.level", "typeParam": 1}], typeEffect ":" TRANSLATE "} D, { "isDUPLICATE": false, "isTOP": false, "effect": 35 [{"duration": 2095, "timeposition": 2579, "param": 3035294 34 [{"effectPoint": [{, ix ": 0 , "y": 0.5}, {"x": 1, "y": 0.5}], "rnax": 20, "name": "z.speed", "typeParam": 1, reffectPoint ": 5 [ {"x": 0, 0}, {"x": 1 "y": 0}], "max": 0.3, "name": "z.lev el "," typeParam ": 1}]," typeEffect ":" ZOOM "}, {" duration ": 2095," timeposition ": 2579," param ": [{" effectPoint ": 10 [{" x ": 0, "y": 1}, {"x": 0.08, "y": 1}, {"x": 0.12, "y": 0.8}, {"x": 0.19, "y": 1} , {"x": 0.2601, "y": 0.9638}, 15 {"x": 0.3130, "y": 0.8}, {"x": 0.3658, "y": 0.9759}, {"x": 0.4631 , "y": 1}, {"x": 0.5243, "y": 0.8}, {"x": 0.5754, "y": 1}, 20 {"x": 0.7157, "y": 1} , {"x": 0.77, "y": 0.8}, {"x": 0.8070, "y": 1}, {"x": 1, "y": 1}], "max": 1, "name": "f.. level "," typeParam ": 0}], 25" typeEffect ":" FADE "}]}, risDUPLICATE": false, "isTOP": false, "effect": [{"duration": 2116, "timeposition": 4414, "param": [{"effectPoint": [{"x": 0, "y": 0.5}, {"x": 1, "y": 0.5}], 30 "max": 20, " name ":" z.speed "," typeParam ": 1}, {" effectPoint ": [{" x ": 0," y ": 0}, {" x ": 1," y ": 0}] , "max": 0.3, "name": "z.level", "typeParam": 1}], "typeEffect": "ZOOM"), 35 {"duration": 2116, "timeposition": 4414, "param "{3035294} [{" effectPoint ": [{" x ": 0," y ": 1}, {11x": 0.1, "y": 1}, {"x": 0.12, "y": 0.8 }, {"x": 0.15, "y": 1}, {"x": 0.28, "y": 1}, {"x": 0.33, "y": 0.8}, {"x": 0.35 , "y": 1}, {"x": 0.4916, "y": 1}, 10 {"x": 0.5226, "y": 0.8}, {"x": 0.5521, "y": 1} , {"x": 0.6974, "y": 1}, {"x": 0.7291, "y": 0.8}, {"x": 0.7609, "y": 1}, 15 {"x": 0.94 , "y": 1}, {"x": 0.96, "y": 0.8}, {"x": 1, "y": 1}], "max": 1, "name": "flevel" , "typeParam": 01], "typeEffect": "FADEU 20 {" isDUPLICATE ": false," isTOP ": false," effect ": [{" duration ": 1176," timeposition ": 6270," param ": [{"effectPoint": [{"x": 0, "y": 0.5}, {"x": 1, "y": 0.5}], "max": 20, "name": "z.speed "," typeParam ": 1}, 25 {" effe ctPoint ": [{" x ": 0," y ": 0}, {" x ": 1," y ": 0}]," max ": 0.3," name ":" z.level "," typeParam ": 1}]," typeEffect ":" ZOOM "}, {" duration ": 1176," timeposition ": 6270," param ": 30 [{" effectPoint ": [{" x ": 0," y ": 1}, {" x ": 0.1," y ": 1}, {" x ": 0.15," y ": 0.8}, {" x ": 0.19," y ": 1}, 35 {" x ": 0.4819," y ": 1}, 3035294 36 {" x ": 0.5349," y ": 0.8}, {" x ": 0.5831," y ": 1}, {" e0 94, "y" * 0.8}, {"x": 1y: 1}], "max": 1, "name": "flevel", "typeParam": 0}], "typeEffect": "FADE"}]}, {" isDUPLICATE ": fIse," isTOP ": fIse," effecr: [{"duration": 381, "timeposition": 323902, "param": 10 [{"effectPoint": [{"x": 0, "y" : 0}, {"x": 1, "y": 0}], "max": 1, "name": "f. level "," typeParam ": 0}]," typeEffect ":" FADEU, {"isDUPLICATE": false, "isTOP": false, "effect": 15 [{"duration": 405, "timeposition": 324273, "param": [{"effectPoinr: [{" x ": 0," y ": 0}, {" x ": 1," y ": 0}]," max ": 1," name ":" f.level "," typeParam ": 0}]," typeEffect ":" FADE "} D, 20 {" isDUPLICATE ": false," isTOP ": false," effect ": [{" duration ": 416," timeposition ": 324668," param ": [{" effectPoint ": [{" x ": 0," y ": 0}, {" x ": 1" y ": 0}]," max ": 1, "name": "f. level "," typeParam ": 0}], 25" typeEffect ":" FADE "}]}, risDUPLICATF: false," isTOP ": false," effect ": [{" duration ": 417," timeposition ": 325074 , "param": [{"effectPoint": '[{"x": 0, "y": 0}, {"x": 1, "y": 0}], 30 "max": 1, " name ":" flevel "," typeParam ": 0}]," typeEffect ":" FADE "} D, {" isDUPLICATE ": false," isTOP ": false," effect ": 0}], 3035294 37 ANNEX II (as part of the description) Extracted content of a derived synchronization file 5 {"SubFrameJSON": {"listEffectCarriers": [{"duration": 3160, "isTOP": false, "effect": [{" param ": [{" effectPoint ": 10 [{" x ": 0," y ": 1.0010}, {" x ": 1" y ": 1.4619}]," name ":" x "}, {" effectPoint ": [{" x ": 0," y ": 1.0010}, 15 {" x ": 1," y ": 1.4619}]," name ":" y "}]," typeEffect ":" SCALE "}, {" param ": [{" effectPoint ": 20 [{" x ": 0" y ": 0}, {" x ": 0.0524," y ": 0.5427}, {" x ": 0.0773, "y": 0.9167, {"x": 0.0822, "y": 0.9753}, {"x": 0.8702, "y": 0.9965}, 25 {"x": 1, "y": 0}], "name": "alpha"}], "typeEffect": "OPAC ITY"}, {"param": [{"effectPoint": 30 [{"x" .0 "y": 0}, {"x" : 1 "y": 0}], "name": "y"}], "typeEffect ":" TRANSLATE "}]," position ": - 130," idPhoto ": 0}, 35 3035294 38 {" duration ": 2287," isTOP ": false," effect ": [{" param ": [{ "effectPoint": [{"x": 0 "y": 1.0010}, {"x": 1 "y": 1.2970}], "name": "x"), {"effectPoint": [{"x ": 0," y ": 1.0010}, 10 {" x ": 1," y ": 1.2970}]," name ":" y "}]," typeEffect ":" SCALE "}, {" param " : [{"effectPoint": 15 [{"x" ": 0," "y" ": 0}, {" x ": 0.1792," y ": 1}, {" x ": 0.8863," y " : 1}, {"x": 1, "y": 0}], "name": "alpha"}], 20 "typeEffect": "OPACITY"}, {"param": [{"effectPoint": [{"x": 0 "y": 0}, {"x": 1, "y": 0}], "name": "y"}], "typeEffect": "TRANSLATE")], "position": 2620, "idPhoto": 1}, {"duration": 1910, "isTOP": false, 30 "effect": [{"parre: [{" effectPoint ": [{" x ": 0, "" y ": 1.0010}, {" x ": 1," y ": 1.2360}], 35" name ":" xl, 3035294 39 {"effectPoint": [{"x": 0, "y": 1.0010}, {"x": 1, "y": 1.2360}], "name": "y"}], 5 "typeEffect": "SCALE"}, {"param": [{"effectPoint": [{"x": 0 "y": 0}, {"x": 0.1361, "y": 1}, 10 {"x": 0.8638, "y": 1}, {"x": 1, "y": 0}], "name": "alpha"}], "typeEffect": "OPACITY"}, {"param": 15 [{"effectPoint": [{'x': 0 "y" : 0}, {"x": 1 "y": 0}] "name": "y"}], "typeEffect": "TRANSLATE"}], 20 "position": 4647, "idPhoto": 2} , {"duration": 2959, "isTOP": false, "effect": [{"param": 25 [{"effectPoint": [{"x": 0, "y": 1.0010}, {"x" : 1, "y": 1.4204}], "name": "x"), {"effectPoint": 30 [{"x": 0, "y": 1.0010}, {"x": 1, "y ": 1.4204}]," name ":" y "}]," typeEffect ":" SCALE "}, {" param ": 35 [{" effectPoint ": 3 0 3 5 2 9 4 [{" x ": 0, "y": 0), {"x": 0.0878, "y": 1}, {"x": 0.9121, "y": 1}, {"x": 1 "y": 0}] 5 "name": "alpha"}], "typeEffect": "OPACITY"), {"param": [{"effectPoint": [{"x": 0 "y": 0}, 10 {"x" : 1, "y": 0}], "name": "y"}], "typeEffect": "TRANSLATE")], "position": 6297, "id Photo": 31, 15 {"duration": 2106, "isTOP": false, "effect": [{"param": [{"effectPoint": [{"x": 0, "y": 1.0010}, 20 {"x": 0.3945, "y" : 1.0943}, {"x": 0.4563, "y": 1.1777}, {"x": 1, "y": 1.3568)], "name": "x"), {"effectPoint": 25 [{ "x": 0, "y": 1.0010}, {"x": 0.3945, "y": 1.0943}, {"x": 0.4563, "y": 1.1777}, {"x": 1, "y ": 1.3568}]," name ":" y "}], 30" typeEffect ":" SCALE "}, {" param ": [{" effectPoint ": [{" x ": 0" y ": 0} , {"x" : 0.0368, "y": 0.2986, 35 {"x": 0.0466, "y": 0.3402}, 3035294 41 {"x": 0.1234y: 0.9576}, {"x": 0. 1806, "y": 0 9998}, {"x": 0 2486, "y": 0.9004}, {"x": 0.2820, "y": 0.9985}, 5 {"x": 0.3945, "y" : 0.9999}, {"x": 0.4563, "y": 1.0007}, {"x": 0.3982, "y": 0.9933}, {"x": 0.4490, "y": 0.9006}, {"x" : 0.4958, "y": 0.9997}, 10 {"x": 0.6057, "y": 1}, {"x": 0.6617, "y": 1}, {"x": 0.6851, "y": 0. 9020}, {"x": 0.7242, "y": 0.9985}, {"x": 0.8599, "y": 1 15 {"x": 0.8765, "y": 0.9358}, {"x": 0.8849 , "y": 0.8416}, {"x": 0.9267, "y": 0.5921}, {"x": 1, "y": 0)], "name": "alpha"}], 20 "type Effect ":" OPAC ITY "), {" param ": [{" effectPoint ": [{" "x" ": 0" "y" ": 0}, {" "x" ": 1" "y" ": 0}] 25" name ":" y "}]," Effect type ":" TRANSLATE ")]," position ": 8996,1dPhoto": 4}, 30 {"ration": 1415, "isTOP ": false," effect ": [{" param ": [{" effectPoint ": 35 [{" x ": 0," y ": 1}, 3035294 42 {" x ": 0.2544," y ": 1 }, {"x": 0.2579, "y": 1.0638}, {"x": 0.5003, "y" -: 1.06382}, {"x": 0.5038, "y": 1.1363}, 5 {"x" : 0.7462, "y": 1.13636}, {"x": 0.7498, "y": 1.2195}, {"x": 1, "y": 1.2195}], "name": "x"), " effectPoint ": 10 [{" x ": 0," y ": 1}, {" x ": 0.2544," y ": 1}, {" x ": 0.2579," y ": 1.0638}, {" x " ": 0.5003," y ": 1.0638}, {" x ": 0.5038," y ": 1.1363}, 15 {" x ": 0.7462," y ": 1.1363}, {" x ": 0.7498," y " : 1.2195}, {"x": 1, "y": 1.2195}], "name": "y"}], "typeEffect": "SCALE"), 20 {"param": [{"effectPoint": [{"x": 0 "y": 0}, {"x": 0.0070, "y": 1}, {"x": 0.9929, "y": 1}, 25 {"x": 1, "y": 0}], "name": "alpha"}], "ty peEffect ":" OPAC ITY "), {" param ": [{" effectPoint ": 30 [{" x ": 0," y ": 0}, {" x ": 1," y ": 0}] , "name": "y"}], "typeEffect": "TRANSLATE"}], "position": 24577, "idPhoto": 12}, 3035294 43 {"duration": 1391, "isTOP": false, "effect": [{"param": [{"effectPoint": [{"x": 0, "y": 1}, {"X": 0.2501, "y": 1}, {"x": 0.2537, "y": 1.0638, {"x": 0.4924, "y": 1.0638}, {"x": 0.4960, "y": 1.1363}, 10 {"x": 0.7426, "y": 1.1363 }, {"x": 0.7462, "y": I .2195}, {"x": 1, "y": 1.2195}], "name": "x"}, {"effectPoint": [{" x ": 0," y ": 1}, 15 {" x ": 0.2501," y ": 1}, {" x ": 0.2537," y ": 1 .0638}, {" x ": 0.4924, "y": 1.0638 {"x": 0.4960, "y": 1.1363}, {"x": 0.7426, "y": 1 .I363}, 20 {"x": 0.7462, "y": 1.2195}, {"x": 1 "y": 1.2195}], "name": "y"}], "typeEffect": "SCALE"}, {"param": 25 [{"effectPoint": [{"x" : 0, "y": 0}, {"x": 0.007189072609633357, "y": 1}, {"x": 0.9928109273903667, "y": 1}, {"x": 1 "y": 0} ], 30 "name": "alpha"}], "typeEffect": "OPACITY"}, {"param": [{"effectPoint": [{"x": 0, "y": 0}, 35 { "x": 1 "y": 0}], 3035294 44 "name": "y"}], "typeEffect": "TRANSLATE"}], "position": 2598 2, "id Photo": I 31]}} {"IistTags": 5 "subframe_id": 20150317154219001, // identifier of the file "masterframe_id": 20150317154219000, // identifier of the file // principal of origin "sframelabel": "intro_1_part_1", // extract tag from // the corresponding audio record 10 "subframe_previous_id": null, // previous file id // extract from the original main file "subframe_nextid": null, // id of the following file // extracted from the original main file "duration": 38, // duration of the extract of the corresponding audio recording 15 "total_duration": 191, // duration of the audio recording // corresponding to the original main file "nb_photo": 32}, // corresponding number of images displayed "startTooth": 0, // number of the first time window "stopTooth": 40, // number of the last time window 20 " bit rate ": 128, // bit rate in kb / s of the corresponding audio record {" ppm_moy ": 0," ppm_min ": 0," cpm_min ": 0," cpm_moy ": 0, 25" cpm_max ": 0," cpm_ppm ": 0," ppm_max ": 0," is_ end ": false," is_start ": true, 30" end_rise 17, "start_level": 6, "nb_photo_top": 0, "version_fg" : "V401", "artist": "aaa", "artistic_operator": "ppp", 35 "masterframe_validated": true, 3035294 "validated_by": "vvv", "validated_date": "ddd", "last_update_date": " ddd "," categories ": 5 {" hit_of the_moment_end ":" ddd "," best_year ": null," mood ": [" mood_party "," mood_bittersweet "," mood_sad "]," pace ": [" pace_fast_rough " , "pace_cooll," release_year ": yyy," countries ": [" gb "," fl, "sung": ["uk"], "gem": false, "deluxe": true, "cult": false, "instrumental": false, 10 "genre" rgenre_techno "," genre_dance "," genre_pop "," genre_technol, "theme": ["theme_20101," hit_of the_moment_start ":" dddl, "album": "aaa", "song_title ":" ttt "," major ":" mmm "," comment_3 ":", "comment_2": "", "comment_1": "", "comment_4": "", "stereo": true} 15

Claims (16)

REVENDICATIONS1. A method of generating a synchronized slideshow with audio events, the method comprising steps performed by a terminal (FT, MT) and comprising: storing an image data sequence including ordered images, rendering an audio recording ( AFE), read a synchronization file (SE) related to the audio recording and defining time windows (EC <n>) for displaying an image (PCT <n>), each time window being defined by data 10 (ECP <n>, ECW <n>) defining start and end times of the time window, and being associated with an image rank (n) of the image data sequence and data of display effect (EF1-EF6) to be applied to an image to be displayed during the time window, the start and end times of each time window being synchronized with audio events of the audio recording, and successively generate frames image in synchroni same with the playback of the audio recording, each frame of image being to be displayed during a frame period, determining for each frame of picture: at least one active time window as a function of a start of frame and data defining the start and end times of the time windows, an image of the image data sequence to be displayed for each active time window, according to the image rank associated with the active time window, and a display animation for each image to be displayed, based on the display effect data of the corresponding active time window and the start time of the frame, each image frame being formed from the image corresponding to each active time window, to which is applied the display animation determined for the image. The method of claim 1, wherein a display transition (TT <n>) between two successive images (PCT <n-1> -PCT <n>) of the image data sequence is defined by a time overlap period (TTW <n>) of two successive time windows (EC <n-1> -EC <n>), and a transition display animation defined by the display effect data (EF1-EF6) of the two successive time windows during the time overlap period. The method of claim 1 or 2, wherein median times of the display transitions (TT <n>) are synchronized with audio events of the audio recording (AFE). 4. Method according to one of claims 1 to 3, comprising steps of displaying the image frames generated on the screen of the terminal (FT, MT), or of generating a video sequence gathering the frames of generated images. The method according to one of claims 1 to 4, wherein the image display effect data (EF1-EF6) of each time window (EC <n>), define for each frame period included in the time window, at least one of the following parameters: a value and a rate of variation of the attenuation of image display, a value and a speed of variation of zoom of the image, an angle and a speed of rotation of the image with respect to a display window of the image, a value, a speed and a direction of movement of the image with respect to a display window of the image, an amplitude, a frequency of vibration and a parameter subjected to the vibration selected from a translation, a rotation, a zoom or an attenuation of the image, geometric variations of the image format, color variations of the image, and an amplitude, and a vibration frequency to be applied to a mechanical vibrator of the terminal. 3035294 48 The method of claim 5, wherein the image display effect data (EF1-EF6) of each time window (EC <n>) comprises for each display effect parameter a set of points defining a variation curve of the display effect parameter, extending between times of start and end of the time window. 7. Method according to one of claims 1 to 6, comprising steps of merging several synchronization files (SF) and corresponding merge associated audio recording files (AFE). 10 The method of claim 7, wherein the merging of a plurality of synchronization (SF) files comprises steps of: placing in the first position in a file resulting from a file selected from the merging synchronization files having a label indicating it may appear at the beginning of a slide show, layout as a result of a previous file inserted in the resulting file, of a file selected from the synchronization files to be merged having labels indicating a start volume and / or a number of start beats having values close to an end volume and a number of end beats indicated in the previous file, and last position in the resulting file of a selected file among the synchronization files to be merged with a label indicating that it can appear at the end of a slide show. 25 9. A method of generating a synchronization file used by the method of generating a slideshow according to one of claims 1 to 8, the method comprising steps of generating a main synchronization file (MF) consisting of : 30 play an audio recording (AF) file to link to the main synchronization file, and display in a graphical human-machine interface image a waveform (AWF) defined from the audio recording file ( AF), receiving from an operator actions identifying audio events in the audio recording, defining in conjunction with the identified audio events instants (TTP <n>) of transition (TT <n>), defining instants of start (ECP <n>) and end of time windows (EC <n>) from the transition instants, the start times 5 and end of each time window respectively corresponding to a start time of a transition and a moment of e end of a following transition, the transitions instants and the start and end times of the time windows being defined in relation to a common time axis with the waveform, receiving and processing time adjustment commands transitions (TTW <n>), and adjust the start and end times of the time windows according to the adjusted durations of the transitions, receive from the operator transition effect data, and receive data from the operator image display effect parameter parameters for a time window, the display effect parameter data including for each specified parameter points of a parameter variation curve between the start and end times of the time window, and write in the main synchronization file the data 20 received and / or defined for each time window and each transition. The method of claim 9, wherein the transition times are in the middle of a transition, the start and end times of the time windows being defined according to a predefined transition time assigned to each transition. The method of claim 9 or 10, including a step of generating a derived synchronization file (SF) from the main synchronization file (MF), the derived synchronization file being used to implement the method according to one of claims 1 to 8. The method of claim 11, wherein the generation of the synchronization file (SF) comprises steps of: extracting the main synchronization file (MF) from a series of consecutive time windows 3035294 50 parameter definition of display animation (EF1-EF6) of the extracted time windows, according to the display effect parameters defined for the extracted time windows, the animation parameters being directly usable by image animation functions of a terminal operating system (FT, MT) used to render the synchronized slideshow with audio events, and extracting the corresponding audio recording (AF) file from a corresponding audio recording (AFE) extract extracted time windows. 10 The method according to one of claims 11 and 12, wherein certain time windows (EC <n>) defined in the main synchronization file (MF) include an indication that the time window is associated with the same image as the window. previous temporal, the generation of the derived synchronization file (SF) comprising a step of merging two consecutive time windows associated with the same image. The method of one of claims 11 to 13, wherein generating the derived sync file (SF) comprising steps of introducing slide show start and end transitions into the derived sync file and into an audio recording extract (AFE) corresponding to the derived synchronization file. 25 Terminal configured to implement the method according to one of claims 1 to 8. 16. Terminal configured to implement the method according to one of claims 9 to 14. 30