KR20130133649A - Method and device for storing and/or reproducing sound and images - Google Patents

Method and device for storing and/or reproducing sound and images Download PDF

Info

Publication number
KR20130133649A
KR20130133649A KR1020127033710A KR20127033710A KR20130133649A KR 20130133649 A KR20130133649 A KR 20130133649A KR 1020127033710 A KR1020127033710 A KR 1020127033710A KR 20127033710 A KR20127033710 A KR 20127033710A KR 20130133649 A KR20130133649 A KR 20130133649A
Authority
KR
South Korea
Prior art keywords
sound
image
place
time
file
Prior art date
Application number
KR1020127033710A
Other languages
Korean (ko)
Inventor
피에르 올리비에
Original Assignee
아쉬.오.뻬.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 아쉬.오.뻬. filed Critical 아쉬.오.뻬.
Priority claimed from PCT/EP2011/058603 external-priority patent/WO2011147895A1/en
Publication of KR20130133649A publication Critical patent/KR20130133649A/en

Links

Images

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G11B20/10009—Improvement or modification of read or write signals
    • G11B20/10037—A/D conversion, D/A conversion, sampling, slicing and digital quantisation or adjusting parameters thereof
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G11B20/10009—Improvement or modification of read or write signals
    • G11B20/10222—Improvement or modification of read or write signals clock-related aspects, e.g. phase or frequency adjustment or bit synchronisation
    • G11B20/10231—Improvement or modification of read or write signals clock-related aspects, e.g. phase or frequency adjustment or bit synchronisation wherein an asynchronous, free-running clock is used; Interpolation of sampled signals
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G11B20/10527—Audio or video recording; Data buffering arrangements

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

A method of storing sounds and images in a memory, the method comprising a first file comprising a digital image m (1 ≦ m ≦ M) and a second file comprising a sound relating to information linked to the associated digital image m And storing at least one sequence in memory, wherein the image contained in the first file is displayed on the screen, whether place j = 1 (1 ≦ j ≦ J) is indicated in the displayed image and It is checked at which point in the image where j = 1 (1≤j≤J) is indicated and at what moment recording of the sound is triggered, the clock starts at the moment recording of the sound is triggered, and place j is When it is found that it is pointed at the displayed image, the coordinates (x j , y j ) of the pointed place j are stored in a third file (f3 j ) forming part of the sequence. A time Δt j at which the first time t1 j indicated by the clock is sampled at the moment the sound associated with the place j is generated, and the generation of the sound linked to the place j can be implemented or implemented. Is taken, the first time t1 j and time Δt j are stored in a fourth file f4 j forming part of the sequence, and the storage of the sound in the second file f2 j Is implemented by storing the sound produced during the time Δt j .

Description

Method and device for storing and / or playing sound and images {METHOD AND DEVICE FOR STORING AND / OR REPRODUCING SOUND AND IMAGES}

The present invention relates to a method of storing sound and images in a memory, the method comprising a first file comprising a digital image m (1 ≦ m ≦ M) and a sound relating to information linked to the associated digital image m. Storing at least one sequence comprising a second file in a memory, the image contained in the first file being displayed on a screen, and the display of the image being placed in the displayed image with j = 1 (1≤ is verified to determine whether j < J) is pointed to, and when it is found that place j is pointed to in the displayed image, the coordinates (x j , y j ) of the pointed place j form part of the sequence. Stored in a third file f3 j , then the method is repeated for any other place j ≠ 1 indicated in the image. The invention also relates to a device for applying the method as well as to a method for reproducing recorded sound and images.

This method is described in patent US 7 536 796. In the method described in this patent, a picture or film is taken by, for example, a digital device. Such photos or films are thus stored in a memory formed by, for example, a USB key, a DVD disk or the Internet side. The user can direct a place to an image when he wants to add sound to the image. Also, such sound is stored in the memory after it is recorded. Then, when a person wants to see such a photo or film, the sound is produced simultaneously with the photo or film.

In the case of film, the synchronization between sound and images can be properly synchronized since they are moving pictures and microphones in the camera can be used, but this does not apply to pictures where the user wants to add sound. The user can associate the sound with the picture, but there is no possibility of highlighting certain elements in the picture by the sound. It is also not clear that the user synchronizes the sound with the image, especially if the sound is recorded separately from the image.

It is an object of the present invention to provide a method for storing sounds and images in a memory, which enables a user to easily synchronize a sound which he wishes to add to an element forming part of the displayed image, even if the sound and image are recorded separately. To generate.

To this end, in the method according to the invention, the indicated place j is checked at what moment in the displayed image and at what moment the recording of the sound associated with place j was triggered, and the clock is The first time t1 j indicated by the clock is sampled at the moment when the sound associated with the place j is generated, and the generation of the sound linked to the place j can be implemented or implemented. A time Δt j is taken, the first time t1 j and time Δt j are stored in a fourth file f4 j forming part of the sequence, and the second file f2 j The storage of the sound within is implemented by storing the sound generated during the time Δt j , and when each of the place j indicated in the image is processed, the clock is the place j = The recording of the segment of the sound associated with N is stopped after stopping. It is possible to associate the time base with the sound by starting the clock at the moment when recording of the sound is triggered, thus making it possible to synchronize the image with the sound when the sound is played. In addition, by sampling and storing the time t1 j and the time Δt j together with the sound associated with the indicated place j, during playback, it is easy to find the link between the place j on the picture and the sound associated with this place. In addition, it is possible to synchronize the sound with the indicated place. Thus, the user can associate the sound with a particular element of the picture included on the indicated place j and have the means to automatically reproduce the recorded sound by indicating the place j. Thus, the user can easily synchronize the sound with the image even if the sound is recorded after the image is taken.

A first embodiment of the method according to the invention is characterized in that the time Δt j is a predetermined time. This makes it easy to determine this time and manage the amount of memory available for storing sounds.

A second embodiment of the method according to the invention is characterized in that the time Δt j is determined by the moment at which generation of the sound linked to place j is stopped. This allows a variable time to be selected during this time.

A third embodiment according to the invention is characterized in that the time Δt j is determined by the moment when the next place j + 1 is indicated in the image. This allows for the selection of variable times for these times with automatic determination of these times.

A fourth embodiment according to the invention checks whether a pause is generated in the generation of the sound during recording of a sound associated with any one of place j, and if such a pose has been generated, at the moment The second time t2 j indicated by the clock and the third time t3 j indicated by the clock are stored in the fourth file f4 j at the moment when the pause is stopped. Thus, it is also possible to play a pose left by someone who produces the sound during recording of the sound without having to consume memory space.

In the fifth embodiment according to the invention, during the recording of the sound associated with any of the places j, it is checked whether an action is performed during the pose, and if it is found that such action is taken, such an action is identified and the fourth file ( f4 j ). Such an action may be, for example, a zoom on place j of interest. By saving these actions it is possible to play them later.

A sixth embodiment according to the invention is characterized in that when a place j is pointed at an indicated image, this image and an identifier are associated and displayed at the pointed place j. By associating the identifier with the pointed place j, it is easier to see when the image can be played back later to facilitate selection of the place by the user.

According to the present invention, a method for displaying a stored image and playing a recorded sound allows at least one of the stored M images to be played on a screen so that a user can select an image m of the stored M images, and the selected image. The sequence associated with m is taken from the memory and the N places associated with the selected image m are displayed after the selection of the stored image m, and after the selection of place j, the second, third and fourth associated with the place j The file is read and the sound associated with this place j is generated from the read second file and starts the sound at the first time and stops the sound when the time Δt j has elapsed. . By using the recorded sequence, one can easily reconstruct the sound associated with the pointed place j and synchronize this sound with the image.

The invention will be described in more detail with reference to the drawings illustrating preferred embodiments of the method and device according to the invention.
1 is an overall view of an example of a device according to the invention.
2 shows the same device with a few images displayed on the screen of the device according to the invention.
3 shows a screen during the application of the sound storage method.
4 is a flowchart illustrating steps of a sound storage method.
5 is a flowchart illustrating steps of a sound storage method.
6 is a diagram illustrating an example of a sequence formed during storage of a sound storage method.
In the drawings, the same reference numerals are assigned to the same or similar elements.

1 is an overall view of an example of a device 1 according to the invention. This device comprises a frame 2 which surrounds the screen 3. The screen 3 may be a touch screen with the advantage of displaying the operation buttons of the device on the screen. However, it will be apparent that the screen need not be a touch screen and other types of screens can be used. If such a screen is not a touch screen, it is possible for control buttons (not included in the figure) to be mounted in this frame to control the device. Voice commands can also be used to control various functions of these devices. Furthermore, the device according to the invention does not necessarily need to be formed by an entity having only the function of displaying an image and playing a sound. The device according to the invention can also be integrated into a computer or telephone equipped with a memory and a data processor.

The device according to the invention comprises a memory and a data processor, preferably a data processor formed by a microprocessor. The memory may be formed by, for example, a semiconductor memory such as a USB key, an optical disk or other type of electronically accessible memory. Such memory should be of a type capable of writing data and preferably erasing data.

An image, preferably an image taken by a user via a digital photography device, is stored in a memory. However, of course, you can store the downloaded image in memory. Storing images in memory is well known and is not described in detail. However, it should be noted that, in accordance with the present invention, for each image to be stored, the storage of each image is accomplished by storing a sequence comprising the first file f1 containing the digital image as shown in FIG. 6.

When the user has stored one or more images in memory in the form of individual images or in the form of video, one or more images can be displayed on the screen 3 of the device 1. FIG. 2 illustrates an example of a series of M (1 ≦ m ≦ M) individual images (m = 1, m = 2, m = 3) displayed on the screen 2. This display method allows the user to have an idea of the stored image so that one can easily select one of the stored images. However, once again, it will be apparent that this is only one way of displaying the stored image and other methods such as scrolling through the image may also be used. However, since it is necessary to select the image m which needs to add sound, it is necessary for the device to have selection means so that the user can select one or more images from images stored in the memory.

When the user selects one of the stored images, for example the image shown in FIG. 3, the method according to the invention can be started. This can be implemented, for example, by activating a button displayed on the screen or by activating a button on the device. After activating this button, for example, as shown in FIG. 3, another series of buttons will be activated by being displayed on the screen when the touch screen is used. This other series of buttons consists, for example, of a button 5 for triggering and stopping the recording of the sound, a button 6 for the pose of the recording of the sound and a button 7 for the zoom. In addition, the frame 4 is marked to mark the time elapsed since the start of the recording of the sound, and the frame 8 represents the volume of the sound to be recorded. Naturally, other buttons such as cursor operation buttons can also be displayed on the screen.

4 illustrates in a flow chart a method for storing sound according to the invention. After activating a button (5) indicating that the user wants to record a sound to be associated with the selected image m (10, REC?), It is pointing to the place x j , y j (1≤j≤N) of the image m. Check whether it is (11, x j , y j ?). This allows the user to select a place j on the displayed image m in which the subject the user wishes to comment is displayed. In this way, the user can select the N places to be pointed at in the image. This number may vary depending on the capacity of the memory and the size of the screen.

After the user points to place j in the image, the coordinates (x j , y j ) of the pointed place j are stored in a third file f3 j that forms part of sequence 1 linked to image m (see FIG. 6). When place j is indicated in the displayed image m, it is preferred that the identifier 9 is displayed in place j associated with and pointed to this image (see FIG. 3). This allows the user not only to recognize the pointed place j when the sound is being recorded, but also to recognize the place in the image with which the sound is associated during continuous display. Such an identifier may be any identifier that allows for distinguishing a point j pointed within a specific color or image, for example, a star, a triangle, a small red ball.

Next, it is checked at which moment the recording of the sound is triggered by, for example, touching the button 6 to start the clock 14 (SCLK). Next, when the sound associated with place j is generated at any moment, and the sound associated with place j is found by the clock at the moment when generation starts, the first time t1 j is removed from the clock. Is taken and stored in a temporary memory (16; STt1 j ).

Next, it is checked whether an event occurs during the sampling of the sound 17 (EV?). Such an event may be triggered by another user, for example, when the user presses the button 7 to zoom in to stop sound generation, or when the user activates the button 6 to mark a pose or change color. It can be an action. Each time such an event occurs, the time tk j indicated by the clock is sampled at the moment the event occurs (18, tk j ). Thus, when generation of the sound is stopped to mark a pose, the second time t2j is sampled. The third time t3j is sampled when the pause ends. The second and third times are stored temporarily (STT). It is preferred that the fourth time t4j is sampled and the action identified when the action is taken. The time t4 j and the identified action are then temporarily stored (STA) 19.

The period Δt j during which a sound linked to place j may be produced or included is included (20; Δt j ). This can be done, for example, by a predetermined period of 3 seconds per indicated place. According to another embodiment, the period Δt j is the moment at which the generation of the sound linked to place j is stopped, for example, by the user activating the button 5 or the method itself detects a stop of the sound. Is determined by Finally, the period Δt j is determined by the moment when the next place j + 1 is pointed at image m. In these last two embodiments, the time t f indicated by the clock is sampled and the period Δt j is determined by the time difference between t f and t 1 . The period Δt j and time t1 j are stored in a fourth file forming part of the sequence.

The sound generated during the period Δt j is stored in the second file 21 (STf 2 ). Thus the sequence is completed by adding the second, third and fourth files. The completed sequence is then stored in memory. Then, it is checked whether another place is indicated, and if so, repeat for the other place pointed until each of the indicated N places has been processed. If the action has been identified, the identifier of this action is stored in the fourth file. The clock is stopped at the moment all points N have been processed (STCLK 23). The total time of the sound recorded for the N images is limited so as not to saturate the memory having the sound. 5 illustrates a method according to the invention which can display a stored image and play back the recorded sound with the selected image. When the user wants to use the device according to the invention to view the recorded image, he will launch the vision program. This is done, for example, by touching a button 30 (Fig. 5) displayed on the screen or a fixed button on the device itself. After activation of the button, one or more images stored in memory 31 are displayed (DISPA) so that the user can select from among the displayed images.

The device waits until the user selects an image from the images stored in memory (SLM?). Assume that the user has selected image m of M images, and this image m is displayed on the screen (33; DISPm). The sequence linked to this image m is also sampled 34 (RSQm). If the application includes an indicator 9, the indicator 9 is located at each of the N places in the display image in which coordinates (x j , y j ) are stored in the third file f3 j of the sampled sequence (35). ; DISP ID).

The application waits until place (x j , y j ) is selected in the display image (wx j , y j ?). Place the second and the fourth file is read out is linked to the place (x j, y j) which exist in the first file after the selection of (x j, y j) ( 37; R f2 j, f4 j) a second file, The sound stored at is generated and provided to the user (38; Psf2 j ). For this purpose, the generation of the sound is controlled by the times t1 j and t2 j stored in the fourth file, which enables synchronization between the image and the sound. Applicable by different times to allow a pose or action.

After the creation of the sound, the application checks if another place has been selected (39, N?), And if so, the method repeats from step 33. If any other place has been selected, the method stops.

Claims (10)

A method of storing sounds and images in a memory, the method comprising a first file comprising a digital image m (1 ≦ m ≦ M) and a second file comprising a sound relating to information linked to the associated digital image m And storing at least one sequence in memory, wherein the image contained in the first file is displayed on a screen, and the display of the image is such that place j = 1 (1 ≦ j ≦ J) in the displayed image. Is verified to determine whether it is pointed out, and when it is found that place j is pointed to in the displayed image, the coordinates (x j , y j ) of the pointed place j form a third file f3 forming part of the sequence. j ), then the method is repeated for any other place j ≠ 1 indicated in the image,
Checking at which point the pointed place j was pointed in the displayed image and at what point the recording of the sound associated with place j was triggered, at the moment the recording of the sound was triggered,
The first time t1 j indicated by the clock is sampled at the moment when the sound associated with the place j is generated,
A time Δtj at which generation of a sound linked to place j can be implemented or implemented is taken, and the first time t1 j and time Δt j are fourth files f4 forming part of the sequence. j ), the storage of the sound in the second file f2 j is implemented by storing the sound generated during the time Δt j , and when each of the place j indicated in the image is processed, The clock is stopped after recording of a segment of sound associated with the place j = N is stopped. 2. The method of claim 1, wherein the time Δt j is a predetermined time. The method of claim 1, wherein the time Δt j is determined by the moment when generation of the sound linked to place j is stopped. The method of claim 1, wherein the time Δt j is determined by the instant the next place j + 1 is indicated in the image. The method according to any one of claims 1 to 4, wherein during recording of the sound associated with any one of place j, it is checked whether a pose is generated in the generation of the sound, and if such a pose is generated, the moment at which the pose occurs. The second time t2 j indicated by the clock and the third time t3 j indicated by the clock at the moment when the pause is stopped are stored in the fourth file f4 j . How to save sound and images. 6. The method of claim 5, wherein during recording of a sound associated with any of the places j, it is checked whether an action is taken during the pose, and if an action is found, such an action is identified and the fourth file f4 j Sound and image storage method characterized in that the stored in. 7. A method according to any one of the preceding claims, wherein when place j is indicated in the displayed image, an identifier is associated with the image and displayed in the pointed place j. A method for displaying a stored image and reproducing a recorded sound by applying the method according to any one of claims 1 to 7,
At least one of the stored M images is reproduced on the screen to allow a user to select an image m of the stored M images,
A sequence associated with the selected image m is taken from the memory and the N places associated with the selected image m are displayed after selection of the stored image m,
After the selection of place j, the second, third and fourth files associated with place j are read out and the sound associated with this place j is generated from the read second file, starting the sound at the first time and Stopping the sound when the time Δt j has elapsed. The method of claim 8, wherein the fourth file associated with the selected place j indicates a pose and / or an action, the pose being included in the generated sound and / or And the action is included in the selected image m and displayed on the screen. A device for implementing a method according to any one of claims 1 to 9,
A memory arranged to store at least one of the M images in the first file as well as the third file and the fourth file and to store a sound associated with the at least one image in the second file, the memory Is connected to an associated selection means for selecting an image m of stored images, the device comprising means for sampling a clock and the time Δt j as well as the first time indicated by the clock, the device And selecting means for selecting an image from the M images and selecting a place (x j , y j ) in the thus selected image m.
KR1020127033710A 2010-05-25 2011-05-25 Method and device for storing and/or reproducing sound and images KR20130133649A (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
BE2010/0316 2010-05-25
BE2010000316 2010-05-25
PCT/EP2011/058603 WO2011147895A1 (en) 2010-05-25 2011-05-25 Method and device for storing and/or reproducing sound and images

Publications (1)

Publication Number Publication Date
KR20130133649A true KR20130133649A (en) 2013-12-09

Family

ID=49981581

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020127033710A KR20130133649A (en) 2010-05-25 2011-05-25 Method and device for storing and/or reproducing sound and images

Country Status (1)

Country Link
KR (1) KR20130133649A (en)

Similar Documents

Publication Publication Date Title
TWI283537B (en) Electronic camera apparatus and operation guide
US20130047081A1 (en) Methods and systems for creating video content on mobile devices using storyboard templates
US20120308209A1 (en) Method and apparatus for dynamically recording, editing and combining multiple live video clips and still photographs into a finished composition
JP5528008B2 (en) Playback apparatus and playback method
KR102078136B1 (en) Apparatus and method for photographing image having audio data
JP2016119600A (en) Editing device and editing method
TWI304546B (en) Storage medium in which audio-visual data with event information is recorded, and reproducing apparatus and reproducing method thereof
CN101178923A (en) Information processing apparatus, information processing method, and program
EP2711853B1 (en) Methods and systems for media file management
JP2007036538A (en) Recording control apparatus and method for number of people in moving picture and still picture reproducing apparatus and method
US20120251081A1 (en) Image editing device, image editing method, and program
Frohlich et al. Augmenting photographs with audio
US20130251345A1 (en) Method and device for storing and/or reproducing sound and images
KR20130133649A (en) Method and device for storing and/or reproducing sound and images
JP2010206799A (en) Method of creating animated series of photograph, and device for implementing the same
US20080212931A1 (en) Method and System for Integrating and/or Randomly Reproducing Images From an Information Storage Medium
US9591253B2 (en) Imaging apparatus and method for controlling imaging apparatus
JP2008236469A (en) Content reproducing device and program
JP2008090580A (en) Electronic apparatus
JP2006186932A5 (en)
TWI524726B (en) Image instantly integrated playback system
JP2009171417A (en) Recording and reproducing device, and recording and reproducing method
JP5188322B2 (en) Information recording device
JP5225365B2 (en) Image reproducing apparatus, image reproducing method, program, and recording medium
JP2009141676A (en) Reproduction device, digital camera, slide show reproduction method and program

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination