JP2001257980A - Device and method for reproducing image and audio - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve a problem that the data of only audio or audio data recorded simultaneously with image acquisition can not be continuously reproduced synchronously with images, for example, since a data file capable of handling is only a file recording image signals conventionally when automatically and continuously reproducing data by a digital still camera or the like. SOLUTION: When performing automatic continuous reproducing while arbitrarily combining an image file 102, an audio file 103 and an image/audio multiplex file 104, information on reproducing is described in an automatic reproducing control file 105 and on the basis of the automatic reproducing control file 105, synchronizing of image and audio is controlled through a CPU 110 by a synchronizing control means 109.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image and audio reproducing apparatus and method for automatically and continuously reproducing image and audio signals obtained by a digital still camera, a digital video camera or the like.

[0002]

2. Description of the Related Art As an example of an image display system using a digital camera, there is an apparatus disclosed in JP-A-11-88808. As shown in FIG. 18, the file name of the video file 1801 selected by the user on the digital camera is stored in a memory card (flash memory card).
It is created as a display management information file 1802 above. A display control unit 1805 for controlling a display unit 1803 such as a liquid crystal display device shown in FIG. 18 obtains a file name of a video to be displayed from a memory card from a display management information file 1802 by a display management information acquisition unit 1804 and sequentially displays the files. A display is provided to the means 1803.

[0003]

However, in the above-mentioned conventional example, the only file to be handled is a file in which an image signal is recorded. For example, audio-only data or audio data recorded at the same time as image acquisition is converted to image data. It is not envisaged that reproduction is performed in synchronism with, and no technical proposal for that is made.

The present invention has been made in view of the above points, and allows a user to freely and easily combine image data, audio data, and data in which images and audio are multiplexed.
It is an object of the present invention to provide an apparatus and a method for continuous reproduction.

[0005]

According to the present invention, at least one of a data file in which an image signal is recorded, a data file in which an audio signal is recorded, and a data file in which an image signal and an audio signal are multiplex-recorded is provided. Storage means for holding one and a data file in which the image signal is recorded, a data file in which an audio signal is recorded, a data file in which an image signal and an audio signal are multiplex-recorded, and information on the reproduction, A reproducing unit for reproducing an image signal and an audio signal of the data file held in the storage unit, and according to the information on the reproduction, a data file recording the image signal, a data file recording an audio signal, By playing back a data file in which an image signal and an audio signal are multiplex-recorded, the image signal and the audio signal are reproduced. It is intended to easily and successively reproduced by synchronizing.

[0006]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The first invention of the present invention holds at least one of a data file in which an image signal is recorded, a data file in which an audio signal is recorded, and a data file in which an image signal and an audio signal are multiplexed and recorded. Storage means for storing, independently of the data file, information relating to reproduction composed of an arbitrary combination of the data files, wherein the information relating to reproduction is one or more data to be reproduced from the storage means. At least one group of files is shown. In the group, information indicating reproduction of a data file in which an image signal and an audio signal are multiplex-recorded, and a data file in which an image signal is recorded or a data file in which an audio signal is recorded are shown. It is characterized in that information indicating reproduction is not mixed.

According to a second aspect of the present invention, in the first aspect, the information relating to reproduction indicates a file name of a data file to be reproduced from the storage means.

According to a third aspect of the present invention, in the first aspect, the information related to reproduction indicates an order of data files to be reproduced from the storage means.

Further, the fourth invention of the present invention is directed to
The invention according to a third aspect is characterized in that the image processing apparatus further comprises a reproducing unit that reproduces an image signal and an audio signal from the data file stored in the storage unit according to the information regarding the reproduction.

According to a fifth aspect of the present invention, in the fourth aspect, at least the reproducing means has either a reading means for reading a data file from the storage means or a decoder for decoding the data file. It is a feature.

A sixth invention of the present invention is to store at least one of a data file in which an image signal is recorded, a data file in which an audio signal is recorded, or a data file in which an image signal and an audio signal are multiplexed and recorded. ,
At least one data file containing one or more data files to be reproduced is held independently of the data files, and holds information on reproduction composed of an arbitrary combination of the data files.
Information indicating reproduction of a data file in which an image signal and an audio signal are multiplex-recorded, and information indicating reproduction of a data file in which an image signal is recorded or a data file in which an audio signal is recorded. And reproducing a video signal and an audio signal from the held data file in accordance with the information on the reproduction described so as not to mix the audio signals.

A seventh invention of the present invention is a computer-readable storage medium storing at least one of a data file in which an image signal is recorded, a data file in which an audio signal is recorded, or a data file in which an image signal and an audio signal are multiplexed. Independently from the storage means in which information relating to reproduction composed of an arbitrary combination of the data files is held,
A reproducing unit that reproduces a video signal and an audio signal from the data file stored in the storage unit in accordance with the information on the reproduction, wherein the information on the reproduction includes one or more data files to be reproduced from the storage unit. At least one group, in which information indicating reproduction of a data file in which an image signal and an audio signal are multiplex-recorded, and information indicating reproduction of a data file in which an image signal is recorded or a data file in which an audio signal is recorded. Are not mixed.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(Embodiment 1) FIG. 1 is a block diagram showing a configuration of an image and audio reproducing apparatus according to Embodiment 1 of the present invention. In FIG. 1, reference numeral 101 denotes a memory unit which stores image and audio digital data obtained (encoded) by a device such as a digital still camera, a digital video camera, and a scanner. Memory means 101
May be a means fixed to a device such as a hard disk drive or a removable means such as a flash memory card. The image file 102 is stored in the memory unit 10
1, the audio data file 103 is an audio data file, and the image / audio multiplex file 104 is an image data and audio data file 1
These files are multiplexed and stored in one file. The automatic playback control file 105 is a file that stores playback data and information indicating a playback order when the image file 102, the audio file 103, and the image / audio multiplex file 104 are continuously played back in combination.
However, in FIG.
02, audio file 103, image / audio multiplex file 1
04, only one automatic reproduction control file 105 is shown, but the present invention is not limited to this, and a plurality of files may actually exist in some cases. In addition, the image file 102, the audio file 103, the image /
All of the audio multiplex files 104 must be stored in the memory means 10
For example, the image file 102 may not be recorded in the memory unit 101.

The reading means 106 comprises a memory means 101
The writing means 107 is a means for writing the automatic reproduction control file 105 to the memory means 101.
The decoder 108 is a means for decoding and reproducing the image file 102, the audio file 103, and the image / audio multiplex file 104 read from the memory unit 101.
At this time, the image signal and the audio signal output from the decoder 108 based on the information of the automatic reproduction control file 105 are
A means for controlling decoding by the decoder 108 so as to have a predetermined synchronization relationship according to the information of the automatic reproduction control file 105 is a synchronization control means 109. CPU (central proc
essing unit) 110 generates an automatic playback control file 105 in response to an input from the operation keys 111, controls the reading unit 106 and the synchronization control unit 109 based on information in the automatic playback control file 105, , And decoding and reproduction of the read file by the decoder 108 are controlled.

The display means 112 includes a liquid crystal display device or a CRT (ca.
This is a display device such as a thode ray tube, and a speaker 113 is means for reproducing the audio signal decoded by the decoder 108.

FIG. 2 is a layout diagram of the operation surface of the image and sound reproducing apparatus.

Reference numerals 201 to 209 denote various keys constituting the operation keys 111 shown in FIG. 1, and a key input signal is sent to the CPU 110 shown in FIG. The main functions of each are as follows.

Reference numeral 201 denotes an image file reproduction mode selection key. When this key is pressed, the memory means 101
In the reproduction mode of the above image file, the CPU 110 controls the reading means 106 to read one of the image file and the image / audio multiplex file recorded in the memory means 101, and after decoding by the decoder 108, The image of the read file is displayed on the display unit 112.

Reference numeral 202 denotes an audio file reproduction mode selection key. When this key is pressed, the memory means 101
In the reproduction mode of the above audio file, the CPU 110 controls the reading means 106 to read one of the audio file and the image / audio multiplex file recorded in the memory means 101, and after decoding by the decoder 108, The sound of the file read by the speaker 113 is reproduced.

Reference numeral 203 denotes an image / audio multiplex file reproduction mode selection key. When this key is depressed, a reproduction mode of the image / audio multiplex file on the memory means 101 is set. One of the image / sound multiplex files recorded in the memory means 101 is read, and after decoding by the decoder 108, the image of the read file is displayed on the display means 112, and the sound is reproduced by the speaker 113. Is done.

Reference numeral 204 denotes a forward key, which is a key to be pressed when reproducing a file different from the currently reproduced file. Reference numeral 205 denotes a return key, which is pressed when reproducing the file reproduced immediately before. 206
Is a determination key, which is pressed when a reproduced file is selected as an object of automatic reproduction.

Reference numeral 207 denotes a grouping key. When this key is depressed, the CPU 110 assigns a group ID number to a specific file group and writes a file name together with a specific character string in the automatic reproduction control file.

Reference numeral 208 denotes a new reproduction control file creation key. When this key is pressed, the CPU 110 controls the writing unit 107 to newly create an automatic reproduction control file on the memory unit 101.

Reference numeral 209 denotes an automatic reproduction key. When this key is pressed, the CPU 110 controls the reading means 106 and the synchronization control means 109 based on the information of the automatic reproduction control file 105, And read it out automatically.

It should be noted that 112 and 113 shown in FIG.
And the speaker 113 shown in FIG.

FIG. 3 is a schematic diagram showing an image file, an audio file, and an image / audio multiplex file stored in the memory means 101. In FIG. 3, image files A,
B and C are files in which image data is stored.
The audio files A, B, and C are files in which audio data is stored. Image / audio multiplex files A and B are files in which image and audio data are multiplexed and stored in one file. Hereinafter, the description will be made assuming that the eight files shown in FIG.

The operation of this embodiment configured as described above will be described below.

When the user freely connects and reproduces image files, audio files, and image / audio multiplex files recorded on the memory means 101, first,
The automatic playback control file 105 is generated by the following procedure.

First, of the eight files shown in FIG. 3, the user plays back the image file B and the image portion of the image / sound multiplex file A continuously in this order. A case will be described in which A and the audio portion of the image / audio multiplex file B are continuously reproduced in this order, and the reproduction of the audio file A is desired to be performed in synchronization with the reproduction start of the image file B.

First, the user presses a new reproduction control file creation key 208. In response to this key input, the editing of the automatic reproduction control file is newly started, and the CPU 11
0 controls the writing means 107 and creates a file having a file name, for example, "AUTOPLY1" on the memory means 101.

Next, the user depresses an image file reproduction mode selection key 201 to select an image to be automatically reproduced, and causes the display means 112 to reproduce and display the image file on the memory means 101. At this time, for example, the display unit 1
12, the image file A is reproduced, and the display image is changed by the feed key 204 to display the image file B, the image file C, the image portion of the image / audio multiplex file A, and the image portion of the image / audio multiplex file B. It is displayed on the means 112 sequentially. Then, when the user wants to successively reproduce the image file B and the image portion of the image / audio multiplex file A in this order, the user operates the forward key 204 or the return key 205 to select the first image file B to be reproduced. It is displayed on the display unit 112. Then, the enter key 206 is pressed. The CPU 110 has a temporary memory for temporarily storing information therein, and when the enter key 206 is pressed in the temporary memory, it is specified that the user has selected this file as an image to be reproduced in the image file reproduction mode. The file name of the image file B is recorded following the character string “IMG_SRC =”. Next, the image of the image / audio multiplex file A is displayed by the feed key 204 or the return key 205. Then, the enter key 206 is pressed again. As a result, the file name of the image / audio multiplex file A is recorded in the temporary memory in the CPU 110 following the character string “IMG_SRC =”. According to the above procedure, the image file B and the image / audio multiplex file A are selected, and the file names of the image file B and the character string "IMG_SRC =" are displayed in the order of reproduction in the CPU 110.
Is recorded within.

Next, an audio file reproduction mode selection key 202 is pressed to select an audio to be automatically reproduced, and the audio file on the memory means 101 is reproduced by the speaker 113. At this time, for example, the audio file A is reproduced on the speaker 113, and the audio file B, the audio file C,
The audio part of the image / audio multiplex file A and the audio part of the image / audio multiplex file B are sequentially reproduced by the speaker 113. When the user wants to continuously play the audio file A and the audio portion of the image / audio multiplex file B in this order, the user operates the feed key 204 or the return key 205 to switch the audio file A to be played first to the speaker. Reproduce at 113. Then, the enter key 206 is pressed. As a result, in the temporary memory in the CPU 110, a character string "SND_SRC =" indicating that the user has selected this file as the sound to be reproduced in the sound file reproduction mode, followed by the sound file A
Is recorded. Next, the audio portion of the image / audio multiplex file B is reproduced by the send key 204 or the return key 205. Then, the enter key 206 is pressed again. As a result, the file name of the image / audio multiplex file B is recorded in the temporary memory in the CPU 110 following the character string “SND_SRC =”. According to the above procedure, the audio file A and the image / audio multiplex file B are selected, and their file names are set to "SND_SRC
= ”Is recorded in the CPU 110 together with the character string“ = ”.

In this state, when the grouping key 207 is pressed next, the CPU 110 sets the two image files B and the image / audio multiplex file A and the audio file A and the image / audio multiplex file B selected as one group. Recognized ID number unique to the group (for example, 001)
And the writing means 107 is controlled to control the memory means 1
Then, the ID number unique to the group and the contents stored in the temporary memory of the CPU 110 are written in the automatic reproduction control file “AUTOPLY1” on No. 01. FIG. 4 shows the contents of the written automatic reproduction control file "AUTOPLY1". "GI shown in FIG.
"D" is the ID number of the group, which is set to 001 in the example of Fig. 4. "IMG_SRC" is the image file or image /
This is a character string indicating the image portion of the audio multiplex file, which clearly indicates that the image portion of the image file B and the image portion of the image / audio multiplex file A are the images selected by the user to be reproduced. "SND_SRC" is a character string indicating the audio part of the audio file or the image / audio multiplex file, and the audio parts of the audio file A and the image / audio multiplex file B are reproduced when the user selects the reproduction. It clearly indicates that the sound should be. In particular, with respect to an image / audio multiplex file, the image portion and the audio portion can be separately specified by the character strings “IMG_SRC” and “SND_SRC”, and an image / audio multiplex file is composed of only image data. It is assumed that it can be handled like an image file or an audio file including only audio data.

Of the files indicated by "IMG_SRC" and "SND_SRC", the file with the smaller number of lines is the file to be reproduced earlier in time.

The above is the procedure for generating the automatic reproduction control file 105. Next, reproduction of a file based on the automatic reproduction control file 105 shown in FIG. 4 will be described.

When the user presses the automatic reproduction key 209, the CPU 110 controls the reading means 106, reads the automatic reproduction control file 105, and acquires the contents. The CPU 110 stores the first
The GID is searched from the line, and the group from the first "GID" to the next "GID" is recognized as one group. Note that the last group in the automatic playback control file 105 is the last GI
From D to the last line of the file. Therefore, in the present embodiment, there is one group, and the group from the first GID to the last line of the automatic reproduction control file 105 is one group.

In the automatic reproduction control file 105, file names are described in the order of reproduction. The image part of the image file or the image / audio multiplex file is specified by the character string “IMG_SRC”, and the sound part of the audio file or the image / audio multiplex file is specified by the character string “SND_SRC” Therefore, the CPU 110 determines from these character strings whether the target file is related to image playback or audio playback. As a result, as for the image, the image file B and the image portion of the image / audio multiplex file A are arranged in this order.
The data is read from the memory unit 101, decoded, and reproduced. At this time, from the description on the first line of the automatic playback control file 105, it is determined that these file groups are one group to which a group ID has been assigned, and the first image file among the image files included in the group is determined. The decoding of the decoder 108 is controlled by the synchronization control means 109 so that the reproduction start of the reproduced image file B and the reproduction start of the audio file A reproduced first among the audio files included in the same group are synchronized. I do.

Specifically, the CPU 110 sends information indicating images and sounds to be reproduced synchronously to the synchronization control means 109.
The decoder 108 internally has a temporary memory for temporarily storing the decrypted result. The decoder 108 decrypts the file read from the memory unit 101 and temporarily writes the decrypted file to the temporary memory. This is a measure for compensating for the difference in the time required for decoding depending on the file. The synchronization control means 109 monitors the progress of the decoding of the image and audio to be reproduced synchronously, and when the decoding is completed to a point where the image and the audio can be output simultaneously, the image and the audio stored in the temporary memory are deleted. Output at the same time.
Thus, the reproduction of the image and the sound is synchronized.

FIG. 5 is a flowchart showing a flow of reproducing a series of these files. In FIG. 5, step 501 is waiting for an input from the automatic reproduction key 209, and when the automatic reproduction key 209 is pressed, the process proceeds to step 502. In step 502, the CPU 110 controls the reading means 106 to
5 is read from the memory means 101. In step 503, the CPU 110 determines whether the read automatic reproduction control file
5 to search for a group ID number and detect a group. Further, in step 504, a file name designated by a character string "IMG_SRC" indicating an image is detected for each detected group, and similarly, in step 505, a character string "S" indicating sound is detected.
The file name specified by "ND_SRC" is detected. Then, in step 506, the file is read from the memory means 101, the decoding is performed by the decoder 108, and the image and sound are synchronously reproduced by the synchronization control means 109 as described above. Control.

FIG. 6 schematically shows the state of reproduction of such an image and a sound, and the user can reproduce the image and the sound as specified by the user.

As described above, according to the present embodiment, the image file and the audio file whose playback start is to be synchronized are
As shown in FIG. 4, they are described in a grouped form in the automatic reproduction control file 105, and the automatic reproduction control file 10
5 so that the start of reproduction of the first image file among the image files included in the group is synchronized with the start of reproduction of the first audio file among the audio files included in the same group. 101
By controlling the reading of files from and the decoding by the decoder 108, the user can freely and easily combine image data, audio data, and data obtained by multiplexing images and audio, and Playback can be started in synchronization.

(Embodiment 2) In Embodiment 1 of the present invention, the structure in which one group consisting of a plurality of files is described in the automatic reproduction control file 105 has been described, but in this case, it is included in the group. Only the synchronization of the image and the sound at the start of the reproduction of the file group can be realized. However, there may be a case where it is desired to reproduce the image and the sound in more detail in synchronization. An embodiment that assumes such a case will be described below.

For example, of the files shown in FIG. 3, the image file A and the image file B are reproduced in this order. At that time, the reproduction start of the image file A and the audio file B is synchronized, and the image file B is further reproduced. When it is desired to synchronize the reproduction start of the audio part of the image / audio multiplex file B with the automatic reproduction control file 105, the following procedure is first performed.

First, the user presses a new reproduction control file creation key 208 as in the first embodiment. As a result, a file having a file name “AUTOPLY2” is created on the memory unit 101, for example.

Next, the user depresses the image file reproduction mode selection key 201 to select an image to be automatically reproduced, reproduces and displays the image file on the memory means 101 on the display means 112, and displays the image file with the forward key 204. The image file A is displayed by changing the image. Then, the enter key 206 is pressed. As a result, the file name of the image file A is recorded in the temporary memory in the CPU 110, following the character string "IMG_SRC =". Next, an audio file reproduction mode selection key 202 is pressed to select an audio to be automatically reproduced, the audio file on the memory means 101 is reproduced by the speaker 113, and the reproduction audio is changed by the send key 204 to change the audio file B. To play. Then, the enter key 206 is pressed. As a result, in the temporary memory in the CPU 110, following the character string "SND_SRC =",
The file name of the audio file B is recorded.

When the grouping key 207 is pressed next in this state, the CPU 110 recognizes the selected image file A and audio file B as one group, assigns a unique ID number (for example, 001) to the group, and The CPU 107 controls the automatic reproduction control file "AUTOPLY2" on the memory means 101 to store the group-specific ID number and the CPU.
The contents stored in the temporary memory of 110 are written.

Next, in the same manner as described above, the image file B and the audio portion of the image / audio multiplex file B are reproduced and selected, and the grouping key 207 is pressed. Accordingly, the CPU 110 recognizes the image file B and the audio portion of the image / audio multiplex file B as one group, assigns a unique ID number (for example, 002) to the group, controls the writing unit 107, and controls the memory unit 101. The ID number unique to the group and the contents stored in the temporary memory of the CPU 110 are additionally written into the above automatic reproduction control file "AUTOPLY2". FIG. 7 shows the contents of the created automatic playback control file "AUTOPLY2". “GID” shown in FIG. 7 is the ID number of the group, and in the example of FIG.
Each group has a different number. As in FIG. 4, "IMG_SRC" is a character string indicating an image part of an image file or an image / audio multiplex file, and "SND_SRC" is a character string indicating an audio part of an audio file or an image / audio multiplex file. . The file group having the GID with the smaller number of lines is the file group to be reproduced first.

The procedure for generating the automatic reproduction control file 105 has been described above. Next, reproduction of a file based on the automatic reproduction control file 105 shown in FIG. 7 will be described.

When the user presses the automatic reproduction key 209, the CPU 110 controls the reading means 106, reads the automatic reproduction control file 105, and acquires its contents. The CPU 110 stores the first
The GID is searched from the line, and the group from the first "GID" to the next "GID" is recognized as one group. Note that the last group in the automatic playback control file 105 is the last GI
From D to the last line of the file. From the description of the automatic reproduction control file 105, the image file A and the audio file B are recognized as one group, and the audio portion of the image file B and the image / audio multiplex file B are recognized as one group. For the image, the file is read out from the memory means 101 in the order of the image file A and the image file B, and for the sound, the file is read out from the memory means 101 in the order of the sound file B and the sound portion of the image / sound multiplex file B, decoded and reproduced. At that time, the image file A and the audio file B
Is one group, and the image file B and the audio portion of the image / audio multiplex file B are one group. Therefore, the reproduction start of the image file A and the reproduction start of the audio file B are synchronized, and the reproduction start of the image file B is synchronized with the reproduction start of the image file B. The decoding by the decoder 108 is controlled by the synchronization control means 109 so that the reproduction start of the audio part of the image / audio multiplex file B is synchronized. The flowchart for playing back a series of these files is as follows:
This is the same as FIG. 5 shown in the first embodiment of the present invention. FIG. 8 schematically shows the state of reproduction of such an image and a sound, and the user can reproduce the image and the sound as specified by the user.

As described above, according to the second embodiment of the present invention, a plurality of groups of a plurality of files are placed in one automatic reproduction control file to synchronize the reproduction of an image and a sound. The user can freely and easily combine image data, audio data, and data obtained by multiplexing the image and the sound, and start the reproduction of the image and the sound in a synchronized manner.

(Embodiment 3) In Embodiments 1 and 2 of the present invention, a group ID number is assigned to a plurality of files in the automatic reproduction control file 105, and the plurality of files are regarded as one group. Although the description has been given of the configuration for performing the synchronous reproduction of the image and the audio, in these examples, the image / audio multiplex file is described on the automatic reproduction control file 105 in a form divided into the image part and the audio part. However, an image / audio multiplex file acquired by a digital still camera or a digital video camera is originally considered to be a file in which audio is acquired simultaneously with image acquisition.
It can be said that the file is recorded on the assumption that the image and the sound are synchronized. Therefore, when a file of such a property is played, it is necessary to describe the file in the automatic playback control file in a form divided into an image part and an audio part.
It is cumbersome for the user and can cause confusion.

Therefore, an embodiment will be described in which an image / audio multiplex file is not divided into an image portion and an audio portion, but is reproduced by an automatic reproduction control file while maintaining the synchronous relationship between the image and the audio.

For example, when the user wants to successively reproduce the multiplexed image / audio file A and the multiplexed image / audio file B in this order among the files shown in FIG. Generate a playback control file.

First, the user is asked to enter the first embodiment of the present invention.
Similarly, a new reproduction control file creation key 208 is pressed. Thereby, for example, "AUTOPLY3" is displayed on the memory means 101.
Is created.

Next, the user presses the image / audio multiplex file reproduction mode selection key 203 to select the image / audio multiplex file to be automatically reproduced, and
1 to reproduce the image / audio multiplex file. After the image / audio multiplex file A is reproduced by changing the file to be reproduced by the send key 204 or the return key 205, the enter key 206 is pressed. As a result, in the temporary memory in the CPU 110, the character "CMP_SRC =" is displayed in the temporary memory in the image / audio multiplex file reproduction mode to clearly indicate that the user has selected this file as a multiplexed image and audio file to be reproduced. Following the column, the file name of the image / audio multiplex file A is recorded. Similarly, the image / audio multiplex file B is reproduced, and when the enter key 206 is pressed, the file name of the image / audio multiplex file B is recorded in the temporary memory in the CPU 110 following the character string "CMP_SRC =". By the above procedure, the image / audio multiplex file A and the image / audio multiplex file B are selected, and their file names are stored in the CPU 110 in the order in which they are to be reproduced, along with a character string "CMP_SRC =".

When the grouping key 207 is depressed next in this state, the CPU 110 recognizes the selected image / audio multiplex file A and image / audio multiplex file B as one group and identifies the group with an ID number unique to the group (for example, 00
1) is added, and the writing control unit 107 is controlled so that the automatic reproduction control file “AUTOPLY3” on the memory unit 101 is added to
The ID number unique to the group and the contents stored in the temporary memory of the CPU 110 are written. FIG. 9 shows the contents of the written automatic reproduction control file "AUTOPLY3". “GID” shown in FIG. 9 is a group ID number, and “CMP_SRC” is a character string indicating an image / audio multiplex file, whereby the image / audio multiplex files A and B are selected and reproduced by the user. It clearly indicates that it should be image and audio data. A file group having a GID with a smaller number of lines is a file group to be reproduced first.

The procedure for generating the automatic reproduction control file 105 has been described above. Next, reproduction of a file based on the automatic reproduction control file 105 shown in FIG. 9 will be described.

When the user presses the automatic reproduction key 209, the CPU 110 controls the reading means 106, reads the automatic reproduction control file 105, and acquires the contents. In the automatic reproduction control file 105, file names are described in the order of reproduction. Since the image / audio multiplex file is specified by the character string “CMP_SRC”, it is determined from the character string that the target file is recorded by multiplexing the image and the audio. As a result, the image / audio multiplex file A and the image / audio multiplex file B are read from the memory unit 101 and decoded, and the image and the audio are reproduced synchronously.

Specifically, the CPU 110 sends information indicating a file to be synchronously reproduced to the synchronous control means 109.
The decoder 108 internally has a temporary memory for temporarily storing the decrypted result. The decoder 108 decrypts the file read from the memory unit 101 and temporarily writes the decrypted file to the temporary memory. This is a measure for compensating for the time difference in the decoding time between the image part and the audio part in the image / audio multiplex file. The synchronization control means 109 monitors the progress of the decoding of the image and the sound to be reproduced, and simultaneously outputs the image and the sound stored in the temporary memory when the decoding is completed to a point where the image and the sound can be output simultaneously. Let it. Thus, the reproduction of the image and the sound is synchronized.

FIG. 10 is a flowchart showing a flow of reproducing a series of these files. In FIG. 10, steps 501 to 503 are the same as those in FIG. Step 1001 is a step of detecting a file name specified by a character string “CMP_SRC” indicating an image for each detected group. And step 10
In 02, the CPU 110 reads the specified image / audio multiplex file from the memory unit 101, controls decoding by the decoder 108, and controls synchronous reproduction of the image and audio by the synchronization control unit 109.

FIG. 11 schematically shows the state of reproduction of such an image and a sound, and the user can reproduce the image and the sound as specified by the user.

As described above, according to the third embodiment of the present invention, the data in which the image and the sound are multiplexed is not divided into the image portion and the sound portion, and the synchronous relationship between the image and the sound is maintained. In format, the user can freely and easily combine and play back the images and sounds in synchronization.

(Embodiment 4) In Embodiment 3 of the present invention, an example in which a group consisting only of image / audio multiplex files is described in the automatic playback control file 105 to perform automatic playback has been described. Will be described with reference to an embodiment in which automatic reproduction is performed including image files and audio files.

For example, of the files shown in FIG. 3, the user plays back the image file B, the image / audio multiplex file B, and the image file C in this order. To synchronize the reproduction start, synchronize the audio part of the image / audio multiplex file B with the image part of the same file, and synchronize the reproduction start of the image file C and the audio part of the image / audio multiplex file A with the following: According to such a procedure, first, an automatic reproduction control file is generated.

First, the user is asked to enter the first embodiment of the present invention.
Similarly, a new reproduction control file creation key 208 is pressed. Thereby, for example, "AUTOPLY4" is displayed on the memory means 101.
Is created.

Next, the user presses the image file reproduction mode selection key 201 to select an image to be automatically reproduced, reproduces and displays the image file on the memory means 101 on the display means 112, and displays the image file with the forward key 204. The image file B is displayed by changing the image. Then, the enter key 206 is pressed. As a result, in the temporary memory in the CPU 110, a character string “IMG_SRC =” indicating that the user has selected this file as an image to be reproduced in the reproduction mode of the image file, followed by the file name of the image file B Is recorded. Next, an audio file playback mode selection key 2 is used to select audio to be automatically played.
02 is pressed, the audio file on the memory means 101 is reproduced by the speaker 113, and the reproduction sound is changed by the feed key 204 to reproduce the audio file A. Then, the enter key 206 is pressed. As a result, in the temporary memory in the CPU 110, a character string "SND_SRC =" for specifying that the user has selected this file as the sound to be reproduced in the sound file reproduction mode, followed by the file name of the sound file A Is recorded.

In this state, when the grouping key 207 is pressed next, the CPU 110 recognizes the selected image file B and audio file A as one group, assigns a unique ID number (for example, 001) to the group, and The CPU 107 controls the automatic reproduction control file "AUTOPLY4" on the memory means 101 to store the group-specific ID number and the CPU.
The contents stored in the temporary memory of 110 are written.

Next, an image / audio multiplex file reproduction mode selection key 203 is pressed to select an image / audio multiplex file to be automatically reproduced, and the image / audio multiplex file on the memory means 101 is reproduced. After the image / audio multiplex file B is reproduced by changing the display image using the send key 204 or the return key 205, the enter key 206 is pressed. As a result, a character string "CMP_SRC =" in the temporary memory in the CPU 110 is displayed in the temporary memory in the image / audio multiplex file reproduction mode to clearly indicate that the user has selected this file as a file in which the image and audio to be reproduced are multiplexed. Then, the file name of the image / audio multiplex file B is recorded.

When the grouping key 207 is pressed next in this state, the CPU 110 recognizes the selected image / audio multiplex file B as one group, assigns a unique ID number (eg, 002) to the group, and
7 and the automatic reproduction control file "AUTOPLY4" on the memory means 101 and the CPU 110
The content stored in the temporary memory is additionally written.

Next, the image file reproduction mode selection key 201 is pressed again to select an image to be automatically reproduced, and the image file on the memory means 101 is displayed on the display means 11.
2 and display the image file C by changing the display image with the feed key 204. And enter key 20
Press 6. Thus, the file name of the image file C is recorded in the temporary memory in the CPU 110, following the character string “IMG_SRC =”. Next, the audio file reproduction mode selection key 202 is pressed again to select the audio to be automatically reproduced, the audio file on the memory means 101 is reproduced by the speaker 113, and the reproduction audio is changed by the feed key 204 to change the image / image. The audio portion of the audio multiplex file A is reproduced. Then, the enter key 206 is pressed. As a result, the file name of the image / audio multiplex file A is recorded in the temporary memory in the CPU 110 following the character string “SND_SRC =”.

When the grouping key 207 is depressed next in this state, the CPU 110 recognizes the selected image file C and the audio portion of the image / audio multiplex file A as one group, and an ID number unique to the group (for example, 003).
And the writing means 107 is controlled to control the memory means 1
Further, the ID number unique to the group and the contents stored in the temporary memory of the CPU 110 are additionally written into the automatic reproduction control file "AUTOPLY4" on the file 01. FIG. 12 shows the contents of the written automatic playback control file "AUTOPLY4". "GID" shown in FIG. 12 is the ID number of the group.
In the example, different numbers are given to the three groups. As in FIG. 4, "IMG_SRC" is a character string indicating an image portion of an image file or an image / audio multiplex file, and "SND_SRC" is a character string indicating an audio portion of an audio file or an image / audio multiplex file. Also, similarly to FIG. 9, "CMP_SRC" is a character string indicating an image / audio multiplex file. And the GID of the younger row
Is a group to be played first, and within the group, among files indicated by a character string such as "IMG_SRC", a file having a small number of lines indicated by the same character string is reproduced first. .

The procedure for generating the automatic reproduction control file 105 has been described above. Next, reproduction of a file based on the automatic reproduction control file 105 shown in FIG. 12 will be described.

When the user presses the automatic reproduction key 209, the CPU 110 controls the reading means 106, reads the automatic reproduction control file 105, and acquires its contents. The CPU 110 searches for a GID from the first line of the automatic reproduction control file, and finds 1 from the first “GID” to the next “GID”.
Recognize as one group. Note that the last group in the automatic reproduction control file 105 is from the last GID to the last line of the file. Automatic playback control file 1
05, the image file B and the audio file A are 1
One group, the image / audio multiplex file B is recognized as one group, and the audio portions of the image file C and the image / audio multiplex file A are recognized as one group. Then, the image file B, the audio file A,
The audio portions of the image / audio multiplex file B, image file C, and image / audio multiplex file A are read, decoded, and reproduced. At this time, since the image file B and the audio file A are one group, the image / audio multiplex file B is one group, and the audio part of the image file C and the image / audio multiplex file A is one group, The reproduction of the file B and the reproduction of the audio file A are started in synchronization with each other. Thereafter, the image portion and the audio portion of the image / audio multiplex file B are reproduced in synchronization with each other. The decoding by the decoder 108 is controlled by the synchronization control means 109 so as to synchronize with the start of reproduction of the audio portion of the multiplex file A. FIG. 13 is a flowchart showing a flow of reproducing a series of these files.

In FIG. 13, steps 501 to 50
5 is the same as FIG. 5, and step 1001 is FIG.
The description is omitted because it is the same as. Step 1301
Is a step of reproducing a file for each detected group. As described in the first to third embodiments of the present invention, the CPU 110 reads the file from the memory unit 101, decodes the file by the decoder 108, The synchronous control means 109 controls synchronous reproduction of images and sounds.

FIG. 14 schematically shows such a state of reproduction of an image and a sound, and the user can reproduce the image and the sound as specified by the user.

As described above, according to the fourth embodiment of the present invention, when an image and a sound are automatically reproduced by combining three types of files: an image file, an audio file, and an image / audio multiplex file. The user can freely and easily combine three types of files in a format that does not divide the multiplexed data and audio into an image portion and an audio portion, while maintaining the synchronous relationship between the image and the audio. Audio can be synchronized and played.

In the fourth embodiment of the present invention, when files are grouped, an image / audio multiplex file designated by a character string "CMP_SRC" and a character string "IMG_SRC"
And the file specified by "SND_SRC" are not mixed. That is, when the image / audio multiplex file specified by the character string “CMP_SRC” is placed in one group, one group is configured only by the image / audio multiplex file specified by the character string “CMP_SRC”. For example, in FIG. 12, the group whose GID is 002 includes only the image / audio multiplex file specified by the character string “CMP_SRC”. The reason for this is described below.

For example, as shown in FIG. 15, the reproduction is started by synchronizing the image file B and the audio file A, the audio file B is reproduced after the audio file A, and thereafter,
The image and sound of the image / audio multiplex file B are played back synchronously,
Finally, it is assumed that the image file C and the audio portion of the image / audio multiplex file A are to be reproduced in synchronization. In this case, the following procedure can be considered as an example of a method of creating the automatic reproduction control file as described above. First,
The editing of the automatic playback control file 105 is started by pressing the new playback control file creation key 208, and the image file B is displayed on the display means 112 by operating the image file playback mode selection key 201, the forward key 204, and the return key 205. Then, the file name is stored in the CPU 110 following the character string "IMG_SRC" by the enter key 206. Next, the image / audio multiplex file reproduction mode selection key 203, the forward key 204, and the return key 205 are operated in the same manner to reproduce the image / audio multiplex file B. Then, the character string "CMP_SRC" is changed by the enter key 206. Subsequently, the CPU 110 stores the file name. Then, the image file C is displayed again by operating the image file reproduction mode selection key 201, the forward key 204, and the return key 205.
Is displayed, and the character string "IMG_SR"
This file name is stored in the CPU 110 following C ". Thus, the file name to be reproduced is stored in the temporary memory of the CPU 110 in the order of the image file B, the image / audio multiplex file B, and the image file C.

As for the audio files, the audio file A, the audio file B, and the audio portion of the image / audio multiplex file A are reproduced in the order of reproduction, by the audio file file reproduction mode selection key 202, the forward key 204, and the return key 205.
Is operated to reproduce the audio portions of the audio file A, the audio file B, and the image / audio multiplex file A with the speaker 113, and then the enter key 206 causes the CPU 110 to store these file names following the character string "SND_SRC". . The file selected by pressing the grouping key 207 is grouped, and this is grouped with a group ID number (for example, 0
01) and write it to the automatic reproduction control file.

FIG. 16 shows the automatic reproduction control file 105 created by the above procedure. In the automatic reproduction control file 105, six files are grouped by one group ID (GID) as shown in FIG.

Next, consider a case where a plurality of files are automatically played back by the automatic playback control file 105 shown in FIG.

In the automatic reproduction control file 105 shown in FIG. 16, the image file B, the image / audio multiplex file B, and the image file C are arranged in order, and it can be determined that the images should be reproduced in this order. However, regarding the audio file, the audio file A, the audio file B, and the audio portion of the image / audio multiplex file A are reproduced in this order;
Play the audio file so that the start of playback of the first image file among the image files included in the group and the start of playback of the first audio file among the audio files included in the same group are synchronized. It can be determined that it is only necessary to synchronize the reproduction start of the image file B and the reproduction start of the audio file A. However, the audio part of the image / audio multiplex file B, the audio file B and the image / audio multiplex file The temporal positional relationship with the audio portion of A is shown in the automatic playback control file 105 in FIG.
Can not be determined from the description of. More specifically, the audio file A that needs to be synchronized with the image file B that is reproduced before the image / audio multiplex file B needs to be reproduced before the audio portion of the image / audio multiplex file B. , The audio parts of the audio file B and the image / audio multiplex file A are
16 except that it is reproduced after the audio file A.
Can not be determined from the automatic playback control file.

Therefore, if the automatic reproduction control file is created by the procedure described above, the audio portion of the image / audio multiplex file B, the audio file B and the image / audio
It is necessary to additionally describe information for specifying the temporal positional relationship with the audio portion of the audio multiplex file A in the automatic reproduction control file. However, in this case, the description of the automatic reproduction control file becomes complicated, and a device for automatically reproducing images and sounds based on the automatic reproduction control file also has a large burden for analyzing the automatic reproduction control file. Specifically, it becomes necessary for the playback device to have hardware or software for analyzing a more complicated automatic playback control file. In addition, the labor for creating the automatic reproduction control file is increased, and the burden is imposed on the user.

Therefore, as shown in FIGS. 12 and 14, when an image / audio multiplex file is designated by a character string "CMP_SRC" and the image and audio are handled as one file that is reproduced synchronously, the character The character string "CMP_SRC" without mixing the files specified by the columns "IMG_SRC" and "SND_SRC"
One group is composed of only the image / audio multiplex file specified by. That is, due to the nature of the file, such as an image / audio multiplex file, the synchronization relationship between the image and the audio is 1
If files that are completed in one file are grouped together in a single group, files of the same format can be combined into an auto-play control file together with other files that do not originally have a synchronous relationship between images and audio. The temporal positional relationship between the files is not obscured.

It is apparent from the third embodiment of the present invention that there is no problem even if a plurality of files specified by "CMP_SRC" are placed in one group.

With the above-described processing, it is not necessary to add and describe information for specifying the temporal positional relationship between audio parts of an audio file or an image / audio multiplex file to the automatic reproduction control file. By describing the simple automatic playback control file, the temporal positional relationship between the files can be clearly specified. This does not increase the load on the automatic reproduction control file analysis of the device that automatically reproduces images and sounds, and does not increase the load on the user to create the automatic reproduction control file.

FIG. 17 shows an example of an automatic reproduction control file in the case of reproducing an image and a sound in a synchronous relationship as shown in FIG. As shown in FIG. 17, the part indicating the reproduction of the image / audio multiplex file B is set to GID = 002, and the GID specifying another file is set.
It is clear from the above description that the temporal positional relationship between the files can be clearly defined if the file is separated.

In all the embodiments of the present invention, the encoding method and the file format of the image file, the audio file, and the image / audio multiplex file are not particularly specified. Even if the file is encoded by the
It is clear that the present invention is effective for any file format. Further, whether an image file, an audio file, or an image / audio multiplex file is a compressed file or an uncompressed file,
Further, it is clear that the present invention is effective even for a file having additional information such as a header.

In all the embodiments of the present invention, "IMG_SRC", "SND
_SRC "and" CMP_SRC "are used, but these are merely examples, and the present invention is not limited to these.

In all the embodiments of the present invention, a configuration is also conceivable in which the decoder 108 includes a digital-to-analog converter for converting a digital signal into an analog signal.

Further, in all the embodiments of the present invention, the key input of the operation key 111 is performed in the order from 201 to 2 in FIG.
Although the description has been made using the method of performing key input by pressing as shown in FIG. 08, the present invention is not limited to this, and a method of selecting a necessary operation from a touch panel displayed on a liquid crystal display device or a menu display is also available. Conceivable.

Further, in all the embodiments of the present invention, it has been described that the automatic reproduction control file used at the time of reproduction exists as if there is only one in the memory means 101, but the present invention is not limited to this. Instead, for example, a plurality of automatic playback control files exist on the memory unit 101,
A configuration is also conceivable in which the user can arbitrarily select an automatic reproduction control file to be used for automatic reproduction from among them. In this case, for example, all the automatic playback control files on the memory means 101 are displayed on the display means 112,
Among these methods, a method is conceivable in which the user can freely select the automatic reproduction control file by key input or the like, but is not limited to this.

Further, in all the embodiments of the present invention, the automatic reproduction control file is described to be recorded on the memory means 101. However, the present invention is not limited to this. For example, the automatic reproduction control file may be stored in a storage means different from the memory means 101. It is also possible to remember.

Also, in all the embodiments of the present invention, a configuration has been described in which an image and a sound are reproduced when the automatic reproduction control file is created. However, the present invention is not limited to this. Display means 1
A method of displaying those file names on the screen 12 and selecting a file to be automatically reproduced from the file names is also conceivable.

Further, in all the embodiments of the present invention, a configuration has been described in which an image and a sound are reproduced when an automatic reproduction control file is created. However, a configuration in which a thumbnail image is displayed for an image is also conceivable. . In addition, a configuration in which a part of the sound is reproduced, for example, only the beginning part, may be considered.

In all the embodiments of the present invention, the number of frames in the image portion of the image file and the image / audio multiplex file is not particularly described.
It may be a still image of a frame or a moving image composed of a plurality of frames.

Further, in all the embodiments of the present invention, a configuration has been described in which an image and a sound are reproduced when the automatic reproduction control file is created. However, when the image is a moving image composed of a plurality of frames, A configuration in which only some of the images are displayed is also conceivable.

Further, in all the embodiments of the present invention, it is needless to say that at least the processing by the CPU 110 can be realized by software, and the software can be stored in a memory in advance or separately stored on a recording medium. You can give it.

[0100]

As described above, according to the present invention, files of different formats such as a data file in which an image signal is recorded, a data file in which an audio signal is recorded, and a data file in which an image signal and an audio signal are multiplexed are recorded. Thus, it is possible to realize a device that allows the user to freely and easily combine and continuously reproduce, and at that time, start reproduction of a predetermined image and sound in synchronization with each other.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an image and audio reproducing apparatus according to Embodiments 1 to 4 of the present invention.

FIG. 2 is a layout diagram of an operation surface of the image and sound reproducing apparatus according to the first to fourth embodiments.

FIG. 3 is a schematic diagram showing an image file, an audio file, and an image / audio multiplex file stored on a memory unit according to the first to fourth embodiments.

FIG. 4 is a diagram showing contents of an automatic reproduction control file according to the first embodiment;

FIG. 5 is a flowchart of an automatic reproduction operation according to the first embodiment.

FIG. 6 is an explanatory diagram for explaining images and sounds that are automatically reproduced in the first embodiment;

FIG. 7 is a diagram showing contents of an automatic reproduction control file according to the second embodiment.

FIG. 8 is an explanatory diagram for explaining an image and a sound to be automatically reproduced according to the second embodiment;

FIG. 9 is a diagram showing contents of an automatic reproduction control file according to the third embodiment.

FIG. 10 is a flowchart of an automatic reproduction operation according to the third embodiment.

FIG. 11 is an explanatory diagram for explaining an image and a sound to be automatically reproduced in the third embodiment.

FIG. 12 is a diagram showing contents of an automatic reproduction control file according to the fourth embodiment.

FIG. 13 is a flowchart of an automatic reproduction operation according to the fourth embodiment.

FIG. 14 is an explanatory diagram for explaining images and sounds to be automatically reproduced according to the fourth embodiment;

FIG. 15 is an explanatory diagram for describing an example of a description method in a group of files specified by a character string “CMP_SRC” in the fourth embodiment;

FIG. 16 is a diagram showing an example of an inappropriate description content of an automatic reproduction control file for describing an example of a description method in a group of files specified by a character string “CMP_SRC” in the fourth embodiment.

FIG. 17 is a diagram showing an example of an appropriate description content of an automatic reproduction control file for describing an example of a description method in a group of files designated by a character string “CMP_SRC” in the fourth embodiment.

FIG. 18 is a block diagram showing an example of an automatic playback device in a conventional example.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 101 Memory means 102 Image file 103 Audio file 104 Image / audio multiplex file 105 Automatic reproduction control file 106 Reading means 107 Writing means 108 Decoder 109 Synchronization control means 110 CPU 111 Operation keys 112 Display means 113 Speaker

 ────────────────────────────────────────────────── ─── Continuing on the front page (72) Inventor Michiharu Uematsu 1006 Kazuma Kadoma, Kadoma City, Osaka Prefecture F-term within Matsushita Electric Industrial Co., Ltd. 5C022 AA13 AC01 AC69 AC71 5C052 AA17 CC11 DD02 DD04 DD06 EE08 GA01 GA04 GB01 GB07 GC05 GE08 5C053 FA08 FA10 FA24 FA27 GA11 GB11 GB21 HA27 JA12 KA24 LA01

Claims (7)

[Claims] 1. A storage unit for holding at least one of a data file in which an image signal is recorded, a data file in which an audio signal is recorded, or a data file in which an image signal and an audio signal are multiplexed, wherein the storage unit comprises: Information relating to reproduction composed of an arbitrary combination of the data files is held independently of the data file, and the information relating to the reproduction is reproduced from the storage unit.
At least one group of the above data files is shown. In the group, information indicating reproduction of a data file in which an image signal and an audio signal are multiplex-recorded, and a data file or an audio signal in which the image signal is recorded are recorded. An image and sound reproducing apparatus, wherein information indicating data file reproduction is not mixed. 2. The image and audio reproducing apparatus according to claim 1, wherein the information on reproduction indicates a file name of a data file to be reproduced from the storage means. 3. The image and audio reproducing apparatus according to claim 1, wherein the information on reproduction indicates an order of data files to be reproduced from the storage means. 4. The image processing apparatus according to claim 1, further comprising a reproducing unit configured to reproduce an image signal and an audio signal from the data file stored in the storage unit in accordance with the information regarding the reproduction. Audio playback device. 5. The image and sound reproducing apparatus according to claim 4, wherein at least the reproducing means has either a reading means for reading the data file from the storage means or a decoder for decoding the data file. 6. At least one of a data file in which an image signal is recorded, a data file in which an audio signal is recorded, or a data file in which an image signal and an audio signal are multiplex-recorded, and any combination of the data files is stored. And at least one group in which at least one data file to be reproduced is put together. In the group, a data file in which an image signal and an audio signal are multiplex-recorded is stored. According to the information related to the reproduction described so as not to mix the information indicating the reproduction and the information indicating the reproduction of the data file in which the image signal is recorded or the data file in which the audio signal is recorded, the video signal is output from the held data file. And an audio signal. The method of playback voice. 7. At least one of a data file in which an image signal is recorded, a data file in which an audio signal is recorded, or a data file in which an image signal and an audio signal are multiplex-recorded, and any one of the data files independently of the data file A reproduction unit configured to reproduce a video signal and an audio signal from a data file stored in the storage unit in accordance with the reproduction-related information, from the storage unit storing the reproduction-related information including the combination of Is the one to be reproduced from the storage means.
At least one group in which the above data files are put together is shown. In the group, information indicating reproduction of a data file in which an image signal and an audio signal are multiplex-recorded, and a data file or an audio signal in which the image signal is recorded are recorded. An image and sound reproducing apparatus, wherein information indicating data file reproduction is not mixed.