JP2001257992A - Method and device for reproducing image and voice - Google Patents

Abstract

PROBLEM TO BE SOLVED: To settle a problem that only a data file recording image signals can be treated so far and thereby the data on only voices and the voice data recorded simultaneously with acquisition of image, for example, cannot be continuously reproduced synchronously with images when the data are automatically and continuously reproduced with a digital still camera, etc. SOLUTION: When the data are automatically and continuously reproduced via an optional combination of an image file 102, a voice file 103 and an image/ voice multiple file 104, the information on this reproduction is described on an automatic reproduction control file 105 and also a synchronization control means 109 controls synchronization between the images and voices via a CPU 110 on the basis of the file 105. Furthermore, the information added to each file and the time of reproduction are also described on the file 105.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image and audio reproducing apparatus and method for automatically and continuously reproducing image and audio signals obtained by a digital still camera, a digital video camera or the like.

[0002]

2. Description of the Related Art As one example of an image display system using a digital camera, there is an apparatus disclosed in Japanese Patent Application Laid-Open No. H11-88808. This corresponds to the video file 310 selected by the user on the digital camera as shown in FIG.
1 is created as a display management information file 3102 on a memory card (flash memory card). A display control means 3105 for controlling a display means 3103 such as a liquid crystal display device shown in FIG. 31 stores a file name of a video to be displayed from a memory card in a display management information file 3102.
From the display management information acquisition unit 3104, and sequentially displays the information on the display unit 3103.

[0003]

However, in the above-mentioned conventional example, the only file to be handled is a file in which an image signal is recorded. For example, audio-only data or audio data recorded at the same time as image acquisition is converted to image data. It is not envisaged that reproduction is performed in synchronism with, and no technical proposal for that is made.

The present invention has been made in view of the above points, and allows a user to freely and easily combine image data, audio data, and data in which images and audio are multiplexed.
Providing an apparatus and method for continuous playback,
The present invention provides an apparatus and a method for synthesizing and reproducing image data to be reproduced, audio data, data obtained by multiplexing an image and audio, and further reproducing the image data, audio data, and image and audio. It is an object of the present invention to provide an apparatus and a method for continuously reproducing the multiplexed data by freely and easily combining reproduction times of the multiplexed data.

[0005]

According to the present invention, at least one of a data file in which an image signal is recorded, a data file in which an audio signal is recorded, and a data file in which an image signal and an audio signal are multiplex-recorded is provided. Storage means for holding one and a data file in which the image signal is recorded, a data file in which an audio signal is recorded, a data file in which an image signal and an audio signal are multiplex-recorded, and information on the reproduction, A reproducing unit for reproducing an image signal and an audio signal of the data file held in the storage unit, and according to the information on the reproduction, a data file recording the image signal, a data file recording an audio signal, By playing back a data file in which an image signal and an audio signal are multiplex-recorded, the image signal and the audio signal are reproduced. It is intended to easily and successively reproduced by synchronizing.

The present invention further provides a data file for storing additional information, and synthesizes the data file with an image and a sound to be reproduced synchronously.

Further, according to the present invention, synchronous reproduction of an image and a sound can be controlled more finely by describing the reproduction time of the image and the sound to be reproduced in the information relating to the reproduction.

[0008]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The first invention of the present invention relates to a data file in which at least an image signal is recorded, a data file in which an audio signal is recorded, or a data file in which an image signal and an audio signal are multiplex-recorded, A storage unit for storing information relating to reproduction of the file and an additional information file storing information to be added to the data file;
Information indicating the file names of the one or more data files and information indicating the file names of the one or more additional information files are described.

A second invention of the present invention relates to a data file in which at least an image signal is recorded, a data file in which an audio signal is recorded, or a data file in which an image signal and an audio signal are multiplexed, and Holding information relating to reproduction and an additional information file storing information added to the data file, wherein the information relating to reproduction includes information indicating a file name of one or more data files to be reproduced; The method is characterized in that information indicating file names of one or more of the additional information files is described.

In a third aspect of the present invention based on the first aspect, the additional information file is a data file recording an image signal, a data file recording an audio signal, or a multiplex recording of an image signal and an audio signal. The data is combined with one of the data files.

According to a fourth aspect of the present invention, in the first aspect, the additional information file is a data file recording an image signal, a data file recording an audio signal, or a multiplex recording of an image signal and an audio signal. The data file is any one of an image, a sound, and a text to be synthesized with the data file.

A fifth aspect of the present invention is a data processing system, comprising: at least one of a data file in which an image signal is recorded, a data file in which an audio signal is recorded, or a data file in which an image signal and an audio signal are multiplexed, and Storage means for holding information relating to reproduction, wherein the information relating to reproduction includes information indicating a file name of one or more of the data files to be reproduced and information indicating a reproduction time of the data file. It is characterized by that.

[0013] A sixth invention of the present invention relates to a data file in which at least an image signal is recorded, a data file in which an audio signal is recorded, or a data file in which an image signal and an audio signal are multiplex-recorded, Information relating to reproduction, wherein the information relating to reproduction includes information indicating a file name of one or more data files to be reproduced and information indicating a reproduction time of the data file. Is the way.

Further, the seventh invention of the present invention provides the above-mentioned first,
The invention according to the fifth aspect is characterized in that the information relating to reproduction includes information indicating an order in which the data files stored in the storage means are reproduced.

The eighth invention of the present invention is directed to the second invention,
6. The method according to claim 6, wherein the information on reproduction includes information indicating an order in which the held data files are reproduced.

According to a ninth aspect of the present invention, in the fifth aspect, the information on reproduction includes information indicating a time for reproducing each data file held in the storage means. It is assumed that.

The tenth invention of the present invention is directed to the sixth invention.
According to the invention, the information on reproduction includes information indicating a time for reproducing each held data file.

The eleventh invention of the present invention is directed to the fifth invention.
In the invention, the information relating to reproduction includes information indicating a time at which each data file held in the storage means is reproduced.

The twelfth invention of the present invention is directed to the sixth invention.
In the invention, the information relating to reproduction includes information indicating a time at which each held data file is reproduced.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(Embodiment 1) FIG. 1 is a block diagram showing a configuration of an image and audio reproducing apparatus according to Embodiment 1 of the present invention. In FIG. 1, reference numeral 101 denotes a memory unit which stores image and audio digital data obtained (encoded) by a device such as a digital still camera, a digital video camera, and a scanner. Memory means 101
May be a means fixed to a device such as a hard disk drive or a removable means such as a flash memory card. The image file 102 is stored in the memory unit 10
1, the audio data file 103 is an audio data file, and the image / audio multiplex file 104 is an image data and audio data file 1
These files are multiplexed and stored in one file. The automatic playback control file 105 is a file that stores playback data and information indicating a playback order when the image file 102, the audio file 103, and the image / audio multiplex file 104 are continuously played back in combination.
However, in FIG.
02, audio file 103, image / audio multiplex file 1
04, only one automatic reproduction control file 105 is shown, but the present invention is not limited to this, and a plurality of files may actually exist in some cases. In addition, the image file 102, the audio file 103, the image /
All of the audio multiplex files 104 must be stored in the memory means 10
For example, the image file 102 may not be recorded in the memory unit 101.

The reading means 106 comprises a memory means 101
The writing means 107 is a means for writing the automatic reproduction control file 105 to the memory means 101.
The decoder 108 is a means for decoding and reproducing the image file 102, the audio file 103, and the image / audio multiplex file 104 read from the memory unit 101.
At this time, the image signal and the audio signal output from the decoder 108 based on the information of the automatic reproduction control file 105 are
A means for controlling decoding by the decoder 108 so as to have a predetermined synchronization relationship according to the information of the automatic reproduction control file 105 is a synchronization control means 109. CPU (central proc
essing unit) 110 generates an automatic playback control file 105 in response to an input from the operation keys 111, controls the reading unit 106 and the synchronization control unit 109 based on information in the automatic playback control file 105, , And decoding and reproduction of the read file by the decoder 108 are controlled.

The display means 112 includes a liquid crystal display or a CRT (ca) for displaying an image signal decoded by the decoder 108.
This is a display device such as a thode ray tube, and a speaker 113 is means for reproducing the audio signal decoded by the decoder 108.

FIG. 2 is a layout diagram of the operation surface of the image and sound reproducing apparatus.

Reference numerals 201 to 209 denote various keys constituting the operation keys 111 shown in FIG. 1, and key input signals are sent to the CPU 110 shown in FIG. The main functions of each are as follows.

Reference numeral 201 denotes an image file reproduction mode selection key.
In the reproduction mode of the above image file, the CPU 110 controls the reading means 106 to read one of the image file and the image / audio multiplex file recorded in the memory means 101, and after decoding by the decoder 108, The image of the read file is displayed on the display unit 112.

Reference numeral 202 denotes an audio file reproduction mode selection key. When this key is pressed, the memory means 101
In the reproduction mode of the above audio file, the CPU 110 controls the reading means 106 to read one of the audio file and the image / audio multiplex file recorded in the memory means 101, and after decoding by the decoder 108, The sound of the file read by the speaker 113 is reproduced.

Reference numeral 203 denotes an image / audio multiplex file reproduction mode selection key. When this key is pressed, the reproduction mode of the image / audio multiplex file on the memory means 101 is set. One of the image / sound multiplex files recorded in the memory means 101 is read, and after decoding by the decoder 108, the image of the read file is displayed on the display means 112, and the sound is reproduced by the speaker 113. Is done.

Reference numeral 204 denotes a forward key, which is a key to be pressed when reproducing a file different from the currently reproduced file. Reference numeral 205 denotes a return key, which is pressed when reproducing the file reproduced immediately before. 206
Is a determination key, which is pressed when a reproduced file is selected as an object of automatic reproduction.

Reference numeral 207 denotes a grouping key. When this key is pressed, the CPU 110 assigns a group ID number to a specific file group, and writes a file name together with a specific character string in the automatic reproduction control file.

Reference numeral 208 denotes a new reproduction control file creation key. When this key is pressed, the CPU 110 controls the writing means 107 to newly create an automatic reproduction control file on the memory means 101.

Reference numeral 209 denotes an automatic reproduction key. When this key is pressed, the CPU 110 controls the reading means 106 and the synchronization control means 109 based on the information of the automatic reproduction control file 105, And read it out automatically.

Incidentally, reference numerals 112 and 113 shown in FIG.
And the speaker 113 shown in FIG.

FIG. 3 is a schematic diagram showing an image file, an audio file, and an image / audio multiplex file stored in the memory means 101. In FIG. 3, image files A,
B and C are files in which image data is stored.
The audio files A, B, and C are files in which audio data is stored. Image / audio multiplex files A and B are files in which image and audio data are multiplexed and stored in one file. Hereinafter, the description will be made assuming that the eight files shown in FIG.

The operation of the present embodiment configured as described above will be described below.

When the user freely connects and reproduces image files, audio files, and image / audio multiplex files recorded on the memory means 101, first,
The automatic playback control file 105 is generated by the following procedure.

First, among the eight files shown in FIG. 3, the user plays back the image file B and the image portion of the image / sound multiplex file A continuously in this order. A case will be described in which A and the audio portion of the image / audio multiplex file B are continuously reproduced in this order, and the reproduction of the audio file A is desired to be performed in synchronization with the reproduction start of the image file B.

First, the user presses a new reproduction control file creation key 208. In response to this key input, the editing of the automatic reproduction control file is newly started, and the CPU 11
0 controls the writing means 107 and creates a file having a file name, for example, "AUTOPLY1" on the memory means 101.

Next, the user depresses the image file reproduction mode selection key 201 to select an image to be automatically reproduced, and causes the display means 112 to reproduce and display the image file on the memory means 101. At this time, for example, the display unit 1
12, the image file A is reproduced, and the display image is changed by the feed key 204 to display the image file B, the image file C, the image portion of the image / audio multiplex file A, and the image portion of the image / audio multiplex file B. It is displayed on the means 112 sequentially. Then, when the user wants to successively reproduce the image file B and the image portion of the image / audio multiplex file A in this order, the user operates the forward key 204 or the return key 205 to select the first image file B to be reproduced. It is displayed on the display unit 112. Then, the enter key 206 is pressed. The CPU 110 has a temporary memory for temporarily storing information therein, and when the enter key 206 is pressed in the temporary memory, it is specified that the user has selected this file as an image to be reproduced in the image file reproduction mode. The file name of the image file B is recorded following the character string “IMG_SRC =”. Next, the image of the image / audio multiplex file A is displayed by the feed key 204 or the return key 205. Then, the enter key 206 is pressed again. As a result, the file name of the image / audio multiplex file A is recorded in the temporary memory in the CPU 110 following the character string “IMG_SRC =”. According to the above procedure, the image file B and the image / audio multiplex file A are selected, and the file names of the image file B and the character string "IMG_SRC =" are displayed in the order of reproduction in the CPU 110.
Is recorded within.

Next, the audio file reproduction mode selection key 202 is pressed to select the audio to be automatically reproduced, and the audio file on the memory means 101 is reproduced by the speaker 113. At this time, for example, the audio file A is reproduced on the speaker 113, and the audio file B, the audio file C,
The audio part of the image / audio multiplex file A and the audio part of the image / audio multiplex file B are sequentially reproduced by the speaker 113. When the user wants to continuously play the audio file A and the audio portion of the image / audio multiplex file B in this order, the user operates the feed key 204 or the return key 205 to switch the audio file A to be played first to the speaker. Reproduce at 113. Then, the enter key 206 is pressed. As a result, in the temporary memory in the CPU 110, a character string "SND_SRC =" indicating that the user has selected this file as the sound to be reproduced in the sound file reproduction mode, followed by the sound file A
Is recorded. Next, the audio portion of the image / audio multiplex file B is reproduced by the send key 204 or the return key 205. Then, the enter key 206 is pressed again. As a result, the file name of the image / audio multiplex file B is recorded in the temporary memory in the CPU 110 following the character string “SND_SRC =”. According to the above procedure, the audio file A and the image / audio multiplex file B are selected, and their file names are set to "SND_SRC
= ”Is recorded in the CPU 110 together with the character string“ = ”.

When the grouping key 207 is pressed next in this state, the CPU 110 sets the two image files B and the image / audio multiplex file A and the audio file A and the image / audio multiplex file B selected as one group. Recognized ID number unique to the group (for example, 001)
And the writing means 107 is controlled to control the memory means 1
Then, the ID number unique to the group and the contents stored in the temporary memory of the CPU 110 are written in the automatic reproduction control file “AUTOPLY1” on No. 01. FIG. 4 shows the contents of the written automatic reproduction control file "AUTOPLY1". "GI shown in FIG.
"D" is the ID number of the group, which is set to 001 in the example of Fig. 4. "IMG_SRC" is the image file or image /
This is a character string indicating the image portion of the audio multiplex file, which clearly indicates that the image portion of the image file B and the image portion of the image / audio multiplex file A are the images selected by the user to be reproduced. "SND_SRC" is a character string indicating the audio part of the audio file or the image / audio multiplex file, and the audio parts of the audio file A and the image / audio multiplex file B are reproduced when the user selects the reproduction. It clearly indicates that the sound should be. In particular, with respect to an image / audio multiplex file, the image portion and the audio portion can be separately specified by the character strings “IMG_SRC” and “SND_SRC”, and an image / audio multiplex file is composed of only image data. It is assumed that it can be handled like an image file or an audio file including only audio data.

[0042] Of the files indicated by "IMG_SRC" and "SND_SRC", the file with the smaller number of lines is the file to be reproduced earlier in time.

The procedure for generating the automatic reproduction control file 105 has been described above. Next, reproduction of a file based on the automatic reproduction control file 105 shown in FIG. 4 will be described.

When the user presses the automatic reproduction key 209, the CPU 110 controls the reading means 106, reads the automatic reproduction control file 105, and acquires its contents. The CPU 110 stores the first
The GID is searched from the line, and the group from the first "GID" to the next "GID" is recognized as one group. Note that the last group in the automatic playback control file 105 is the last GI
From D to the last line of the file. Therefore, in the present embodiment, there is one group, and the group from the first GID to the last line of the automatic reproduction control file 105 is one group.

In the automatic reproduction control file 105, file names are described in the order of reproduction. The image part of the image file or the image / audio multiplex file is specified by the character string “IMG_SRC”, and the sound part of the audio file or the image / audio multiplex file is specified by the character string “SND_SRC” Therefore, the CPU 110 determines from these character strings whether the target file is related to image playback or audio playback. As a result, as for the image, the image file B and the image portion of the image / audio multiplex file A are arranged in this order.
The data is read from the memory unit 101, decoded, and reproduced. At this time, from the description on the first line of the automatic playback control file 105, it is determined that these file groups are one group to which a group ID has been assigned, and the first image file among the image files included in the group is determined. The decoding of the decoder 108 is controlled by the synchronization control means 109 so that the reproduction start of the reproduced image file B and the reproduction start of the audio file A reproduced first among the audio files included in the same group are synchronized. I do.

Specifically, the CPU 110 sends information indicating images and sounds to be reproduced synchronously to the synchronization control means 109.
The decoder 108 internally has a temporary memory for temporarily storing the decrypted result. The decoder 108 decrypts the file read from the memory unit 101 and temporarily writes the decrypted file to the temporary memory. This is a measure for compensating for the difference in the time required for decoding depending on the file. The synchronization control means 109 monitors the progress of the decoding of the image and audio to be reproduced synchronously, and when the decoding is completed to a point where the image and the audio can be output simultaneously, the image and the audio stored in the temporary memory are deleted. Output at the same time.
Thus, the reproduction of the image and the sound is synchronized.

FIG. 5 is a flowchart showing a flow of reproducing a series of these files. In FIG. 5, step 501 is waiting for an input from the automatic reproduction key 209, and when the automatic reproduction key 209 is pressed, the process proceeds to step 502. In step 502, the CPU 110 controls the reading means 106 to
5 is read from the memory means 101. In step 503, the CPU 110 determines whether the read automatic reproduction control file
5 to search for a group ID number and detect a group. Further, in step 504, a file name designated by a character string "IMG_SRC" indicating an image is detected for each detected group, and similarly, in step 505, a character string "S" indicating sound is detected.
The file name specified by "ND_SRC" is detected. Then, in step 506, the file is read from the memory means 101, the decoding is performed by the decoder 108, and the image and sound are synchronously reproduced by the synchronization control means 109 as described above. Control.

FIG. 6 schematically shows such a state of reproducing an image and a sound, and the user can reproduce the image and the sound as specified by the user.

As described above, according to the present embodiment, an image file and an audio file whose playback start is to be synchronized are
As shown in FIG. 4, they are described in a grouped form in the automatic reproduction control file 105, and the automatic reproduction control file 10
5 so that the start of reproduction of the first image file among the image files included in the group is synchronized with the start of reproduction of the first audio file among the audio files included in the same group. 101
By controlling the reading of files from and the decoding by the decoder 108, the user can freely and easily combine image data, audio data, and data obtained by multiplexing images and audio, and Playback can be started in synchronization.

(Embodiment 2) In Embodiment 1 of the present invention, a configuration in which one group made up of a plurality of files is described in the automatic reproduction control file 105 has been described, but in this case, it is included in the group. Only the synchronization of the image and the sound at the start of the reproduction of the file group can be realized. However, there may be a case where it is desired to reproduce the image and the sound in more detail in synchronization. An embodiment that assumes such a case will be described below.

For example, of the files shown in FIG. 3, the image file A and the image file B are reproduced in this order. At this time, the reproduction start of the image file A and the audio file B is synchronized, and the image file B is further reproduced. When it is desired to synchronize the reproduction start of the audio part of the image / audio multiplex file B with the automatic reproduction control file 105, the following procedure is first performed.

First, the user presses the new reproduction control file creation key 208 as in the first embodiment. As a result, a file having a file name “AUTOPLY2” is created on the memory unit 101, for example.

Next, the user depresses the image file reproduction mode selection key 201 to select an image to be automatically reproduced, reproduces and displays the image file on the memory means 101 on the display means 112, and displays the image file with the forward key 204. The image file A is displayed by changing the image. Then, the enter key 206 is pressed. As a result, the file name of the image file A is recorded in the temporary memory in the CPU 110, following the character string "IMG_SRC =". Next, an audio file reproduction mode selection key 202 is pressed to select an audio to be automatically reproduced, the audio file on the memory means 101 is reproduced by the speaker 113, and the reproduction audio is changed by the send key 204 to change the audio file B. To play. Then, the enter key 206 is pressed. As a result, in the temporary memory in the CPU 110, following the character string "SND_SRC =",
The file name of the audio file B is recorded.

When the grouping key 207 is pressed next in this state, the CPU 110 recognizes the selected image file A and audio file B as one group, assigns a unique ID number (for example, 001) to the group, and The CPU 107 controls the automatic reproduction control file "AUTOPLY2" on the memory means 101 to store the group-specific ID number and the CPU.
The contents stored in the temporary memory of 110 are written.

Next, in the same manner as described above, the audio portions of the image file B and the image / audio multiplex file B are reproduced and selected, and the grouping key 207 is pressed. Accordingly, the CPU 110 recognizes the image file B and the audio portion of the image / audio multiplex file B as one group, assigns a unique ID number (for example, 002) to the group, controls the writing unit 107, and controls the memory unit 101. The ID number unique to the group and the contents stored in the temporary memory of the CPU 110 are additionally written into the above automatic reproduction control file "AUTOPLY2". FIG. 7 shows the contents of the created automatic playback control file "AUTOPLY2". “GID” shown in FIG. 7 is the ID number of the group, and in the example of FIG.
Each group has a different number. As in FIG. 4, "IMG_SRC" is a character string indicating an image part of an image file or an image / audio multiplex file, and "SND_SRC" is a character string indicating an audio part of an audio file or an image / audio multiplex file. . The file group having the GID with the smaller number of lines is the file group to be reproduced first.

The procedure for generating the automatic reproduction control file 105 has been described above. Next, reproduction of a file based on the automatic reproduction control file 105 shown in FIG. 7 will be described.

When the user presses the automatic reproduction key 209, the CPU 110 controls the reading means 106, reads the automatic reproduction control file 105, and acquires the contents. The CPU 110 stores the first
The GID is searched from the line, and the group from the first "GID" to the next "GID" is recognized as one group. Note that the last group in the automatic playback control file 105 is the last GI
From D to the last line of the file. From the description of the automatic reproduction control file 105, the image file A and the audio file B are recognized as one group, and the audio portion of the image file B and the image / audio multiplex file B are recognized as one group. For the image, the file is read out from the memory means 101 in the order of the image file A and the image file B, and for the sound, the file is read out from the memory means 101 in the order of the sound file B and the sound portion of the image / sound multiplex file B, decoded and reproduced. At that time, the image file A and the audio file B
Is one group, and the image file B and the audio portion of the image / audio multiplex file B are one group. Therefore, the reproduction start of the image file A and the reproduction start of the audio file B are synchronized, and the reproduction start of the image file B is synchronized with the reproduction start of the image file B. The decoding by the decoder 108 is controlled by the synchronization control means 109 so that the reproduction start of the audio part of the image / audio multiplex file B is synchronized. The flowchart for playing back a series of these files is as follows:
This is the same as FIG. 5 shown in the first embodiment of the present invention. FIG. 8 schematically shows the state of reproduction of such an image and a sound, and the user can reproduce the image and the sound as specified by the user.

As described above, according to the second embodiment of the present invention, a plurality of groups each consisting of a plurality of files are placed in one automatic reproduction control file, thereby synchronizing image and audio reproduction. The user can freely and easily combine image data, audio data, and data obtained by multiplexing the image and the sound, and start the reproduction of the image and the sound in a synchronized manner.

(Embodiment 3) In Embodiments 1 and 2 of the present invention, a group ID number is assigned to a plurality of files in the automatic reproduction control file 105, and the plurality of files are regarded as one group. Although the description has been given of the configuration for performing the synchronous reproduction of the image and the audio, in these examples, the image / audio multiplex file is described on the automatic reproduction control file 105 in a form divided into the image part and the audio part. However, an image / audio multiplex file acquired by a digital still camera or a digital video camera is originally considered to be a file in which audio is acquired simultaneously with image acquisition.
It can be said that the file is recorded on the assumption that the image and the sound are synchronized. Therefore, when a file of such a property is played, it is necessary to describe the file in the automatic playback control file in a form divided into an image part and an audio part.
It is cumbersome for the user and can cause confusion.

Therefore, an embodiment will be described in which an image / audio multiplex file is not divided into an image portion and an audio portion, but is reproduced by an automatic reproduction control file while maintaining the synchronous relationship between the image and the audio.

For example, when the user wants to continuously reproduce the image / audio multiplex file A and the image / audio multiplex file B in this order among the files shown in FIG. Generate a playback control file.

First, the user is asked to enter the first embodiment of the present invention.
Similarly, a new reproduction control file creation key 208 is pressed. Thereby, for example, "AUTOPLY3" is displayed on the memory means 101.
Is created.

Next, the user presses the image / audio multiplex file reproduction mode selection key 203 to select the image / audio multiplex file to be automatically reproduced, and
1 to reproduce the image / audio multiplex file. After the image / audio multiplex file A is reproduced by changing the file to be reproduced by the send key 204 or the return key 205, the enter key 206 is pressed. As a result, in the temporary memory in the CPU 110, the character "CMP_SRC =" is displayed in the temporary memory in the image / audio multiplex file reproduction mode to clearly indicate that the user has selected this file as a multiplexed image and audio file to be reproduced. Following the column, the file name of the image / audio multiplex file A is recorded. Similarly, the image / audio multiplex file B is reproduced, and when the enter key 206 is pressed, the file name of the image / audio multiplex file B is recorded in the temporary memory in the CPU 110 following the character string "CMP_SRC =". By the above procedure, the image / audio multiplex file A and the image / audio multiplex file B are selected, and their file names are stored in the CPU 110 in the order in which they are to be reproduced, along with a character string "CMP_SRC =".

In this state, when the grouping key 207 is pressed next, the CPU 110 recognizes the selected image / audio multiplex file A and image / audio multiplex file B as one group and identifies the group with an ID number unique to the group (for example, 00
1) is added, and the writing control unit 107 is controlled so that the automatic reproduction control file “AUTOPLY3” on the memory unit 101 is added to
The ID number unique to the group and the contents stored in the temporary memory of the CPU 110 are written. FIG. 9 shows the contents of the written automatic reproduction control file "AUTOPLY3". “GID” shown in FIG. 9 is a group ID number, and “CMP_SRC” is a character string indicating an image / audio multiplex file, whereby the image / audio multiplex files A and B are selected and reproduced by the user. It clearly indicates that it should be image and audio data. A file group having a GID with a smaller number of lines is a file group to be reproduced first.

The procedure for generating the automatic reproduction control file 105 has been described above. Next, reproduction of a file based on the automatic reproduction control file 105 shown in FIG. 9 will be described.

When the user presses the automatic reproduction key 209, the CPU 110 controls the reading means 106, reads the automatic reproduction control file 105, and acquires the contents. In the automatic reproduction control file 105, file names are described in the order of reproduction. Since the image / audio multiplex file is specified by the character string “CMP_SRC”, it is determined from the character string that the target file is recorded by multiplexing the image and the audio. As a result, the image / audio multiplex file A and the image / audio multiplex file B are read from the memory unit 101 and decoded, and the image and the audio are reproduced synchronously.

Specifically, CPU 110 sends information indicating a file to be synchronously reproduced to synchronization control means 109.
The decoder 108 internally has a temporary memory for temporarily storing the decrypted result. The decoder 108 decrypts the file read from the memory unit 101 and temporarily writes the decrypted file to the temporary memory. This is a measure for compensating for the time difference in the decoding time between the image part and the audio part in the image / audio multiplex file. The synchronization control means 109 monitors the progress of the decoding of the image and the sound to be reproduced, and simultaneously outputs the image and the sound stored in the temporary memory when the decoding is completed to a point where the image and the sound can be output simultaneously. Let it. Thus, the reproduction of the image and the sound is synchronized.

FIG. 10 is a flowchart showing a flow of reproducing a series of these files. In FIG. 10, steps 501 to 503 are the same as those in FIG. Step 1001 is a step of detecting a file name specified by a character string “CMP_SRC” indicating an image for each detected group. And step 10
In 02, the CPU 110 reads the specified image / audio multiplex file from the memory unit 101, controls decoding by the decoder 108, and controls synchronous reproduction of the image and audio by the synchronization control unit 109.

FIG. 11 schematically shows the state of the reproduction of the image and the sound, and the user can reproduce the image and the sound as specified by the user.

As described above, according to the third embodiment of the present invention, the data in which the image and the sound are multiplexed is not divided into the image part and the sound part, and the synchronous relation between the image and the sound is maintained. In format, the user can freely and easily combine and play back the images and sounds in synchronization.

(Embodiment 4) In Embodiment 3 of the present invention, an example has been described in which a group consisting only of image / audio multiplex files is described in the automatic reproduction control file 105 to perform automatic reproduction. Will be described with reference to an embodiment in which automatic reproduction is performed including image files and audio files.

For example, of the files shown in FIG. 3, the user plays back the image file B, the image / audio multiplex file B, and the image file C in this order. To synchronize the reproduction start, synchronize the audio part of the image / audio multiplex file B with the image part of the same file, and synchronize the reproduction start of the image file C and the audio part of the image / audio multiplex file A with the following: According to such a procedure, first, an automatic reproduction control file is generated.

First, the user is asked to enter the first embodiment of the present invention.
Similarly, a new reproduction control file creation key 208 is pressed. Thereby, for example, "AUTOPLY4" is displayed on the memory means 101.
Is created.

Next, the user presses the image file reproduction mode selection key 201 to select an image to be automatically reproduced, reproduces and displays the image file on the memory means 101 on the display means 112, and displays the image file with the forward key 204. The image file B is displayed by changing the image. Then, the enter key 206 is pressed. As a result, in the temporary memory in the CPU 110, a character string “IMG_SRC =” indicating that the user has selected this file as an image to be reproduced in the reproduction mode of the image file, followed by the file name of the image file B Is recorded. Next, an audio file playback mode selection key 2 is used to select audio to be automatically played.
02 is pressed, the audio file on the memory means 101 is reproduced by the speaker 113, and the reproduction sound is changed by the feed key 204 to reproduce the audio file A. Then, the enter key 206 is pressed. As a result, in the temporary memory in the CPU 110, a character string "SND_SRC =" for specifying that the user has selected this file as the sound to be reproduced in the sound file reproduction mode, followed by the file name of the sound file A Is recorded.

When the grouping key 207 is pressed next in this state, the CPU 110 recognizes the selected image file B and audio file A as one group, assigns a unique ID number (for example, 001) to the group, and The CPU 107 controls the automatic reproduction control file "AUTOPLY4" on the memory means 101 to store the group-specific ID number and the CPU.
The contents stored in the temporary memory of 110 are written.

Next, the image / audio multiplex file reproduction mode selection key 203 is pressed to select the image / audio multiplex file to be automatically reproduced, and the image / audio multiplex file on the memory means 101 is reproduced. After the image / audio multiplex file B is reproduced by changing the display image using the send key 204 or the return key 205, the enter key 206 is pressed. As a result, a character string "CMP_SRC =" in the temporary memory in the CPU 110 is displayed in the temporary memory in the image / audio multiplex file reproduction mode to clearly indicate that the user has selected this file as a file in which the image and audio to be reproduced are multiplexed. Then, the file name of the image / audio multiplex file B is recorded.

When the grouping key 207 is pressed next in this state, the CPU 110 recognizes the selected image / audio multiplex file B as one group, assigns a unique ID number (eg, 002) to the group, and
7 and the automatic reproduction control file "AUTOPLY4" on the memory means 101 and the CPU 110
The content stored in the temporary memory is additionally written.

Next, the image file reproduction mode selection key 201 is pressed again to select an image to be automatically reproduced, and the image file on the memory means 101 is displayed on the display means 11.
2 and display the image file C by changing the display image with the feed key 204. And enter key 20
Press 6. Thus, the file name of the image file C is recorded in the temporary memory in the CPU 110, following the character string “IMG_SRC =”. Next, the audio file reproduction mode selection key 202 is pressed again to select the audio to be automatically reproduced, the audio file on the memory means 101 is reproduced by the speaker 113, and the reproduction audio is changed by the feed key 204 to change the image / image. The audio portion of the audio multiplex file A is reproduced. Then, the enter key 206 is pressed. As a result, the file name of the image / audio multiplex file A is recorded in the temporary memory in the CPU 110 following the character string “SND_SRC =”.

When the grouping key 207 is pressed next in this state, the CPU 110 recognizes the selected image file C and the audio portion of the image / audio multiplex file A as one group, and an ID number unique to the group (for example, 003).
And the writing means 107 is controlled to control the memory means 1
Further, the ID number unique to the group and the contents stored in the temporary memory of the CPU 110 are additionally written into the automatic reproduction control file "AUTOPLY4" on the file 01. FIG. 12 shows the contents of the written automatic playback control file "AUTOPLY4". "GID" shown in FIG. 12 is the ID number of the group.
In the example, different numbers are given to the three groups. As in FIG. 4, "IMG_SRC" is a character string indicating an image portion of an image file or an image / audio multiplex file, and "SND_SRC" is a character string indicating an audio portion of an audio file or an image / audio multiplex file. Also, similarly to FIG. 9, "CMP_SRC" is a character string indicating an image / audio multiplex file. And the GID of the younger row
Is a group to be played first, and within the group, among files indicated by a character string such as "IMG_SRC", a file having a small number of lines indicated by the same character string is reproduced first. .

The procedure for generating the automatic reproduction control file 105 has been described above. Next, reproduction of a file based on the automatic reproduction control file 105 shown in FIG. 12 will be described.

When the user presses the automatic reproduction key 209, the CPU 110 controls the reading means 106, reads the automatic reproduction control file 105, and acquires the contents. The CPU 110 searches for a GID from the first line of the automatic reproduction control file, and finds 1 from the first “GID” to the next “GID”.
Recognize as one group. Note that the last group in the automatic reproduction control file 105 is from the last GID to the last line of the file. Automatic playback control file 1
05, the image file B and the audio file A are 1
One group, the image / audio multiplex file B is recognized as one group, and the audio portions of the image file C and the image / audio multiplex file A are recognized as one group. Then, the image file B, the audio file A,
The audio portions of the image / audio multiplex file B, image file C, and image / audio multiplex file A are read, decoded, and reproduced. At this time, since the image file B and the audio file A are one group, the image / audio multiplex file B is one group, and the audio part of the image file C and the image / audio multiplex file A is one group, The reproduction of the file B and the reproduction of the audio file A are started in synchronization with each other. Thereafter, the image portion and the audio portion of the image / audio multiplex file B are reproduced in synchronization with each other. The decoding by the decoder 108 is controlled by the synchronization control means 109 so as to synchronize with the start of reproduction of the audio portion of the multiplex file A. FIG. 13 is a flowchart showing a flow of reproducing a series of these files.

In FIG. 13, steps 501 to 50
5 is the same as FIG. 5, and step 1001 is FIG.
The description is omitted because it is the same as. Step 1301
Is a step of reproducing a file for each detected group. As described in the first to third embodiments of the present invention, the CPU 110 reads the file from the memory unit 101, decodes the file by the decoder 108, The synchronous control means 109 controls synchronous reproduction of images and sounds.

FIG. 14 schematically shows such a state of reproducing an image and a sound, and the user can reproduce the image and the sound as specified by the user.

As described above, according to the fourth embodiment of the present invention, when an image and a sound are automatically reproduced by combining three types of files, an image file, an audio file, and an image / audio multiplex file, The user can freely and easily combine three types of files in a format that does not divide the multiplexed data and audio into an image portion and an audio portion, while maintaining the synchronous relationship between the image and the audio. Audio can be synchronized and played.

In the fourth embodiment of the present invention, when files are grouped, an image / audio multiplex file specified by a character string “CMP_SRC” and a character string “IMG_SRC”
And the file specified by "SND_SRC" are not mixed. That is, when the image / audio multiplex file specified by the character string “CMP_SRC” is placed in one group, one group is configured only by the image / audio multiplex file specified by the character string “CMP_SRC”. For example, in FIG. 12, the group whose GID is 002 includes only the image / audio multiplex file specified by the character string “CMP_SRC”. The reason for this is described below.

For example, as shown in FIG. 15, the reproduction is started by synchronizing the image file B and the audio file A, the audio file B is reproduced after the audio file A, and thereafter,
The image and sound of the image / audio multiplex file B are played back synchronously,
Finally, it is assumed that the image file C and the audio portion of the image / audio multiplex file A are to be reproduced in synchronization. In this case, the following procedure can be considered as an example of a method of creating the automatic reproduction control file as described above. First,
The editing of the automatic playback control file 105 is started by pressing the new playback control file creation key 208, and the image file B is displayed on the display means 112 by operating the image file playback mode selection key 201, the forward key 204, and the return key 205. Then, the file name is stored in the CPU 110 following the character string "IMG_SRC" by the enter key 206. Next, the image / audio multiplex file reproduction mode selection key 203, the forward key 204, and the return key 205 are operated in the same manner to reproduce the image / audio multiplex file B. Then, the character string "CMP_SRC" is changed by the enter key 206. Subsequently, the CPU 110 stores the file name. Then, the image file C is displayed again by operating the image file reproduction mode selection key 201, the forward key 204, and the return key 205.
Is displayed, and the character string "IMG_SR"
This file name is stored in the CPU 110 following C ". Thus, the file name to be reproduced is stored in the temporary memory of the CPU 110 in the order of the image file B, the image / audio multiplex file B, and the image file C.

As for the audio files, the audio file A, the audio file B, and the audio portion of the image / audio multiplex file A are sequentially reproduced in the order in which the audio files are to be reproduced.
Is operated to reproduce the audio portions of the audio file A, the audio file B, and the image / audio multiplex file A with the speaker 113, and then the enter key 206 causes the CPU 110 to store these file names following the character string "SND_SRC". . The file selected by pressing the grouping key 207 is grouped, and this is grouped with a group ID number (for example, 0
01) and write it to the automatic reproduction control file.

FIG. 16 shows the automatic reproduction control file 105 created by the above procedure. In the automatic reproduction control file 105, six files are grouped by one group ID (GID) as shown in FIG.

Next, consider a case where a plurality of files are automatically reproduced by the automatic reproduction control file 105 shown in FIG.

In the automatic reproduction control file 105 shown in FIG. 16, the image file B, the image / audio multiplex file B, and the image file C are arranged in order, and it can be determined that the images should be reproduced in this order. However, regarding the audio file, the audio file A, the audio file B, and the audio portion of the image / audio multiplex file A are reproduced in this order;
Play the audio file so that the start of playback of the first image file among the image files included in the group and the start of playback of the first audio file among the audio files included in the same group are synchronized. It can be determined that it is only necessary to synchronize the reproduction start of the image file B and the reproduction start of the audio file A. However, the audio part of the image / audio multiplex file B, the audio file B and the image / audio multiplex file The temporal positional relationship with the audio portion of A is shown in the automatic playback control file 105 in FIG.
Can not be determined from the description of. More specifically, the audio file A that needs to be synchronized with the image file B that is reproduced before the image / audio multiplex file B needs to be reproduced before the audio portion of the image / audio multiplex file B. , The audio parts of the audio file B and the image / audio multiplex file A are
16 except that it is reproduced after the audio file A.
Can not be determined from the automatic playback control file.

Therefore, if the automatic playback control file is created by the procedure described above, the audio portion of the image / audio multiplex file B, the audio file B and the image / audio
It is necessary to additionally describe information for specifying the temporal positional relationship with the audio portion of the audio multiplex file A in the automatic reproduction control file. However, in this case, the description of the automatic reproduction control file becomes complicated, and a device for automatically reproducing images and sounds based on the automatic reproduction control file also has a large burden for analyzing the automatic reproduction control file. Specifically, it becomes necessary for the playback device to have hardware or software for analyzing a more complicated automatic playback control file. In addition, the labor for creating the automatic reproduction control file is increased, and the burden is imposed on the user.

Therefore, as shown in FIG. 12 and FIG. 14, when an image / audio multiplex file is designated by a character string "CMP_SRC", The character string "CMP_SRC" without mixing the files specified by the columns "IMG_SRC" and "SND_SRC"
One group is composed of only the image / audio multiplex file specified by. That is, due to the nature of the file, such as an image / audio multiplex file, the synchronization relationship between the image and the audio is 1
If files that are completed in one file are grouped together in a single group, files of the same format can be combined into an auto-play control file together with other files that do not originally have a synchronous relationship between images and audio. The temporal positional relationship between the files is not obscured.

It is apparent from the third embodiment of the present invention that there is no problem even if a plurality of files specified by "CMP_SRC" are placed in one group.

By doing so, there is no need to add and describe information for specifying the temporal positional relationship between the audio parts of the audio file or the image / audio multiplex file to the automatic reproduction control file. By describing the simple automatic playback control file, the temporal positional relationship between the files can be clearly specified. This does not increase the load on the automatic reproduction control file analysis of the device that automatically reproduces images and sounds, and does not increase the load on the user to create the automatic reproduction control file.

As an example of an automatic reproduction control file for reproducing an image and a sound in a synchronous relationship as shown in FIG. 15, an example as shown in FIG. 17 can be considered. As shown in FIG. 17, the part indicating the reproduction of the image / audio multiplex file B is set to GID = 002, and the GID specifying another file is set.
It is clear from the above description that the temporal positional relationship between the files can be clearly defined if the file is separated.

The user mistakenly inputs the character string "CMP_SRC".
And the strings "IMG_SRC" and "SND_
It is conceivable to create an automatic playback control file in which files specified by "SRC" are mixed in the same group. In such a case, an error message or the like indicating an operation error is displayed on the display unit 112. Then, it is conceivable to guide the user to create the automatic reproduction control file correctly.

(Embodiment 5) In Embodiments 1 to 4 of the present invention, by describing a group consisting of a plurality of files in the automatic reproduction control file 105, image files, audio files, image / audio multiplexing are performed. The method of synchronizing and reproducing images and sounds by combining three types of files has been described. Next, an example will be described in which, when an image and a sound are reproduced according to the description of the automatic reproduction control file 105, information other than these is added and the reproduction is performed.

FIG. 18 is a block diagram showing a configuration of an image and sound reproducing apparatus described in the fifth embodiment of the present invention. The difference between the block diagrams of the first to fourth embodiments of the present invention shown in FIG. 1 and the block diagram shown in FIG. 18 is that, in FIG.
And decoding / synthesizing means 18
02 is newly provided.

18 are the same as those of the image and sound reproducing apparatus shown in FIG. 1 and their explanation is omitted, and only the parts different from those in FIG. 1 will be explained.

An additional information file 1801 is a file storing information added to the image file 102, the audio file 103, and the image / audio multiplex file 104.
For example, a frame image or title image to be displayed over an image,
Alternatively, text such as shooting date and time, shooting location, file name, photographer's name, contact information, comments on images, etc. indicated by character code, or shooting conditions, numerical data and symbols indicating shooting conditions, and playback over audio Special sound effects. Decoding / combining means 1802
Is an image file read from the memory means 101,
This is a means for obtaining a signal in which the audio file, the image / audio multiplex file, and the additional information file 1801 are combined. However, FIG. 18 shows only one additional information file 1801 for simplicity, but the present invention is not limited to this, and a plurality of files may actually exist in some cases.

FIG. 19 is a block diagram showing the structure of the decoding / combining means 1802. In FIG. 19, a decoder 1901 is a means for decoding the same image file, audio file, and image / audio multiplex file as the decoder 108 shown in FIG. The decoder 1902 is a similar means, but is provided for decoding the additional information file 1801. The combining means 1903
This is a means for performing a synthesizing process such as overlapping the signals decoded by the decoders 1901 and 1902, and outputting the resulting signals.

FIG. 20 is a layout diagram of the operation surface of the image and sound reproducing apparatus described in the fifth embodiment of the present invention. The difference between the arrangement diagram shown in FIG. 2 and the arrangement diagram shown in FIG. 20 is that an additional information reproduction mode selection key 2001 is newly provided in FIG.

The keys 201 to 209 are the same as those of the image and sound reproducing apparatus shown in FIG. The main functions of the additional information reproduction mode selection key 2001 are as follows. In addition, 112 and 113 of FIG. 20 are a display means and a speaker similarly to FIG.

Reference numeral 2001 denotes an additional information reproduction mode selection key. When this key is pressed, the CPU 110 controls the reading means 106 to read one of the additional information files 1801 recorded in the memory means 101, and after decoding by the decoder 1902, the additional information file is displayed. It is reproduced by means 112 or speaker 113. At this time, the signal decoded by the decoder 1902 is output through the synthesizing unit 1903.
02 is output as it is.

FIG. 21 is a schematic diagram showing the additional information file stored in the memory means 101. In FIG. 21, frame image files A and B and text files A and B
Is an additional information file that is combined with an image file to decorate the image file and add information in characters. The sound effect files A and B are additional information files for superimposing a special sound effect on the reproduced sound by being synthesized with the sound file. Hereinafter, the description will be made assuming that the six additional information files shown in FIG. 21 are recorded on the memory unit 101 together with the eight image files, audio files, and image / audio multiplex files shown in FIG. .

Regarding the fifth embodiment of the present invention configured as described above, the operation thereof will be described focusing on parts different from the first embodiment of the present invention.

The additional information file recorded on the memory means 101 can be converted into an image file, an audio file, an image /
When the reproduction is performed by adding to the audio multiplex file, the automatic reproduction control file is generated by the following procedure.

First, the user reproduces an image and a sound from the eight files shown in FIG. 3 in the same combination as in the first embodiment of the present invention. It is assumed that the text file A is combined with the image portion of the / audio multiplex file A, and the sound file A is combined with the sound effect file B for reproduction.

First, the user presses a new reproduction control file creation key 208. In response to this key input, the editing of the automatic reproduction control file is newly started, and the CPU 11
0 controls the writing means 107 and creates a file having a file name of, for example, "AUTOPLY5" on the memory means 101.

Next, as in the first embodiment of the present invention, the user presses the image file reproduction mode selection key 201 to select an image to be automatically reproduced, and
01 is displayed on the display means 112, and the image key B to be reproduced first is displayed on the display means 112 by operating the feed key 204 or the return key 205. Then, the enter key 206 is pressed. When the enter key 206 is pressed, the CPU 110 records the file name of the image file B in the internal temporary memory, following the character string “IMG_SRC =”. Next, in order to select an additional information file to be combined with the image file B, the additional information reproduction mode selection key 2001 is pressed, and the memory unit 10 is pressed.
1 to reproduce the additional information file. At this time, if the additional information file to be reproduced is a frame image file, the image is displayed on the display unit 112; if the file is a text file, the text included in the file is displayed on the display unit 112; , The sound effect of the speaker 1
Play back at 13. Then, the additional information file to be superimposed is reproduced in the same manner as when the image file is selected, and the name of the additional information file is stored in the temporary memory of the CPU 110 by pressing the enter key 206. At this time, "ADD" to specify that this is an additional information file
Following the character string “_SRC”, the file name of the frame image file B is stored.

In the same manner as described above, after selecting the image portion of the image / audio multiplex file A, the text file A is selected, and after selecting the audio file A, the sound effect file B is selected and reproduced. The image file you want,
The file name of the audio file, the image / audio multiplex file, and the file name of the additional information file are stored in the temporary memory of the CPU 110 together with the character strings described above.

When the grouping key 207 is pressed in this state, the CPU 110 recognizes the two selected image files B and the image / audio multiplex file A, and the audio file A and the image / audio multiplex file B as one group. And an ID number unique to the group (for example, 00
1) is added, and the writing means 107 is controlled to write the ID number unique to the group and the contents stored in the temporary memory of the CPU 110 in the automatic reproduction control file "AUTOPLY5" on the memory means 101 in the order of storage. In FIG.
The content of the written automatic playback control file "AUTOPLY5" is shown.

Of the files indicated by "IMG_SRC" and "SND_SRC", the file with the smaller number of lines is the file to be reproduced earlier in time, and the file specified by "ADD_SRC" is the file with the smaller number of lines. This is an additional information file that is combined with the file described in the line immediately before counting from the side.

The procedure for generating the automatic reproduction control file 105 has been described above. Next, reproduction of a file based on the automatic reproduction control file 105 shown in FIG. 22 will be described.

When the user presses the automatic reproduction key 209, the CPU 110 controls the reading means 106, reads the automatic reproduction control file 105, and acquires the contents. The CPU 110 searches for a GID from the first line of the automatic reproduction control file, and finds 1 from the first “GID” to the next “GID”.
Recognize as one group. Note that the last group in the automatic reproduction control file 105 is from the last GID to the last line of the file.

In the automatic reproduction control file, file names are described in the order of reproduction. Since the file specified by "ADD_SRC" is an additional information file, "ADD_SRC"
When reproducing the file described in the line immediately preceding “_SRC”, the additional information file is synthesized and reproduced. Specifically, the CPU 110 transmits information indicating the file to be synthesized to the synchronization control unit 109. Through the combining means 190
Send to 3. The synthesizing unit 1903 includes the decoders 1901 and 1
A signal to be combined is determined based on an instruction from the CPU 110 via the synchronization control unit 109 among the signals sent from the 902, and a combining process is performed.

As a result, when the image file B is reproduced, the frame image file B is synthesized, and the image / audio multiplex file A
The text file A is synthesized when the image portion is reproduced, and the sound effect file B is synthesized when the audio file A is reproduced. Since the synthesis of the additional information file is not instructed for the audio portion of the image / audio multiplex file B, the audio portion of the image / audio multiplex file B is reproduced as it is.

FIG. 23 is a flowchart showing the flow of reproducing a series of these files. In FIG. 23, steps 501 to 505 are the same as those in FIG. Step 2301 is a step of detecting a file name designated by a character string “ADD_SRC” indicating an additional information file for each detected group. Then, in step 2302, the CPU 110
01, read each file and additional information file designated, and decode by the decoders 1901, 1902;
The combining unit 1903 controls the combining of the image or sound and the additional information file.

FIG. 24 schematically shows the state of reproduction of such an image and a sound, as shown in FIG. 24. The user can combine the image and the sound in the form of synthesizing the additional information file as specified by the user. Can be played.

As described above, according to the fifth embodiment of the present invention, according to the description of the automatic reproduction control file 105, the three files of the image file, the audio file, and the image / audio multiplex file
When synthesizing images and sounds and combining them to play back images and sounds, it is possible to instruct the synthesis of additional information files, which allows images and sounds to be freely reproduced in a form synthesized with the additional information files. It is possible.

In Embodiment 5 of the present invention, two decoders 1901 and 1902 shown in FIG. 19 are not necessarily required, and a configuration in which one decoder is shared may be used.

Also, in the fifth embodiment of the present invention, as an example of the additional information file, a frame image file, a text file, and a sound effect file have been described. It is not limited.

Further, in Embodiment 5 of the present invention, "ADD_SRC" is used as a character string for specifying the additional information file, but these are merely examples, and the present invention is not limited to this.

(Embodiment 6) In Embodiments 1 to 4 of the present invention, by describing a group consisting of a plurality of files in the automatic playback control file 105, an image file, an audio file, and an image / audio multiplexing can be obtained. The method of synchronizing and reproducing images and sounds by combining three types of files has been described. In these, since the reproduction time of the image and the sound is not particularly mentioned, when reproducing the image and the sound in accordance with the description of the automatic reproduction control file 105, the reproduction time of each image and the sound is designated. Will be described.

FIG. 25 is a layout diagram of the operation surface of the image and sound reproducing apparatus described in the sixth embodiment of the present invention. The arrangement diagram shown in FIG. 2 is different from the arrangement diagram shown in FIG. 25 in that a reproduction time setting key 2501 and a numeric input dial 2502 are newly provided in FIG.

The keys 201 to 209 are the same as those of the image and sound reproducing apparatus shown in FIG. Playback time setting key 2501 and numeric input dial 2
The main functions of 502 are as follows.

Reference numeral 2501 denotes a reproduction time setting key. When this key is depressed, the apparatus enters a mode for setting the reproduction time of the selected file. Numeral 2502 is a dial for inputting numerical values. By rotating this dial, an arbitrary numerical value is input.

The structure of the image and sound reproducing apparatus described in the sixth embodiment of the present invention is the same as that of the block diagram shown in FIG.

The operation of the sixth embodiment of the present invention configured as described above will be described focusing on parts different from the first embodiment of the present invention.

The image file, audio file, and image / audio multiplex file recorded on the memory means 101 are
When the reproduction is performed by designating the reproduction time, the automatic reproduction control file is generated by the following procedure.

First, it is assumed that the user wants to reproduce images and sounds from the eight files shown in FIG. 3 in the same combination as in the first embodiment of the present invention, and to specify respective reproduction times.

First, the user presses a new reproduction control file creation key 208. In response to this key input, the editing of the automatic reproduction control file is newly started, and the CPU 11
0 controls the writing means 107 and creates a file having a file name, for example, "AUTOPLY6" on the memory means 101.

Next, as in the first embodiment of the present invention, the user presses the image file reproduction mode selection key 201 to select an image to be automatically reproduced, and
01 is displayed on the display means 112, and the image key B to be reproduced first is displayed on the display means 112 by operating the feed key 204 or the return key 205. Then, the enter key 206 is pressed. When the enter key 206 is pressed, the CPU 110 records the file name of the image file B in the internal temporary memory, following the character string “IMG_SRC =”. Next, when a reproduction time setting key 2501 is pressed to specify the reproduction time, candidate values of the reproduction time are displayed on the display unit 112 in, for example, seconds. The candidate value may be, for example, an initial value set in advance in the device. When the user rotates the numeric input dial 2502, the candidate value of the reproduction time changes according to the rotation, and when the reproduction time reaches a desired value, the rotation of the numeric input dial is stopped. . For example, when it is desired to reproduce the image file B for 10 seconds, the numeric input dial 2502 may be rotated so that the reproduction time displayed on the display unit 112 becomes 10 seconds. Next, when the enter key 206 is pressed, the display
Are stored in the temporary memory of the CPU 110. At this time, the reproduction time is stored in seconds after the character string "PLY_DUR" for specifying that this indicates the reproduction time.

In the same manner as described above, the reproduction time is set after the image portion of the image / audio multiplex file A is selected, and the reproduction time is set after the audio file A is selected. / The playback time of the audio portion of the audio multiplex file B can be set.

After the selection of the file to be reproduced and the setting of the reproduction time are completed, pressing the grouping key 207 causes the CPU 110 to select the two selected image files B.
And an audio / video multiplex file A, and an audio file A and an audio / video multiplex file B are recognized as one group, and a unique ID number (for example, 001) is assigned to the group. The ID number unique to the group and the contents stored in the temporary memory of the CPU 110 are written in the automatic reproduction control file "AUTOPLY6" on the file 101 in the order of storage. FIG. 26 shows the contents of the written automatic reproduction control file "AUTOPLY6".

[0136] Of the files indicated by "IMG_SRC" and "SND_SRC", the file with the smaller number of lines is the file to be reproduced earlier in time. It is shown by. In the example of the automatic playback control file "AUTOPLY6" in FIG. 26, the playback time of the image file B is 10 seconds, the playback time of the image portion of the image / audio multiplex file A is 15 seconds, and the playback time of the audio file A is 20.
2 shows a case where the reproduction time of the audio portion of the image / audio multiplex file B is 5 seconds. Note that the playback time specified by "PLY_DUR" is the playback time of the file described in the immediately preceding line counting from the youngest line.

The procedure for generating the automatic reproduction control file 105 has been described above. Next, reproduction of a file based on the automatic reproduction control file 105 shown in FIG. 26 will be described.

When the user presses the automatic reproduction key 209, the CPU 110 controls the reading means 106, reads the automatic reproduction control file 105, and acquires the contents. The CPU 110 searches for a GID from the first line of the automatic reproduction control file, and finds 1 from the first “GID” to the next “GID”.
Recognize as one group. Note that the last group in the automatic reproduction control file 105 is from the last GID to the last line of the file.

In the automatic reproduction control file, file names are described in the order of reproduction. Also, since the numerical value specified by “PLY_DUR” is the playback time in seconds, “PLY_DUR”
When the file described in the line immediately before “R” is reproduced, the reproduction is performed for this reproduction time.
The PU 110 sends information indicating a file to be synchronously reproduced and information on a reproduction time to the synchronous control means 109. The synchronization control means 109 monitors the progress of the decoding of the reproduced image and audio, and stops the decoding by the decoder 108 when the decoding of the data corresponding to the specified reproduction time of the image and audio is completed. Then, decoding of the image and audio to be decoded next is started. Thus, the reproduction time of the image and the sound is controlled.

As a result, the image file B is reproduced for 10 seconds, and the image portion of the subsequent image / audio multiplex file A is 15 seconds.
Played for seconds. The reproduction of the audio file A is started in synchronization with the reproduction of the image file B, and after the reproduction for 20 seconds, the audio portion of the subsequent image / audio multiplex file B is 5
Then, the reproduction of a series of images and sounds ends.

FIG. 27 is a flowchart showing a flow of reproducing a series of these files. In FIG. 27, steps 501 to 505 are the same as those in FIG. Step 2701 is a step of detecting a numerical value designated by a character string “PLY_DUR” indicating a reproduction time of each file for each detected group. Then, in step 2702, the CPU 110
1 to read out the designated files and instruct the synchronization control means 109 on the files to be reproduced synchronously and the reproduction time. The synchronization control unit 109 controls the decoding by the decoder 108, and performs synchronous reproduction of the image and audio and control of the reproduction time.

FIG. 28 schematically shows the state of reproduction of such an image and a sound, and the user can reproduce the image and the sound for the time designated by himself / herself.

As described above, according to the sixth embodiment of the present invention, according to the description of the automatic reproduction control file 105, the three files of the image file, the audio file, and the image / audio multiplex file
When synchronizing and reproducing images and sounds by combining different types of files, the reproduction time of each file can be specified, whereby the images and sounds can be reproduced freely for the specified time.

In the sixth embodiment of the present invention, the specification of the reproduction time is described as the reproduction time of each file. However, the present invention is not limited to this. For example, the reproduction start time of the file reproduced first is specified. Is set to 0, and the reproduction time of the file is set based on the absolute time from the reproduction start time. For example, as shown in FIG. 29, when the total playback time of each file to be automatically played back is specified by a character string “PLY_TTL” and the playback start time of each file is specified by “PLY_TIM”, As described above, it is possible to set the reproduction time of the file to be reproduced for each file. In the example of FIG. 29, the total time of the automatic reproduction is specified as 25 seconds, the reproduction start time of the image file B to be reproduced first is specified as 0 second by a character string “PLY_TIM”, and then the reproduction is performed. If the reproduction start time of the image portion of the image / audio multiplex file A is specified to be 10 seconds by a character string "PLY_TIM", the file can be reproduced in the same manner as described with reference to FIGS. .

In the sixth embodiment of the present invention, when the reproduction time setting key 2501 is pressed,
Although the reproduction time candidate value displayed in 2 has been described as an initial value preset in the device, the present invention is not limited to this. For example, the candidate value is stored in each of an image file, an audio file, and an image / audio multiplex file. Time required to originally reproduce all the data (for example, 5 seconds for an image file that stores 5 seconds of moving images; 10 seconds for an audio file that stores 10 seconds of audio data) )
Is determined from the data in each file, and this is displayed on the display unit 112 first.

In Embodiment 6 of the present invention, the reproduction time is set in units of seconds. However, the present invention is not limited to this, and the present invention is effective in any unit of time.

In Embodiment 6 of the present invention, the image part of the image file and the image / audio multiplex file is
The present invention is effective in both a moving image including a plurality of frames and a still image including a single frame. When the image is a still image, the still image is continuously displayed for a designated time. Configurations are possible.

In the sixth embodiment of the present invention, when the image portion of the image file and the image / audio multiplex file is a moving image, when the file is reproduced for a designated time, the moving image is reproduced from the beginning. And a method in which the user arbitrarily sets a place where reproduction is started.
When the user arbitrarily sets a playback start location, the playback start location of the moving image is indicated by the time from the first part of the moving image, and “PLY_STR” is prepared as a character string indicating this, for example. For example, a method such as writing the character string "PLY_DUR" in the automatic reproduction control file may be considered. As an example, based on the automatic reproduction control file shown in FIG. 26, assume that the image file B is a moving image of 30 seconds, and the image file B is reproduced for 10 seconds from the position 3 seconds after the beginning. In this case, the description of the automatic reproduction control file is as shown in FIG. The character string "PLY_STR" indicates the reproduction start position of the moving image, and by specifying "3", the reproduction start position of the image file B can be specified. In the character string "PLY_STR", not only an image file but also an image portion of an image / audio multiplex file and a reproduction start position of an audio file may be designated.
If the reproduction start location is not specified by the character string "PLY_STR", for example, the reproduction may be unconditionally started from the beginning of the moving image.

In the sixth embodiment of the present invention, when the file to be reproduced is a moving image, the time specified for reproduction is stored in each of the image file and the image / audio multiplex file. If it is longer than the time required to play the image data originally, after the moving image has been played within the specified time, an image prepared by the device, such as a blue screen, may be displayed. Good. Specifically, when a reproduction of 10 seconds is instructed for a moving image of 3 seconds, an image is displayed for the first 3 seconds, and a blue screen is displayed for the remaining 7 seconds. Similarly, in the case of audio, when the time specified for reproduction is longer than the time required to originally reproduce all the audio data stored in the audio file and the image / audio multiplex file. After the reproduction of the audio within the designated time is completed, the audio prepared by the device may be reproduced in advance, or the sound may be silenced.

In the sixth embodiment of the present invention, when the file to be played back is a moving image, the time designated for playback is stored in each of the image file and the image / audio multiplex file. If the time is longer than the time required to originally reproduce the image data, the display unit 112
It is conceivable that an error message or the like is displayed on the top, and the user is guided to set a time required for originally reproducing all the image data.

Further, in the sixth embodiment of the present invention, “PLY_DUR”, “PLY_DUR”
Although “TTL”, “PLY_TIM”, and “PLY_STR” are used, these are merely examples, and the present invention is not limited to these.

In all of the embodiments of the present invention, the encoding method and the file format of the image file, the audio file, and the image / audio multiplex file are not specified in detail, but these files may be any code. Even if the file is encoded by the
It is clear that the present invention is effective for any file format. Further, whether an image file, an audio file, or an image / audio multiplex file is a compressed file or an uncompressed file,
Further, it is clear that the present invention is effective even for a file having additional information such as a header.

In all embodiments of the present invention, "IMG_SRC", "SND
_SRC "and" CMP_SRC "are used, but these are merely examples, and the present invention is not limited to these.

In all the embodiments of the present invention, a configuration in which the decoder 108 includes a digital-analog converter for converting a digital signal into an analog signal is also conceivable.

Further, in all the embodiments of the present invention, the key input of the operation key 111 is performed in the order from 201 to 2 in FIG.
Although the description has been made using the method of performing key input by pressing as shown in FIG. 08, the present invention is not limited to this, and a method of selecting a necessary operation from a touch panel displayed on a liquid crystal display device or a menu display is also available. Conceivable.

Further, in all the embodiments of the present invention, the explanation has been made as if there is only one automatic reproduction control file used in the reproduction in the memory means 101, but the present invention is not limited to this. Instead, for example, a plurality of automatic playback control files exist on the memory unit 101,
A configuration is also conceivable in which the user can arbitrarily select an automatic reproduction control file to be used for automatic reproduction from among them. In this case, for example, all the automatic playback control files on the memory means 101 are displayed on the display means 112,
Among these methods, a method is conceivable in which the user can freely select the automatic reproduction control file by key input or the like, but is not limited to this.

Further, in all the embodiments of the present invention, the automatic reproduction control file is described to be recorded on the memory means 101. However, the present invention is not limited to this. For example, the automatic reproduction control file may be stored in a storage means different from the memory means 101. It is also possible to remember.

Also, in all the embodiments of the present invention, a configuration has been described in which an image and a sound are reproduced when the automatic reproduction control file is created. However, the present invention is not limited to this. Display means 1
A method of displaying those file names on the screen 12 and selecting a file to be automatically reproduced from the file names is also conceivable.

In all of the embodiments of the present invention, a configuration has been described in which an image or sound is reproduced when an automatic reproduction control file is created. However, a configuration in which a thumbnail image is displayed for an image is also conceivable. . In addition, a configuration in which a part of the sound is reproduced, for example, only the beginning part, may be considered.

In all the embodiments of the present invention, the number of frames in the image portion of the image file and the image / audio multiplex file is not particularly mentioned.
It may be a still image of a frame or a moving image composed of a plurality of frames.

Further, in all the embodiments of the present invention, a configuration has been described in which an image and a sound are reproduced when the automatic reproduction control file is created. However, when the image is a moving image including a plurality of frames, A configuration in which only some of the images are displayed is also conceivable.

In all the embodiments of the present invention, it is needless to say that at least the processing by CPU 110 can be realized by software, and the software can be stored in a memory in advance or separately stored on a recording medium. You can give it.

[0163]

As described above, according to the present invention, files of different formats such as a data file in which an image signal is recorded, a data file in which an audio signal is recorded, and a data file in which an image signal and an audio signal are multiplexed are recorded. Thus, it is possible to realize a device that allows the user to freely and easily combine and continuously reproduce, and at that time, start reproduction of a predetermined image and sound in synchronization with each other.

Further, according to the present invention, it is possible to instruct the synthesizing of the additional information file when synchronizing the start of the reproduction of the predetermined image and the audio, whereby the image and the audio are synthesized with the additional information file. It is possible to play back freely in the form shown.

Further, according to the present invention, when the start of reproduction of a predetermined image and sound is executed in synchronization, the reproduction time of each file can be designated, whereby the image and sound can be freely designated. It is only possible to play.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an image and audio reproducing apparatus according to Embodiments 1 to 4 of the present invention.

FIG. 2 is a layout diagram of an operation surface of the image and sound reproducing apparatus according to the first to fourth embodiments.

FIG. 3 is a schematic diagram showing an image file, an audio file, and an image / audio multiplex file stored on a memory unit according to the first to fourth embodiments.

FIG. 4 is a diagram showing contents of an automatic reproduction control file according to the first embodiment;

FIG. 5 is a flowchart of an automatic reproduction operation according to the first embodiment.

FIG. 6 is an explanatory diagram for explaining images and sounds that are automatically reproduced in the first embodiment;

FIG. 7 is a diagram showing contents of an automatic reproduction control file according to the second embodiment.

FIG. 8 is an explanatory diagram for explaining an image and a sound to be automatically reproduced according to the second embodiment;

FIG. 9 is a diagram showing contents of an automatic reproduction control file according to the third embodiment.

FIG. 10 is a flowchart of an automatic reproduction operation according to the third embodiment.

FIG. 11 is an explanatory diagram for explaining an image and a sound to be automatically reproduced in the third embodiment.

FIG. 12 is a diagram showing contents of an automatic reproduction control file according to the fourth embodiment.

FIG. 13 is a flowchart of an automatic reproduction operation according to the fourth embodiment.

FIG. 14 is an explanatory diagram for explaining images and sounds to be automatically reproduced according to the fourth embodiment;

FIG. 15 is an explanatory diagram for describing an example of a description method in a group of files specified by a character string “CMP_SRC” in the fourth embodiment;

FIG. 16 is a diagram showing an example of an inappropriate description content of an automatic reproduction control file for describing an example of a description method in a group of files specified by a character string “CMP_SRC” in the fourth embodiment.

FIG. 17 is a diagram showing an example of an appropriate description content of an automatic reproduction control file for describing an example of a description method in a group of files designated by a character string “CMP_SRC” in the fourth embodiment.

FIG. 18 is a block diagram showing an image and audio reproducing apparatus according to the fifth embodiment.

FIG. 19 is a block diagram showing decoding / synthesizing means according to the fifth embodiment;

FIG. 20 is a layout diagram of an operation surface of the image and sound reproduction device according to the fifth embodiment.

FIG. 21 is a schematic diagram showing an additional information file stored on a memory unit according to the fifth embodiment.

FIG. 22 is a view showing contents of an automatic reproduction control file according to the fifth embodiment.

FIG. 23 is a flowchart of an automatic reproduction operation according to the fifth embodiment.

FIG. 24 is an explanatory diagram for explaining a combination of an image and a sound automatically reproduced and an additional information file in the fifth embodiment.

FIG. 25 is a layout diagram of an operation surface of the image and sound reproduction device according to the sixth embodiment.

FIG. 26 is a diagram showing contents of an automatic reproduction control file according to the sixth embodiment.

FIG. 27 is a flowchart of an automatic reproduction operation according to the sixth embodiment.

FIG. 28 is an explanatory diagram for explaining a reproduction time of an image and a sound automatically reproduced in the sixth embodiment.

FIG. 29 is a view showing another example of the automatic reproduction control file according to the sixth embodiment.

FIG. 30 is a view showing another example of the automatic reproduction control file according to the sixth embodiment.

FIG. 31 is a block diagram showing an example of an automatic playback device in a conventional example.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 101 Memory means 102 Image file 103 Audio file 104 Image / audio multiplex file 105 Automatic reproduction control file 106 Reading means 107 Writing means 108 Decoder 109 Synchronization control means 110 CPU 111 Operation keys 112 Display means 113 Speaker

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/781 H04N 5/92 H 5/92 (72) Inventor Michiharu Uematsu 1006 Odakadoma, Kazuma, Kadoma, Osaka Address F-term of Matsushita Electric Industrial Co., Ltd. (reference)

Claims (12)

[Claims] At least one of a data file in which an image signal is recorded, a data file in which an audio signal is recorded, or a data file in which an image signal and an audio signal are multiplex-recorded, information relating to reproduction of the data file, Storage means for holding an additional information file storing information to be added, wherein the information related to reproduction includes information indicating a file name of one or more data files to be reproduced, and one or more An image and sound reproducing apparatus, wherein information indicating a file name of an additional information file is described. 2. At least one of a data file in which an image signal is recorded, a data file in which an audio signal is recorded, or a data file in which an image signal and an audio signal are multiplex-recorded, information relating to reproduction of the data file, An additional information file storing information to be added, wherein the information related to reproduction includes information indicating a file name of one or more data files to be reproduced, and a file of one or more additional information files. A method for reproducing images and sounds, characterized by describing information indicating a name. 3. The additional information file is combined with one of a data file recording an image signal, a data file recording an audio signal, and a data file recording an image signal and an audio signal in a multiplexed manner. An image and sound reproducing apparatus according to claim 1. 4. The additional information file may be any of an image, a sound, and a text, which are combined with a data file recording an image signal, a data file recording an audio signal, or a data file recording a multiplexed image signal and an audio signal. 2. The image and audio reproducing apparatus according to claim 1, wherein: 5. A storage means for holding at least one of a data file in which an image signal is recorded, a data file in which an audio signal is recorded, or a data file in which an image signal and an audio signal are multiplex-recorded, and information relating to reproduction of the data file. Wherein the information relating to the reproduction includes information indicating a file name of one or more data files to be reproduced and information indicating a reproduction time of the data file. Playback device. 6. At least one of a data file in which an image signal is recorded, a data file in which an audio signal is recorded, or a data file in which an image signal and an audio signal are multiplex-recorded, and information relating to reproduction of the data file are held. A method for reproducing images and sounds, wherein information relating to reproduction includes information indicating a file name of one or more data files to be reproduced and information indicating a reproduction time of the data file. 7. The image and audio reproducing apparatus according to claim 1, wherein the information on reproduction includes information indicating an order of reproducing data files stored in the storage means. 8. The image and audio reproducing method according to claim 2, wherein the information on reproduction includes information indicating an order of reproducing the held data files. 9. The image and audio reproducing apparatus according to claim 5, wherein the information relating to reproduction includes information indicating a time for reproducing each data file held in the storage means. 10. The image and sound reproducing method according to claim 6, wherein the information relating to reproduction includes information indicating a time for reproducing each of the held data files. 11. The image and audio reproducing apparatus according to claim 5, wherein the information relating to reproduction includes information indicating a time at which each data file held in the storage means is reproduced. 12. The image and audio reproducing method according to claim 6, wherein the information relating to reproduction includes information indicating a time at which each held data file is reproduced.