JPH0779399A - Multi-medium data recording and reproducing device - Google Patents

Abstract

PURPOSE:To attain consecutive reproduction/consecutive branch reproduction of a picture and an audio signal smoothly by generating a multi-medium data stream having an interactive story branch independently of number of story branch points. CONSTITUTION:A generator 100 generating a data stream 110 by using plural data files, file link information 106 and story branch information is provided with a file arrangement order decision means 101, a means generating each file program search data (pre-load file) and a means linking the data file and the pre-load file. Furthermore, a means reproducing the data stream has a branch destination decision input means, a branch source file storage means and a pre-load file storage means of a branch destination and a pre-load file of a branch object is loaded to a pre-load file storage means during display of a branch source picture and the relevant pre-load file is displayed while the branch destination file is accessed after the branch destination is decided.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia data recording / reproducing system for recording at least a moving image by recording on a recording medium, and reading and reproducing from the recording medium, and an apparatus thereof. Specifically, when these moving picture files are continuously read while being read from a recording medium in which a plurality of compressed moving picture files are recorded, a plurality of predetermined moving picture files are branched by a branch command at a reproduction point. Achieves selective branch playback to stories, and plays individual video files independently as before.
The present invention relates to a multimedia data recording / reproducing system and its device that can be smoothly displayed.

[0002]

2. Description of the Related Art CDs (Compact Discs) developed as recording media for digital audio have a large storage capacity and are used as external storage media for personal computers and the like. These are called CD-ROMs. There is. Since the CD-ROM has a large capacity, image data such as moving images and still images, audio data such as music and sound effects, and reproduction control data that describes procedures for reproducing the image data and audio data, etc. Recently, the use of a so-called multimedia software as a recording medium, in which all the data are collectively recorded and the image data and the audio data are reproduced according to the reproduction control data and a user's instruction, has been particularly noticed. In the field of home-use game consoles, game software (hereafter, game software)
With the increasing complexity and scale of CD-ROM, CD-ROMs have begun to be used. In game software, the effect of images is great in order to make the user feel more realistic. In general, visual effects are stronger in moving images than in still images. For these reasons, the importance of moving images in game software is increasing. However, since the CD-ROM was originally developed for audio, the transfer speed is insufficient for applications that need to transfer enormous amounts of data such as moving images at once. In order to solve this problem, a compressed image in which the absolute amount of data is reduced by compressing the moving image data is prepared and recorded on a recording medium.
Techniques have been developed to display moving images by restoring this compressed image when playing back the image. By using this technology, it has become possible to reproduce moving images even when using a recording medium having a relatively low data transfer rate such as a CD-ROM. In addition, by developing the above technology, it is possible to record compressed image data and compressed audio data in a CD-ROM, and reproduce the image data so that the audio can be reproduced without interruption. It is disclosed in Kaihei 5-28652. With the development of such technology, game software is also diversifying. An example of diversification is the emergence of game software with a story, which is generally called a role-playing game. In this role-playing game, many story developments are prepared in advance. The development of the story is often determined by some condition accumulated by the user's selection and the progress of the game.
Actually, some branch points are provided in the story, and the story branches according to the above conditions at this branch point. The images are also reproduced in accordance with different stories. Also, depending on the story development, the image once displayed may be used again.
FIG. 8 is a diagram for explaining the concept of such linked display of moving images. For example, assume that image branching is set as shown in FIG. Here, A, B, C, ..., F are names of moving image files to be displayed. That is, in this example, after the moving image file A is displayed, any of the moving image files B, C, and D is displayed. FIG. 8 (2) shows an example of story development when there is a linked display setting like (1). In the moving image file A, a scene in which a hero running on a road encounters a cliff is displayed, and the user takes some workaround for the hero on the screen. In the case of this example, three branch conditions are set, and when the main character jumps (that is, when the user operates so that the main character jumps:
The story branches so that the moving image file B is displayed in (same below), the moving image file C is displayed when nothing is done, and the moving image file D is displayed when dashing.
Conventionally, such branching of moving images is performed as follows. FIG. 9 is a diagram for explaining a conventional moving image concatenated reproduction method. Here, it is assumed that the moving image files required for reproduction are collected into a single file in a unit of several seconds to several tens of seconds in display time and recorded in advance on the CD-ROM. In addition, it is assumed that all devices necessary for playing back moving images are available. When there is a connection setting as shown in FIG. 9 (1), the moving image A is first read from the CD-ROM and displayed. In the recording area of the moving image A on the CD-ROM, together with the data of the moving image A, information indicating the recording positions of the moving image files B, C, and D that are candidates for the branch destination is recorded. FIG. 9 (2) shows the control contents executed by the moving image reproducing apparatus. That is, a branching condition for determining the image to be reproduced next occurs during the period (several seconds to several tens of seconds) during which the moving image A is displayed due to the user's action. When the image to be displayed next is determined by the branching condition, the moving image A first
The seek and read of the branch destination moving image data is executed according to the recording position information of the branch destination candidate that has been read together with the data of. Ideally, it is desirable that the determination of the branch destination and the reading of the branch destination moving image data be performed within the display period of the moving image A, as in the example in which the moving image display in FIG. The operation of reading out the next image within the display period of a certain image will be referred to as the preload operation hereinafter). If the preload operation is moving image A
If it does not end within the display period of, the image display is stopped until the preload operation is completed and the display of the branch destination moving image is started, or the last frame of the moving image A is continuously displayed ( (See the example in which the moving image display in FIG. 9 (2) is interrupted). In other words, in the above example, one of the following conditions must be satisfied as a condition for continuously displaying moving images. That is, (a) the display period of the moving image A is sufficiently long. (B) The decision of the branch destination is made within the display period of the moving image A and at a sufficiently early stage. It can be seen that what is done within the display period of is a necessary condition for continuous playback of moving images. In addition, as a technique for realizing the branch display control of moving images as described above, Japanese Patent Laid-Open No. 4-33
There is an example disclosed in Japanese Patent No. 2969.

[0003]

However, in the moving image branch reproduction according to the above-mentioned conventional example, a moving image may be interrupted depending on conditions, and smooth branch reproduction cannot be performed. In addition, even when the moving images are continuous, a reading period of the branch destination image data is required until the next image is actually displayed after the branch destination is determined. If there is a request to display an image, this cannot be met. The present invention has been made to solve these problems, and an object of the present invention is to enable a moving image concatenated reproduction and also to realize a branch reproduction during the concatenated reproduction. It is to provide a creating method, a creating means for realizing the creating method, a reproducing method for the moving image stream created by the creating means, and a reproducing means for realizing the reproducing method. Another object of the present invention is to realize a file management method with high access efficiency in a recording medium used for recording and reproducing a moving image stream suitable for continuous reproduction and branch reproduction of the moving image. Here, the moving image stream refers to the entire series of moving image files recorded on the recording medium.

[0004]

In order to solve the above-mentioned problems, in the present invention, a plurality of multimedia data files, reproduction connection order information of the plurality of multimedia data files, and the plurality of multimedia data are provided. In the multimedia data recording apparatus, which comprises at least multimedia data stream forming means for forming a multimedia data stream from reproduction branch information indicating that there are a plurality of concatenation candidates for any one or more of the files, A multimedia data stream forming means for determining a concatenation order of the multimedia data files according to the reproduction concatenation order information and the reproduction branch information; and, for each of the plurality of multimedia data files, Its composition A preload file generating means for generating a preload file to be used for cueing at the time of reproduction using a part or all of the data, and the plurality of multimedia data files and the preload file generated by the preload file generating means. File concatenation means for concatenating is provided, said file concatenation means comprising: each said multimedia data file and said preload file corresponding to all said multimedia data files that may be concatenated to said multimedia data file. A multimedia data stream is formed by generating a composite file in which are combined and connecting the composite file according to the file connection order determined by the file connection order determining means and the reproduction branch information. Then, the multimedia data reproducing apparatus of the present invention stores a preload file storage means for separating and storing the preload file from the composite file loaded from the multimedia data stream, and a file in which the preload file is separated. The file storage means and the branch destination determination input means for specifying the branch destination file when a plurality of branch destination candidate files connected to the files stored in the file storage means appear. In order to achieve the other object, the multimedia data stream is provided with a file information storage area for storing information about each multimedia data file forming the multimedia data stream, and the multimedia data stream A name for independent reproduction is given to the multimedia data files that compose a stream, a file is created by removing the data corresponding to the preload portion of the multimedia data files from each multimedia data file, A name for continuous / branch playback is given to a composite file in which the preload files corresponding to all the multimedia data files that may be linked are connected, and these files are stored in the file information storage area. Register name The file registration means provided in the multimedia data recording apparatus.

[0005]

When a branch destination file is specified by the branch destination determination input means during continuous / branch playback of the multimedia data stream in the multimedia data playback device, the branch stored in the preload file storage means By playing the preload file corresponding to the destination file and loading the file with the continuous / branch playback name corresponding to the branch destination file, the playback can be continued without interruption.
In the continuous / branch playback, the multimedia playback device accesses the branch destination file by the continuous / branch playback name when a branch determination input is made during playback of any multimedia data file. In single playback, the individual playback names are used for access, so single playback can be performed smoothly. In addition, the playback device does not need to determine the content of the file (single playback or continuous playback), and only needs to access by looking at the name, which simplifies the device configuration.

[0006]

Embodiments of the present invention will be described below with reference to the drawings. First, the procedure for creating a moving image stream will be described with reference to FIGS. 1 to 4, 8 and 10. In this embodiment, a CD-ROM is taken as an example of a recording medium for the created moving image stream. FIG. 1 is a diagram showing a configuration example of a moving image stream creating apparatus to which the present invention is applied. Reference numeral 100 is a moving image stream creating apparatus main body including each of the components described later, 101 is a moving image file connection information 106 described later, and The moving image file arrangement order determining means 102 for determining the arrangement order of the moving image files based on the file size information of the moving image files accumulated in the moving image database 108 is displayed next to the moving image file being displayed. Preload image size determining means for determining a size to be preloaded for a preload operation of preloading a part or all of a power image, 1
Reference numeral 03 is a preload image generating means for generating an image having a preload size determined by the preload image size determining means 102 from a moving image file read from a moving image database 108 described later, and 104 is determined by the moving image file arrangement order determining means 101. Reproduction control information generation means 105 for generating reproduction control information 109, which will be described later, to be used when reproducing the moving image file according to the arranged arrangement information of the moving image file, 105 is determined by the moving image file arrangement order determining means 101. The preload image generation means 103 according to the arrangement order information of the moving image files.
A moving image stream generating means for generating a moving image stream 110 described later by using the preloaded image generated by the above and a moving image file accumulated in a moving image database 108 described later, and 106 is a moving image file as shown in FIG. Information relating to the connection setting of the moving image file connection information for determining the arrangement order of the moving image files by the moving image file arrangement order determining unit 101.
Reference numeral 7 denotes an access speed of the CD-ROM drive 501 shown in FIG. 5 for reproducing a moving image from a CD-ROM medium 500 shown in FIG. 5 described later, which records a moving image stream 110 described below generated by the moving image stream generation means 105. Playback device access specification information describing the specifications of the
Reference numeral 8 denotes a moving image database capable of recording a large number of moving image files in which image data used as a material of the moving image stream 110 has been compressed in advance by a data compression means (not shown).
The reproduction control information 110 is generated, the moving image stream 110 is generated by the moving image stream generation means 105, and the reproduction control information 109 and the moving image stream 1 are generated.
CD-ROM medium 50 of FIG.
It is a CD-ROM media creating means for creating 0. 2 is a diagram showing an example of the moving image file connection information 106, which is text data as shown in the example. The text contains the following three types of information. (1) Moving image file name (NodeName in FIG. 2) (2) If no branching condition occurs, moving image file name displayed next to the file in (1) (Defaul in FIG. 2
tLink) (3) Branch destination candidate file name when a branch condition occurs (InputLink in FIG. 2) Then, these three types of information are handled as one set,
This information set exists as many as the moving image files necessary to form the moving image stream. FIG. 3 is a diagram showing an example of the moving picture stream 110 created by the moving picture stream creating apparatus of FIG.
Reference numeral 300 is a part of the moving image stream 110, 301 is an enlarged portion near the boundary between the moving images A and B, and 302 and 303.
Is a preload part of the moving image B (details will be described later). Figure 4
FIG. 4 is a diagram for explaining a recording state of the moving image stream 110 created by the moving image stream creating apparatus of FIG. 1, where 400 is a part of the moving image stream 110, and 401 is a part 400 of the moving image stream, This is a part corresponding to the moving image file B. FIG. 10 is a flowchart for explaining a procedure for creating a moving image stream performed by the moving image stream creating apparatus in FIG. Note that the examples of FIGS. 2 to 4 are described so as to correspond to the example of the connection setting of the moving image files shown in FIG. The moving image file arrangement order determining unit 101 reads the moving image file connection information 106 illustrated in FIG. 2 and knows the setting of connecting and branching the moving image files. According to the example of FIG. 8, the moving image A is reproduced first, and the moving images B, C, and D are next.
You can see that it branches to either of. Therefore, the arrangement order is determined so that B, C, and D are successively arranged after the moving image A. Here, the size of each moving image file is added as information together with the determined arrangement order information (FIG. 10, process 1001). In order to smoothly perform the branch reproduction, it is necessary to preload the image of the branch destination (either B, C, or D in this example) within the display period of the moving image A. As in the example, when the display period of the moving image A is short, or when the file size of B, C, D is large, there are cases in which all of B, C, D cannot be preloaded. In order to solve this, in this embodiment, as shown in FIG.
D The head part of each is cut out and newly defined as a preloaded image, and a new moving image file is created by adding these preloaded images to the end of the moving image file A, and the moving image file A that constitutes the story is created.
Add the file name "A_IN_STORY" which means. Also,
The file name "A_SINGLE", which means that it is a single file, is attached to the data part of only the moving image file A that does not include the part of the preloaded image concatenated at the end. At the time of concatenated playback of moving images, as shown in Fig. 3 (2), "A_IN_S"
By loading “TORY”, the leading part of the branch destination candidate image can be loaded at the same time, so that the display of the branch destination image can be started even in the worst case where the branch destination is determined at the end of the display period of the moving image A. If the remaining part is accessed during the display period of the beginning part of the branch destination image, the display will not be interrupted.On the contrary, if only moving image A is to be played back, "A_SINGLE" should be loaded. The size to be cut out as the preload image is determined by the size of the moving image A and the reproduction device access specification information 107, and the preload image generation means 103 and the reproduction control information 1
04 (steps 1002 and 1003 in FIG. 10).
The preload image generation means 103 is a moving image database 1
The moving images B, C, D are read from 08, and the data is cut out from the head portions of these files by the size determined by the preload image size determining means.
A preload image corresponding to D is generated and sent to the moving image stream generation means 105 (FIG. 10, process 1004). In the moving image stream generating means 105, the B, C, and D preload images generated by the preload image generating means are connected to the end of the moving image A. Next, referring to the arrangement order information sent from the moving image file arrangement order determining means 101, the moving image B is connected following the moving image A to which the preload image is connected at the end. Regarding the moving image B, the head portion is connected as a preload image to the end portion of the moving image A, but this head portion is also connected without being cut. Therefore, the preload part of the moving image B is doubly present in the moving image stream. This is because, when the moving image B is reproduced independently, it is easier to manage the file and the access is faster when one file is recorded continuously. Figure 4
It is shown in (1). As described above, in the moving image stream of this embodiment, a file for single reproduction and a file for continuous reproduction are generated based on one moving image file, and these files are given different file names for management. There is. Moreover, since the actual contents of these two files are duplicated except for the preload part, the recording efficiency on the recording medium hardly decreases. Hereinafter, the moving images B, C, and D are similarly generated and connected to create a series of moving image streams 110 (FIG. 10, processing 1005). In parallel with the process of generating the moving image stream 110, the reproduction control information generating unit 104 controls reproduction by the arrangement order information from the moving image file arrangement order determining unit 101 and the preload image size data from the preload image size determining unit 102. Information 109 is generated (process 1006 in FIG. 10).
The reproduction control information 109 includes the reproduction order of the moving image file, the branching condition in the moving image file having branch points, and the inside of the file in which the preload image is linked to the end of the main image (for example, “A_IN_STORY”). The recording start position and recording size information of the preload image are included. The reproduction control information 109 created by the above procedure
Then, the moving picture stream 110 is burned onto a CD-ROM by the CD-ROM media creating means 111 (FIG. 10, processing 1007). Next, FIG. 1 and FIG. 3 to FIG. 5, FIG.
The reproduction procedure of the CD-ROM will be described using 1. It is assumed that the connection settings of the moving image files to be reproduced are as shown in FIG. 8 (1) as in the above description. FIG. 5 is a diagram showing an example of the configuration of a moving image file reproducing apparatus according to the present invention, 500 is a CD-ROM medium created by the moving image stream creating apparatus of FIG. 1, and 501 is a CD.
C for reading data from the ROM medium 500
D-ROM drive, 502 is CD-ROM drive 5
Playback control information storage means for storing the playback control information read from the CD-ROM medium 500 by using 01, 50
3 is a branch decision input means for inputting a branch condition at a branch point provided in the story, 504 is a playback device control means for controlling the entire moving image file playback device, and 505 is a CD-ROM drive. Of the moving image data to be stored, a moving image storage means for storing a preloaded image, and 506 is a preloaded moving image storage means 50.
Branch source moving image storage means for storing a branch source moving image to be displayed temporally prior to the moving image stored in 5.
Reference numeral 07 is a moving picture file decoding means for restoring compressed moving picture data stored in the preload moving picture storage means and branch source moving picture storage means 506 to generate moving picture data, and sending it to the display device 508 which will be described later. It is a display device that displays, etc. Further, FIG. 11 is a flow chart for explaining the procedure of reproduction control performed by the moving image file reproducing apparatus of FIG. First, continuous playback and branch playback will be explained. When the moving image file reproducing apparatus is turned on and the CD-ROM drive 501 is loaded with the CD-ROM medium 500, the following initialization processing is performed. The playback device control means 504 first reads the playback control information 109 from the CD-ROM medium 500 and stores it in the playback control information storage means 502. Next, with reference to the reproduction control information 109, reading of the moving image file (moving image A, file name: A_IN_STORY) to be displayed first is started, and if the moving image A has a branch setting, the user The default branch destination is fixed in case there is no branch decision input (step 1101 in FIG. 11). Then C
Moving image file "A_IN_S" from D-ROM media 500
A process (FIG. 11, processes 1102 and 1103) of reading one sector of the “TORY” data and allocating the data to the branch source moving image data (that is, the moving image A) and the preload image (that is, the preload portions of the moving images B, C, and D) If the image is a preloaded image, the preloaded moving image storage means 505
(FIG. 11, processing 1104), and if it is a branch source moving image, it is stored in the branch source moving image storage means 506 (FIG. 11, processing 1105). Branch source moving image storage means 50
The data of the moving image A stored in No. 6 is transferred / restored to the moving picture file decoding means 507, and the display on the display device 508 is started (FIG. 11, processing 1106). Here, when the user inputs a branch decision input through the branch decision input means 503, the next branch destination moving image file is decided by referring to the reproduction control information 109 stored in the reproduction control information storage means 502. (FIG. 11, processing 110
7). Next, it is determined whether or not the display of the branch source moving image (moving image A) that is currently being reproduced is ended (step 1108 in FIG. 11). If the moving image A continues to be displayed, the CD-ROM drive 501 is displayed.
Read the next sector from and repeat the procedure described above. In the present embodiment, since the preload image is connected to the end of the branch source image, the above processing is normally repeated for the number of recorded sectors of the moving image A.
When the processing for decoding / displaying data from the reading of the sector unit for the moving image A is completed (FIG. 11, YES in step 1108), processing 1107 in FIG.
The branch destination video file confirmed in
The pre-load portion of the moving image B is read from the pre-load moving image storage unit 505 and transferred to the moving image file decoding unit 507 (FIG. 11, processing 1109), and the moving image B
Playback is started as the next playback video file (Fig. 1
1, process 1110). When the reproduction of the moving image B is started, the default branch destination image is set by referring to the reproduction control information 109 stored in the reproduction control information storage means 502 (FIG. 11, processing 1111). After this, the file "B_IN
The first sector of "_STORY" is the CD-ROM drive 501
Then, the processing 1102 and subsequent steps in FIG. 11 are repeated.
In the file "B_IN_STORY", as shown in (2) of FIG. 4, the start address of the first sector is 1020. This address is the rest of the moving image B excluding the preload portion when referring to (1) of FIG. Points to the beginning of the part. Therefore, following the leading portion of the moving image B that has been preloaded previously, the remaining portion can be smoothly read. In this way, by loading the moving image A of the branch source and preloading the leading portion of the image of the branch destination, even if the branch decision input is made at the final display portion of the moving image A, Images can be played back smoothly without interruption. The continuous and branched playback of moving images have been described above, but it may be possible that some applications may request playback of each moving image file independently. For example, to reproduce the moving image B, the file "B_SINGLE" may be read from the CD-ROM drive 501. As mentioned in the previous procedure for creating a moving image stream, the preload portion of the branch destination image is recorded overlapping at the end of the branch source image and the beginning portion of the branch destination image. As shown in Fig. 4 (2), a file for single playback ("B_SINGLE" in this example)
Is recorded in a continuous area on the CD-ROM medium 500 from the start address 1000 to 1000 sectors. Therefore, even in the case of single playback, the continuous area is accessed, so that high-speed reading can be performed.
As described above, in the present embodiment, files for single reproduction and continuous reproduction are generated based on one moving image file, and different file names are given to these in the CD-ROM medium 500. I manage it. Since the preload part of the branch destination candidate image is added to the end of the file for continuous playback, regardless of the timing of branch decision input,
It is possible to realize smooth branch playback of moving images. In addition, even in the case of independent playback, since the recording areas of each moving image file are continuous, efficient access is possible. In addition, since the substance of the above-mentioned file for independent reproduction and the substance of continuous / branch reproduction are duplicated on the CD-ROM medium 501 except for the preload portion, the recording efficiency is hardly reduced. The reproduction control information storage unit 502, the preload moving image storage unit 505, and the branch source moving image storage unit 506 in this embodiment can be realized by using a semiconductor memory or the like. Next, a second embodiment according to the present invention will be described. The characteristic difference between this embodiment and the first embodiment is that
This is the configuration of the moving picture stream 110 created by the moving picture stream creating apparatus in FIG. Therefore, in the description of the present embodiment, the portions that overlap with the first embodiment will be omitted, and the features of the configuration of the moving image stream 110 described above and the control method for reproducing the moving image stream 110 in this case will be described. Do. Drawings added in the description of this embodiment are FIGS. 6 and 7. FIG. 6 is a diagram for explaining the recording state of the moving image file inside the moving image stream 110 and the method of concatenated reproduction in the second embodiment of the present invention. In FIG. 6, 600 is a moving image stream 1.
10 is a part 6 and 601 is a part 6 of the moving image stream 110.
00, the enlargement is for several sectors in which moving image A is recorded. FIG. 7 is a diagram showing an example of the recording state of the data sectors of the moving image stream 110 and the name given to the file for management in the second embodiment of the present invention. In FIG. 7, 700 is a part of the moving picture stream 110, and 701 is an enlargement of the sector in which the moving picture B is recorded in the moving picture stream 110. 6 to 7
The example of is described so as to correspond to the example of the connection setting of the moving image files shown in FIG. In the first embodiment, the preload portion of the moving image B, C, and D that is the branch destination candidate image is added to the end of the moving image A of the branch source, but in the present embodiment, this preload portion is added. The feature is that it is recorded by interleaving with the data of the branch source image. As shown in FIG. 6 (1), in this example, the moving image A and the preloaded portion of the moving image B are interleave-recorded at a ratio of 3: 1. Then, different channel numbers are assigned to the sector in which the moving image A is recorded and the sector in which the preload portion of the moving image B is recorded (in FIG. 6 (1), 0 is assigned to A and 1 is assigned to B). Exist). When the recording of the preload part of moving image B is completed,
Similarly, moving images C and D are interleaved and recorded, and for example, C is 2 and D is 3 in the sectors where C and D are recorded.
Channel numbers are assigned in this way. When the recording medium is a CD-ROM, this channel number is defined by the standard so that it is written in the sub-header part in each data sector. However, the correspondence between channel number and file name cannot be written in the directory entry in the CD-ROM standard. Therefore, the correspondence between the channel number and the file name is configured to be written in the reproduction control information 109 in the reproduction control information generation means 104 in FIG. FIG. 7 (1) shows a state in which the moving image B and the branch candidate image following the moving image B are interleaved and recorded. Addresses 1000 to 1020 are the preload part of the moving image B, and this is the moving image A as described above.
Interleaved recording is also performed in the recording area of. Since the preload portion of the addresses 1000 to 1020 is a portion that is not used during continuous reproduction as in the case of the first embodiment, the branch destination candidate image (moving images E and F in this example) of the moving image B is stored in this address area. ) Does not interleave.
Then, the interleave recording is started from the address 1020 and subsequent addresses which follow. At this time, the channel number 1 is assigned to the moving image B, and the channel numbers 4 and 5 are assigned to the moving images E and F, respectively, and are written in the sub-header portion of each data sector. The file name "B_IN_STO" is added to the data from the address 1020 to the address 2080 (the ending address of the moving image B including the preload portions of the moving images E and F).
RY ”is given to the data from the address 1000, and the file name“ B_SINGLE ”is given. This is for continuous reproduction and single reproduction as in the first embodiment. The moving image stream recorded by the above method is used. For continuous reproduction, the moving image file reproducing apparatus is provided with a buffer for each channel number as shown in FIG. 6 (2), and the channel number assigned to the sector read from the CD-ROM 500 is referred to for correspondence. The data is stored in the buffer of the channel number to be read, and is read from the buffer and displayed according to the correspondence between the channel number and the file name written in the playback control information 109. In the moving image file playback device of FIG. For example, the configuration is as follows: That is, the preload image storage means 505 and the branch source moving image storage means 506.
Instead of this, a storage means for each channel number is provided. This may be provided with a separate storage means for each channel number, or as a single storage means, and the internal storage area may be selectively used according to the channel number.
For example, if the file “A_IN_STORY” is read, the sector storing the moving image A has the channel number 0, and the sector storing the preload portion of the moving image B has the channel number 1 and so on. Since it is written in the subheader part, the data should be stored in the buffer corresponding to each channel number. When there is a branch decision input during the display of the moving image A, the name of the branch destination image and the channel number corresponding to it are read from the reproduction control information 109, and the preload image is reproduced first while the rest of the file (this In this case, since the file corresponding to "remaining" is managed by giving it a dedicated name, the application does not need to be aware that it is "remaining.") In other words, if the branch destination is B, "B_IN_STOR
"Y" is read out. Also, when each moving image file is to be played back independently, it is sufficient to read out files with special names "A_SINGLE" and "B_SINGLE". At this time, Fig. 7 (1)
As shown in, the preload image is also interleaved in the file for single playback, but the data unnecessary for single playback can be discarded by referring to the channel number when reading the data. As described above, in this embodiment, the preload image is not added to the end of the branch source image as in the first embodiment, but is interleaved and recorded in the branch source image. In comparison, the preloaded image data can be obtained at the previous stage in time. For this reason, in the present embodiment, even if the branch decision input is made at a relatively early stage within the display period of the branch source image, the display of the branch destination image can be immediately started, so that a visually more natural moving image branch reproduction is performed. Has the effect that it becomes possible. In addition, in this embodiment, the same effect as that of the first embodiment can be obtained. In addition, 2 explained above
In one embodiment, a CD-ROM is taken as an example of a moving image stream recording medium, but the effect of the present invention is not limited to this, and a recording medium using another optical disk or a magnetic recording medium is used. Even in the case, since the physical file access processing (track access, etc.) occurs for the concatenated reproduction, the same effect can be obtained. Moreover, although the moving image compression method is not specifically mentioned, if the recording method is such that the output time of the data is longer than the time of loading the data from the recording medium, for example, MPEG (Motion Picture Expert Grou
Even if it is a compression method such as p) or a recording / playback method of non-compressed data, its effect can be exhibited. Furthermore, although the story branching of moving image files has been described in each of the embodiments, it is necessary to continuously reproduce even other multimedia data such as a compressed audio file or a compressed audio / image mixed file. Can realize story branching by applying the present invention.

[0007]

As described above, according to the present invention, in creating and reproducing a series of moving picture streams accompanied by story branching, a single moving picture stream is constructed based on each moving picture file. Two types of files are created, one for playback and one for continuous playback, and these files are given different file names on the recording medium for management. Since the preload portion of the branch destination candidate image is added to or inserted into the file for continuous playback, the preload portion is played back even when the timing of the branch decision input is at the end of the display period of the branch source image. ，
Subsequent data can be loaded during this time,
It is possible to realize smooth branch playback of moving images. The size of the preload image can be set freely by the application because it is determined by parameters such as the length of the display period of the branch source image, the performance of the playback device for the recording medium, or the buffer size provided in the playback device. Also,
Even when the file is played independently, the recording area of each moving image file is continuous, so efficient and high-speed access is possible. Moreover, the above-mentioned single playback and continuous
Since the entity of the file for branch playback is duplicated on the recording medium except for the preload part, the recording efficiency does not decrease.

[Brief description of drawings]

FIG. 1 is a diagram illustrating a configuration example of a moving image stream creation device to which the present invention has been applied.

FIG. 2 is a diagram showing an example of moving image file connection information 106.

FIG. 3 is a diagram showing an example of a moving image stream 110 created by the moving image stream creating apparatus of FIG. 1 and a concept of a reproduction operation.

4 is a diagram illustrating a recording state of a moving image stream 110 created by the moving image stream creating apparatus in FIG.

FIG. 5 is a diagram showing a configuration example of a moving image file reproducing apparatus according to the present invention.

FIG. 6 is a diagram illustrating a recording state of a moving image file inside a moving image stream 110 and a method of concatenated reproduction according to a second embodiment of the present invention.

FIG. 7 is a diagram showing an example of a recording state of a data sector of a moving image stream 110 and a name given to a file for management in a second embodiment of the present invention.

FIG. 8 is a diagram illustrating the concept of linked display of moving images.

FIG. 9 is a diagram for explaining a conventional moving image concatenated reproduction method.

10 is a flowchart illustrating a procedure for creating a moving image stream performed by the moving image stream creating apparatus in FIG.

11 is a flowchart illustrating a procedure of playback control performed by the moving image file playback apparatus of FIG.

[Explanation of symbols]

Reference numeral 100 ... Moving image stream creating apparatus main body, 101 ... Moving image file arrangement order determining means, 102 ... Preload image size determining means, 103 ... Preload image generating means, 1
04 ... Reproduction control information generating means, 105 ... Moving image stream generating means, 106 ... Moving image file connection information, 107
... playback device access specification information, 108 ... moving image database, 109 ... playback control information, 110 ... moving image stream, 111 ... CD-ROM media creating means, 500 ...
CD-ROM media, 501 ... CD-ROM drive, 502 ... Reproduction control information storage means, 503 ... Branch decision input means, 504 ... Reproduction device control means, 505 ... Preload image storage means, 506 ... Branch source moving image storage means, 5
07 ... Moving image file decoding means, 508 ... Display device.

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁶ Identification number Internal reference number FI Technical indication location H04N 7/24 7/14 (72) Inventor Harumi Tomomi 292 Yoshida-cho, Totsuka-ku, Yokohama-shi, Kanagawa Stock company Hitachi Media Media Laboratory (72) Inventor Taka Takeuchi 292 Yoshida-cho, Totsuka-ku, Yokohama-shi, Kanagawa Hitachi Video Media Laboratory (72) Inventor Junya Monma 292 Yoshida-cho, Totsuka-ku, Yokohama, Kanagawa Stock Company Hitachi, Ltd. Information & Video Media Division (72) Inventor Toshihiro Matsunaga 292 Yoshida-cho, Totsuka-ku, Yokohama-shi, Kanagawa Hitachi Image Information Systems Co., Ltd.

Claims (14)

[Claims] 1. A plurality of data files, reproduction and connection order information of the plurality of data files, and reproduction indicating that there are a plurality of connection candidates for any one or more of the plurality of data files. A multimedia data recording apparatus having at least a data stream forming means for forming a data stream from branch information, wherein the data stream forming means is configured in accordance with the reproduction connection order information and the reproduction branch information. A file concatenation order determining means for deciding the concatenation order of the data files and a part or all of the constituent data of each of the plurality of data files is used to generate a preload file used for cueing at the time of reproduction. The preload file generating means, the plurality of data files, and the preload file generating means. There is a file concatenation means for concatenating the generated preload file, and the file concatenation means is provided for each of the data files and all the data files that may possibly be concatenated with the data file. A composite file is generated by connecting the corresponding preload files, and the composite file is connected in accordance with the file connection order determined by the file connection order determining means and the reproduction branch information.
A multimedia data recording device characterized by forming a data stream. 2. The file concatenation order determining means according to claim 1, wherein the reproduction concatenation order information, the reproduction branch information, and the size information of the plurality of data files are referred to. A reproducing apparatus used for reproducing a data stream, wherein a multimedia data recording apparatus is characterized in that a connection order of the plurality of data files is determined so as to shorten a data access time. 3. The preload file generating means according to claim 1 or 2, wherein the preload file generating means determines the size information of the plurality of data files and the data access performance of the reproducing device used when reproducing the data stream. A multimedia data recording device characterized in that the size of a preload file to be generated is determined by referring to the information to be expressed. 4. The reproduction procedure information of the data file and the data, based on the file concatenation order determined by the file concatenation order determining means, the reproduction branch information, and the size of the preload file. −
A multimedia data recording apparatus comprising reproduction control information generation means for generating reproduction control information including information on a recording position and size of the preload file connected to the data file. 5. The data recording according to claim 4, wherein the data stream formed by the data stream forming means and the reproduction control information generated by the reproduction control information generating means are recorded on a recording medium. A multimedia data recording apparatus having means. 6. The multimedia data recording apparatus according to claim 5, wherein the recording medium on which the data stream is recorded by the data stream recording means is a CD-ROM. 7. The data stream according to any one of claims 1 to 6, wherein the data stream has a file information storage area for storing information relating to each data file forming the data stream. A name for single reproduction is given to the data files constituting the above, each data file file and the preload files corresponding to all the data files that may be linked to the data file. A file for which the data corresponding to the preload portion of the data file itself has been removed from the concatenated composite file is given a name for continuous / branch playback, and the single playback name and the continuous playback are given to the file information storage area. / A multimedia data recording apparatus having a file name registration means for registering a name for branch reproduction. 8. The method according to any one of claims 1 to 7, wherein the data file and the preload file are linked by the file linking means by linking the preload file to the end of the data file. Multimedia data recording device characterized by. 9. The method according to claim 1, wherein the concatenation of the data file and the preload file performed by the file concatenation means is a method of interleaving the preload file with the data file. Multimedia data recording device characterized by. 10. A multimedia recording apparatus according to claim 1, wherein said data file is composed of data compressed by a data compression means. 11. The method according to any one of claims 1-10.
Data files are multimedia data recording devices characterized by being composed of moving image data. 12. The moving image data forming the data file according to claim 11, wherein the moving image data is MPEG (Motion Pic).
multimedia data recording device characterized by being compressed by the ture Expert Group method. 13. A multimedia data reproducing device for reproducing a data stream generated by the multimedia data recording device according to claim 1, from a composite file loaded from the data stream. Preload file storage means for separately storing the preload file, file storage means for storing the file in which the preload file is separated, and a plurality of branch destination candidate files connected to the files stored in the file storage means In this case, the branch destination determination input means for specifying the branch destination file is provided, and when the branch destination file is specified by the branch destination determination input means during continuous / branch reproduction, the preload file storage means is provided. Do not play the preload file corresponding to the stored branch destination file. And loading a file with a name for continuous / branch playback corresponding to the branch destination file, and loading a file with a name for single playback corresponding to the file to be played during single playback. Multimedia data playback device. 14. The reproduction control information storage means for storing the reproduction control information according to claim 13,
A multimedia data reproducing apparatus characterized in that the reproduction of the data stream is performed according to the reproduction control information stored in the reproduction control information storage means.