JP2003168284A - Data recording method and data editing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method of saving user's trouble when editing a video to which a sub audio track is added. <P>SOLUTION: First data and second data are correlated and recorded. The second data are classified into a first class to by synchronized with a particular part of the first data and a second class not to be synchronized with a particular part of the first data, and the classified data are recorded. That is, information showing a (independent/dependent) relation of the sub audio track to a video track is prepared, and a treatment of the sub audio track in editing the video track is changed on the basis of the information. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

TECHNICAL FIELD The present invention relates to a hard disk,
The present invention relates to a data recording method and a data editing method for recording / editing video data and audio data on a randomly accessible recording medium such as an optical disk.

[0002]

2. Description of the Related Art A digital video recording / reproducing apparatus using a disk medium (hereinafter referred to as a video disk recorder) is becoming popular. There is a non-destructive editing function or a non-linear editing function as a characteristic function of the disk medium which is not present in the tape medium. With this function, you can play any section (scene) of the AV stream in any order without moving or copying the AV stream recorded on the disc.
This is realized by creating information (playback management information) indicating from where to where in the AV stream and in what order, and playing back according to the information.

For example, as shown in FIG. 30, a content includes video data, audio data to be recorded at the same time as the video data, and reproduced in synchronization with the video data, and the video data and the audio data. Separately, it is composed of three types of data with audio data added later, each as a track, and Vide
o track3000, Main audio track3010, Sub audio track
It is assumed that it is managed by 3 tracks of 3020.

At this time, if the section T3051 to T3052 in the figure is to be deleted, the following two types can be considered as the result that the user may desire. The first result is that all the sections of three tracks (sections 3002, 3012, 3022 in the figure) corresponding to the section from T3051 to T3052 are out of the reproduction target,
1 is that the sections before and after that are continuously reproduced.

[0005] Such a result is obtained when the section removed from the reproduction target is strongly related, for example, Sub audio track 3020.
It is considered to be desirable when the section 3022 of is a dubbing in English for the section 3002 of the Video track 3000. This is because, if the section 3022 of the Sub audio track 3020 is not excluded from the reproduction target, only the dubbed voice in English with no corresponding video remains.

On the other hand, the second result that the user may desire is the Video track 3000 corresponding to the section from T3051 to T3052.
And Main audio track 3001 section (section 3002 in the figure,
3012) is excluded from the playback target, and as shown in FIG.
For track3000 and Main audio track 3010, the section before and after that is continuously played, and Sub audio track302
As for 0, it means that it is played back as it was before deletion.

[0007] Such a result is obtained by the Sub audio track 3020.
It is considered to be desirable when the continuity of the data is high and the relation with other tracks is weak, for example, when the Sub audio track 3020 is BGM for the Video track 3000. This is because the BGM becomes discontinuous when the section 3022 of the Sub audio track 3020 is removed from the reproduction target.

In the case of editing using a conventional tape medium, the first result is obtained from T3051 to T305 at the time of copying.
It is relatively easy because you only need to remove 2, but when you try to get the second result, first you need to copy except T3051 to T3052, and record the data of Sub audio track again. It will be troublesome. On the other hand, with disk media, simply by rewriting the track management information,
The result of can be easily obtained.

[0009]

However, in the prior art, when the user tries to obtain the first result, the user selects the sections 3002, 3012, 3022 from the screen as shown in FIG.
Will be selected and the delete command will be executed. Similarly, in order to obtain the second result, the user selects the sections 3002 and 3012 from the screen shown in FIG. 30 and executes the delete command. That is, it is necessary to explicitly specify where to delete.

The present invention has been made in view of the above problems, and provides a data recording method and a data editing method capable of reducing the trouble of the user when editing a video to which sub audio is added. The purpose is to

[0011]

Means for Solving the Problems The first invention of the present application is
A recording method for recording the first data and the second data in association with each other, the second data, the first type requiring synchronization with a specific portion of the first data, and the first It is characterized in that it is recorded separately from the second type which does not need to be synchronized with the specific part of the data of 1.

The second invention of the present application is characterized in that, when the first data is edited, the second data classified into the first type is edited simultaneously with the related first data. To do.

A third invention of the present application is characterized in that, when the first data is edited, the second data classified into the first type is not edited at the same time as the related first data. .

[0014]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The description here will be made in the order of the configuration commonly used in the present invention and the content unique to each embodiment.

<System Configuration> FIG. 1 is a configuration diagram of a video disk recorder capable of post-recording, which is commonly used in the present invention. This device, as shown in FIG.
0, host CPU 101, RAM 102, ROM 103, user interface 104, system clock 105, optical disk 106, pickup 107, ECC (Error Correcting Coding) decoder 1
08, ECC encoder 109, playback buffer 110, recording / post-recording buffer 111, demultiplexer 112, multiplexer 113, multiplexing buffer 114, audio decoder 11
5, a video decoder 116, an audio encoder 117, a video encoder 118, and a camera, a microphone, a speaker, a display and the like (not shown).

The host CPU 101 receives the demultiplexer 112, the multiplexer 113, and the pickup 10 via the bus 100.
7. Also, although not shown, communication with the audio decoder 115, the video decoder 116, the audio encoder 117, and the video encoder 118 is performed.

During reproduction, the data read from the optical disc 106 through the pickup 107 is stored in the ECC decoder 108.
The error is corrected by and is temporarily stored in the reproduction buffer 110. The demultiplexer 112 is the audio decoder 11
5. According to the data transmission request from the video decoder 116, the data in the reproduction buffer is distributed to an appropriate decoder according to its type.

On the other hand, at the time of recording, the audio encoder 11
The data compression-encoded by 7 and the video encoder 118 is once sent to the multiplexing buffer 114, AV-multiplexed by the multiplexer 113, and sent to the recording / post-recording buffer 111. Data in the recording / post-recording buffer 111 is added with an error correction code by the ECC encoder 109, and is recorded on the optical disc 106 through the pickup 107.

MPEG-1 is used as an audio data encoding method.
Layer-II is used, and MPEG-2 is used for the video data encoding method.

The optical disk 106 is a removable optical disk in which recording and reproduction are performed spirally from the outer circumference to the inner circumference. An ECC block is composed of 16 sectors for error correction, with 2048 bytes as one sector. When rewriting the data in the ECC block, read the entire ECC block containing the data, perform error correction, rewrite the target data, add the error correction code again, configure the ECC block, and write it to the recording medium. Need to record. Further, the optical disc 106 adopts ZCAV (constant zone angular velocity) in order to improve recording efficiency, and the recording area is composed of a plurality of zones having different rotational speeds.

<File System> A file system is used to manage various information on the optical disc 106.
The file system is a personal computer (PC)
UDF (Universal Disk Format) considering interoperability with
To use. On the file system, various management information and
The AV stream is treated as a file.

The user area is managed in 2048-byte logical blocks (one-to-one correspondence with sectors). Each file is
It may be composed of an integer number of extents (consecutive logical blocks) and may be distributed and recorded in extent units. The free area is managed in logical block units using Space Bitmap.

<File Format> The QuickTime file format is used as a format for AV stream management. The QuickTime file format is a multimedia data management format developed by Apple Inc. and is widely used in the PC world.

The QuickTime file format is composed of video data, audio data, etc. (collectively referred to as media data) and management information. Together, they are called a QuickTime movie (movie for short). Both may be in the same file or in separate files.

If the files exist in the same file, FIG.
Take the configuration as shown in (a). Various information is stored in a common structure called atom. The management information is stored in the structure called Movie atom, and the AV stream is stored in the structure called Movie data atom. The management information in Movieatom includes a table for deriving the relative position in the file of AV data corresponding to an arbitrary time in media data, attribute information of media data, and external reference information described later. include.

On the other hand, when the management information and the media data are stored in different files, the structure shown in FIG. 2B is adopted. The management information is stored in the structure called Movie atom, but the AV stream does not need to be stored in atom.
At this time, the Movie atom "externally references" the file containing the AV stream.

External reference can be made to a plurality of AV stream files, as shown in FIG. 2C, and by this mechanism, the AV stream itself is apparently moved without physically moving. Make it look like you've edited,
So-called "non-linear editing" and "non-destructive editing" are possible.

Now, referring to FIGS. 3 to 12, the Quic
The format of kTime management information will be described. First, the atom, which is a common information storage format, will be described. At the beginning of the atom is the size of the atom, Atom
There is always size and Type, which is the type information for that atom. Type is distinguished by 4 characters, for example, 'mo in Movie atom.
It is'mdat 'in ov' and Movie data atom.

Each atom can contain another atom. That is, there is a hierarchical structure between atoms. The structure of the Movie atom is shown in FIG. Movie header atom is the Movie atom
Manages the overall attributes of the movie managed by. Track
The atom stores information about tracks such as video and audio included in the movie. User data atom
Is an atom that can be uniquely defined.

The structure of the Track atom is shown in FIG. Track he
The ader atom manages the overall attributes of that track. The edit atom manages which section of media data is reproduced at which timing of the movie. Track
The reference atom manages the relationship with another track.
Media atom manages data such as actual video and audio. User data atom manages information unique to the manufacturer. In the present invention, information about the type of track including this atom, such as an original track and a sub audio track, is stored.

The structure of the Track header atom is shown in FIG.
Here, only what is necessary for the later description will be described. flags is a set of flags indicating attributes. As a typical one, there is a Track enabled flag. When this flag is 1, the track is played, and when it is 0, it is not played. layer represents the spatial priority of the track, and if there are multiple tracks displaying images, laye
The image is displayed in the foreground for tracks with smaller r values.
Also, Track ID indicates the ID of the track that contains this atom, and multiple tracks with the same ID do not exist in one movie.

The structure of the Media atom is shown in FIG. Media he
The ader atom manages the overall attributes of the media data managed by the Media atom. Handler refere
The nceatom stores information indicating which decoder decodes the media data. Media information atom
Manages attribute information unique to media such as video and audio.

The structure of the Media information atom is shown in FIG. Media information header atom manages media-specific attribute information such as video and audio. Handler
The reference atom is as described in the section of Media atom. The Data information atom includes a Data reference atom that is an atom that manages the name of a file that includes media data that the QuickTime movie refers to. Sample ta
The ble atom manages the size of data, playback time, and the like.

Next, the Sample table atom will be described, but before that, the data management method in QuickTime will be described with reference to FIG. In QuickTime, the smallest unit of data (eg, video frame) is called a sample. For each track, the samples are ordered by playback time
Numbers from 1 (sample number) are attached.

In the QuickTime format, the reproduction time length and data size of each sample are managed. An area in which samples belonging to the same track are continuously arranged in the file in the order of reproduction time is called a chunk. Chunks are also numbered from 1 in the order of playback time.

Further, in the QuickTime format, the addresses from the file head of each chunk and the number of samples contained in each chunk are managed. Based on these pieces of information, it is possible to find the position of the sample corresponding to an arbitrary time.

The structure of the Sample table atom is shown in FIG. S
The ample description atom manages the data format (Data format) of each chunk and the index of the chunk of the file in which the sample is stored. Time-to-
The sample atom manages the playback time of each sample.

The Sync sample atom manages the samples that can be decoded, among the individual samples. Sample-t
The o-chunk atom manages the number of samples included in each chunk. Sample size atom manages the size of each sample. Chunk offset atom manages the address from the file head of each chunk.

As shown in FIG. 10, the edit atom is composed of one
Contains Edit list atom. Edit list atom is Number of ent
Track duration and Media ti for the number specified by ries
It has a set (entry) of me and Media rate values. Each entry corresponds to a section that is continuously played on the track,
They are arranged in the order of playback time on that track.

Track duration is the playback time on the track of the section managed by the entry, Media time is the position on the media data corresponding to the beginning of the section managed by the entry, and Media rate is the section managed by the entry. Indicates the playback speed of. When Media time is -1, playback of the sample on the track is stopped for the Track duration of the entry. This section is called empty edit.

FIG. 11 shows an example of using the Edit list. Here, it is assumed that the contents of the Edit list atom are the contents shown in FIG. 11 (a) and the sample structure is shown in FIG. 11 (b). Note that here, the track duratio of the i-th entry
Let n be D (i), Media time be T (i), and Media rate be R (i). At this time, the actual reproduction of the sample is as shown in FIG.
It is performed in the order shown in. This will be briefly described.

First, entry # 1 has a Track duration of 1300.
Since 0, Media time is 20000, and Media rate is 1, the section 13000 from the beginning of the track is time 2 during sampling.
Play the section from 0000 to 33000. Then entry # 2 is T
Since the rack duration is 5000 and the Mediatime is -1, nothing is played during the period from 13000 to 18000 in the track.

Finally, entry # 3 has a Track duration of 10
Since 000, Media time is 0, and Media rate is 1, the section from time 0 to 10000 in the sample is reproduced in the section from time 18000 to 28000 in the track.

FIG. 12 shows the structure of the Track reference atom. This atom manages the relationship between the track containing this atom and other tracks. There are multiple types of relationships between tracks, and Track reference for each type
Provide a type atom. The structure of Track reference type atom is explained. type is the type of relationship managed by this atom, for example "sync" which indicates synchronization between type tracks.
Stores "chap", which indicates a chapter break. trac
The track ID of the track containing this atom and the track ID of the track having the relationship indicated by type are stored in k-IDs.

FIG. 13 shows the structure of the User data atom. This atom can store any number of unique information that is not defined in the QuickTime format. One unique information is managed by one entry, and one entry is Si
It consists of ze, Type and User data. Size represents the size of the entry itself, Type represents identification information for distinguishing each unique information, and User data represents actual data.

<Form of AV Stream> First, the structure of the AV stream in this embodiment will be described with reference to FIGS. 14 and 15.
Will be explained. AV stream is an integer number of Record Uni
It consists of t (RU). RU is a unit for continuously recording on the disc. The length of the RU constitutes the AV stream
Seamless playback regardless of how the RU is placed on the disc (images and sounds can be played back without interruption during playback)
And real-time post-recording (recording audio while seamlessly playing a post-recording video) are guaranteed. This setting method will be described later.

Also, the stream is constructed so that the RU boundary coincides with the ECC block boundary. Due to these properties of the RU, even after the AV stream is recorded on the disc, the arrangement of RU units can be easily changed on the disc while ensuring seamless reproduction.

The RU is composed of an integer number of video units (VUs). The VU is a unit that can be independently reproduced, and therefore can be an entry point when reproducing.

The VU configuration is shown in FIG. A VU is an integer number of GOPs (groups of pictures) that store video data for about 1 second, and an integer number of AAUs (audio access units) that store main audio data that is played back at the same time. Composed of and.

The GOP is a unit of image compression in the MPEG-2 video standard, and is composed of a plurality of video frames (typically about 15 frames). AAU is MPEG-1 Layer-
It is a unit of audio compression in the II standard and is composed of 1152 sound waveform sample points. Sampling frequency is 48kHz
In this case, the playback time per AAU is 0.024 seconds. In the VU, AAU and GOP are arranged in this order in order to reduce the delay required for AV synchronized playback.

Further, in order to enable independent reproduction in VU units, the sequence header (S
H) put. The VU playback time is defined as the number of video frames included in the VU times the video frame period.
In addition, if an integer number of VUs are combined to form an RU,
Fill the end of VU with 0 to align the beginning and end of the with the ECC block boundary.

<AV Stream Management Method> The AV stream management method is based on the aforementioned QuickTime file format. FIG. 16 shows an AV stream management form. The video track manages each video frame as one sample (video sample) and a chunk of video in the VU as one chunk (video chunk). The main audio track is one AAU sample (audio sample),
The chunk of audio in VU is managed as one chunk (audio chunk).

<RU Unit Determination Method> Next, the RU unit determination method will be described. In this determination method, a reference device (reference device model) is assumed, and a continuous recording unit is determined so that seamless reproduction does not fail on it.

First, the reference device
The model will be described with reference to FIG. Reference device model is one pickup and ECC encoder / decoder 501, track buffer connected to it.
502, demultiplexer 503, dubbing buffer 504,
It is composed of an audio encoder 509, a video buffer 505, an audio buffer 506, a video decoder 507, and an audio decoder 508.

The seamless reproduction in this model requires at least 1 in the track buffer 502 at the start of VU decoding.
Guaranteed if there are individual VUs. The data input speed of the audio frame data to the ECC encoder 501 and the data output speed of the ECC decoder 501 are Rs.

Further, Ta is the maximum period during which reading and recording by access are stopped. In addition, short access (100
Let Tk be the time required for a track). It should be noted that these periods include seek time, rotation waiting time, and the time until the data first read from the disk after access is output from the ECC. In this embodiment, Rs = 20Mbps, T
Let a = 1 second and Tk = 0.2 seconds.

When reproduction is performed in the reference device model, it can be guaranteed that there is no underflow in the track buffer 502 if the following conditions are satisfied.

Before indicating the conditions, the symbols are first defined.
Let C # i be the i-th continuous area that makes up the AV stream, and C #
The reproduction time included in i is Tc (i). Tc (i) is the total playback time of VUs whose head is included in C # i. Also,
Let Ta be the access time from C # i to C # i + 1.

Further, the VU read time corresponding to the reproduction time Tc (i) is Tr (i). At this time, the condition of not causing the track buffer 502 to underflow is that Tc (i) ≧ Tr (i) + Ta · Ta at any C # i when the maximum read time including the split jump is Tr (i). .. <Formula 1> is satisfied.

This expression is a sufficient condition for seamless reproduction,

[0061]

[Equation 1]

This is because it is a sufficient condition that satisfies the above condition.

In Tr (i) in <Expression 1>, Tr (i) = Tc (i) × (Rv + R
a) / Rs is substituted, and the condition of Tc (i) that can guarantee seamless reproduction by solving with Tc (i) Tc (i) ≧ (Ta × Rs) / (Rs-Rv-Ra) ・ ・ ・ < Equation 2> is obtained.

That is, if the sum of the VUs included at the beginning of each continuous area satisfies the above equation, seamless reproduction can be guaranteed. At this time, each continuous area may be limited to include a complete VU group that satisfies the above expression.

<Equation 2> must be satisfied even in the automatic divided movie file. However, the first RU of the first split movie and the last RU of the last split movie are <
Formula 2> may not be satisfied. This is because the beginning can be absorbed by delaying the start of reproduction from the start of reading data from the recording medium, and the end does not need to worry about continuous reproduction because there is no subsequent data. By loosening the conditions at the beginning and the end in this way, a short empty area can be effectively used.

<Index File> In order to manage various contents (hereinafter referred to as AV files) including QuickTime movies and still image data contained in the disc, a special QuickTime movie file called AV Index file is stored in the disc. Put one. Fig. 18 shows the AV Index
The file structure is shown below. AV Index file is a normal Quic
As with the kTime movie file, the management information Movie a
It consists of tom1791 and Movie data atom 1792 of the data itself.

The AV Index file manages a plurality of entries, and each AV file in the disc is managed by one entry. In addition, a container (hereinafter called a folder) for collecting each AV file is also managed by one entry.

The Movie atom 1791 is a Property track 1793 for managing the attribute information of each entry and a Title track 179 for managing the title character string data of each entry.
4, it consists of a total of four types of tracks: a Thumbnail track 1795 for managing the thumbnail image data of each entry, and an Intro music track 1796 for managing the representative audio data of each entry.

Attribute information regarding each entry is managed as a sample of each of the tracks 1792 to 1795.
For example, attribute information about AV file 1740 is Property tra.
Sample 1701 on ck1793, title string data is Titl
Sample 1711 on e track 1794, thumbnail image data is sample 1721 on Thumbnail track 1795, representative audio data is sample 1731 on Intro music track 1796
Manage with.

The correspondence between samples is made based on the reproduction start time of each sample. That is, it is determined that samples located at the same time between tracks correspond to the same entry.

The Movie data atom 1793 stores attribute information regarding each AV file, title character string data, thumbnail image data, and representative audio data. The attribute information has the configuration shown in FIG. Each field will be described. version indicates the version of the file format. pe-flags is a collection of various flags, and details will be described later.

The parent-entry-number is the en of the entry corresponding to the folder to which the entry corresponding to the attribute information belongs.
Stores try-number, entry-number stores the entry-number of the entry corresponding to the attribute information. These two pieces of information represent the inclusion relationship between files and folders. set-depend
Descriptions of ent-flags and user-private-flags are omitted.

Creation-time and modification-time represent the date and time when the entry corresponding to this attribute information was created and the date and time when it was modified. duration represents the reproduction time of the entry corresponding to this attribute information. binary-file-identifier
If the entry corresponding to this management information corresponds to a file, is the path name of the file encoded in a fixed length, and a detailed description thereof will be omitted.

The referred-counter stores the number of times the file managed by the entry corresponding to this attribute information is referenced by another file. referring file list is
Stores a list of pathnames of actually referenced files. URL file identifier is used when the managed file cannot be encoded in the above binary-file-identifier.
The file path is stored in URL (Unified Resource Locator) format.

<Processing at the time of recording> The process when the user instructs recording will be described with reference to FIG. The AV stream recorded at this time has a video bit rate Rv = 5Mb.
It is assumed that ps, audio sampling frequency 48 kHz, and bit rate Ra = Rp = 256 kbps. It is assumed that the file system management information has already been read into the RAM 102.

First, the stream structure and continuous region structure are determined (step 701). If 1 VU is configured with 1 GOP = 30 frames, Rs = 20Mbps, Ta = 1 second, Rv = in <Equation 4>
By substituting 5 Mbps and Ra = 256 kbps, Te (i) range of 1.36 seconds or more can be obtained. The playback time for 1 VU is 0.5 seconds, so the RU playback time is 2 seconds.

Next, a movie file recording preparation is made.
Specifically, open the file and search for a free area where one RU can be recorded continuously. If it does not exist, stop recording,
Notify the user that recording is not possible (step 702).

In addition, the audio encoder 117 and the video encoder 118 are activated (step 703). Next, it is checked whether or not 1 RU worth of data is stored in the recording buffer 111 (step 704).

If it has been accumulated, the data for 1 RU in the recording buffer 111 is continuously recorded (step 705).
If not accumulated, it is checked whether or not the recording end is instructed (step 706). If not instructed, step 704 is executed, and if instructed, the following recording end processing is performed.

First, the remaining data (step 707) and management information are recorded in the currently recorded movie file (step 708). Finally, the QuickTime movie file created this time is registered in the AV Index file (step 709). The track types of the video track and audio track are set to "original".

<Processing when Sub Audio is Added> The processing when audio (sub audio) data is added to a video that has already been recorded will be described with reference to FIGS. 21 to 24. There are two possible methods for adding sub audio data from the user. (1) Addition of newly input audio data (post-recording) (2) Designation of already recorded audio data and addition of each will be described below.

<Processing When Adding Sub Audio: Adding New Input Audio> First, a case where so-called post-recording is performed to add newly input audio data will be described. As shown in FIG. 21, on the optical disc 106, a quic in which video data and audio data are stored.
It is assumed that the kTime movie file 2002 and the AV Index file 2001 in which the QuickTime movie file is registered are recorded.

The video data and audio data stored in the QuickTime movie file 2002 are the video track 2011 and the main audio track 20 respectively.
It is supposed to be managed by 12. At this time, a process for adding newly input audio data as sub audio to the QuickTime movie file 2002 will be described with reference to the flowchart shown in FIG.

First, QuickTim which can be reproduced as the initial state
A list of e-movie files is displayed on the GUI screen (step 801). This list is created based on the information recorded in the AV Index file 2001. Since the user wants to add sub audio to the movie file 2002, the QuickTime movie file 2002
Select and instruct playback, and as a result, the movie file
Playback of 2002 is started (step 802).

Next, the user gives an instruction to pause at the place where the dubbing is desired to start, and pauses the reproduction (step 80).
3). Next, the user gives an instruction to start dubbing, and as a result, dubbing is started (step 804). At that time, as a file for recording the post-recording audio data, a QuickTime movie file 200 as shown in FIG.
3 is newly created.

During post-recording, the audio data input from the audio encoder 117 is recorded in the QuickTime movie file 2003 (step 805). When the user instructs the dubbing stop, the management information regarding the input audio data is stored in the file 2003 in the form of a Movie atom (step 806). Next, a track 2023 for managing the sub audio to be added is created in the QuickTime movie file 2002 (step 807).

The track type of the track 2023 is set to "sub audio". Immediately thereafter, the user is presented with a selection screen of "dependent on video (edited in sync with video)" or "independent of video (irrelevant to video editing)" (step 808). In the case of a new input, it is highly likely that it is dependent on video, so the initial value is set to "dependent on video".

When the user selects "dependent on video", first, in the Track header atom of the track 2023, the Track
Track reference t whose type is "sync" in the reference atom
ype atom is added, and T of that Track reference type atom
The Track ID of the video track 2021 of the Quick Time movie file 2002 is stored in rack IDs (step 810).

Next, it is confirmed to the user whether the input audio data may be reused in another content (step 811). It is registered in the Index file 2001 (step 812).

Next, a Sample table atom is added to the track 2023 based on the information of the movie file 2003. At this time, the reference destination of the data is movie file 2003
And In addition, based on the playback start point of the sub audio for that track, that is, the currently paused point.
Create an Edit list atom (step 813).

Finally, the management information of the QuickTime movie file 2002 on the RAM 102 is transferred to the QuickTit on the optical disc 106.
It is reflected in the Movie atom of the me movie file 2002 (step 814), and the Referred-count of the entry corresponding to the QuickTime movie file 2002 in the AV Index file 2001 on the optical disc 106 is incremented by 1 (step 815).

<Processing When Adding Sub Audio: Add Prerecorded Audio> Next, a case where prerecorded audio data is designated and added will be described. As shown in FIG. 24, a QuickTime movie file 2102 in which video data and audio data are stored on the optical disc 106.
Then, it is assumed that a QuickTime movie file 2103 storing only audio data and an AV Index file 2101 in which the QuickTime movie file is registered are recorded.

The video data and audio data stored in the QuickTime movie file 2102 are the video track 2121 and the main audio track 21 respectively.
It is supposed to be managed by 12. The audio data stored in the QuickTime movie file 2103 is assumed to be managed by the audio track 2122.

At this time, QuickTime movie file 2102
The processing for adding the QuickTime movie 2103 as sub audio to the above will be described with reference to the flowchart shown in FIG.

First, QuickTim which can be reproduced as the initial state
A list of e-movie files is displayed on the GUI screen (step 901). This list is created based on the information recorded in the AV Index file 2101. Since the user wants to add sub audio to the movie file 2102, the QuickTime movie file 2102
Select and instruct playback. As a result, the reproduction of the movie file 2102 is started (step 902).

Next, the user gives an instruction to pause at the place where the sub audio is desired to be added, and pauses the reproduction (step 903). Next, an instruction is given to add sub audio, and in accordance with the instruction, a list of QuickTime movie files containing only audio data registered in the AV Index file 2101 is displayed on the GUI screen (step 904). The user selects the movie file 2103 from this list.

Next, a track 2123 for managing the sub audio to be added is created in the QuickTime movie file 2102 (step 905). The track type of the track 2123 is set to “sub audio”. Immediately after that, the user is presented with a selection screen of "dependent on video (edited in synchronization with video)" and "independent of video (irrespective of video editing)" (step 906). Note that when selected from a file, there is a high possibility that synchronization will not occur as compared with the above-mentioned dubbing, so the initial value is set to "independent of video".

When the user selects “dependent on video”, Track refer to the Track header atom of track 2123.
Track reference type at type "sync" in ence atom
om and add Track I of its Track reference type atom
Video Track of Quick Time Movie File 2102 to Ds
The Track ID of 2121 is stored (step 908).

Next, a sample table atom is added to the track 2123 based on the information of the QuickTime movie file 2103. At this time, the reference destination of the data is the movie file 2103. Furthermore, an Edit list atom is created for the track based on the playback start point of the sub audio, that is, the position where the sub audio is currently paused (step 909).

Finally, the management information of the QuickTime movie file 2002 on the RAM 102 is transferred to the QuickTit on the optical disc 106.
It is reflected in the Movie atom of the me movie file 2002 (step 910), and the Referred-count of the entry corresponding to the QuickTime movie file 2102 in the AV Index file 2101 on the optical disc 106 is incremented by 1 (step 911).

<Delete Process> The process at the time of partial deletion in this embodiment will be described with reference to FIG. 26 as an example. Here, it is assumed that the user gives an instruction to delete the partial sections T2031 to T2032 of the QuickTime movie file 2002 as shown in FIG. The processing at this time will be described with reference to the flowchart shown in FIG.

First, it is checked whether or not a sub audio track exists in the QuickTime movie file to be deleted (step 1001). If not, step 10
Execute 04. If present, its sub audio track (track 2023) is the video track (track 2021)
It is checked whether it is synchronized with (step 1002).

Specifically, Track r in the Track header atom
Track reference typ with type “sync” in the eference atom
e atom exists, and track-IDs of the video track Track I
If D is included, it is determined to be in sync. If it is not synchronized, execute step 1004, and if it is synchronized,
The sub audio track section (section 2053) corresponding to the partial sections T2031 to T2032 is excluded from the reproduction target (step 1003).

Next, the sections (sections 2051 and 2052) corresponding to the partial sections T2031 to T2032 in the video track and the main audio track are excluded from the reproduction target (step 1004). Next, the above-mentioned edited result is recorded on the optical disc 106.
M of the above AV file (QuickTime movie file 2002)
It is reflected in the ovie atom (step 1005).

Finally, the above-mentioned editing result is recorded on the optical disc 106.
It is reflected in the above AV Index file (AV Index file 2001). Specifically, Duration and Modificati associated with editing
Reflect changes such as on-time.

As a result of the above processing, when the sub audio track 2023 is synchronized with the video track 2021,
As shown in FIG. 8, sections 2051, 2052, and 2053 of the video track 2021, the main audio track 2022, and the sub audio track 2023 are excluded from the reproduction targets.

On the other hand, when the sub audio track 2023 is not synchronized with the video track 2021, only the video track 2021 and the main audio track 2022 are excluded from the reproduction targets of the sections 2051 and 2052, respectively, as shown in FIG. The sub audio track 2203 is the same as before deletion. In the case of FIG. 28, section 20 of video track 2021
In the section after 61, only the sub audio track 2023 will be played, which is unnatural, so the video track
The section of the sub audio track 2023 corresponding to the section 2061 and subsequent sections of 2021 may be excluded from the reproduction target.

That is, the user only needs to specify the attribute once when recording the sub audio, and does not make any particular edit intention (editing a part of the video causes the BGM to become discontinuous) without any particular designation at the time of editing. Or, there is no dubbing voice left alone).

Although the description is omitted here, when the video is inserted into T2011, as in the above description, when the sub audio track 2023 is synchronized with the video track 2021, there is no data in the section T2031 of the sub audio track 2023. It goes without saying that the sub audio track 2023 is not changed when the playback section is inserted and is not synchronized.

When the user instructs the deletion of the QuickTime movie file 2002, if the QuickTime movie file 2003 referenced by the sub audio track 2023 is not registered in the AV Index file 2001, the QuickTime movie file 2003 is re-created. Since it cannot be used, the QuickTime movie file 2003 is deleted along with the deletion of the QuickTime movie file 2002. Q
uickTime movie file 2003 is AV Index file 2001
If you are registered with, QuickTime Movie File 2002
Delete only.

Furthermore, in this embodiment, partial deletion is
This was realized only by rewriting the Movie atom of the ickTime movie file 2002, that is, the management information, but it goes without saying that the actual AV data included in the QuickTime movie files 2002 and 2003 can be deleted.

<Variation> In this embodiment, the relationship between the sub audio track and the video track is represented by Trackr.
Although it is managed by the information of the eference atom, it goes without saying that any form may be used as long as it can show the relationship between both tracks. For example, it may be managed by another file such as an AV Index file.

Further, in the present embodiment, the user is allowed to select "independent of video" or "dependent on video" when sub audio is added, but the system may automatically set.

Further, although sub audio is taken up in the present embodiment, the present invention is not limited to sub audio. For example, it is needless to say that the present invention can be applied to animations displayed on video in a superimposed manner.

Further, in this embodiment, the sub audio data is stored in a file different from the reference source movie file, but it may be stored in the same file.

Further, in the present embodiment, the audio data file for external reference is recorded in the QuickTime movie file format, but other formats such as MP3 (MPEG 1 Audio Layer 3) format and WAV format (Windows (Registered trademark) standard audio format). However, when referencing those audio data files in the sub audio track, the Sample table ato
We need to parse those files to build m.

[0117]

As described above, according to the present invention,
When sub audio data is added to the video data later, by specifying the synchronization relationship with the video, it is possible for the user to edit as he / she intended without having to specify it when editing, such as deleting or adding. Become.

[Brief description of drawings]

FIG. 1 is a block diagram showing a schematic configuration in an embodiment of the present invention.

FIG. 2 is an explanatory diagram showing the relationship between management information and an AV stream in the QuickTime file format.

[Figure 3] Movie in QuickTime file format
It is explanatory drawing which shows the outline of atom.

[Figure 4] Track in the QuickTime file format
It is explanatory drawing which shows the outline of atom.

[Figure 5] Track in QuickTime file format
It is explanatory drawing which shows the structure of a header atom.

[Figure 6] Media in QuickTime file format
It is explanatory drawing which shows the structure of atom.

[Figure 7] Media in QuickTime file format
It is explanatory drawing which shows the structure of an information atom.

FIG. 8 is an explanatory diagram showing an example of data management by a Sample table atom.

[Figure 9] Sampl in QuickTime file format
It is explanatory drawing which shows the structure of e table atom.

Figure 10: Edi in QuickTime file format
It is explanatory drawing which shows the structure of t atom.

FIG. 11 is an explanatory diagram showing an example of specifying a reproduction range by an Edit atom.

Fig. 12 Tra in QuickTime file format
It is explanatory drawing which shows the structure of ck reference.

[Figure 13] Use in the QuickTime file format
It is explanatory drawing which shows the structure of r data atom.

FIG. 14 is an explanatory diagram showing the structure of an AV stream according to the present invention.

FIG. 15 is an explanatory diagram showing the structure of a VU according to the present invention.

FIG. 16 is an explanatory diagram showing an AV stream management mode according to the present invention.

FIG. 17 is an explanatory diagram showing a reference device model according to the present invention.

FIG. 18 is an explanatory diagram showing the structure of an AV Index according to the present invention.

FIG. 19 is an explanatory diagram showing a structure of attribute information in the AV Index according to the present invention.

FIG. 20 is a flowchart showing a recording operation according to the present invention.

FIG. 21 is an explanatory diagram showing an example of a state immediately before the addition of sub audio data in the present invention.

FIG. 22 is a flowchart showing a new input sub audio adding operation in the present invention.

FIG. 23 is an explanatory diagram showing an example of a state immediately after adding sub audio data in the present invention.

FIG. 24 is an explanatory diagram showing an example of a state immediately before adding recorded data as sub audio in the present invention.

FIG. 25 is a flowchart showing an operation of adding prerecorded sub audio data in the present invention.

FIG. 26 is an explanatory diagram showing an example of a state immediately before partial deletion according to the present invention.

FIG. 27 is a flowchart showing a partial deletion operation in the present invention.

FIG. 28 is an explanatory diagram showing an example of a first state after partial deletion according to the present invention.

FIG. 29 is an explanatory diagram showing an example of a second state after partial deletion according to the present invention.

FIG. 30 is an explanatory diagram showing an example of a state immediately before partial deletion in the related art.

FIG. 31 is an explanatory diagram showing an example of a first result after the partial deletion that the user may desire in the related art.

FIG. 32 is an explanatory diagram showing an example of a second result after the partial deletion that the user may desire in the related art.

[Explanation of symbols]

100 bus 101 Host CPU 102 RAM 103 ROM 104 User interface 105 system clock 106 optical disk 107 pickup 108 ECC decoder 109 ECC encoder 110 Playback buffer 111 Recording / recording buffer 112 Demultiplexer 113 multiplexer 114 Multiplexing buffer 115 audio decoder 116 video decoder 117 audio encoder 118 video encoder

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Takayoshi Yamaguchi             22-22 Nagaikecho, Abeno-ku, Osaka-shi, Osaka             Inside the company F-term (reference) 5C053 FA23 GA11 GB15 GB37 HA30                       JA07 JA22 JA30                 5D044 AB07 BC04 CC06 DE32 DE48                       GK12 GM21 HL16                 5D110 AA14 AA29 BB01 BB20 CA05                       CA06 CA31 CB08 CC06 CF21                       DA12 DB03 DC05 DC16 DE01

Claims (3)

[Claims] 1. A recording method for recording first data and second data in association with each other, the first data requiring synchronization of the second data with a specific portion of the first data. And a second type that does not require synchronization with the specific portion of the first data for recording. 2. A method of editing data recorded according to the recording method according to claim 1, wherein the second data classified into the first type when the first data is edited, A data editing method characterized by editing at the same time as related first data. 3. A method of editing data recorded according to the recording method of claim 1, wherein, when editing the first data, the second data classified into the first type includes: A data editing method characterized by not editing at the same time as the related first data.