JP2001176195A - Recording device and method, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent a drop of accessibility and to improve an editing property when the data whose data structure is converted are recorded on a recording medium. SOLUTION: An MPEG coded encoding output is supplied to a file generator 5. The file generator 5 converts the data structure of the encoding output so as to have a file structure dealt with a Quick Time. Plural video Samples are answered to a video Chunk, and plural audio Samples so as to become a time equal to the video Chunk are answered to the audio Chunk. The processing of error correction coding, data modulation are performed for the data made as the file format of the Quick Time, and the processed data are recorded on an optical disk 20. Plural pieces of sets that video and audio Chunks are multiplexed are recorded with the continuous recording length of the optical disk. A Chunk flag showing a relation of a track becoming an object of continuous recording and a Chunk number showing the number of Chunk or set pieces incorporated in the continuous recording length are defined newly in the Movie Resource part of the Quick Time.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to a recording apparatus and method suitable for recording a video signal and / or an audio signal encoded by compression encoding, for example, MPEG, on an optical disk, and a recording medium.

[0002]

2. Description of the Related Art In recent years, QuickTime has been known as multimedia-compatible system software. QuickT
ime is software for handling data that changes over time (called a movie). Movie includes moving image, audio and character data. Currently, Apple
As a QuickTime file format, MPEG-1 (Mov
ing Picture Experts Group phase 1) program stream (data format in which video elementary stream and audio elementary stream are multiplexed with time)
There is a file storage format. In this storage format, MPEG
1—corresponds the entire file, ie a single closed scene, to a Sample in the QuickTime file format, regardless of its length, and its huge Sa
treats mple as one giant Chunk.

[0003] In addition, audio and video data are put together into one QuickTime file format.
Track and one Media. MPEG as a new Media Type to understand this data
Media is defined, and video and audio data contained in huge Samples and Chunks are understood.

[0004]

SUMMARY OF THE INVENTION However, the huge
Accessibility to specific data in the sample decreases,
In addition, there is a problem of poor editability. For example, in order to enable playback and editing by QuickTime on a computer, video and audio data on a recording medium, for example, an optical disk in a portable camera-integrated recording / reproducing apparatus are transferred to QuickTime
It is conceivable that the data is stored according to the file format. Even in this case, it is necessary to solve the problem of poor access to specific data and poor editability. The same applies to a recording / reproducing apparatus for not only video data but also audio data.

Accordingly, an object of the present invention is to provide a QuickTim
e. A recording apparatus and method capable of preventing deterioration in accessibility and improving editability when recording data having a data structure converted to a file structure conforming to a multimedia data format such as e. , And a recording medium.

[0006]

According to a first aspect of the present invention, there is provided a recording apparatus for recording video data on a rewritable optical disk, wherein the video data is encoded by compression encoding. The data structure of the encoded video data from the encoding means is converted so that it has a file structure that can be handled by the encoding means and computer software for synchronously reproducing moving images without using special hardware. And a means for recording data having a file structure on an optical disc, wherein the file structure has a first data unit and a second data unit as a set of a plurality of first data units. , A plurality of second data units corresponding to a continuous recording length when writing to an optical disc.

According to a second aspect of the present invention, there is provided a recording apparatus for recording audio data on a rewritable optical disk,
Means for converting the data structure of audio data or coded audio data so as to have a file structure that can be handled by computer software for synchronously playing a moving image or the like without using special hardware; and a file structure. Means for recording data having the following structure on an optical disc, wherein the file structure has a first data unit and a second data unit as a set of a plurality of first data units, and a plurality of second data units. A recording apparatus is characterized in that a data unit is made to correspond to a continuous recording length when writing to an optical disk.

According to a third aspect of the present invention, in a recording apparatus for recording video data and audio data on a rewritable optical disk, compression encoding having a group structure of a plurality of frames is performed by combining inter-frame prediction encoding and motion compensation. Video encoding means for encoding video data, audio output means for outputting compressed encoded or uncompressed audio data, and computer software for synchronously reproducing moving images without using special hardware. The data structures of the encoded video data from the encoding means and the audio data from the audio output means are respectively converted so as to have a file structure that can be handled, and the encoded video data and audio data having the file structure are multiplexed. Means and a file structure Becomes the multiplexed data and means for recording on the optical disc, the file structure, the second and the first data unit, as a set of a plurality of first data units
A plurality of second data units corresponding to a continuous recording length when writing to the optical disc.

According to a ninth aspect of the present invention, there is provided a recording method for recording video data on a rewritable optical disk, wherein the video data is encoded by compression encoding;
Converting the data structure of the encoded video data so that it has a file structure that can be handled by computer software for synchronously playing a moving image or the like without using special hardware; and On the optical disc, and the file structure is composed of a first data unit and a plurality of first data units.
And a second data unit as a set of data units, and a plurality of second data units are made to correspond to a continuous recording length when writing to an optical disc.

According to a tenth aspect of the present invention, in a recording method for recording audio data on a rewritable optical disk, a file which can be handled by computer software for synchronously reproducing a moving image or the like without using special hardware. Converting the data structure of the audio data or encoded audio data to have a structure, and recording the data having the file structure on the optical disc, the file structure comprising:
It has a first data unit and a second data unit as a set of a plurality of first data units, and is adapted to correspond to a continuous recording length when writing the plurality of second data units to an optical disc. Is a recording method.

According to an eleventh aspect of the present invention, there is provided a recording method for recording video data and audio data on a rewritable optical disk, wherein compression encoding having a group structure of a plurality of frames is performed by combining inter-frame prediction encoding and motion compensation. A video encoding step for encoding video data, an audio output step for outputting compressed encoded or uncompressed audio data, and a computer for synchronously reproducing moving images without using special hardware Converting the encoded video data and the output audio data data structure so as to have a file structure that can be handled by software, and multiplexing the encoded video data and audio data having the file structure; Structured and multiplexed Recording the data on an optical disc, wherein the file structure has a first data unit and a second data unit as a set of a plurality of first data units, and a plurality of second data units. The recording method is adapted to correspond to a continuous recording length at the time of writing to an optical disc.

According to a twelfth aspect of the present invention, there is provided a recording medium having recorded thereon a computer-controllable program for recording video data on a rewritable optical disk, the program comprising the steps of: encoding video data by compression encoding; , So that it has a file structure that can be handled by computer software for synchronously playing moving images etc. without using special hardware,
The method comprises the steps of converting the data structure of encoded video data and recording data having a file structure on an optical disc, wherein the file structure includes a first data unit and a set of a plurality of first data units. A second data unit, wherein the plurality of second data units are made to correspond to a continuous recording length when writing to an optical disk.

According to a thirteenth aspect of the present invention, in a recording medium on which a computer-controllable program for recording audio data on a rewritable optical disk is recorded, the program synchronizes a moving image or the like without using special hardware. Converting the data structure of the audio data or the encoded audio data to have a file structure that can be handled by computer software for reproducing the data, and recording the data having the file structure on an optical disc. ,
The file structure has a first data unit and a second data unit as a set of a plurality of first data units, and corresponds to a continuous recording length when writing the plurality of second data units onto an optical disc. The recording medium is characterized in that the recording medium is to be stored.

According to a fourteenth aspect of the present invention, there is provided a recording medium on which a computer-controllable program for recording video data and audio data on a rewritable optical disk is recorded. A video encoding step of encoding video data by compression encoding having a group structure of a plurality of frames, an audio output step of outputting compressed encoded or uncompressed audio data, and special hardware. The data structure of the encoded video data and the output audio data are converted so as to have a file structure that can be handled by computer software for synchronously reproducing moving images without using the code having the file structure. Video data and audio A step of multiplexing Odeta,
Recording the multiplexed data on an optical disc having a file structure.
And a second data unit as a set of a plurality of first data units, the plurality of second data units corresponding to a continuous recording length when writing to an optical disc. It is a recording medium.

According to the present invention, when recording data having a file structure on an optical disk, the continuous recording length is made to correspond to a plurality of second data units (for example, Chunk of QuickTime), so that the accessibility and the editability are improved. Can be improved.
Also, since a plurality of sets of coded video data and audio data (compressed or uncompressed) are made to correspond to the continuous recording length, accessibility and editability can be improved.

[0016]

DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below with reference to the drawings. FIG. 1 shows a digital recording / reproducing apparatus according to an embodiment of the present invention. In FIG. 1, reference numeral 1 denotes a video encoder. The video input is supplied to a video encoder 1 where the video signal is compression encoded. Reference numeral 2 denotes an audio encoder, and an audio input is compressed and encoded in the audio encoder 2 by an audio input. As compression coding for video signals and audio signals, for example, M
PEG is used. The output of each of the video encoder 1 and the audio encoder 2 is called an elementary stream.

In the case of MPEG, the video encoder 1 includes a motion prediction unit for detecting a motion vector, a picture order rearrangement unit, a subtraction unit for forming a prediction error between an input video signal and a local decoded video signal, and a DCT for a subtraction output. DCT to transform
, A quantization unit for quantizing the output of the DCT unit, a variable-length encoding unit for variable-length encoding the quantized output, and a buffer memory for outputting encoded data at a constant rate.
The picture order rearranging unit rearranges the order of the pictures to one suitable for the encoding process. That is, the I and P pictures are encoded first, and then the pictures are rearranged in an order suitable for encoding the B picture. The local decoding unit includes an inverse quantization unit, an inverse DCT unit, an addition unit, a frame memory, and a motion compensation unit. In the motion compensation unit, forward prediction, backward prediction, and bidirectional prediction are possible. In the case of intra coding, the subtraction unit does not perform the subtraction processing, and simply passes the data. Further, the audio encoder 2 includes a subband encoding unit, an adaptive quantization bit allocation unit, and the like.

As an example, in the case of a portable camera-integrated disk recording / reproducing apparatus, an image taken by a video camera is used as a video input, and sound collected by a microphone is used as an audio input. In the video encoder 1 and the audio encoder 2, an analog signal is converted into a digital signal and processed. In this embodiment, a rewritable optical disk is used as a recording medium. As this type of optical disk, a magneto-optical disk, a phase change disk, or the like can be used. In one embodiment, a relatively small diameter magneto-optical disk is used.

Video encoder 1 and audio encoder 2
Is supplied to the file generator 5. The file generator 5 has a data structure of a video elementary stream and an audio elementary stream so as to have a file structure that can be handled by computer software for synchronously reproducing a moving image or the like without using special hardware. To convert. In this embodiment, for example, QuickTime is used as software.
A series of time-varying data processed by QuickTime (video data, audio data, text data)
Is called a QuickTime Movie. In the file generator 5, the encoded video data and the encoded audio data are multiplexed. The file generator 5 is controlled by the system control microcomputer 9 to create the structure of the QuickTime movie file.

The QuickTime movie file from the file generator 5 is sequentially written to the memory 7 via the memory controller 8. When a data write request to the disk is input from the system control microcomputer (microcomputer) 9 to the memory controller 8, the QuickTime movie file is read from the memory 7 by the memory controller 8. Here, the transfer rate of the QuickTime movie encoding is lower than the transfer rate of the write data to the disk, for example, about 1/2. Therefore, while the QuickTime movie file is continuously written to the memory 7, reading from the memory 7 is performed intermittently while the system control microcomputer 9 monitors that the memory 7 does not overflow or underflow.

The QuickTime movie file read from the memory 7 via the memory controller 8 is supplied to the error correction code / decoder 11. The error correction code / decoder 11 writes the QuickTime movie file into the memory 10 once, performs a process of generating interleaved and redundant data of the error correction code, and reads out the data to which the redundant data is added from the memory 10.

The output of the error correction code / decoder 11 is supplied to a data modulator / demodulator 13. The data modem 13 is
When digital data is recorded on a disk, the data is modulated so that clock extraction during reproduction is facilitated and problems such as intersymbol interference do not occur. For example, RLL (1,
7) can be used.

The output of the data modulator / demodulator 13 is supplied to the magnetic field modulation driver 14 and outputs a signal for driving the optical pickup 23. Magnetic field modulation driver 14
Drives the magnetic field head 22 according to the input signal to apply a magnetic field to the optical disk 20. Optical pickup 23
Irradiates the optical disc 20 with a recording laser beam. Thus, data is recorded on the optical disc 20. The optical disk 20 is driven by a motor 21
LV (constant linear velocity), CAV (constant angular velocity), or Z
It is rotated at CAV (zone CLV).

Since the intermittent data read from the memory controller 8 is recorded on the optical disc 20, a continuous recording operation is not normally performed. When a certain amount of data is recorded, the recording operation is interrupted, and the next recording request is made. The recording operation is performed intermittently so as to wait until the recording operation.

In response to a request from the system control microcomputer 9, the drive control microcomputer 12
And the entire disk drive is controlled. Thereby, a recording operation is performed. Servo circuit 15
Accordingly, servo, tracking servo, and focus servo for movement of the optical pickup 23 in the disk radial direction are performed, and spindle servo of the motor 21 is performed. Although not shown, a user operation input unit is provided in association with the system control microcomputer 9.

Next, the configuration and operation for reproduction will be described. At the time of reproduction, the optical disk 20 is irradiated with a reproduction laser beam, and the light reflected from the optical disk 20 is converted into a reproduction signal by a detector in the optical pickup 23. In this case, a tracking error and a focus error are detected from the output signal of the detector of the optical pickup 23, and the servo circuit 15 controls the read laser beam so that the read laser beam is positioned on the track and focused on the track. Further, in order to reproduce data at a desired position on the optical disc 20, the radial movement of the optical pickup 23 is controlled.

At the time of reproduction, as in the case of recording,
kTime Plays data from the optical disc 20 at a higher rate than the transfer laser of the movie file, for example, at twice the rate. In this case, usually, continuous reproduction is not performed, but after reproducing a certain amount of data, the reproduction operation is interrupted, and an intermittent reproduction operation such as waiting for the next reproduction request is performed.
In the reproduction operation, similarly to the recording operation, the drive control microcomputer 12 issues a request to the servo circuit 15 in response to a request from the system control microcomputer 9, and the entire disk drive is controlled.

A reproduced signal from the optical pickup 23 is input to the data modulator / demodulator 13 and demodulated. The demodulated data is supplied to the error correction code / decoder 11. In the error correction code / decoder 11, the reproduced data is once written in the memory 10 and deinterleaving processing and error correction processing are performed. Quic after error correction
The kTime movie file is written to the memory 7 via the memory controller 8.

The QuickTime movie file written in the memory 7 is output to the file decoder 6 in accordance with a request from the system control microcomputer 9 in synchronization with the timing of demultiplexing. The system control microcomputer 9 is used to continuously reproduce video and audio signals.
The amount of data reproduced from the optical disk 20 and written to the memory 7 and the amount of data read from the memory 7 and output to the file decoder 6 are monitored, and the memory controller 8 and the drive control are controlled so that the memory 7 does not overflow or underflow. The microcomputer 12 controls the microcomputer 12 to read data from the optical disc 20.

The file decoder 6 decomposes the QuickTime movie file into a video elementary stream and an audio elementary stream under the control of the system control microcomputer 9. The video elementary stream is supplied to the video decoder 3, and the audio elementary stream is supplied to the audio decoder 4. The video elementary stream and the audio elementary stream from the file decoder 6 are output so that they are synchronized.

Video decoder 3 and audio decoder 4
Performs decoding of the compression encoding, respectively, and generates a video output and an audio output. For example, MPEG is used as compression encoding of video signals and audio signals. Although not shown, a video output is output to a display (liquid crystal or the like) via a display drive and displayed, and an audio output is output to a speaker via an audio amplifier and reproduced.

The video decoder 3 includes a buffer memory, a variable-length code decoding unit, an inverse DCT unit, an inverse quantization unit, an addition unit for adding the output of the inverse quantization unit and the local decoding output, a picture order rearranging unit, and a frame. It is configured by a local decoding unit including a memory and a motion compensation unit. In the case of intra coding, the addition processing is not performed in the addition unit,
The data passes through the adder. The decoded data from the adding unit is set to the original image order by the picture order rearranging unit.

Since the optical disk 20 on which data is recorded as described above is detachable, it can be reproduced by other devices. For example, a personal computer operating with QuickTime application software can read data recorded on the optical disk 20 and reproduce video and audio data recorded by the personal computer. further,
The present invention can be applied to a case where only video data or only audio data is handled.

The above-described embodiment of the present invention will be described in more detail. First, QuickTime will be schematically described with reference to FIG. QuickTime is generally an OS extension function for playing moving images without using special hardware. A variety of data formats can be handled, and up to 32 tracks of audio, video, MIDI and other output can be synchronized.

A QuickTime movie file is roughly divided into two parts, Movie Resource and Movie Data. The Movie Resource section stores the time required to play the QuickTime file and information for referencing actual data. The Movie Data section stores actual video and audio data. .

One QuickTime movie file contains:
Different types of Me, such as sound, video, text
dia Data can be stored as separate Tracks respectively, called Sound Track, Video Track, Text Track,
It is strictly managed on the time axis. Each Track has a Media for referring to the compression method, storage location and display time of each actual data. In the Media, the size of the minimum unit Sample that indicates the unit in which the actual data is stored in the Movie Data part, the storage location of the Chunk that collects multiple Samples and blocks them,
Stores information such as the display time.

FIG. 2 shows an example of a QuickTime movie file that handles audio data and image data. Quic
The largest component of a kTime movie file is Movi
e Resource part and Movie Data part. Movie Reso
In the urce part, data required for reproducing the file and data for referring to actual data are stored. Also,
The Movie Data portion stores actual data such as video and audio.

The Movie Resource part will be described in detail. Movie Resource part 50 and track part 5 that describes information about individual data stored in the movie data
1, a media section 52 for describing information about individual data, a media information section 53, and a sample table section 54. This Resource
Is related to one Video Track, and although not shown, the audio track has the same structure.
Resource 55 is described.

The Movie Resource portion 50 includes a movie header 41 that describes information relating to the entire file. The track section 51 includes a Track header 42 that describes information on the entire track. The media section 52 includes a Media header 4 that describes information related to the entire medium.
3. Medi that describes information related to handling of media data
a handler 44 is included. Media information section 53 includes a Media that describes information related to the image media.
A header 45, a data handler 46 for describing information related to handling of image data, and a data information 47 for describing information about data are included.
The sample table section 54 includes a sample description 57 for describing each Sample, a time-to-sample describing the relationship between the Sample and the time axis, a Sample size 48 describing the size of the Sample, and a relationship between the Sample and the Chunk. A sample-to-two chunk to be described, a chunk offset 49 for describing a start byte position of the chunk in the movie file, a sync sample for describing synchronization, and the like are stored.

On the other hand, for example, MP
Audio data encoded by a compression encoding scheme based on EG audio layer 2, and for example MPE
Image data encoded by the compression encoding method conforming to the G rule is stored in units of Chunks each composed of a predetermined number of Samples. Of course, the encoding method is not limited to these, and it is also possible to store linear data that has not been subjected to compression encoding.

Each Track in the Movie Resource part,
It is associated with the data stored in the Movie Data part. That is, since the example shown in FIG. 2 deals with audio data and image data, Movie Resour
The ce part contains a track for video data and a track for audio data, and the Movie Data part contains
Actual data of audio data and actual data of image data are included. When dealing with other types of data, use Mo
The contents of the Track in the vie Resource portion and the contents of the actual data in the Movie Data portion may be adjusted to the data to be handled. For example, when handling text, MIDI, and the like, the Movie Resource portion may include a track for text, MIDI, and the like, and the Movie Data portion may include actual data such as text and MIDI.

FIGS. 3 and 4 show Mo in QuickTime.
This shows a more detailed data structure of the vie resource. FIGS. 3 and 4 are originally one diagram, but show the data structure of the resource by dividing it due to the restriction of the drawing space. As described with reference to FIG.
The e Resource section 50 includes a track section 51 for describing information about individual data stored in the movie data, a media section 52 for describing information about individual data,
It has a hierarchical structure of a media information section 53 and a sample table section 54. This Resource is related to one Video Track and is not shown.
ce55 is described.

Next, as a compression encoding / decoding method, MPE
When G2 is used, the compressed video data (video elementary stream) and the compressed audio data (audio elementary stream) are
Explain how to convert to e-file format. Here, MPEG will be described.
Has a hierarchical structure of six layers of a sequence layer, a GOP layer, a picture layer, a slice layer, a macroblock layer, and a block layer in order from the top. A header is added to the head of each layer. For example, the sequence header is a header added to the head of the sequence layer, and includes a sequence start code, a horizontal and vertical size of a screen, an aspect ratio, a picture rate, a bit rate, a VBV buffer size, a constraint parameter bit, and two quantization matrices. The load flag and the contents are included.

In the case of MPEG, there are three types of picture types, I, P and B. I picture
(Intra-coded picture: Intra-coded picture) uses information that is closed only in one picture at the time of encoding. Therefore, at the time of decoding, decoding can be performed using only the information of the I picture itself. P picture (Predictive-code
d picture: a forward prediction coded image uses a previously decoded I picture or P picture temporally earlier as a prediction image (a reference image for obtaining a difference). Encoding the difference from the motion compensated predicted image,
Encode without taking the difference or select the more efficient one for each macroblock. B picture (Bidirectionally p
redictive-coded picture: bidirectional predictive coded image)
Are the predicted I-pictures or P-pictures that are temporally earlier and the I-pictures or P-pictures that are temporally later, as predicted images (images serving as a reference for taking a difference).
Three types of pictures, as well as interpolated images made from both, are used. Among the three types of difference coding after motion compensation and intra coding, the most efficient one is selected for each macroblock.

Therefore, as the macroblock type,
Intra-frame coding (Intra) macroblock, forward (Fward) inter-frame prediction macroblock predicting the future from the past, and backward (Backward) interframe prediction macroblock predicting the future from the future, There is a bidirectional macroblock to be predicted. All macroblocks in an I picture are intra-coded macroblocks. The P picture includes an intra-frame coded macro block and a forward inter-frame predicted macro block. The B picture includes all four types of macroblocks described above.

In MPEG, a GOP (Group Of Picture) structure, which is a group of a plurality of pictures, is defined in order to enable random access. G
According to the MPEG rules regarding the OP, first, on the bit stream, the first of the GOP is an I picture,
Specifies that the end of the GOP is an I or P picture in the order of the original images. Also, as a GOP,
Structures that require prediction from the last I or P picture of the previous GOP are also allowed. A GOP that can be decoded without using the image of the previous GOP is a closed GOP
It is called. In this embodiment, the structure is a closed GOP, and editing in GOP units is possible.

As MPEG audio (compression method), three modes of layer 1, layer 2 and layer 3 are defined. For example, in layer 1, 32-subband encoding and adaptive bit allocation are performed, and one audio decoding unit is 384 samples. One audio decoding unit is one of the audio bit stream.
An audio frame. The audio decoding unit alone is the minimum unit that can decode encoded data into audio data. Similarly, for video data, a video decoding unit corresponding to one video frame is defined. One video frame is 1/30 in the NTSC system.
Seconds. Normally, the bit rate of layer 1 audio is 256 kbps in stereo. In layer 2, 32-subband encoding and adaptive bit allocation are performed, and one audio decoding unit is 1152 samples. Usually, the bit rate of layer 2 audio is 192 kbps in stereo.

The file generator 5 has the above-described QuickTime
MPE to file structure conforming to file format
Convert video and audio data compressed with G. FIG. 5 shows a video frame, a GOP, and a QuickTime
Shows the relationship between Sample and Chunk units in the file format. As described above, Sample is the minimum unit in Movie data, and Chunk is a unit obtained by collecting and blocking a plurality of Samples.

As shown in FIG. 5A, for example, 15 video frames of the original video signal are compression-encoded by MPEG2,
One GOP is set. Fifteen video frames are 0.5 seconds in duration. The GOP is preferably a closed GOP
Structure. A sequence header (SH) is added to the head of each GOP. The sequence header and the GOP are one video decoding unit. GO sequence header
By adding each P, Samp directly in QuickTime
The access in units of le and the decoding of the data become possible.
The video encoder 1 in FIG. 1 outputs the MPEG video elementary stream shown in FIG. 5A.

As shown in FIG. 5B, one of the video decoding units
One is 1Sample of the QuickTime file format. Two samples that are temporally continuous (for example, Sample # 0,
Sample # 1) is associated with one video Chunk (for example, Chunk # 0). The length of one video chunk is one second, and the length of three video chunks is three seconds. Note that one sample may correspond to six GOPs and one video chunk may correspond to one sample. Even then, one video
Chunk's duration is 3 seconds.

FIG. 6 is a diagram showing an audio frame, an audio decoding unit, and a Quic when MPEG-2 layer 2 encoding (256 kbps in 2-channel stereo) is performed.
Sample and audio Ch in kTime file format
Indicates the relationship with the unit of unk. In layer 2, 1152 samples / channel of audio samples are defined as one audio frame. As shown in FIG. 6A, in the case of stereo, audio data of 1152 samples × 2 channels is encoded in layer 2 and is set as one audio decoding unit. One audio decoding unit includes data of 384 bytes × 2 channels after compression encoding. In the audio decoding unit, header and information necessary for decoding (allocation, scale factor, etc.)
Is included.

As shown in FIG. 6B, one of the audio decoding units is defined as one sample of the QuickTime file format. Therefore, audio decoding can be performed in QuickTime on a Sample basis. 41 Samps that are continuous in time
le (for example, Sample # 0 to Sample # 40) to one audio
Chunk (for example, Chunk # 0) and 42 samples that are temporally continuous (for example, Sample # 41 to Sample # 82) are made to correspond to one audio Chunk (for example, Chunk # 1) and are temporally continuous. 42 Samples (for example, Sample # 8
3 ~ Sample # 124) to one audio chunk (eg Ch
unk # 2). The length of one audio chunk is
When the sampling frequency of the audio is 48 kHz, it is about 1 second. Therefore, three consecutive audio chunks are 3 seconds long.

5 and 6 separately show the structure of the video data and the structure of the audio data. In the file generator 5, these are multiplexed as one data stream (also referred to as interleaving). And QuickT
Form an ime movie file. In a QuickTime movie file, video chunks and audio chunks are
Alternately exists in vie data. In this case, the audio chunk and the video chunk, which are synchronized and played at the same time,
(For example, video Chunk # 0 in FIG. 5B and audio in FIG. 6B
The related video and audio chunks are arranged adjacent to each other so as to correspond to the chunk # 0). As described above, the time length of the video data included in one video chunk is equal to the time length of the audio data included in one audio chunk, and is selected to be, for example, one second. The time length of one audio chunk is not strictly 1 second, but the time length of three video chunks and the time length of three audio chunks are equal to 3 seconds.

As another example of audio compression encoding,
ATRAC (Adaptive Tr
ansform Acoustic Coding) may be used. ATRA
In C, one sample 1 sampled at 44.1 kHz
Processes 6-bit audio data. The smallest data unit when processing audio data in ATRAC is a sound unit. In the case of stereo, one sound unit is 512 samples × 16 bits × 2 channels.

When ATRAC is adopted as audio compression encoding, as shown in FIG. 7A, one sound unit is compressed into audio decoding units of 212 bytes × 2 channels. As shown in FIG. 7B, one audio decoding unit is one sample of the QuickTime file format.
To correspond to. Also, 64 Samples are made to correspond to one audio chunk of the QuickTime file format.

As audio compression encoding, M
PEG audio layer 3, ATRAC3 with a higher ATRAC compression rate, and the like can also be used. Further, according to the present invention, audio data may be recorded without compression. A system without compression is called linear PCM.
Also in the linear PCM, 512 audio samples are regarded as one audio decoding unit, and one audio decoding unit is defined as 1 Sample of the QuickTime file format.
To correspond to.

FIG. 8 shows a QuickTime file format for video when video and audio are multiplexed. As shown in FIG. 8A, the period of a video frame is set to t0 seconds, and the number of frames included in one GOP is set to f0. The MPEG video elementary stream shown in FIG. 8B is formed by encoding the original video data using MPEG2. As mentioned above,
A sequence header (SH) is added for each GOP.

Then, as shown in FIG. 8C, the GOP to which the sequence header is added is associated with one Sample in the QuickTime file format. The size of one sample is called a sample size. A plurality of Samples, for example, the six Samples described above, constitute one Chunk of the QuickTime file format. As shown in FIG. 8D, video Chunks and audio Chunks are multiplexed by being alternately arranged in Movie data, thereby forming a QuickTime movie file. The start position of each video chunk on the QuickTime movie file is called a video chunk offset. The video chunk offset is represented by the number of bytes from the beginning of the file to the beginning of the video chunk.

FIG. 9 shows a QuickTime file format relating to audio when video and audio are multiplexed. In FIG. 9, division symbols A, B, C, and D are given from the lower side to the upper side in the order of signal processing. As shown in FIG. 9A, the original audio signal is digitized, and one audio frame includes f0 audio samples × n channels. By compressing and encoding the original audio data with MPEG audio, an MPEG audio elementary stream shown in FIG. 9B is formed.

Then, as shown in FIG. 9C, for example, one audio decoding unit is associated with 1 Sample in the QuickTime file format. The size of one sample is
It is called Sample size. Multiple Samples, for example 1 above
One audio chunk of the QuickTime file format is composed of 25 samples. As shown in FIG. 9D, video Chunks and audio Chunks are multiplexed by being alternately arranged on the time axis, thereby forming a QuickTime movie file. The beginning of each audio chunk on the QuickTime movie file is audio
It is called Chunk offset. The audio chunk offset is represented by the number of bytes from the beginning of the file to the beginning of the audio chunk. The time lengths of the video chunk and the audio chunk are equal to each other, and are 1 second or 3 seconds.

[0061] Sample size of video sample, audio
Sample size of sample, value of video chunk offset,
The value of the audio chunk offset is described in the resource of the QuickTime movie file. Thus, each Sample in each Chunk can be specified, and editing can be performed in Sample units (decoding units).

As described above, the QuickTim in which the video Chunk and the audio Chunk are multiplexed (interleaved)
A recording method for recording an e-movie file on the optical disc 20 will be described. As mentioned above, Quic
The kTime movie file is largely a Movie Resource
And Movie Data. QuickTime
When recording a movie file on the optical disc 20,
Movie Resource and Movie Data (actual data) Chunk
(Video Chunk or Audio Chunk) correspond to the continuous recording length on the disc. What is the continuous record length?
One access, that is, a length that allows writing to consecutive addresses without involving a jump operation of the optical pickup 23.

When the video chunk and the audio chunk are multiplexed, the audio chunk and the video chunk corresponding (adjacent) to each other in the movie data are multiplexed.
Make several of the sets of k correspond to the continuous record length. FIG.
As shown in FIG. 5, three sets of video Chunk #i for one second shown in FIG. 5B and audio Chunk #i for about one second shown in FIG. Seconds of data correspond to the continuous recording length on the optical disk. For example, data for 3 seconds of (Audio Chunk # 1, Video Chunk # 1, ~ Audio Chunk # 3, Video Chunk # 3) is 1
It is recorded so as to correspond to the continuous recording length.

As shown in FIG. 10, the position of the continuous recording length on the optical disk 20 is physically discontinuous. Therefore, a track jump occurs during the playback of two consecutive recording lengths, such as during the playback of the Movie Resource first and then the playback of the first audio chunk and video chunk. However, as described above, the transfer rate of the write / read data is selected to be higher than the transfer rate of the QuickTime movie file, for example, twice, so that even if intermittent reading is performed,
Can play back a series of QuickTime movie files.

As described above, the transfer rate of the QuickTime movie file, the read rate of the optical disk, the time of the continuous recording length, and the seek time of the disk drive (the time it takes to jump from one track to a different track and reproduce) are mutually different. Involved. Therefore, the time of video and audio data recorded in the continuous recording length can be variously selected other than 3 seconds. It is preferable that the time corresponding to the time of the number of video frames of the video data recorded in the continuous recording length includes an integer number of audio samples.

In the above-described embodiment, it is possible to record only video or audio on an optical disc, or to multiplex video and audio and record on an optical disc.
It is possible to include one or more Chunks. Thus, in one embodiment, the audio Chunk,
Information indicating how the video chunk is set as the continuous recording length on the optical disc is stored in the Movie Resource section (management information section) in the QuickTime movie file. That is, how the data of the audio track and the data of the video track are subject to continuous recording can be understood by looking at the information in the management data section in the file.
This information includes information indicating the relationship between tracks to be continuously recorded and information on the number of chunks (or sets) included in the continuous recording length.

Specifically, the above-described information is described in a portion of a sample description 57 (see FIGS. 2 and 4) existing in a Movie Resource portion in a QuickTime movie file. FIG. 11 shows the general structure of a QuickTime movie file composed of two tracks, video and audio. The sample description 57 can store CODEC (compression / expansion method) and various kinds of information relating to its attributes as information mainly necessary for interpreting the sample data.

FIG. 12 shows a sample description 57.
Is shown in more detail. In this embodiment, in addition to the information storage area normally used in the sample description 57, seven fields are additionally defined as shown in FIG. The Data format field is information for identifying a format type such as an audio or video compression method. In this example, when recording MPEG2 video and audio data of MPEG audio layer 2, DM is used as an example of the format type.
The character string PG is stored.

The expanded seven fields are defined as a set. This is QuickTime's Movie Re
Similar to the basic structural unit of source, the structure starts with "size" over the entire extended part, followed by "type" for recognizing the extended contents, and then actual extended "data". I have it.

Specifically, in this example, a 4-byte Extens
The size (the number of bytes) of all seven extended fields is stored in the ion size part, and the extent of the extended part is identified. Subsequently, a character string such as stde, for example, is stored as a type name for recognizing the expanded contents in the 4-byte Extension type portion. In other words, it is understood that the type name (stde) stores information on tracks to be continuously recorded on the disk defined by extension and information on its chunk as data. Then, five types (Flags, Track ID, Data
reference index, Recorded data size, Repeat number)
Fields are defined, and the following contents are stored in each of them.

The 1-byte Flags contains Track ID, Data re
Stores information flags related to the interpretation method of data stored in ference index, Recorded data size, and Repeat number. 4-byte Track ID, 2-byte Data reference
index, 2 bytes of recorded data size, 1 byte of R
For the epeat number, Ch of the audio or video track
Information indicating the unit in which the unk is interleaved and continuously recorded is stored in a complex manner.

Flags is mainly determined by whether chunks of different tracks depending on the value are interleaved (value: 4) and written continuously on the disk, or independently (value: 0).
Is shown.

The Track ID is, in the movie file,
It is the identification value of the index of the track stored in the Track header 42 of FIGS. 2 and 3. Also, its value is
It is not duplicated in one movie file. By using this value, it is specified which track is to be subjected to continuous writing.

The Data reference index is an identification value assigned to each sample description table that stores detailed information of the sample in the sample description 57 (shown in detail in FIG. 11) existing in the track. Normally, one sample description stores one sample description table. However, after editing a movie file, a plurality of sample description tables may be stored. Further, the value is not duplicated in one track. By using this value, which Sample des
Defines whether a chunk composed of samples with sample information described in the cription table is subject to continuous writing.

The recorded data size includes Track ID and Dat
Chunk of one track specified by a reference index
Specifies the minimum number of chunks recorded continuously on the disc.

Repeat number is Track ID, Data refer
Specifies the number of times that the chunk set of the track specified by the ence index and the recorded data size is repeated a plurality of times and continuously recorded on the disc.

The above five data fields are combined to store information indicating which tracks of the tracks are sequentially recorded on the disk as a set in what order and in what unit.

Hereinafter, an example will be described. For simplicity,
A movie file having one audio and one video track or a movie file having only audio tracks will be described.

FIG. 13A shows a first example. The first example is
There is an audio track (Track ID = 1) and a video track (Track ID = 2).
(Data reference index = 1) and video chunk (D
Ata reference index = 1) is alternately written one by one, and the audio chunk is sequentially written on the disk in order of the video chunk. In this case, in the above-mentioned five data fields, audio tracks Flags = 4 Track ID = 2 Data reference index = 1 Recorded data size = 1 Repeat number = 1 Video tracks Flags = 4 Track ID = 0 Data reference index = 0 Recorded data size = 1 A value such as Repeat number = 1 is stored.

In these values, since the two tracks are arranged in an interleaved manner, the Flags field gives a value of 4 as a value for indicating the interleaved format in both tracks.

The dependency between the two tracks is
Since Chunk and video Chunk connected after that are set as a set, only the audio track placed first is described as a description of which track Chunk has a connected dependency with Chunk. To indicate the Track ID of the video Track in the Track ID field
The value (2) is added to the data reference index field (1) in addition to the data reference index value of the video track.

On the other hand, the video track which is the rear track
In order to indicate that there is no concatenated object after the track, the Track ID field and Data re
A value (0) for indicating discontinuity is given to both of the ference index fields.

Recorded data size is the number of chunks of continuously written audio and video tracks.
In the field, give a value (1) that indicates 1 chunk at a time.
Is the number of repetitions one by one, and (1) is given once each in the field of Repeat number.

FIG. 13B shows a second example. The second example is
There is an audio track (Track ID = 1) and a video track (Track ID = 2).
(Data reference index = 1) and video chunk (D
Ata reference index = 1) is alternately written one by one, and the video Chunk and the audio Chunk are successively written on the disk in this order. In this case, in the five data fields described above, audio tracks Flags = 4 Track ID = 0 Data reference index = 0 Recorded data size = 1 Repeat number = 1 Video tracks Flags = 4 Track ID = 1 Data reference index = 1 Recorded data size = 1 A value such as Repeat number = 1 is stored.

FIG. 13C shows a third example. The third example is
There is an audio track (Track ID = 1) and a video track (Track ID = 2).
(Data reference index = 1) and Chun of video
k (Data reference index = 1), two audio chunks first, followed by video chunks
Are consecutively written on the disc in sets in the order of one. In this case, the five data fields described above include audio tracks Flags = 4 Track ID = 2 Data reference index = 1 Recorded data size = 2 Repeat number = 1 Video tracks Flags = 4 Track ID = 0 Data reference index = 0 Recorded data size = 1 A value such as Repeat number = 1 is stored.

FIG. 13D shows a fourth example. The fourth example is
There is an audio track (Track ID = 1) and a video track (Track ID = 2).
(Data reference index = 1) and one video Chun
k (Data reference index = 1), and one set of audio chunks, one video chunk, and three consecutive sets of data are sequentially written on the disc in succession. Is the case. In this case, the above 5
In one data field, audio tracks Flags = 4 Track ID = 2 Data reference index = 1 Recorded data size = 1 Repeat number = 3 Video tracks Flags = 4 Track ID = 0 Data reference index = 0 Recorded data size = 1 A value such as Repeat number = 3 is stored.

FIG. 13E shows a fifth example. The fifth example is
There is an audio track (Track ID = 1) and a video track (Track ID = 2).
(Data reference index = 1) and Chun of video
k (Data reference index = 1), two audio chunks first, followed by video chunks
Indicates a case where one sequential set is continuously written on the disk in a unit of two consecutive sets. In this case, in the above-mentioned five data fields, audio tracks Flags = 4 Track ID = 2 Data reference index = 1 Recorded data size = 2 Repeat number = 2 Video tracks Flags = 4 Track ID = 0 Data reference index = 0 Recorded data size = 1 A value such as Repeat number = 2 is stored.

FIG. 13F shows a sixth example. The sixth example is
Only audio tracks (Track ID = 1) exist,
This is a case where audio chunks (Data reference index = 1) are continuously written on a disc in units of one. In this case, values such as audio tracks Flags = 0 Track ID = 0 Data reference index = 0 Recorded data size = 1 Repeat number = 1 are stored in the five data fields described above.

FIG. 13G shows a seventh example. The seventh example is
Only audio tracks (Track ID = 1) exist,
This is a case where three chunks of audio (Data reference index = 1) are continuously written on a disc. In this case, values such as audio tracks Flags = 0 Track ID = 0 Data reference index = 0 Recorded data size = 3 Repeat number = 1 are stored in the five data fields described above.

In the above description, an example in which the present invention is applied to a portable camera-integrated disk recording / reproducing apparatus has been described. However, the present invention can be applied to other devices. For example, the present invention can be applied to a digital still camera, a digital audio recorder / player, and the like.

Further, in the present invention, part or all of the hardware configuration shown in the block diagram of FIG. 1 may be realized by software. The software is provided by being stored in a computer-readable recording medium such as a CD-ROM.

[0092] Although QuickTime has been described, other than that, computer software capable of synchronously reproducing a plurality of time-varying series of data without using special hardware has been proposed. The present invention may be applied.

[0093]

According to the present invention, when data having a file structure is recorded on an optical disc, the continuous recording length is made to correspond to a plurality of second data units (for example, a Chunk of QuickTime), so that the accessibility is improved. Editability can be improved. According to the present invention, information indicating the relationship between tracks to be continuously recorded and information indicating the number of chunks or sets included in the continuous recording length are recorded in the management unit. You can know.

[Brief description of the drawings]

FIG. 1 is a block diagram of one embodiment of the present invention.

FIG. 2 is a schematic diagram illustrating an example of a QuickTime file format to which the present invention can be applied.

FIG. 3 is a schematic diagram illustrating a more detailed data structure of a Movie Resource in QuickTime.

FIG. 4 is a schematic diagram showing a more detailed data structure of a Movie Resource in QuickTime.

FIG. 5 is a schematic diagram for explaining a relationship between a GOP of MPEG video and a file format of QuickTime in one embodiment of the present invention.

FIG. 6 is a schematic diagram for explaining an example of a relationship between compression-encoded audio and a QuickTime file format according to an embodiment of the present invention.

FIG. 7 is a schematic diagram for explaining another example of the relationship between the compression-encoded audio and the QuickTime file format according to the embodiment of the present invention.

FIG. 8 is a schematic diagram for explaining a relationship between a GOP of MPEG video and a file format of QuickTime in one embodiment of the present invention.

FIG. 9 is a schematic diagram for explaining an example of a relationship between a compression-encoded audio and a QuickTime file format according to an embodiment of the present invention.

FIG. 10 is a schematic diagram for explaining an example of a method for recording on an optical disc in one embodiment of the present invention.

FIG. 11 is a schematic diagram showing a general data structure of a QuickTime movie file composed of two tracks of video and audio.

FIG. 12 is a schematic diagram illustrating the data structure of a sample description in one embodiment of the present invention in more detail.

FIG. 13 is a schematic diagram for explaining some examples of a chunk flag and a chunk number in one embodiment of the present invention.

[Explanation of symbols]

1 ... video encoder, 2 ... audio encoder, 3
... Video decoder, 4 ... Audio decoder, 5 ...
..File generator, 6... File decoder, 20.
··optical disk

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 7/30 H04N 7/133 Z 7/32 7/137 Z G11B 27/00 D (72) Inventor Ishizaka Toshiya 6-35 Kita Shinagawa, Shinagawa-ku, Tokyo F-term (reference) in Sony Corporation 5C052 AA03 AA04 AB06 AB10 CC11 5C059 KK41 MA00 MA23 MA41 ME01 NN28 PP04 RC00 RC24 RC28 RC31 RF05 SS11 SS30 UA32 UA33 UA39 5D044 AB05 BC06 CC04 DE03 DE12 DE14 DE27 DE57 GK04 GK07 5D110 AA17 AA27 AA29 DA01 DA12 DE02 DE04 DE06

Claims (14)

[Claims] 1. A recording apparatus for recording video data on a rewritable optical disk, comprising: an encoding means for encoding the video data by compression encoding; and synchronously reproducing a moving image without using special hardware. Means for converting the data structure of the encoded video data from the encoding means so as to have a file structure that can be handled by computer software for recording, and means for recording data having the file structure on an optical disc. The file structure has a first data unit and a second data unit as a set of a plurality of the first data units. When writing the plurality of the second data units to the optical disc, A recording apparatus adapted to correspond to a continuous recording length. 2. A recording apparatus for recording audio data on a rewritable optical disk, wherein the recording apparatus has a file structure that can be handled by computer software for synchronously reproducing a moving image without using special hardware. Means for converting the data structure of audio data or encoded audio data; and means for recording data having the file structure on an optical disc, wherein the file structure comprises a first data unit and a plurality of first data units. And a second data unit as a set of data units, wherein the plurality of second data units are made to correspond to a continuous recording length when writing to the optical disc. 3. A recording apparatus for recording video data and audio data on a rewritable optical disk, wherein video data is encoded by compression encoding having a group structure of a plurality of frames by combining inter-frame prediction encoding and motion compensation. Video encoding means, audio output means for outputting compressed encoded or uncompressed audio data, and files which can be handled by computer software for synchronously reproducing moving images without using special hardware The data structures of the encoded video data from the encoding means and the audio data from the audio output means are respectively converted so as to have a structure, and the encoded video data having the file structure and the audio data are multiplexed. Means and the above file structure Means for recording multiplexed data on an optical disc, wherein the file structure has a first data unit and a second data unit as a set of a plurality of the first data units. A recording apparatus, wherein a plurality of the second data units are made to correspond to a continuous recording length when writing to the optical disc. 4. The multiplexed data according to claim 3, wherein the time lengths of the coded video data of the second data unit and the audio data of the second unit are substantially equal. Recording device. 5. The multiplexed data according to claim 3, wherein the coded video data of the second data unit and the audio data of the second unit are alternately arranged, and the multiplexed data is adjacent to the second data unit. A plurality of sets of encoded video data and audio data in units of (1) and (2) correspond to the continuous recording length. 6. The audio data according to claim 2, wherein the audio data is compression-coded by ATRAC, and
A recording device comprising one or more AC sound units. 7. The data structure according to claim 1, wherein the file structure further includes a data portion for describing management information, wherein the data portion includes the number of the second data units included in the continuous recording length. A recording device characterized by describing 8. The data structure according to claim 3, wherein the file structure further includes a data portion for describing management information, and the set of encoded video data and audio data of the second unit is recorded in the data portion. A recording apparatus, wherein a flag indicating whether or not the recording is performed and the number of the sets included in the continuous recording length are described. 9. A recording method for recording video data on a rewritable optical disk, comprising: a step of encoding the video data by compression encoding; and a step of synchronously reproducing a moving image or the like without using special hardware. Converting the data structure of the encoded video data to have a file structure that can be handled by computer software; and recording the data having the file structure on an optical disc. And a second data unit as a set of a plurality of the first data units, wherein the plurality of the second data units correspond to a continuous recording length when writing to the optical disc. Characteristic recording method. 10. A recording method for recording audio data on a rewritable optical disk, wherein the recording device has a file structure that can be handled by computer software for synchronously reproducing a moving image or the like without using special hardware. Converting the data structure of audio data or encoded audio data; and recording the data having the file structure on an optical disc. The file structure includes a first data unit and a plurality of first data units. And a second data unit as a set of data units, wherein the plurality of second data units are made to correspond to a continuous recording length when writing to the optical disc. 11. A recording method for recording video data and audio data on a rewritable optical disk, wherein video data is encoded by compression encoding having a group structure of a plurality of frames by combining inter-frame prediction encoding and motion compensation. Video encoding step, audio output step of outputting compressed encoded or uncompressed audio data, and computer software for synchronously playing back moving images without using special hardware. Respectively converting the encoded video data and the data structure of the output audio data so that the encoded video data and the output audio data have a file structure, and multiplexing the encoded video data having the file structure and the audio data. Have multiplexed Recording the recorded data on an optical disc, wherein the file structure has a first data unit and a second data unit as a set of a plurality of the first data units. 2. A recording method, wherein the two data units correspond to a continuous recording length when writing to the optical disc. 12. A recording medium on which a computer-controllable program for recording video data on a rewritable optical disk is recorded, the program comprising: a step of encoding the video data by compression encoding; Converting the data structure of the encoded video data so that it has a file structure that can be handled by computer software for synchronously playing back moving images without using hardware, The file structure has a first data unit and a second data unit as a set of a plurality of the first data units, and a plurality of the second data units. The continuous recording length when writing to the optical disc. Recording medium. 13. A recording medium on which a computer-controllable program for recording audio data on a rewritable optical disk is recorded, wherein the program synchronously reproduces a moving image or the like without using special hardware. Converting the data structure of the audio data or the encoded audio data so as to have a file structure that can be handled by computer software for recording the data having the file structure on an optical disc. The structure has a first data unit and a second data unit as a set of the plurality of first data units. A continuous recording length when writing the plurality of second data units to the optical disc A recording medium characterized by the following. 14. A recording medium on which a computer-controllable program for recording video data and audio data on a rewritable optical disc is recorded, wherein the program combines inter-frame predictive coding and motion compensation. A video encoding step of encoding video data by compression encoding having a frame group structure; an audio output step of outputting compressed encoded or uncompressed audio data; a moving image without using special hardware. The encoded video data and the data structure of the output audio data are respectively converted so as to have a file structure that can be handled by computer software for synchronously reproducing the encoded video data having the file structure. Data and the above Multiplexing the audio data, and recording the multiplexed data on an optical disc having the file structure. The file structure includes a first data unit and a plurality of the first data units. And a second data unit as a set of a plurality of second data units, wherein the plurality of second data units correspond to a continuous recording length when writing to the optical disc.