JP4189304B2 - Data processing device - Google Patents

Description

  The present invention relates to an apparatus for compressing video signals and audio signals and recording them on a recording medium such as an optical disc, and an apparatus for expanding and reproducing video signals and audio signals recorded on the recording medium.

  Various data streams for compressing and encoding video (video) signals and audio (audio) signals at a low bit rate have been standardized. As an example of such a data stream, a system stream of DV standard (consumer digital VCR SD standard) or MPEG2 system standard (ISO / IEC 13818-1) is known. The system stream includes three types of program stream (PS), transport stream (TS), and PES stream. Such a data stream is recorded on an optical disc or the like according to a predetermined standard.

  In recent years, data recording devices (such as consumer camcorders) that implement post-recording using such data streams have begun to spread. Post-recording refers to recording new audio after recording video and audio. By performing post-recording, the newly recorded audio can be reproduced in synchronization with the video instead of the originally recorded audio.

  Hereinafter, in the present specification, the originally recorded sound is referred to as “original audio”, and the newly recorded sound is referred to as “substitute audio”. The video and front audio are collectively called “video”. Data representing video is called “video data”, data representing front audio is called “front audio data”, and data representing back audio is called “back audio data”.

  Post-recording is generally realized by the following two steps. First, in the first step, a moving image is recorded in a recording mode in which post-recording is possible. In this recording mode, a data stream is recorded with a data structure for recording the back audio in the future. In the second step, the back audio is recorded while reproducing the recorded moving image. When post-recording is performed according to this procedure, a reproducing apparatus (data reproducing apparatus) can reproduce the video and the back audio in synchronization. The user instructs video data, audio data, and reproduction timing to be reproduced simultaneously by describing a playlist. In this specification, simultaneous playback of video and other data is called simultaneous playback. The front voice data may be deleted or coexisted with the back voice data. When back audio is present, video, front audio, and back audio may be played simultaneously.

  In addition to the real-time post-recording in which audio is recorded while reproducing a moving image in the second step, there is a non-real-time post-recording process in which an audio file is copied without viewing the reproduced moving image.

  Here, the configuration of the data reproducing apparatus will be described. FIG. 1 shows a functional block configuration of a conventional data reproducing apparatus. The data reproducing apparatus can reproduce a data stream recorded on an optical disc 131 such as a DVD-RAM disc or a Blu-ray disc (BD). In the following description, it is assumed that the data stream is an MPEG transport stream (TS). The TS is composed of a plurality of packets (TS packets), and each TS packet includes video data, front audio data, or back audio data.

  Simultaneous playback (playback of video and back audio) by the data playback device will be described. The playback unit 121 reads out a TS from the optical disc 131 via the pickup 130, performs processing such as A / D conversion, and outputs each TS packet. The first transport stream decomposing unit 165 separates the TS packet into video data and front audio data via the buffer memory 172. The video decompression unit 111 decompresses (decodes) the video data and displays it on the video display unit 110.

  On the other hand, the back audio data processing is performed in parallel with the video data processing. First, based on the management information of the recording area of the optical disc 131 managed by the logical block management unit 141, the post-recording reproduction control unit 171 specifies the back audio data to be read. Based on the read instruction from the playback control unit 171, the playback unit 121 reads the back audio data, performs A / D conversion, and outputs a TS packet of the back audio data to the buffer memory 172. The buffer memory 172 stores the back audio data in a different area from the video data. The second transport stream decomposition unit 166 reads the back audio data from the buffer memory 172, and the D / A conversion unit 176 decodes the back audio data and outputs it from the audio output unit 112. The first voice decompression unit 113 and the D / A conversion unit 176 have the same function in that the voice data is decoded.

  Since the back audio data is recorded independently after recording the video data and the front audio data, the pickup 130 needs to move to the recording position of each data and read the data at the time of simultaneous reproduction. FIG. 2 shows an operation sequence of the pickup 130 when the video and the back audio are reproduced in synchronization. The target of reading is the video data in the moving image file and the back audio data in the audio file.

  First, the pickup 130 moves to the recording position of the audio file on the optical disc 131 and reads a certain amount of back audio data (lead # 0). The pickup 130 then seeks the recording position of the moving image file (seek # 0) and reads the video data (read # 1). The data reproduction device starts displaying video and outputting back audio after starting to read video data. Thereafter, the pickup 130 sequentially moves to the audio file (seek # 1), reads back audio data (read # 2), and seeks the recording position of the video data (seek # 2).

  FIG. 3 shows a time transition between the code amount (data amount) of the video data and the code amount (data amount) of the back audio data in the buffer memory 172. In FIG. 3, it is assumed that the data read for decoding is deleted from the buffer memory 172 at the same time as being read. As shown in FIG. 3, during the seek (2, 4, 6, 7), the amount of video data and audio data does not change (2) or both decrease (4, 6, 7). While the video data is being read (3, 8), the video data increases while the amount of the back audio data decreases. Conversely, while the back audio data is being read (5), the audio data increases while the video is being read. The amount of data decreases.

  The pickup 130 reads data in a physically continuous area (continuous data area) in one read operation. The minimum data length of the continuous data area is determined by the recording apparatus at the time of recording. FIG. 2 shows the positioning of the minimum length D of the continuous data area relating to the video data. The minimum length is not necessarily the same, but the same applies to the continuous data area of audio data.

  In order to reproduce the video and the back audio without interruption, it is necessary that the data amount of the data read and stored in the buffer memory 172 is not set to zero. Therefore, it is necessary to appropriately determine the minimum length of the continuous data area at the time of recording data so that data can be sufficiently stored in the buffer memory. If the minimum length is always recorded, simultaneous playback can be performed without interruption. From the viewpoint of recording efficiency, the minimum length of the continuous data area of video data that consumes a large amount of data is particularly important. This is because the free space of the recording medium cannot be used as the minimum length of the continuous data area increases. For example, according to the techniques described in Patent Literature 1 and Patent Literature 2, a continuous data area for video data is considered in consideration of the longest time required for each seek # 1, 2, and 3 in FIG. The minimum length D is determined. The reason for considering seek # 3 is that when the pickup 130 encounters a discontinuous point (boundary of the continuous data area) of the moving image file, the pickup 130 is moved, and extra time is required. Note that seek # 3 in FIG. 2 corresponds to seek in V (7) in FIG. However, since FIG. 3 shows the worst case, the period corresponding to the readout time of the moving image file between seek # 2 and seek # 3 in FIG.

Here, the minimum length D of the continuous data area for the video data is derived based on the following mathematical formula. T _V-CDA is the minimum reading time length of the continuous data area for moving images during simultaneous playback, Vr is the data transfer speed at the time of reading, and t _A- is the reading time length of the continuous data area for audio during post-recording playback _{. Let CDA be} the data transfer speed Vo during playback. Further, the longest seek time of the pickup 130 is set as T _SEEK . The unit for reading out the data of the back audio file is assumed to be 1 to 2 times the data size of the minimum continuous data area, for example, from 96 kbytes to 192 kbytes. The reason why the width is 1 to 2 times is to facilitate the editing of the back audio file. For example, even if partial deletion is performed, it is possible to easily maintain a continuous data area by handling only before and after the editing point.

  Then, in FIG.

という関係がある。よって、ｔ_V-CDAは以下のように求まる。

There is a relationship. Therefore, t _V-CDA is obtained as follows.

  Now, since Vr = Ar, Equation 4 is simplified as follows.

Therefore, if the minimum data sizes of the voice and voice continuous data areas are S _A-CDA and S _V-CDA (bits), respectively, these are obtained by Equation 6 and Equation 7, respectively.

As a specific example, from t _v-play = t _v-CDA * Vr / Vo, t _A-play = (t _A-CDA / 2) * Vr / Ao, T _SEEK = 1.2 seconds, Vo = 15. If 57 Mbps, Ao = 0.256 Mbps, and Vr = 20 Mbps, the minimum value of the video continuous data area is 18.5 seconds (t _v-play ), and the minimum value of the audio continuous data area is 18.1 seconds ( t _A-play ), the video data size is 35.7 Mbytes (S _v-CDA ), and the audio data size is 58 kbytes (S _A-CDA ). Therefore, since the size of the continuous data area for voice needs to be an integral multiple of the ECC block, it is 64 kbytes or more.
International Publication No. WO02 / 23896 International Publication No. WO03 / 044796

  If the minimum length D of the continuous data area for the video data is determined based on the above-described technique, the minimum length D may become very large. In addition to the above conditions, when considering the defect rate of the disk and the like, the minimum length D corresponds to a data amount corresponding to a reproduction time of about 22 seconds to 23 seconds in terms of a video reproduction time. For example, when video data is partially deleted, empty areas less than the minimum length D are generated here and there. On the other hand, in order to realize uninterrupted simultaneous playback after post-recording for all moving image files, it is necessary to record all video data on a continuous data area having a minimum length D or more. On the other hand, an area less than the minimum length D is not used because a continuous data area cannot be formed.

  Also, when connecting any playback section of a video file with a playlist and playing back audio data simultaneously, to ensure that the video and audio can be played back simultaneously without interruption, each playback section of the video file has a minimum length D. It is necessary that the audio data playback section is selected as long as the minimum length is selected. At this time, if the minimum length of the video data is long, it cannot be used as a practical playlist. That is, the minimum length needs to be shortened in order to realize a practical simultaneous playback playlist. It is desirable that continuous playback is possible without interruption even if the playback section is set short. In addition to self-recording / reproducing, it is desirable that post-recording and simultaneous reproduction are possible even if the company, model, and price are different according to a predetermined format.

  As a method for shortening the minimum length D, there is a method for shortening the minimum length by introducing a pickup movement model shown in FIG. According to this, the continuous data area for moving images is made not less than the minimum length and less than twice the minimum length.

という関係式から

From the relational expression

によって最小長が求まる。Ｔ_SEEK＝１．２秒，Ｖｏ＝１５．５７Ｍｂｐｓ，Ａｏ＝０．２５６Ｍｂｐｓ，Ｖｒ＝２０Ｍｂｐｓとすると、映像用連続データ領域の最小値（ｔ_v-play）は１３．６秒となる。しかし、この手法によっても、まだ短くなることが好ましい。

To find the minimum length. When T _SEEK = 1.2 seconds, Vo = 15.57 Mbps, Ao = 0.256 Mbps, and Vr = 20 Mbps, the minimum value (t _v-play ) of the video continuous data area is 13.6 seconds. However, it is preferable that this method is still shortened.

  As described above, there is a need for a data recording method that uses an optical disk more efficiently and a method for reproducing recorded data without interruption.

  In this specification, a recording method in which the data area of the back audio data and the data area of the moving image data are adjacent to each other along the rotation direction of the optical disc is referred to as an interleave method, and a recording method that is not adjacent is referred to as a non-interleave method. In FIG. 62, the data area of the corresponding back audio data and the data area of the moving image data are not adjacent to each other. On the other hand, FIG. 63 shows an example of the data structure of the data stream by the interleave method. When the corresponding moving image data and the back audio data are recorded adjacently along the rotation direction of the optical disk, it is not necessary to seek when reading the moving image data and the back audio data. Thereby, the value of the minimum data length of the continuous data area can be reduced. Note that, according to the interleave method shown in FIG. 63, the continuous data area of the back audio data synchronized in time is immediately before the MPEG transport stream including the moving picture having a playback time length of 0.4 to 1 second. Is provided. The back audio data and the video data are separated at the ECC block boundary, and the video data end is recorded at the end of the continuous data area. This method does not allow post-recording to the audio data area in real time, and the audio data area is finely divided, so if non-real-time data writing is performed, the writing location is dispersed, so the writing process takes a very long time. There was a problem of requiring.

In the data processing apparatus according to the present invention, video data representing video is recorded in an area composed of a plurality of first unit areas of a predetermined size, and audio data representing audio is recorded from a plurality of second unit areas of a predetermined size. The video and the audio can be synchronized and reproduced from the optical disc recorded in the configured area. The data processing device includes: a playback control unit that instructs reading of the video data and the audio data; and playback of the video and the audio based on the read data; and the first and second units based on the instructions A head for reading data for each area, an audio buffer memory for storing the read audio data, and a video buffer memory for storing the read video data are provided. The reproduction control unit instructs the audio buffer memory to read the audio data from the second unit area, and then (n + 2) times the maximum time required for the head to move (n: an integer greater than or equal to 2) The video data that can be reproduced over a first time corresponding to the second time required for reading audio data in the next second unit area is separated from the n pieces of the first unit areas. The video buffer memory is instructed to read, and the data amount of the audio data read to the audio buffer memory is read to the video buffer memory from the first time and the separated n first unit areas. Ri reproducible data amount der over time, the size of the first unit region, read out the image data from one of the first unit area in the video buffer memory Time, and the head that has been determined as being capable of storing the image data of the above amount of renewable data for up to the time required for movement.
The data amount of the video data necessary for reproduction and display over the first time and the second time is equal to or greater than the product of the sum of the first time and the second time and the reading speed of the video data. May be the value.
The data length of the first unit area in which the video data is stored is not less than a value obtained by dividing the product of the third time, which is the total time required for reading the video data, and the read speed of the video data by n. The video and the audio may be reproduced from a certain optical disk in synchronization.
The maximum time required for the head to move may be a seek time required for movement between the innermost circumference and the outermost circumference of the optical disc.
One of the video data and the audio data is recorded in the central area of the recording area of the optical disc in the radial direction, and the maximum time required for the head to move is the innermost circumference and the innermost circumference of the optical disc. It may be approximately half of the seek time with the outer periphery.
The minimum length of the unit area in which the video data is stored is the time required for reading the video data until the accumulation of the video data that can be reproduced over at least the maximum time required for the head to move is completed. The video and the audio may be reproduced synchronously from the optical disc that is equal to or higher than the product of the video data read speed.
The data lengths of the first and second unit areas for recording the video data and the audio data may be equal to or longer than a predetermined minimum length defined for each of the video data and the audio data.
The data amount of the audio data read out at the second time may be between 1 and 2 times the minimum length of the unit area for storing the audio data.
The data processing apparatus according to the present invention can record audio data representing audio on an optical disc. The optical disc has a first area composed of a plurality of first unit areas of a predetermined size, and video data representing video is recorded in the first area. The size of the first unit area is equal to or larger than the amount of video data that can be reproduced over the maximum time required for the head to move and the time for reading the video data from the first unit area to the video buffer memory. Is determined to be storable. The data processing device secures a second area composed of an audio buffer memory for accumulating the audio data and a plurality of second unit areas of a predetermined size, and instructs the second area to record the audio data. A recording control unit, and a head for writing and reading data for each of the first and second unit areas based on an instruction. The recording control unit has a maximum time (n + 2) required for the head to move. ) The audio that can be reproduced over a fourth time corresponding to a multiple (n: an integer equal to or greater than 2) and a fifth time required to read the video data in the n separated first unit areas A value greater than the data amount of data is specified as the data length of the second area, and the second area is secured.
The data processing device is configured to instruct reading of the video data, and to instruct playback of the video based on the read video data, and a video buffer memory that stores the read video data The playback control unit further includes a sixth time corresponding to three times the maximum time required for the head to move and a data amount corresponding to twice the data length of the second unit area. An instruction is given to store the video data that can be reproduced over a seventh time required for data reading while reading from the n or less first unit areas to the video buffer memory and instructing reproduction. Also good.
The recording control unit may instruct each of the second unit areas to continuously record the audio data.
The recording control unit generates reproduction control information that specifies the reproduction timing of each of the video data and audio data, and instructs the recording of the reproduction control information in an area different from the first area and the second area. May be.
The reproduction control unit may be capable of reproducing the video data and the audio data in synchronization based on the reproduction control information.
One of the first area and the second area may be provided at a position substantially half of the recording area of the optical disc in the radial direction of the optical disc.
The optical disc has a third area composed of a plurality of third unit areas of a predetermined size, and at least one of video data and audio data is recorded in the third area. The three unit areas are arranged physically adjacent to at least one first unit area, and the recording control unit is configured to perform the fourth time, the fifth time, and the n number of the first unit areas. Even if the second area is secured by specifying the data length of the second unit area based on the data amount of the audio data that can be reproduced over the eighth time required for reading the data in the third unit area Good.

  According to the present invention, it is possible to obtain a data processing apparatus capable of reproducing data without interruption. In particular, even an inexpensive data processing apparatus having a relatively slow seek time can reproduce data without interruption. Also, according to the data processing apparatus of the present invention, video data and audio data can be recorded by efficiently using the recording area.

(Embodiment 1)
FIG. 4 shows a functional block configuration of the data processing apparatus according to the present embodiment. This data processing apparatus can record a moving image data stream including video data and audio data on an optical disc 131 such as a DVD-RAM disc or a Blu-ray disc (BD), and reproduces the recorded data stream. can do.

  Furthermore, the data processing apparatus can also perform post-recording in which new audio is recorded after video and audio are recorded. By performing the post-recording, the data processing apparatus can reproduce the newly recorded back audio (substitute audio) in synchronization with the video instead of the originally recorded front audio (original audio).

  The data processing apparatus shown in FIG. 4 has both a recording function and a reproducing function. Since these are independent functions, they can be separated. Therefore, the data processing device is realized as a data recording device that performs recording processing according to a procedure that will be described later, or as a data reproducing device that performs playback processing according to a procedure that will be described later.

  Therefore, hereinafter, the recording function and the reproducing function of the data processing apparatus will be described separately. In the following description, the moving picture data stream is described as a transport stream (TS), but a program stream will be referred to later.

  FIG. 5 shows a configuration related to the recording function of the data processing apparatus shown in FIG. The data processing apparatus includes a video signal input unit 100, a video compression unit 101, an audio signal input unit 102, an audio compression unit 103, a transport stream assembly unit 104, a dummy packet generation unit 105, and a recording unit 120. A reproduction unit 121, a logical block management unit 141, a continuous data area detection unit 160, and a recording control unit 161.

  The video signal input unit 100 is a video signal input terminal, and receives a video signal representing video data. The video compression unit 101 generates video data by compressing and encoding the data amount of the video signal. This compression coding is, for example, ISO / IEC 13818-2 MPEG2 video compression. The audio signal input unit 102 is an audio signal input terminal, and receives an audio signal representing audio data. The audio compression unit 103 compresses and encodes the data amount of the audio signal to generate audio data. This compression coding is MPEG2-AAC (Advanced Audio Coding) compression of ISO / IEC13818-7. The audio signal input unit 102 and the audio compression unit 103 are used for both front audio recording and back audio recording.

  The audio compression method may be Dolby AC-3 compression, ISO / IEC 13818-3 MPEG AudioLayer2, or the like.

  For example, when the data processing device is a video recorder, the video signal input unit 100 and the audio signal input unit 102 are respectively connected to the video output unit and the audio output unit of a tuner unit (not shown), and video from Receive signals and audio signals. When the data processing device is a movie, a camcorder or the like, the video signal input unit 100 and the audio signal input unit 102 respectively receive the video signal and audio signal output from the CCD (not shown) and the microphone of the camera. receive.

  The transport stream assembling unit 104 (hereinafter referred to as “assembling unit 104”) packetizes the compressed and encoded video data and audio data into TS packets to generate a transport stream (TS). The dummy packet generator 105 generates a dummy packet when the data processing apparatus is operating in a recording mode in which post-recording is possible. The dummy packet is also a packet defined in TS.

  As will be described later with reference to FIG. 12, the buffer memory 164 includes a moving image buffer memory that temporarily stores moving image data and an audio buffer memory that temporarily stores back audio.

  The recording unit 120 controls the optical head (pickup) 130 based on an instruction from the recording control unit 161, and records the video object unit (VOBU) of the TS from the position of the logical block number instructed from the recording control unit 161. . At this time, the recording unit 120 divides each VOBU into units of 32 Kbytes, adds an error correction code in that unit, and records it on the optical disc 131 as one logical block. When recording of one VOBU is completed in the middle of one logical block, recording of the next VOBU is continuously performed without opening a gap.

  The playback unit 121 reads out a TS from the optical disc 131 via the pickup 130, performs processing such as A / D conversion, and outputs each TS packet.

  The logical block management unit 141 activates the playback unit 121 as necessary, reads the space bitmap of the UDF (Universal Disk Format) file system recorded on the optical disk 131, and uses the logical block (used) / Unused). Then, in the final stage of the recording process, an FID and a file entry, which will be described later, are written into a file management area on the disc. In this embodiment, the space bitmap is read collectively when the power is turned on. It is not necessary to read the space bitmap during recording in the recording mode assuming post-recording, post-recording recording, and post-recording playback.

  The continuous data area detection unit 160 (hereinafter referred to as “area detection unit 160”) searches the usage status of the sector of the optical disk 131 managed in the logical block management unit 141, and the unused logical block is the maximum. A continuous free logical block area that continues for 2.6 seconds in terms of recording / reproduction rate is detected. Then, the logical block number of the logical block area is notified to the recording unit 120 every time the writing of the logical block unit occurs, and the logical block management unit 141 is notified that the logical block has been used.

  The recording control unit 161 controls the operation of the recording unit 120. The recording control unit 161 instructs the area detection unit 160 in advance to detect continuous free logical block areas. The recording control unit 161 notifies the recording unit 120 of the logical block number every time writing in units of logical blocks occurs, and notifies the logical block management unit 141 when the logical block has been used. Note that the recording control unit 161 may cause the region detection unit 160 to dynamically detect the size of continuous free logical block regions.

  FIG. 6 shows the data structure of MPEG-TS generated by the data processing device. A TS includes a plurality of video object units (VOBU), and each VOBU is composed of one or more TS packets. The data size of each TS packet is 188 bytes. The TS packet includes, for example, a packet (V_TSP) in which compressed video data is stored, a packet (A_TSP) in which compressed front audio data is stored, and a packet (D_TSP) in which back audio data to be recorded in the future is stored. ) Etc.

  The TS packet V_TSP includes a header and video data (video data). A_TSP includes a header and voice (audio data). D_TSP includes a header and back audio dummy data. Each is identified by a packet identifier (PID) in the header. In FIG. 6, PID = "0x0020" is assigned to V_TSP, PID = "0x0021" is assigned to A_TSP, and PID = "0x0022" is assigned to D_TSP. In addition, as other types of TS packets, a packet storing a program association table (PAT), a packet storing a program map table (PMT), and a program clock reference (PCR) are stored. Packet exists. However, since these are not particularly problematic in the present invention, description and illustration are omitted.

  FIG. 7 shows the relationship between the MPEG-TS and the data area of the optical disc 131. The TS VOBU includes data of a reproduction time (display time) of about 0.4 to 1 second of video and is recorded in a continuous data area of the optical disc 131. The continuous data area is composed of physically continuous logical blocks, and in this embodiment, data of 10 to 20 seconds is recorded in this area as the reproduction time of video data at the maximum rate. The data processing apparatus assigns an error correction code to each logical block. The data size of the logical block is 32 kbytes. Each logical block includes 16 2 Kbyte sectors.

  In principle, one VOBU can decode video and audio only with the data of the VOBU. The data size of one VOBU varies within the range of the maximum recording / playback rate if the video data is a variable bit rate, and is almost constant if the video data is a fixed bit rate.

  FIG. 8 shows a state in which recorded data is managed in the file system of the optical disc 131. For example, a file system of the UDF standard or an ISO / IEC 13346 (Volume and file structure of write-once and rewritable media using non-sequential recording for information interchange) file system is used.

  In FIG. 8, continuously recorded TSs have file names MOVIE. It is recorded as MPG. The TS packet structure is held in the file. One file is composed of one or more continuous data areas. A head sector number or a logical block number is set as the position of the file entry constituting the file. In this file, the file name and the position of the file entry are managed by a file identifier (FID). The file name is MOVIE. Set as MPG, the position of the file entry is set in the ICB column as the first sector number of the file entry. The file entry includes allocation descriptors (allocation descriptors) a to c for managing the continuous data areas (CDA) a to c. FIG. 9 shows the data structure of each allocation descriptor. The allocation descriptor has fields describing an extent length (Extent Length) and an extent position (Extent Position).

  The reason why one file is divided into a plurality of areas a to c is that a defective logical block, a PC file that cannot be written, etc. exist in the middle of the area a.

  FIG. 10 is a conceptual diagram showing the relationship between one file and a continuous data area. The data size of the first continuous data area and the last continuous data area may be any size. However, the minimum length of each of the other continuous data areas is determined in advance at the time of recording, and any area that is longer than the minimum length is secured. The data is read out in the order of, for example, areas # 0, # 1,. In the actual reading process, the pickup 130 moves between areas, but it is logically understood as continuous data. Such a logical data structure is called a continuous data area chain. When one file is represented by one continuous data area chain, seamless continuous reproduction is guaranteed as will be described later. Such data reproduction processing from the continuous data area chain will be described in detail later.

  The size of the first continuous data area is equal to or smaller than the minimum data size when, for example, the front portion of the recorded moving image file is deleted. Also, the continuous data size at the end is less than the minimum data size when, for example, a recording stop operation is performed in the middle of a continuous data area when recording a movie file, or the rear part of the recorded movie file is deleted It is.

  FIG. 11 shows a configuration related to the post-recording function of the data processing apparatus shown in FIG. It is assumed that moving image data has already been recorded on the optical disc 131. Since the post-recording reproduces the video data of the moving image data and records the back audio synchronized with the video, a configuration for newly reproducing the video and a configuration for recording the back audio are required.

  The data processing apparatus includes a video display unit 110, a video expansion unit 111, an audio output unit 112, a first audio expansion unit 113, and a first transport stream decomposition unit 165.

  The first transport stream decomposing unit 165 (hereinafter referred to as “first decomposing unit 165”) acquires the moving image stream recorded on the optical disc 131 via the pickup 130, the reproducing unit 121, and the buffer memory 164. Then, the first decomposing unit 165 separates each TS packet of the moving image stream into a video data packet (V_TSP) and a front audio data packet (A_TSP). The video decompression unit 111 decompresses (decodes) the video data and displays it on the video display unit 110. The first audio decompression unit 113 decompresses (decodes) the video data and outputs it from the audio output unit 112. Note that the audio output unit 112 and the first audio expansion unit 113 can be used when the front audio is switched to the back audio.

  The data processing apparatus further includes a post-recording recording control unit 162. The post-recording recording control unit 162 controls the transmission path so that the moving image stream recorded on the optical disc 131 is processed, and instructs the reproduction of video and audio. The recording control unit 162 simultaneously performs control for recording the back voice. That is, based on the control of the recording control unit 162, the audio compression unit 103 compresses and encodes the back audio input to the audio signal input unit 102, and the assembling unit 104 converts the compression-encoded back audio data into TS. To do. As a result, the back audio data is recorded on the optical disc 131 as a back audio file via the buffer memory 164, the recording unit 120, and the pickup 130.

  FIG. 12 shows the data flow during post-recording in the data processing apparatus. The moving image data stream recorded on the optical disk 131 is taken into the moving image buffer memory of the buffer memory 164 at the transfer speed Vr via the pickup 130, and the moving image data stream is further transferred to the first decomposing unit 165 at the transfer speed Vo. The When the first decomposition unit 165 decomposes the video data packet and the audio data packet, the video expansion unit 111 and the first audio expansion unit 113 decode and reproduce the video and audio. On the other hand, the back audio is converted into audio data by the audio compression unit 103 and then taken into the audio buffer memory via the assembly unit 104 at the transfer speed Ai. Further, the audio data is written onto the optical disc 131 via the pickup 130 at the transfer speed Aw. Reading of moving image data and writing of audio data are realized by alternately switching one pickup 130 in a time division manner. Here, it is assumed that Vr> Vo and Aw> Ai.

  FIG. 13 shows the relationship between the data structure of the TS in the back audio data file and the data area of the optical disc 131. The TS is composed of a TS packet (A_TSP) including encoded back audio data. The TS packet (A_TSP) is configured by adding a header to audio data that has been subjected to AAC compression coding. Also, a plurality of continuous data areas of 96 kbytes are secured on the optical disk 131, and TS files are continuously recorded in these areas. “96 kbytes” may be a fixed length, or may be changed in the range of 96 kbytes to 192 kbytes, for example. This makes it very easy to edit the back audio file. Each region may be physically separated from each other or may be adjacent to each other. When adjacent to each other, they can be collectively regarded as one continuous data area. The data size of the continuous data area at this time is an integral multiple of the fixed length. Note that this TS file also has a packet (not shown) including PAT, PMT, and the like.

  Next, FIG. 14 shows a configuration related to the playback function of the data processing apparatus shown in FIG. Description of elements in this configuration that overlap those in FIG. 11 is omitted. Hereinafter, the second transport stream decomposing unit 166 (hereinafter referred to as “second decomposing unit 166”), the second audio decompressing unit 114, and the playback control unit 163 for reproducing the back audio will be described.

  The second decomposing unit 166 acquires the TS packet of the back audio file from the audio buffer memory of the buffer memory 164, and separates and extracts the back audio data from the TS. The second audio decompression unit 114 decompresses (decodes) the back audio data.

  The playback control unit 163 passes the moving image file recorded on the optical disc 131 through the pickup 130, the playback unit 121, the first decomposition unit 165, the video decompression unit 111, and the first audio decompression unit 113, so that the video and the table are displayed. Play as audio. Then, at the timing of playing back audio, the playback control unit 163 passes the back audio file recorded on the optical disc 131 through the pickup 130, the playback unit 121, the second decomposition unit 166, and the second audio expansion unit 114. Play by. The logical block management unit 141 manages the storage position of the optical disk 131 of the TS file to be read.

  FIG. 15 shows the flow of data when reproducing the back-recorded back audio in the data processing apparatus. The moving image data recorded on the optical disc 131 is taken into the moving image buffer memory through the pickup 130 at the transfer speed Vr, and the moving image data is transferred to the decomposing unit 165 at the transfer speed Vo, and further the video decompressing unit. 111 and the first audio decompression unit 113 reproduce the video and audio. On the other hand, the back audio data already recorded on the optical disk 131 is taken into the audio buffer memory through the pickup 130 at the transfer speed Ar, and the back audio data is further transferred via the decomposing unit 166 at the transfer speed Ao. It is reproduced as back audio by the 2 audio extension unit 114. Here, it is assumed that Vr> Vo and Ar> Ao.

  FIG. 16 shows an example of a recording rule when a moving image file and a back audio file are alternately recorded (that is, an interleave method). The continuous data area for moving images includes an integer number (N) of VOBUs transferred in a transfer time of Tmin or more and less than Tmax (condition 1). The back audio data also includes an integer number of audio frames having a reproduction time of Tmin or more and less than Tmax (condition 2). The video transfer time and audio frame playback time are almost equal. It is assumed that the magnitude of the difference is not more than a predetermined value (Condition 3). In addition, it is assumed that the playback timing (for example, PTS) of the moving image is substantially equal to the playback timing of the first audio frame, and the magnitude of the difference is a predetermined value (for example, 1 frame or less) (condition 4). The end of the back audio continuous data area and the moving image continuous data area coincides with the end of the ECC block (condition 5). Then, as Tmin, the minimum length of the continuous data area for moving images is selected so that the continuous data area for audio can be secured in another area by the non-interleave method (for example, so as to satisfy Equation 7). As a result, not only non-interleaved post recording but also interleaved post recording is possible.

  Furthermore, Tmin may be determined so that the back audio data recorded by the interleaving method can be reproduced at the same time during the simultaneous reproduction by the non-interleaving method.

  FIG. 17 shows a data structure of TS including moving image data and back audio data. It is another example in the case of recording back audio data by an interleave method. The continuous data area of the back audio file is physically located immediately before the continuous data area of each VOBU of the moving image file. At this time, the back audio data corresponding to the VOBU arranged immediately after is stored in one back audio continuous data area. The continuous data area of the back audio data is composed of three ECC blocks. Two of the three ECC blocks (64 kbytes) are used for one second of audio data. One ECC block (32 kbytes) is used as a spare when a defective block is generated. Thereby, at the time of simultaneous reproduction, random access in units of VOBU can be easily performed by reading from the beginning of the back audio data. As a result, the amount of continuous reading of a moving image file required for seamless data reading during synchronized playback of video and back audio is 1/3 of the conventional one. When the user selects a plurality of arbitrary scenes and reproduces those scenes continuously, it is possible to guarantee seamless data supply to the video decompression unit 111 and the audio decompression units 113 and 114. As will be described later, one ECC block (32 kbytes) can be further provided in the continuous data area of the back audio data, and still image data to be superimposed at the time of reproduction of the moving image file can be recorded.

  Next, how the video data and the back audio data are recorded on the optical disc 131 will be described while explaining the operation sequence of the pickup 130.

  FIG. 18 shows the operation sequence of the pickup 130 when the video and the back audio are reproduced in synchronization with the jump model of the non-interleaved pickup. FIG. 19 shows a time transition between the code amount (data amount) of video data and the code amount (data amount) of back audio data in the buffer memory 164. Numbers (1) and (2) in FIG. 19 correspond to (1) and (2) in FIG. Further, the numbers in circles in FIG. 19 correspond to the same numbers in circles in FIG.

  FIG. 20 shows a more detailed operation sequence of the pickup 130 when the video and the back audio are reproduced in synchronization. One of the main features of this embodiment is that the data length of the continuous data area is made shorter than before. However, if the data length is shortened, the amount of video data having a particularly high playback rate is insufficient. Therefore, the necessary data amount is secured in the buffer memory 164 by increasing the number of continuous data areas of the moving image data to be read. To do. As a result, the video can be reproduced without interruption during the seek operation time and the read time for reciprocating the continuous data area of the back audio data.

  Hereinafter, a specific operation of the pickup 130 will be described. The pickup 130 first reads a certain amount of back audio data from the recording position of the audio file on the optical disc 131 (lead # 0). This amount of data is not less than the minimum data length of the continuous data area for the back audio and not more than twice the minimum data length.

  Thereafter, the pickup 130 seeks the recording position of the moving image file (seek # 0) and reads the video data (read # 1). The data reproduction device starts displaying video and outputting back audio after starting to read video data. Again, the amount of video data to be read out is greater than or equal to the data length of one continuous data area for moving images.

  When the read # 1 ends, the pickup 130 seeks the next continuous data area of the moving image file (seek # 1), and continues to read the video data (read # 2). The pickup 130 repeats a seek operation and a read operation for such a continuous data area of video data. As a result, the amount of video data in the buffer memory 164 gradually increases.

  When reading of the necessary video data is completed (Lead #n), the pickup 130 returns to reading the back audio data. That is, the pickup 130 seeks the continuous data area of the next back audio data by the n-th seek operation, and reads the back audio data from the area (read # (n + 1)). After that, seek back to the position of the previous continuous data area (seek # (n + 1)).

  Here, a worst case is assumed that takes the longest time to read out video data or audio data. Even when each moving image data read has the minimum data size and the seek # (n + 1) returns to the moving image file, it is assumed that the data at that position is, for example, the last sector in the continuous data area. At this time, the pickup 130 performs a seek operation until the next video data is reached. (Seek # (n + 2)). Then, the video data in the next continuous data area is read out.

  FIG. 21 shows a time transition between the code amount (data amount) of video data and the code amount (data amount) of back audio data in the buffer memory 164 in the worst case. First, paying attention to the audio buffer, the back audio data is not read but only played back until the seek #n is completed after the read of the video data in the read # 1. Therefore, the data amount of the audio buffer decreases in proportion to the data transfer speed Ao during reproduction.

  When attention is paid to the video buffer, reading of video data is started at lead # 1, and reproduction of video and back audio is started. The data amount of the video data in the video buffer is increased by the difference (Vr−Vo) between the data transfer rate Vr and the data transfer rate Vo during playback. Since data reading is interrupted during seek # 1, it decreases in proportion to the reproduction speed Vo, and increases again at the speed (Vr−Vo) when reading is started again. When the data amount of the audio buffer approaches 0 in read #n, seek #n is performed to read audio data. Then, video data is read after seek # (n + 1), data reading of one sector, and # (n + 2), and the data amount of the video buffer increases. In the following, one cycle is from read # 1 to seek # (n + 2).

  20 and 21, the following relational expression is derived.

  However, the meaning of the characters in the formula is defined as follows.

t _v-cda : Read time of continuous data area for video during one cycle
t _A-CDA : Read time of continuous data area of back audio during one cycle T _SEEK : Longest seek time (seek time between innermost and outermost circumference of optical disc 131)

As apparent from FIGS. 20 and 21, since the back audio data is read only once in one cycle (read # (n + 1)), t _A-CDA is the maximum read time of read # (n + 1). It corresponds.

  The left side of Equation 16 indicates the amount of video data to be accumulated in the video buffer in the case where the required time is the longest. The right side of Equation 16 indicates the amount of video data necessary for continuous playback of video data. According to Equation 16, the amount of video data to be stored in the video buffer is greater than the amount of data that can be played back during the time required for (n + 2) seeks and the time for reading back audio data once. It will be understood.

  The left side of Equation 17 indicates the amount of back audio data to be accumulated in the audio buffer. The right side of Expression 17 indicates the data amount necessary for continuous reproduction of the back audio data. According to Equation 17, the amount of back audio data to be accumulated in the audio buffer may be greater than or equal to the amount of data that can be played back during the time required for (n + 2) seeks and the video data read time. Is understood.

  From the relationship of Equations 16 and 17, the following Equations 18 and 19 are obtained.

At this time, the minimum data length S _V-CDA of the continuous data area for video is

The minimum data length S _A-CDA of the continuous data area for back audio is

となる。

It becomes.

According to Expression 20, the minimum length S _V-CDA of the moving image continuous data area is calculated by: (a) a seek time for reading audio data in advance and a time for reading audio data; and (b) n times. The total (a + b) with the seek time is set to a size required for accumulating moving image data for the time divided by n. On the other hand, the minimum length SA _A-CDA of the continuous audio data area is (c) seek time and video data read time for reading video data in advance, and (d) n video continuous data. The size is required for accumulating the back audio data corresponding to the total time (c + d) with the seek time for seeking between the areas. In addition, _SV-CDA can be reduced as n is increased. On the other hand, since t _A-CDA increases as n increases, S _A-CDA also increases.

Since each variable value in Equations 20 and 21 can be defined in advance when recording moving image data and back audio data, the post-recording recording control unit 162 of the data processing device uses the equations 20 and 21 for moving images. The minimum value S _V-CDA of the continuous data area and the minimum value S _A-CDA of the continuous data area for the back speech are determined. When recording a moving image in the non-interleaved post-recording mode, the recording control unit 162 causes the region detection unit 160 to search for a continuous data region that is equal to or greater than the minimum value, and secures the region. Thereafter, the recording control unit 162 can instruct the recording unit 120 to record moving image data first, and then record back audio data.

Assuming that T _SEEK = 1.2 seconds, Vo = 15.57 Mbps, Ao = 0.256 Mbps, Vr = 20 Mbps, and n = 7 in this embodiment, the minimum value of the video continuous data area is 7.9 seconds (t _v-play ), the minimum value of the continuous audio data area is 54.3 seconds (t _A-play ), the video data size is 15.3 Mbytes (S _v-CDA ), and the audio data size is 1.7 M The byte (S _A-CDA ), the video buffer size is 77.7 Mbit bits, and the audio buffer size is 27.5 Mbit bits. n is a trade-off relationship between the total of the video buffer size and audio buffer size and the minimum length of the continuous data area, and the memory size was selected within a practical range.

  In the present embodiment, in consideration of the defect rate in the continuous data area and the delay in the decoder model, the minimum data length of the continuous data area is set to about 10 seconds as the reproduction time for moving image data. Further, regarding the back audio data, it is only necessary to store a data amount of about 100 seconds as a reproduction time in consideration of the accumulation delay of moving image data when an interleaved back audio data area is recorded.

  Conventionally, the minimum data length for moving image data is significantly shorter than that required for a playback time of at least 22 to 23 seconds. This makes it possible to create a playlist having a combination of practical time lengths of about 10 seconds. Further, even if there are many short empty data areas due to editing of a moving image or the like, it is relatively easy to secure a continuous data area. According to the present embodiment, it is necessary to secure a continuous data area for the back audio of about 100 seconds. In general, the amount of audio data is sufficiently smaller than the amount of moving image data, and This is not a problem in view of the advantages of the video data.

  Although the minimum length of the continuous data area for moving images is 10 seconds, continuous playback may be guaranteed even when a shorter continuous data area is selected when performing virtual editing. This is because it is sufficient that the necessary data amount can be accumulated while reading the seven continuous data areas. If several continuous data areas are short and others are long and can cover them, continuous playback is possible. Is guaranteed. However, the length of at least one continuous data area needs to be long enough to store reproduction data for one maximum seek time.

  Up to this point, the data stream has been described as a transport stream. However, the present invention can be similarly applied even when the data stream is a program stream.

  FIG. 22 shows the data structure of the program stream. This program stream is a stream conforming to the DVD-VR standard. The program stream includes a plurality of video object units (VOBU). Each VOBU includes a plurality of video packs (V_PCK) storing video data and audio packs (A_PCK) storing audio data. In general, a “pack” is known as one exemplary form of packet.

  The head of VOBU starts from V_PCK including the sequence header or from RDI_PCK of the DVD-VR standard. The video pack includes data for 0.4 second to 1 second in terms of playback time. The video pack (V_PCK) is composed of a pack header and compressed video data. The video data further includes data of each frame of I frame, P frame, and B frame. FIG. 22 shows an example in which a part of the I frame is stored at the head of the video data. On the other hand, the audio pack (A_PCK) includes audio data instead of the video data of the video pack. Note that the data size of one VOBU varies within a range equal to or less than the maximum recording / reproduction rate if the video data is a variable bit rate. If the video data is a fixed bit rate, the data size of VOBU is almost constant.

  The example shown in FIG. 22 is a program stream indicating moving image data, but a video pack does not exist in the VOBU of the program stream of back audio data, and only an audio pack (A_PCK) exists. Alternatively, the back audio data may be an elementary stream.

  FIG. 23 shows a decoder model for reading moving image data and audio data recorded by the interleave method. This model corresponds to the functional block shown in FIG. In FIG. 23, the data transfer rate (Vr) when reading moving image data is 15.57 Mbps, and the data transfer rate (Ar) when reading back audio data is 0.256 Mbps. When synchronously reproducing video and back audio, it is necessary to increase the reading rate by 256 kbps compared to normal reproduction.

  In FIG. 23, the moving image data is sent to the upper functional block, and the back audio data is sent to the lower functional block. The PS buffer and the audio buffer are realized by the buffer memory 164. On the other hand, an upper P-STD (program stream / system target decoder) separates an input program stream into video and front audio and decodes them. P-STD corresponds to the first decomposition unit 165, the video decompression unit 111, and the first audio decompression unit 113 in FIG. The lower audio decoder decodes the back audio data. The audio decoder corresponds to the second decomposing unit 166 and the second audio decompressing unit 114.

  For example, the back audio data program stream can be a post-recorded data stream including still images (JPEG, etc.) and graphics (PNG, etc.) in addition to the back audio data. Note that the “still image” here is intended to be an image intended for a natural (non-artificial) object, for example, and the graphics is intended to be an artificial image created on a computer. However, these are only distinguished for the purpose of managing images by the user or the like. In the following description, only one may be referred to for convenience of explanation. Either can be applied. FIG. 24 shows a decoder model corresponding to a program stream including a still image. The video stream playback process follows P-STD. Each data is separated according to the type of pack by the second decomposing unit 166 and sent to the post-recording audio buffer, JPEG buffer, and PNG buffer for back audio. Each buffer size is predetermined. For example, the size of the back audio buffer is the same as the data size of the back audio data storage area (the back audio continuous data area shown in FIG. 16). The buffer size for still images is the same. The output of video, front audio, back audio, still image, etc. of moving image data is selected according to the user's wishes, and data is constructed according to the output target, order, etc.

  The data processor needs to read data so that overflow or underflow of data to be reproduced does not occur in each buffer. In order to perform reading efficiently, the recording address and the recording size may be recorded on the optical disc 131 for the continuous data area for moving image and the continuous data area for back audio.

FIG. 25 shows an example of a reproduction model when moving image data and back audio data or still image data (or graphics data) are recorded in physically separated areas (non-interleave method). On the optical disk, moving image data is stored in a continuous data area of minimum data length S _V-CDA , and post-recording data including back audio data, still image data, etc. is stored in a continuous data area of minimum data length S _A-CDA Has been. A switch provided after the ECC block that performs error correction switches at a timing when the pickup crosses between a continuous data area of moving image data and a continuous data area of post-recorded data. The subsequent processing is performed as described with reference to FIG.

On the other hand, FIG. 26 shows an example of a reproduction model when moving image data and back audio data or still image data (or graphics data) are recorded in a physically continuous area. At this time, the back audio data is recorded while being interleaved between a plurality of moving image data. By recording a video frame, a back audio frame, and the like having substantially the same reproduction timing adjacent to each other, both data can be read out to the buffer _BT at a time, so that the number of seek operations of the pickup 130 can be reduced. The output of moving image data and back audio data can be switched by a switch and sent to each buffer. The subsequent processing is performed as described with reference to FIG.

  FIG. 27 shows an example when moving image data and back audio data are recorded by the interleave method. Similar to FIG. 63, the data length of the moving image data is not less than twice the minimum length and not less than the minimum length. The data length of the moving image data and the back audio data is a length according to Equations 16 to 21. Similarly to FIG. 63, the transfer time (or playback time) of the back audio data included in the back audio data continuous data area and the video data included in the video data continuous data area that is physically recorded immediately after Assume that the transfer time (or playback time) is equal.

  As a result, even when editing a moving image such as partial deletion, the continuous data area before and after the edited portion can be reconstructed, and the back audio data and the moving image data can be easily rearranged.

  However, in this case, real-time after-recording to the back audio data area to different continuous data areas according to the non-interleave method is possible, but real-time after-recording to the interleaved back audio data area is difficult. .

  If the minimum length of the moving image data and the back audio data is set to a length according to Equations 8 to 15, after-recording can be performed in real time on the interleaved back audio data region. However, on the other hand, the minimum length of the video data is extended.

  FIG. 28 shows that when a moving image file is composed of an MPEG program stream and the moving image file is recorded so that post-recording in an interleaved manner is possible, a maximum of 15 dummy dummy packets (dummy V_PCK) are added at the end of the VOBU. ) Is recorded and the end of the VOBU is made to coincide with the end of the ECC block. According to the fifth condition described with reference to FIG. 16, the end of the back audio continuous data area coincides with the end of the ECC block (condition 5). However, the total size of the N VOBUs generated in the post-recordable recording mode is not always an integral multiple of the ECC block. Therefore, a dummy packet is inserted to match the end of the VOBU immediately before the back audio continuous data area with the end of the ECC block. NA indicates the number of ECC blocks in the back audio data area.

  FIG. 29 shows a data structure of a video pack (V_PCK) conforming to the DVD-VR standard / DVD-Video standard used as a dummy packet. The dummy V_PCK has a video stream including one byte of video data (0x00) and a padding stream. The video data included in the dummy V_PCK may be more than 1 byte, but it is preferable that the video data be less than the dummy packet.

  The data processing apparatus can also record the sub-picture pack (SP_PCK) instead as a dummy packet. SP_PCK may be ignored during playback. Further, the sub-picture pack may be recorded as a dummy packet. FIG. 30 shows a data structure of a sub picture pack (SP_PCK) used as a dummy packet. The sub picture pack includes a sub picture unit (SPU). In order to indicate that there is no data in the pack, the first two bytes of the sub-picture unit in the pack may be set to a specific value (“0x0000”).

  When the back audio dummy data is provided in the moving image data, an audio frame having the same presentation time stamp as the back audio dummy data may be provided for the convenience of editing. Thereby, the process at the time of recording the audio | voice data of a back audio file in a moving image file can be simplified.

Regarding the simultaneous reproduction by the interleave method, the description so far has been made assuming that the moving image data and the back audio data are read in the order in which they are recorded. However, when a playlist is selected by selecting several short scenes (for example, in units of 5 seconds) and reproduced according to the playlist, the pickup movement model shown in FIG. 31 can be applied. FIG. 31 shows an operation sequence of the pickup 130 in consideration of the longest seek time T _SEEK and the short seek time T _sj . Numbers 1 to 4 surrounded by a circle are one cycle. When the back audio data and the moving image data are continuously arranged, it is not always necessary to determine the data amount to be read based on the longest seek time T _SEEK . Therefore, at least the seek time when the pickup 130 moves from the back audio data to the moving image data can be replaced with the short seek time T _sj (<T _SEEK ).

  When the scene selected by the user crosses the interleave area, the pickup movement model shown in FIG. 32 can be applied. FIG. 32 shows the operation sequence of the pickup 130 when reading moving image data across the interleave area. This is processing when (4) and (7) in FIG. The processes of numbers (4), (5), (6), and (7) circled in FIG. 32 correspond to the processes of number (4) circled in FIG. That is, the moving image data is read out slightly before the interleave area (4), and the audio data (shaded portion) included in the interleave area is read a little (5). Thereafter, the head of the moving image data is sought (6) and moved to read out the beginning portion of the moving image data (7). (1) to (7) are one cycle, and the subsequent processing is similarly performed in the next cycle. Note that the seek operation may not be performed in the interleave region. That is, data reading is continued until the area to be read is reached, and when the area is reached, a normal reading operation is performed thereafter. As a result, there is a case where the movement time loss of the pickup 130 is less when the read operation is continued than when the seek operation is performed.

  FIG. 33 shows a continuous data area in which moving image data and back audio data are interleaved, and another back audio continuous data area recorded in a different area. The data stream is recorded with an interleave structure in which a continuous data area for back audio data is secured between continuous data areas for moving image data. It is assumed that moving image data necessary for reproducing a reproduction section designated by the user is stored across three continuous data areas for moving image data. Furthermore, it is assumed that the back audio reproduced in synchronization with the video is arranged not in the interleaved continuous data area for back audio data but in the continuous data area recorded by the non-interleave method. Since there are two back audio data that are not to be reproduced between the continuous data areas for moving images, the pickup 130 moves by skipping those areas. Further, when a part of the final ECC block of the continuous data area for moving images is a UDF file tail, the two file tails are detected and skipped. Thus, two file tails and two back audio data continuous data areas are skipped.

Next, an example of interleaving still image data instead of back audio data will be described. 34, instead of the N _A number of channel audio data in the continuous data area, shows a data structure of still picture data composed of the N _S ECC blocks are interleaved in the video data. Note that the user can arbitrarily select whether to reproduce still image data or to reproduce back audio recorded in another continuous data area recorded by the non-interleave method. When the back audio is reproduced, the data processing device may cause the pickup 130 to skip the still image data area by a procedure similar to the procedure shown in FIG.

Hereinafter, the still image data area will be described. Data area of the still picture corresponds to a data region of the N _S ECC blocks. The still image data in the N _S ECC blocks may be configured as one file as a whole, or one still image data area may include one file. When still image data is arranged after VOBU, Ng or less unused sectors may exist between them. It is assumed that the number of unused sectors Ng is less than 1 ECC block, that is, 15 sectors or less.

The range of the interleave interval of the still image continuous data area can be specified using the SCR value in the case of a program stream. Here, for example, the continuous data area for still images can be arranged at an SCR interval equal to or greater than Tmin which is a timing input to the P-STD and equal to or less than Tmax (= Tmin + 1) (for example, 6 seconds or more and 7 seconds or less). Accordingly, still image data can be written in the N _A ECC blocks in real time while reproducing moving image data.

  The above-described interleave interval of the still image continuous data area is closely related to the data length and video reproduction time of the moving image data continuous data area existing therebetween. FIG. 35 shows the relationship between the SCR interval (that is, the transfer time) and the video playback time. In terms of reproduction time, it is necessary to include moving image data (frames) that can be reproduced in a period of (Tmin + 1) or more and less than (Tmin + 2) between the still image continuous data areas. Such moving image data includes data whose SCR value (that is, transfer time) is Tmin or more and less than (Tmin + 2). This is related to the fact that the MPEG2 standard system target decoder allows a reproduction delay of a maximum of 1 second. FIG. 36 shows the configuration of the functional blocks of the P-STD that is a system target decoder for program streams. That is, as shown in FIG. 35, data whose SCR interval is Tmin or more and less than (Tmin + 1) includes data whose reproduction time is (Tmin + 1) or more and (Tmin + 2) or less. Conversely, the moving image data having a reproduction time of (Tmin + 1) or more and (Tmin + 2) or less includes moving image data having an SCR interval of Tmin or more and (Tmin + 2). From the above, for example, data with a playback time of 6 seconds to 7 seconds corresponds to data with an SCR value of 5 to 7 seconds.

  In the present embodiment, for example, a case where a defective block is included in the continuous data area is not considered. Therefore, the maximum allowable defect rate is K, and the amount of video data to be secured in the buffer memory 164 is determined in consideration of the defect rate.

  In consideration of the defect rate of the ECC block in the worst case of the timing chart of FIG.

  The reading time of the moving image continuous data area is n times as follows.

  The minimum playback time of the continuous video data area is as follows.

  The minimum size of the continuous data area for moving images is as follows.

  The video buffer size is as follows.

  The maximum reading time of the voice continuous data area (twice the minimum value) is as follows.

  The minimum playback time for the continuous audio data area is as follows.

  The minimum size of the continuous audio data area is as follows.

  The audio buffer size is as follows.

  Here, Formula 16 can be replaced with Formula 22, Formula 17 is replaced with Formula 23, Formula 18 is replaced with Formula 29, Formula 19 is replaced with Formula 25, Formula 20 is replaced with Formula 27, and Formula 21 is replaced with Formula 31. be able to. This facilitates providing a continuous data area. When a continuous data area is secured, it may not be a completely continuous unused area that does not include a defective block or a still image file, such as that all ECC blocks can be used continuously. That is, the continuity condition is relaxed.

For example, if T _SEEK = 1.2 seconds, Vo = 15.57 Mbps, Ao = 0.256 Mbps, Vr = 20 Mbps, n = 7, K = 0.02, the minimum value of the video continuous data area is 8.6 seconds. Minutes (t _v-play ), the minimum value of the continuous audio data area is 59.3 seconds (t _A-play ), the video data size is 17.0 Mbytes (S _v-CDA ), and the audio data size is The size is 1.9 Mbytes (S _A-CDA ), the video buffer size is 80.2 Mbit, and the audio buffer size is 30.0 Mbit. As described above, the minimum length of the continuous data area is increased by considering the defect rate.

Further, it is assumed that a data portion other than the moving image data may be mixed in the continuous data area for moving images at a frequency different from the defect rate, and the data skip time and T _sv are used. The data portion other than the audio data even during audio continuous data region is assumed may be slightly mixed, and skip time T _SA of the data portion. Then, the sum of T _sv and T _SA and T _s are used. For example, when T _sv is a part of the final ECC block of the continuous data area for moving images is a file tail (FileTail) of the UDF standard (see Embodiment 1), the skip time and T _ECC for one ECC block are set, If all n consecutive data areas include a file tail (FileTail), T _s , T _sv , and T _SA can be expressed by Expressions 33 to 35.

  Next, considering the skip time in the worst case of the timing chart of FIG.

  The reading time of the moving image continuous data area is n times as follows.

  The minimum playback time of the continuous video data area is as follows.

  The minimum size of the continuous data area for moving images is as follows.

  The video buffer size is as follows.

  The maximum reading time (twice the minimum reading time) of the continuous data area for the back audio is as follows.

  The minimum playback time of the continuous data area for back audio is as follows.

  The minimum size of the back audio continuous data area is as follows.

  The back audio buffer size is as follows.

Further, consider post-recording playback in which the user plays back an arbitrary section of a moving image file and an audio file at the same time. Specifically, as shown in FIG. 33, moving image data and audio data are alternately recorded, and a post-recording reproduction is performed by combining an audio file recorded in a section specified by the user and another area in the moving image data. Assuming the case, in the worst case, two continuous audio data areas interleaved in the continuous video data area of one section designated by the user are included as shown in FIG. Two file tails are also included. In this case, T _s , T _SV , and T _SA can be replaced with Equations (43) to (43) if TA _A-CDA is used as the skip time of the continuous audio data area.

  If the minimum value of the continuous audio data area is set so as to satisfy Expression 44, and the length of the continuous video data area to be specified satisfies Expression 40, the first transport stream decomposing unit during post-recording reproduction Data to be continuously reproduced can be sent to 165. That is, the data to be reproduced can be continuously supplied to the decoder.

For example, if T _SEEK = 1.2 seconds, Vo = 15.57 Mbps, Ao = 0.256 Mbps, Vr = 20 Mbps, n = 7, K = 0.02, the continuous data area for back audio to be interleaved is 10 seconds. The minimum value of the video continuous data area is 10.7 seconds (t _v-play ), the minimum value of the audio continuous data area is 71.4 seconds (t _A-play ), and the video data size is 21.3M. Byte (S _v-CDA ), audio data size is 2.3 Mbytes (S _A-CDA ), video buffer size is 85.1 Mbit, and audio buffer size is 36.1 Mbit. As described above, when the moving image data and the back audio data area are recorded by the interleaving method, the minimum value of the video continuous data area is larger than that in the case of not interleaving.

(Embodiment 2)
Next, a second embodiment of the data processing apparatus according to the present invention will be described. The configuration of the data processing apparatus according to this embodiment is the same as that of the data processing apparatus according to the first embodiment shown in FIG. Therefore, description of each component of the data processing device is omitted.

  In the present embodiment, the data processing apparatus manages the moving image file, the back audio file, the still image file, the free area of the optical disc 131, and the like in the first embodiment using the data structure described below. It is possible to more efficiently read out each data and write data into a free area.

  FIG. 37 shows various files in the continuous data area managed by the media information file MOVE0001.MIF and free area files. Now, when recording of moving image data MOVE0001.MPG is started in a recording mode in which post-recording is possible, the post-recording recording control unit 162 of the data processing device generates a media information file MOVE0001.MIF. The moving image file MOVE0001.MPG file and the media information file MOVE0001.MIF have a one-to-one correspondence. That is, when there are a plurality of moving image files, the post-recording recording control unit 162 generates a media information file corresponding to each moving image file. The generated media information file is recorded on the optical disc 131.

  Next, when the back audio data or the still image data is recorded later by the post recording, the post-recording recording control unit 162, the file name corresponding to each data, the start address of the stored area, the data size Etc. are added to the media information file. FIG. 38 shows the data structure of the media information file. In the media information file, a video file name corresponding to 1: 1, a free area file name, and a file name list of files to be recorded by post-recording (back audio file, still image file, etc.) are described. In the interleave area, usage status management information is described.

  37 and 38, the media information file MOVE0001.MIF is referred to as a moving image file, a back audio file, and a still image file. Therefore, these file names are referred to as media information. It is described in the file. In the example of FIG. 37, in the continuous data area, a still image file and a back audio file are recorded in the area immediately before the moving image data. Further, the data processing apparatus refers to the free area file MOVE0001.EMP. The free area file is defined as a set of areas (free areas E) in which no file exists in the continuous data area, and the area is used as a recording area when the back audio file or the like is recorded on the optical disc 131.

  Two files, still image files 1 and 2, are recorded in the area F1 immediately before the moving image data. At this time, the area name “F1” of the usage status management information of the media information file includes the file names (STILL0001.JPG, STILL0002.JPG) of the still image files 1 and 2 and the individual start addresses # 1 and # 2 (F1). The relative address of the beginning of the file with the beginning of the file being 0) and the individual data sizes are described. As shown in FIG. 38, if a media information file is viewed, a file that can be used in relation to a moving image file, for example, a file name of a back sound, a still image, or the like that is played back in synchronization with the moving image file, storage Since the position can be easily specified, the data can be easily used when the user creates a playlist for synchronously reproducing the video and the back audio. In particular, when the same moving image data, back audio, still image, and the like are used from different playlists, the usage status is managed in one place, so that the same data can be easily reused.

  In FIG. 37 and FIG. 38, it has been described that the continuous data area is interleaved with the moving image data file and the back audio file, and the media information file manages the usage status of the interleave area. However, the media information file is generated regardless of whether or not the empty area file is recorded by interleaving, and management information including information on the relationship between the reproduction time and the recording position of the moving image file is recorded.

  Next, an application example of this media information file will be described. Since the media information file describes a file to be accessed in relation to the moving image file, a playlist that realizes simultaneous playback can be easily generated by using the media information file (FIG. 38). That is, when an arbitrary playback path is specified for a video file by a playlist created by the user, if a media information file is referenced, a back audio file, a still image file, etc. that can be referred to in the playback path of the video Can be easily identified. Note that although means for inputting a playlist is not described in FIG. 4, known input means such as a mouse or a keyboard may be used as long as moving image data to be reproduced, a reproduction period thereof, and the like can be specified.

  FIG. 39 shows the data structure of the playlist file. In the playlist file, a file name list of files referred to by the playlist and playback control information are described. Each file referenced from the playlist is started to be played according to the playback timing described in the playback control information, and the playback is continued according to the playback time length. When the user designates the data to be simultaneously reproduced and the reproduction timing, the recording control unit 161 or the post-recording recording control unit 162 displays the information on the moving image file, the still image included in the reproduction path, and the back audio file name. Are specified based on the media information file, and the playback timing, playback time length, etc. thereof are specified based on the user's instruction and described in the playlist file.

  Note that the recording unit 120 preferably records the media information file and the playlist file physically concentrated on the optical disc 130. This is because the pickup 130 can read these files onto a memory (for example, the buffer memory 164) in a short time at a time. For example, when a user deletes a still image file, it is necessary to perform a correction process on a media information file or a playlist that manages the still image file. After correcting each data on the memory, the pickup 130 performs a seek operation. It is possible to record on the optical disc 131 at once without performing it.

  One continuous data area may be composed of a plurality of moving image files and interleaved files interleaved therebetween. FIG. 40 shows an arrangement example of a moving image file and an interleave file stored in the continuous data area. When the shooting time is short, the post-recording recording control unit 162 can record a plurality of files (A, B, C, and D) in a continuous data area of one moving image data. Also at this time, a media information file is generated corresponding to each moving image file. In each media information file, information such as a back audio file related to the corresponding moving image file is described as described above. By such recording, the interleave area can be effectively used.

  FIG. 41 shows another arrangement example of the moving image file and the interleave file stored in the continuous data area. Specifically, FIG. 41 shows a series of a plurality of video files when the video shooting time is shorter than the playback time corresponding to the minimum length of the continuous data area, and a continuous interleaved file interleaved between them. The data area is shown. In the case of this example, the post-recording recording control unit 162 can shorten the data size of the interleave area to reduce the playback time of the back sound and adjust the playback time to the same playback time as the moving image. However, in order to secure the post-recording area, the recording time length of the moving image data must be determined. For example, it is necessary to be in a recording mode that automatically stops recording after recording for 5 seconds. Or, even in normal recording, if the time during which recording is not performed is short, it is necessary to rearrange the recording position of the moving image data so that the area for post-recording is shortened. Even with such a recording method, the interleave area can be effectively used.

  FIG. 42 shows still another arrangement example of the moving image file and the interleave file stored in the continuous data area. Unlike the example of FIG. 41, in the example of FIG. 42, the data size of the interleave areas F1 to F4 remains the minimum data size of the back audio area, and only the data size of the moving image data portion may be shortened. However, in this case, since the size of the interleave area for storing the post-recorded data is increased, the recording efficiency may be reduced.

  Heretofore, the media information file has been described as managing moving image data and individual data files in the interleave area corresponding to the moving image data. However, as shown in FIG. 43, individual data in the interleave area may be handled as a part of data in one interleave file. The media information file in FIG. 43 refers only to the moving image file and the interleave file. FIG. 44 shows a data structure when the media information file refers to only the moving image file and the interleave file. In the interleave file, since the back audio, still image data, free space, etc. are defined, they are specified in “Type”. Compared with the case where back audio data, still image data, etc. are captured as individual files, the amount of data peculiar to the file such as the header of each file can be reduced.

  Next, a modified example when generating a playlist file will be described. FIG. 45 shows a management structure of various data in the interleave file. As described above, the recording control unit 161 or the post-recording recording control unit 162 indicates the usage status of the recording area in the media information file by various data (sound such as back audio, still image, unused area) in the interleave file. To record. The playlist file # 1 holds the information type, data position, reproduction timing, and the like of the sound # 1, the still image # 1, and the still image # 2 in the reproduction control information. Similarly, the playlist file # 2 holds the information type, data position, reproduction timing, and the like of the still image # 1 and the still image # 2 in the reproduction control information. As described above, the recording control unit 161 or the post-recording recording control unit 162 generates a playlist file based on the media information file.

  FIG. 46 shows the data structure of a playlist file that refers to an interleave file together with a moving image file. Since some data of the interleave file corresponds to individual back audio data, still image data, etc. in the interleave area, MOVE0001. By searching for INT, the usage status and unused area can be known. That is, since it is not necessary to search the reproduction control information of the created playlist, it is easy to create a new playlist.

  In FIG. 45, audio data and still image data are recorded in the interleave file, but may be recorded as an audio data file independent of the interleave file or a still image data file. By making such an independent file, the interleave file includes only unused areas. However, even in this case, the physical position of the data area originally assigned to the interleave file is not changed.

  FIG. 47 shows a management structure of various data in the interleave file in this embodiment. The difference from FIG. 45 is that the usage status management information recorded in the media information file only manages information related to unused areas.

  FIG. 48 shows another management structure of various data in the interleave file in the present embodiment. It clearly shows that only unused areas that are not referenced in the playlist are managed. By referring to the media information file when creating a new playlist, the unused data area can be easily grasped. However, MOVE001. It is necessary to search all playlist files that refer to the MPG and investigate the data usage status.

  FIG. 49 shows another management structure of various data in the non-interleaved post-recording file according to this embodiment. In this management structure, the usage status of the free space secured in advance is managed only by the playlist. That is, the back audio, still image, type of unused area, start address, and the like in the post-recording file generated later are managed as playback control information for the playlist file. However, in this case, when various data in the existing post-recording file are reused when creating a new playlist, it is necessary to search the reproduction control information in the existing playlist and grasp the usage status.

(Embodiment 3)
In the first and second embodiments of the data processing apparatus, the recording position of the generated file on the optical disk is not particularly taken up. However, depending on the recording position of the file, when the number of cases where the seek time is shortened, the amount of data in the buffer is less likely to be reduced, and as a result, there is an advantage that it is resistant to vibration. That is, even when the pickup is out of the reading position during vibration, if there is a high possibility that data remains in the memory, the possibility that there will be no data to be reproduced is low. In addition, when the seek time is shortened, the simultaneous reproduction start delay time can be shortened. In addition, it is possible to allocate an access margin to another access. In addition, it becomes unnecessary for the user to leave an after recording area consciously. As a result, when the user later thinks of after recording, there is no possibility that the recording cannot be performed because there is no remaining recording area. Therefore, a preferable recording position and an application example related thereto will be described below.

  FIG. 50 shows an empty area file DISC0001. An example will be shown in which EMP is provided at approximately half of the recording area of the optical disk in the radial direction. “The position of almost the half of the recording area of the optical disk” means, for example, the position of the central portion within a range of about 3% of the storage capacity of the optical disk, with the half position as a reference. The recording position is determined by the recording control unit 161 or the post-recording recording control unit 162 after the area detecting unit 160 confirms the vacancy. By recording the back audio data later in the empty area in the empty area file, the maximum movement amount and movement time when seeking between the moving image data and the audio data can be halved. Note that the object to be recorded at approximately half the position of the recording area of the optical disk may be a moving image file. This is because even when a moving image file is recorded at this position, the maximum moving amount and moving time when seeking between moving image data and audio data can be halved, just as in the previous example. The same applies to the following examples.

FIG. 51 shows an operation sequence of the pickup 130 when the video and the back audio are reproduced in synchronization. First, the pickup 130 moves to a post recording file (for example, a file of back audio data or still image data). First, the worst seek time required by the pickup 130 at this time is half of the maximum seek time T _SEEK . Thereafter, the post-recording file is read (read # 1). Thereafter, the pickup 130 moves from the post-recording file to the moving image file. At this time, the worst seek time required by the pickup 130 is half of the maximum seek time T _SEEK . Thereby, since the movement time of the pickup 130 for two times considering the reciprocation from the moving image file to the audio file can be halved, the amount of video data to be secured in the buffer memory 164 can be reduced. Furthermore, the delay time until the start of reproduction can be reduced by the maximum seek time T _SEEK .

FIG. 52 shows another procedure for reading data in this embodiment. In this example, in addition to the moving image file and the audio file related to the back audio, the graphics file is further read out. Since the audio file and the graphics file are obtained as a result of post-recording, a part of the free area file shown in FIG. 50 is allocated to the recording area. Therefore, the advantage of FIG. 51 is obtained similarly. First, after reading the audio file, the pickup 130 seeks the storage area of the moving image file to be read. The seek time at this time may be about half (t _hj ) of the maximum seek time T _SEEK as described above.

Next, the post-recording recording control unit 162 reads a necessary portion of the continuous data area of the moving image file at most n times. At that time, seek operation is performed at the maximum (n-1) times. Thereafter, the audio file is read again. The seek time to the audio file is half the maximum seek time T _SEEK (t _hj ).

After reading out the audio file, the graphics file is further read out. Since the maximum movement time when moving between the audio file and the graphics file is within the free space, the time (T _sj ) is shorter than half (t _hj ) of the maximum seek time T _SEEK .

  After the graphics file is read, the seek operation is performed again up to the moving image file, and the moving image file is read from a predetermined position.

As described above, a maximum of (n + 3) seek operations are performed by reading a graphics file in addition to a moving image file and an audio file. However, since the seek time for three times between different files is less than half (t _hj ) of the maximum seek time T _SEEK , the continuous read amount can be kept small. In other words, the minimum length of the continuous data area for a moving image can be further shortened.

  52, the following relationships of Formula 50 and Formula 51 are obtained.

Here, the reading time of the continuous data area of the graphics data is set to t _G-CDA . Other symbols are as described in connection with the first embodiment. From this relationship, when t _G-CDA is set to a predetermined bit rate, t _V-CDA and t _A-CDA can be obtained in the same manner as in the first embodiment.

  With the above configuration, it is possible to reduce the continuous reading amount (buffer amount) of moving image data for realizing seamless post-recording reproduction without physically recording audio data and graphics data alternately.

FIG. 53 shows an empty area file DISC0001. An example is shown in which a plurality of empty areas A to C constituting the EMP are arranged at different positions in the radial direction. For example, the position shown as the empty area B corresponds to the hatched area in FIG. Each area refers to a position within a range of 3% of the storage capacity of the optical disk, for example. Even if an empty area is provided as shown in FIG. 53, the moving time of the pickup 130 can be shorter than the maximum seek time T _SEEK, so the rate at which the data in the buffer is reduced can be kept small.

  FIG. 54 shows an example in which a part of the original free area file is allocated as a post-recording file. Playlist PLAY0001. As the storage area on the PLF optical disk 131, a part of the original free area file secured in advance is used. The remaining part of the free area is a free area file DISC0001. Reconfigured as EMP.

  The data type and address in the post-recording file and the address of the free area are the free area management file MOVE0001. It is recorded as usage status management information in the MAN. The free space management file manages the free space reserved for post-recording of the entire optical disk from the beginning, and how the original free space is used when the free space is used later by post-recording. Manage the situation of being.

  On the other hand, FIG. 61 shows an example in which a post-recording information file is provided to manage the usage status of a local area of the optical disc. The management method shown in FIG. 61 is a modification of the management method shown in FIG. That is, both FIG. 54 and FIG. 61 are the same in terms of data management when the back audio data and the like are interleaved between the continuous data areas of the moving image file. However, in FIG. The use situation of the free area reserved for post recording is managed, whereas FIG. 61 is different in that the use situation of the free area of the entire optical disc is managed by the post recording information file. The data area is managed in the same way as the previous free area management file.

  For example, the data processing apparatus records the files in the following order using the post-recording information file. First, at the time of formatting the optical disc, the recording unit 120 records the reserved area file DISC0001.EMP in the central portion of the disc. Next, the optical disc apparatus records a moving image file and a media information file. After that, in order to post-record back audio, still images, etc., first create a post-recording file PLAY0001.PRF and a post-recording information file for a part of the reserved area file DSC0001.EMP, and allocate that area . After that, the post recording file area is allocated to the audio file. The rest is owned by the post-recording file. Then, a playlist file for simultaneously reproducing the moving image file and the audio file is recorded. As shown in FIGS. 54 and 61, the play list generation and the playback process using the play list manage the moving image file, the media information file for managing the time stamp of the moving image file, and post-recorded / done data. The post-recording information file to be used, the post-recording file for securing the unused portion of the area reserved for post-recording, and the playlist file for defining the playlist are used.

  FIG. 55 shows the data structure of the free space management file. Free space management file DISC0001. MAN describes what type of data is stored in what position and in what size for all of the initial free areas. On the other hand, the playlist PLAY0001. The PLF refers to and manages sound # 1, still image # 1, still image # 2, and unused areas. Information for referring to these is the reproduction control information already described in the second embodiment. This reproduction control information manages empty addresses even for unused areas.

  As described above, the free space management file always manages the usage status of the free space file for post-recording that was initially secured, so it is easy to reuse various data in the free space management file when creating a new playlist. It is. Also, the position of the free area can be efficiently searched by referring to the usage status management information in the free area management file.

  FIG. 56 shows an example of a data structure when no media information file is provided. In this example, the space information management file DISC0001. By using MAN, the usage status of the interleave area can be collectively managed and operated. The data structure of the free space management file at this time is the same as that shown in FIG.

  FIG. 57 shows an example in which data transfer management information is provided in the free space information file. The data transfer management information manages, for example, data to be transferred in units of 5 seconds and a recording position of the data. For example, the sound # 1 data is data to be read within 10 seconds from the start of post-recording reproduction, and the still image # 1 is data to be read within 20 seconds from the start of post-recording reproduction. Still picture # 2 is data to be read from 30 seconds to 40 seconds after the start of post-recording reproduction.

  FIG. 58 shows an example of such data transfer management information. The data size indicates the data size to be read in 5 seconds. Indicates that 0.256 Mbps audio should be read for 5 seconds in the first 5 seconds and the next 5 seconds. The next 10 seconds indicate that still image # 2 should be read. The next 10 seconds indicate that there is no data to be read. Then, it indicates that still image # 2 should be read for the next 10 seconds.

  By providing the data transfer management information and managing the transfer time, the amount of read data can be determined efficiently when the data of the post-recording file is read. For example, even if the read amount of the first post-recording file is a transfer time of 60 seconds under the conditions of a predetermined seek performance and data transfer time, if the disk device is faster, for example 40 It is only necessary to read out data up to the second. Therefore, the data to be read for 40 seconds and the recording position can be known from the data transfer management information. Further, assuming such processing, the data processing apparatus can be operated so as to record only necessary data in the post-recording file. That is, if there is no data that needs to be transferred in a certain transfer time interval, there is no need to record any data in the post-recording file. On the other hand, when such data transfer management information does not exist, it is necessary to reserve an unused data area in the post-recording file. When there is no data transfer management information, it is necessary to assume that data of the post-recording file is transferred at a fixed bit rate.

  On the other hand, FIG. 59 shows an example in which an empty area file is provided not for the recording area for post-recording but for the recording area for moving image data. For example, consider a case where a data stream in which moving image data and back audio data are interleaved is subjected to editing processing, and the front portion and the rear portion of the moving image data are deleted. Of the interleaved moving image portion, a portion that has been deleted by editing processing and is no longer used is a free area file DISC0002. It is handled as data constituting the EMP. In other words, it can be determined that the portion of the moving image file specified by the free area file is not to be reproduced.

  The above example can be similarly applied to data in a recording area for post-recording that is interleaved. FIG. 60 shows an example in which an empty area file for an interleave area is provided. As in the case of the moving image data, the portion of the interleaved area data that has been deleted and is no longer used is the free area file DISC0002. It can be handled as data constituting the EMP.

  The free space management file DISC0002. EMP and DISC0003. The data recording area that is part of the EMP may hold the data as it is, or may be used as an area for recording other files such as a captured still image file.

  In the third embodiment of the present invention, the free area file DISC0001. Although an example in which an area is cut out from the EMP has been described, a completely new unused area may be allocated if there is a free area on the disk.

  In the embodiment of the present invention, not only audio but still image data, graphics data, text data, moving image data, and an execution program may be recorded in the area for recording the back audio data.

  In each embodiment of the present invention, the unit of the minimum length (minimum size) of the continuous data area for recording moving images, still images, graphics, etc. is any one of transfer time, playback time, and display time, Each can be converted as shown in the equation. Further, regarding the reproduction time and transfer time, it is necessary to consider a one second delay in the system target decoder model as described in the first embodiment.

  In each embodiment, the logical block is 32 kbytes and the sector is 2 kbytes, but the logical block size may be an integral multiple of the sector size, for example, the logical block may be 16 kbytes and the sector may be 2 kbytes. Further, both the logical block and the sector may be 2 kbytes.

  In each embodiment, the playlist file may be described in the QuickTime format. Alternatively, in each embodiment, the simultaneous playback (parallel playback) timing of the moving image file and the back audio file may be described in SMIL (Synchronized Multimedia Integration Language) language standardized by W3C. Thereby, the relationship between the moving image file and the back audio file can be clearly described from the viewpoint of the reproduction timing and the like. For example, by specifying the elapsed time from the beginning of the video file and the elapsed time from the beginning of the audio file, it is possible to specify the start point of simultaneous playback. In addition, by using the SMIL language, even if a moving image file, a back audio file, and this file are moved to a personal computer, they can be reproduced by a SMIL player of application software on the personal computer.

  In each embodiment, the video compression code and the audio compression code are the MPEG2 video compression code and the AAC compression code, respectively. However, MPEG1 video compression code or MPEG4 video compression code, MPEG-Audio compression code, Dolby AC3 compression code, Twin-VQ compression code, or the like may be used. In each embodiment, the back audio for the moving image is recorded in the back audio file. However, music (BGM or the like) whose timing is not directly related to the moving image may be recorded and reproduced by the same method as the reproduction of the back sound.

  In each embodiment, the maximum movement time of the pickup is the same at the time of reading and at the time of writing, but may be different. However, if they are different, it is necessary to select an appropriate or larger one as the maximum movement time of the pickup and obtain the data size of the continuous data area.

  In the above description, it is assumed that the unit constituting the transport stream is a transport packet of 188 bytes. However, a unit packet of 192 bytes in total can be used by adding 4-byte transmission timing information (for example, a value expressed by a clock value of 27 MHz) immediately before the transport packet.

  Furthermore, in the description so far, instead of the transport stream, the program stream, and the elementary stream, other data streams such as a QuickTime stream or a stream based on the ISO Base Media format may be used.

  The present invention can be applied to an optical disc apparatus that performs processing capable of reproducing audio and video recorded by post-recording in synchronization with each other, and is particularly suitable for an inexpensive optical disc apparatus having a relatively low seek time. It can be applied even if it exists. Furthermore, the present invention can also be applied to an optical disc apparatus capable of performing post recording on an optical disc, and the recording area of the optical disc can be used efficiently.

It is a figure which shows the structure of the functional block of the conventional data reproduction apparatus. It is a figure which shows the operation | movement order of the pick-up 130 when reproducing | regenerating a video and back audio | voice synchronously. It is a figure which shows the time transition with the code amount (data amount) of the video data in the buffer memory 172, and the code amount (data amount) of back audio | speech data. It is a figure which shows the structure of the functional block of the data processor by this embodiment. It is a figure which shows the structure regarding the recording function of the data processor shown in FIG. It is a figure which shows the data structure of MPEG-TS produced | generated by the data processor. FIG. 3 is a diagram showing a relationship between MPEG-TS and a data area of an optical disc 131. 3 is a diagram showing a state in which recorded data is managed in a file system of an optical disc 131. FIG. It is a figure which shows the data structure of each allocation descriptor. It is a conceptual diagram which is a figure which shows the relationship between 1 file and a continuous data area | region. It is a figure which shows the structure regarding the post recording function of the data processor shown in FIG. It is a figure which shows the data flow at the time of the post recording in a data processor. FIG. 4 is a diagram illustrating a relationship between a data structure of a TS in a back audio data file and a data area of an optical disc 131. It is a figure which shows the structure regarding the reproduction | regeneration function of the data processor shown in FIG. It is a figure which shows the flow of data when reproducing the post-recorded back audio | voice in a data processor. It is a figure which shows the recording rule in the case of recording a moving image file and a back audio file alternately. It is a figure which shows the data structure of TS containing moving image data and back audio | speech data. It is a figure which shows the operation | movement order of the pick-up 130 when reproducing | regenerating a video and back audio | voice synchronously. It is a figure which shows the time transition with the code amount (data amount) of the video data in the buffer memory 164, and the code amount (data amount) of back audio | speech data. It is a figure which shows the more detailed operation | movement order of the pick-up 130 when reproducing | regenerating a video and back audio | voice synchronously. It is a figure which shows the time transition with the code amount (data amount) of the video data in the buffer memory 164, and the code amount (data amount) of back audio | speech data. It is a figure which shows the data structure of a program stream. It is a figure which shows the decoder model of the video data and audio | voice data recorded by the interleaving system. It is a figure which shows the decoder model corresponding to the program stream containing a still image. It is a figure which shows the example of a reproduction | regeneration model when moving image data and back audio | speech data or still picture data (or graphics data) are recorded on the area | region physically separated. It is a figure which shows the example of a reproduction | regeneration model when moving image data and back audio | speech data or still picture data (or graphics data) are recorded on the area | region which continued physically. It is a figure which shows the moving image data and back audio | voice data which were recorded on the physically continuous area | region. It is a figure which shows a mode that a maximum of 15 dummy dummy packets (dummy V_PCK) are recorded on the tail of VOBU, and the tail of VOBU is matched with the tail of an ECC block. It is a figure which shows the data structure of the video pack (V_PCK) based on the DVD-VR standard / DVD-Video standard used as a dummy packet. It is a figure which shows the data structure of the sub picture pack (SP_PCK) used as a dummy packet. It is a figure which shows the operation _| movement order of the pickup 130 in consideration of the longest seek time _TSEEK and short seek time _Tsj . It is a figure which shows the operation | movement order of the pick-up 130 when reading moving image data across an interleave area | region. It is a figure which shows the continuous data area | region where the moving image data and back audio | voice data are interleaved, and the continuous data area | region of the other back audio | voice recorded on the different area | regions. Instead of the N _A number of channel audio data in the continuous data area is a diagram showing a data structure still picture data composed of the N _S ECC blocks are interleaved in the video data. It is a figure which shows the relationship between SCR space | interval and the reproduction time of an image | video. The structure of the functional block of P-STD is shown. It is a figure which shows the various files in the continuous data area managed by media information file MOVE0001.MIF, and a free area file. It is a figure which shows the data structure of a media information file. It is a figure which shows the data structure of a play list file. It is a figure which shows the example of arrangement | positioning of the moving image file stored in a continuous data area, and an interleave file. It is a figure which shows the other example of arrangement | positioning of the moving image file stored in a continuous data area, and an interleave file. It is a figure which shows the further example of arrangement | positioning of the moving image file stored in a continuous data area, and an interleave file. It is a figure which shows the media information file which refers to a moving image file and an interleave file. It is a figure which shows the data structure of a media information file when it is a file to which a moving image file and an interleave file refer. It is a figure which shows the management structure of the various data in an interleave file. It is a figure which shows the data structure of the playlist file which refers to an interleave file with a moving image file. It is a figure which shows the management structure of the various data in the interleave file in Embodiment 2. It is a figure which shows clearly a mode that only the unused area | region which is not referred by the play list is made into management object. It is a figure which shows the other management structure of the various data in the interleave file in Embodiment 2. Free area file DISC0001. It is a figure which shows the example which provided EMP in the substantially half position of the recording area of the optical disk regarding the radial direction. It is a figure which shows the operation | movement order of the pick-up 130 when reproducing | regenerating a video and back audio | voice synchronously. It is a figure which shows the other reading procedure of the data in this embodiment. Free area file DISC0001. It is a figure which shows the example which has arrange | positioned empty area | region AC which comprises EMP in a different position regarding a radial direction. It is a figure which shows the example by which a part of original empty area file was comprised as a post-recording file. It is a figure which shows the data structure of an empty area management file. It is a figure which shows the example of a data structure when not providing a media information file. It is a figure which shows the example which provided the data transfer management information in the vacant area information file. It is a figure which shows the example of such data transfer management information. It is a figure which shows the example which provided the empty area file for moving image data. It is a figure which shows the example which provided the empty area file for interleaving areas. It is a figure which shows the example which provides the post recording information file and manages the usage condition of the local area | region of an optical disk. It is a figure which shows the physical data arrangement | positioning of the moving image file and back audio | voice file recorded by the non-interleave system, and the read-out procedure at the time of simultaneous reproduction | regeneration. It is a figure which shows the moving image file and back audio | voice file recorded by the interleave method.

Explanation of symbols

110 video display unit 111 video expansion unit 112 audio output unit 113 first audio expansion unit 114 second audio expansion unit 120 recording unit 121 reproduction unit 130 pickup 131 optical disk 140 reproduction control unit 141 logical block management unit 160 continuous data area detection unit 161 Recording control unit 162 Post-recording recording control unit 163 Post-recording playback control unit (synchronous playback control unit)
164 Buffer memory 165 First transport stream decomposition unit 166 Second transport stream decomposition unit

Claims (15)

Video data representing video is recorded in an area composed of a plurality of first unit areas of a predetermined size, and audio data representing audio is recorded in an area composed of a plurality of second unit areas of a predetermined size A data processing device capable of synchronously reproducing the video and the audio from an optical disc,
A reproduction control unit that instructs the reproduction of the video and the audio based on the readout of the video data and the audio data, and the read data;
A head for reading data for each of the first and second unit regions based on an instruction;
An audio buffer memory for storing the read audio data;
A video buffer memory for storing the read video data, and the playback control unit instructs the audio buffer memory to read the audio data from the second unit area, and then the head moves. That can be reproduced over a first time corresponding to (n + 2) times (n + 2) times the maximum time required for reading and a second time required for reading audio data in the next second unit area. Instructing the video buffer memory to read video data from n separate first unit areas that require movement of the head ,
The data amount of the audio data read to the audio buffer memory is data that can be reproduced over the first time and the time for reading the video data from the n separated first unit areas to the video buffer memory. Ryodea is,
The size of the first unit area is equal to or larger than the amount of video data that can be reproduced over the maximum time required for the head to move and the time for reading the video data from the first unit area to the video buffer memory. that have been determined so that it can store, the data processing device.   The data amount of the video data necessary for reproduction and display over the first time and the second time is equal to or greater than the product of the sum of the first time and the second time and the reading speed of the video data. The data processing apparatus according to claim 1, wherein   The data length of the first unit area in which the video data is stored is not less than a value obtained by dividing the product of the third time, which is the total time required for reading the video data, and the read speed of the video data by n. The data processing device according to claim 1, wherein the video and the audio are reproduced from the optical disc in a synchronized manner.   The data processing apparatus according to claim 1, wherein the maximum time required for movement of the head is a seek time required for movement between the innermost circumference and the outermost circumference of the optical disc.   One of the video data and the audio data is recorded in the central area of the recording area of the optical disc in the radial direction, and the maximum time required for the head to move is the innermost circumference and the innermost circumference of the optical disc. The data processing apparatus according to claim 1, wherein the time is approximately half of a seek time with respect to the outer periphery.   The minimum length of the unit area in which the video data is stored is the time required for reading the video data until the accumulation of the video data that can be reproduced over at least the maximum time required for the head to move is completed. The data processing apparatus according to claim 1, wherein the video and the audio are reproduced in synchronization from the optical disc that is equal to or higher than a product of a video data reading speed.   2. The data according to claim 1, wherein data lengths of first and second unit areas for recording the video data and the audio data are equal to or longer than a predetermined minimum length defined for each of the video data and the audio data. Processing equipment.   2. The data processing device according to claim 1, wherein a data amount of the audio data read out at the second time is between 1 and 2 times a minimum length of the unit area in which the audio data is stored. A data processing apparatus capable of recording audio data representing audio on an optical disc,
The optical disc has a first area composed of a plurality of first unit areas of a predetermined size, video data representing video is recorded in the first area, and the size of the first unit area is: It is determined that it is possible to store more than the amount of video data that can be reproduced over the time required to read the video data from one first unit area to the video buffer memory and the maximum time required for the head to move. And
An audio buffer memory for storing the audio data;
A recording control unit that secures a second area composed of a plurality of second unit areas of a predetermined size and instructs the second area to record the audio data;
A head for writing and reading data for each of the first and second unit regions based on instructions;
The recording control unit is separated from each other for a fourth time corresponding to (n + 2) times (n: an integer equal to or greater than 2) times the maximum time required for the head to move, and for the head to move. A value equal to or greater than the data amount of the audio data that can be reproduced over a fifth time required to read the video data in the n first unit areas is specified as the data length of the second area; A data processing apparatus that secures two areas. A playback control unit for instructing reading of the video data, and instructing playback of the video based on the read video data;
A video buffer memory for storing the read video data, wherein the reproduction control unit includes a sixth time corresponding to three times the maximum time required for the head to move, and the second unit area. The video data that can be reproduced over a seventh time required to read out audio data having a data amount equivalent to twice the data length of the video data is read from the n first unit areas to the video buffer memory and reproduced. The data processing apparatus according to claim 9, wherein the data processing apparatus instructs to accumulate while performing the instruction.   The data processing device according to claim 9, wherein the recording control unit instructs each of the second unit areas to record the audio data continuously.   The recording control unit generates reproduction control information that specifies the reproduction timing of each of the video data and audio data, and instructs the recording of the reproduction control information in an area different from the first area and the second area The data processing apparatus according to claim 11.   The data processing device according to claim 12, wherein the reproduction control unit is capable of reproducing the video data and the audio data in synchronization based on the reproduction control information.   The data processing apparatus according to claim 9, wherein one of the first area and the second area is provided at a position substantially half of a recording area of the optical disc with respect to a radial direction of the optical disc. The optical disc has a third area composed of a plurality of third unit areas of a predetermined size, and at least one of video data and audio data is recorded in the third area. The three unit regions are arranged physically adjacent to at least one first unit region,
The recording control unit is configured to store the audio data that can be reproduced over the fourth time, the fifth time, and an eighth time required to read the data in the n third unit areas. The data processing device according to claim 9, wherein a data length of the second unit area is specified based on a data amount, and the second area is secured.

Images